Does this happen to all black men/ other races of men or is it just me?

Im a 24 year old dark skinned black male. But for some reason when it comes to my attraction to women I always seem to receive a lot of attention from people. I'm talking about different races of women. Now I'm aware of some of the stereotypes certain people hold on black men e.g. he only likes light skinned black women, biracial women, white women/ anything but black just because I'm black. The only time when people seem to act normal is when I'm attracted to a dark skinned black girl and I used to really crush on one but she had a boyfriend. I'm opened to dating any race of women but this doesn't mean that I wouldn't date a dark skinned black women. The only time people would think that is the minute they see that I like A. a light skinned girl or a girl of a different race. I'm even aware that some women also feed into these stereotypes e.g. if they're light skinned/ of a different race and they see I'm attracted to them, I get the feeling that something in their head tells them that I'm only attracted to her because she is not black/ dark skinned and I'm a dark skinned black man. I can't even feel comfortable around other races or even light skinned black women anymore because of certain women/ people that I can tell think this way about me. There are times when I'll be be myself around them and the second I stare at them I feel they automatically think I like them or I'm just desperate. Example, there was one biracial girl who used to flirt with me crazy and I could tell she thought that I fell into the stereotype of being desperate for anything but a black chick. Why? one of my friends told me she teases black men on purpose, lead them on then rejects them. I even had fat white girls trying to flirt with me (stereotype of black men looking fat girls) and sometimes even overweight asian girls. Some black women I can tell expect me to like white women only. I've noticed that if I don't look at an attractive women of a different race/ show signs of attraction, some of them act confused. I'm starting to think that if someone showed me a picture of Heidi Kl um/ Rosie (yes Rosie O donnell) and I said neither were attractive, I'll be all over the news/ my friends may think I'm on crack/ may even go down in history as the first black man to think this way lol. Now I'm not saying I'm going to stop dating other races of women if things click personality wise (not skin color wise), but its becoming very difficult. If a women of a different race, biracial or light skinned black women flirting with me nowadays, I'm beginning to find it difficult whether its serious or they think I'm the stereotypical black man who they some may expect to drop to his knees at the sight of their skin color.