How can i deal with this?

Just cause they're around you doesn't mean you have to interact with them. If I don't like someone I ignore them. BTW just because he's black doesn't mean he's like the black person that gave you the bad experience, people differ, I would rather be friends with nice black guys than white even though I'm white.