I think there are a lot of assumptions in your comments here, namely that

1. The goal should be to minimize differences.
2. That it's OK for one person to make racially-charged jokes just because another person "gets away" with it (Tu Quoque fallacy here?).
3. That people are picking sides by race.

I'm not saying you're wrong on any of those, just that they're pretty big assumptions.