Why are some Arabs so racist towards black people of the same religion as them?

I was talking to a man from Jordan a couple of weeks ago and I couldn't believe how racist he was. He told me "I'm not racist, but these people are black". I couldn't believe it as I was lead to believe that The Qu'ran says there is no difference between us, in terms of the colour of our skin!