" You can't separate the color from the rice, so that's how close (metaphorically of course) you should be to the person. I personally have never heard it used in a racial sense.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.