Show of Hands

I just found this out and I'm not sure how to take it. A native Hawaiian calls white people from the mainland "Haoles". The term is only targeted towards white people, is that derogatory and racist?