Show of Hands

I recently embarrassed myself at the mall, so this question is inspired by real life: When you meet someone and can't tell if that person is female or male, is it rude to ask?