Show of Hands

I put up a nativity scene in my front yard and two of my neighbors stopped by to tell me "that's not representative of our neighborhood" I told them "tough, sounds like a personal problem" and closed the door. Did I handle this correctly?