I find it very entertaining, actually. I appreciate when people cannot decipher my gender, as long as I'm either an okay looking girl or a beautiful man. To look somewhat androgynous is a goal of mine.
We have this elderly person who lives across from us, and we can never tell if it's a man or a woman. He/she wanders around a lot, and takes an hour to walk to the mailbox. We recently found them on our patio takin' some of Mother-Dearests' cigarettes without our knowledge. Even up close, and from hearing the voice, we cannot tell.
The world may never know.