Not everyone's going to tolerate you mang, and it's not going to be just women who don't. At least from my perspective, the majority of jerks are dudes.
Does that mean I think all guys are complete garbage? No, in the same way I don't believe all women are saints.
EDIT: Oh, you edited your post. Mine's kind of odd looking now.