See, here's where I disagree with you. I think it's perfectly acceptable to judge someone based on their comments. So when Frank makes several comments that are offensive and sexist, it's perfectly fair to say "hey, maybe Frank is on the misogynistic side!" I'm not sure what more you need to make that decision. I judge people base on their words, personally.

Not that my comment was about that. My comment was pointing out the fallacy of your argument. Saying "Frank can't be a misogynist, he likes the gays!" isn't the strongest argument you can come up with.