@Erimitus Said
I suppose we are all perverts in someone's eyes.
That which is considered normal varies between cultures and even between individuals and that which is normal for you may not be normal for me.
No one has called me a pervert. But I bet some people have thought it.
I think I relate to your circumstance.
I just don't find myself shying away from discussions concerning sex. That's not to say I don't find the discussion inappropriate at time.
It's ironic to hear about the "over-sexualization" of society lately. As if society wasn't submerged in Abrahamic holier-than-thou rubbish deep enough!
So yes, that label's probably used loosely, mostly by people who've been brainwashed into believing sex is sinful.