The old boss didn't refuse to have sex with men