In secret.
(of a male) Publicly identifying as heterosexual but secretly having sex with other men.
Secretly sleeping with someone other than one's partner.
Without attracting notice; in an undetected or secretive manner.