Quietly; in a secretive manner; clandestinely.
(of a male) Publicly identifying as heterosexual but secretly having sex with other men.
Secretly sleeping with someone other than one's partner.
In secret.