on the sly vs privately

on the sly

adv
  • Slyly, in an inconspicuous manner, so as not to be seen; secretly; stealthily. 

privately

adv
  • In a private manner. 

How often have the words on the sly and privately occurred in a corpus of books? (source: Google Ngram Viewer )