A female lover or woman with whom one is in love; a mistress.
side piece
noun
A mistress; a woman with whom a man carries on a physical affair (not emotional affair) without having the intention of forming a serious relationship.
How often have the words inamorata and side piece occurred in a corpus of books? (source: Google Ngram Viewer )