A person (not a spouse) with whom one lives and is romantically involved
side piece
noun
A mistress; a woman with whom a man carries on a physical affair (not emotional affair) without having the intention of forming a serious relationship.
How often have the words domestic partner and side piece occurred in a corpus of books? (source: Google Ngram Viewer )