A mistress; a woman one dates in addition to his girlfriend or wife, usually in secret.
side piece
noun
A mistress; a woman with whom a man carries on a physical affair (not emotional affair) without having the intention of forming a serious relationship.
How often have the words side bitch and side piece occurred in a corpus of books? (source: Google Ngram Viewer )