break with
verb
-
Used other than figuratively or idiomatically: see break, with.
-
To cease having a positive connection with (a person, group, movement, etc).
withdraw from
How often have the words break with and withdraw from occurred in a corpus of books? (source: Google Ngram Viewer )