Used other than figuratively or idiomatically: see break, with.
To cease having a positive connection with (a person, group, movement, etc).