change sides vs walk out on

to change one's loyalty from one team or group to an opposing one 

To abandon or desert someone, especially a spouse.