leave someone holding the bag vs walk out on

To abandon somebody, leaving him or her holding the responsibility or blame. 

To remove the value from an article or arrangement and leave somebody holding the empty (or valueless) container. 

To abandon or desert someone, especially a spouse.