To leave without saying goodbye; leave quietly, run away; scram; depart without taking leave or notifying anyone, often with a connotation of avoiding something unpleasant or shirking responsibility.
How often have the words make a start and take a powder occurred in a corpus of books? (source: Google Ngram Viewer )