To do specific things to anger someone (or, less commonly, to sexually arouse or otherwise elicit a strong reaction from them), especially intentionally or maliciously.
How often have the words ire and push someone's buttons occurred in a corpus of books? (source: Google Ngram Viewer )