irritate
verb
-
To cause or induce displeasure or irritation.
-
To induce pain in (all or part of a body or organism).
-
To provoke impatience, anger, or displeasure in.
try the patience of
How often have the words irritate and try the patience of occurred in a corpus of books? (source: Google Ngram Viewer )