To tax the patience of; irk, frustrate, vex, provoke, annoy; to make angry.
To spoil one's good mood or to annoy one.