To tax the patience of; irk, frustrate, vex, provoke, annoy; to make angry.
To anger or annoy someone.