To tax the patience of; irk, frustrate, vex, provoke, annoy; to make angry.
To be difficult to deal with; annoy.