To annoy someone; get on someone's nerves.
To tax the patience of; irk, frustrate, vex, provoke, annoy; to make angry.