drive to distraction vs get on someone's wick

To annoy (someone) so much that they cannot concentrate. 

To annoy or upset someone, especially by repeated disagreeable actions.