To annoy (someone) so much that they cannot concentrate.
To make worse (a problem, bad situation, negative feeling, etc.); aggravate; exasperate.