To annoy (someone) so much that they cannot concentrate.
To annoy or anger someone.
That joke really got my boss's back up.