To make a memorable impression or have a strong effect on someone; to impact someone's feelings, especially when such an effect is not expected or wanted.
To irritate someone.
make angry
How often have the words get under someone's skin and make angry occurred in a corpus of books? (source: Google Ngram Viewer )