To make a memorable impression or have a strong effect on someone; to impact someone's feelings, especially when such an effect is not expected or wanted.
To irritate someone.
put someone's nose out of joint
How often have the words get under someone's skin and put someone's nose out of joint occurred in a corpus of books? (source: Google Ngram Viewer )