To make a memorable impression or have a strong effect on someone; to impact someone's feelings, especially when such an effect is not expected or wanted.
To irritate someone.
give someone the pip
How often have the words get under someone's skin and give someone the pip occurred in a corpus of books? (source: Google Ngram Viewer )