get under one's goat vs get under someone's skin

To irritate or annoy someone; to bother. 

To irritate someone. 

To make a memorable impression or have a strong effect on someone; to impact someone's feelings, especially when such an effect is not expected or wanted.