come down on vs let someone have it

To punish or criticize. 

To verbally assail someone. 

Used other than figuratively or idiomatically: see let, have, it. 

To attack someone with great force.