lay a finger on vs toy with

To merely touch. 

To handle something in a careless or frivolous manner. 

To play, especially with or as with a toy.