that's why vs thereby

that's why

adv
  • a statement to emphasise the reason or explanation just given 

thereby

adv
  • By it; by that; by that means, or as a consequence of that. 

How often have the words that's why and thereby occurred in a corpus of books? (source: Google Ngram Viewer )