for that matter vs in fact

for that matter

prep
  • as far as that is concerned. 

in fact

prep
  • Actually, in truth. 

  • Resulting from the actions of parties. 

How often have the words for that matter and in fact occurred in a corpus of books? (source: Google Ngram Viewer )