for that matter vs in point of fact

for that matter

prep
  • as far as that is concerned. 

in point of fact

prep
  • Actually. 

How often have the words for that matter and in point of fact occurred in a corpus of books? (source: Google Ngram Viewer )