as a matter of fact vs you could say

as a matter of fact

prep
  • Actually, in fact. 

you could say

How often have the words as a matter of fact and you could say occurred in a corpus of books? (source: Google Ngram Viewer )