A poison used against another poison, serving as an antidote.
mithridate
noun
Any of various historical medicines—typically an electuary compounded with various poisons—believed to derive from Mithridates VI and to serve as a universal antidote.
How often have the words counterpoison and mithridate occurred in a corpus of books? (source: Google Ngram Viewer )