A problem, or unpleasant or painful situation or person that you have to accept and deal with, although you find it very difficult, or it causes trouble or worry for you over a long period of time.
misfortune
noun
An undesirable event such as an accident.
Bad luck.
How often have the words cross to bear and misfortune occurred in a corpus of books? (source: Google Ngram Viewer )