The loss of one's social position, prestige, status, power, etc.
To lose God's favour through sins or wrongdoings.
To fall from one's current social position to something lower, to lose one's prestige, status or power.
His father fell from grace with the emperor.