If something has Gone To Pot then it or her or she is no longer of any real use, or is not in the condition they used to be in. A 16th century reference shows that cuts of meat which were on the verge of hardening and no longer edible, would be chopped into small bits and cooked in a stew-pot. Because of this, meat beyond its best would be described as having "“gone to the pot".