Breastfeeding, weight loss, and aging can all cause breasts to sag over time.