Fitness decline can occur at any age, but it typically starts to accelerate after age 30-35. Regular physical activity can help slow down this decline and improve overall health.