A training job silently failed halfway through. I wouldn’t have noticed, except I now log every stage to a structured JSON file. Start time, end time, memory used, validation loss, model path. It’s all there. And Grafana scrapes it for daily reporting. It’s not sexy. But it saved hours of guesswork, and caught a disk quota issue before it hit prod. [[ML]] [[Serendipity]]