MLflow AI Gateway has budget policies. You set a daily, weekly, or monthly spend limit. 👇
When it hits, you can send a webhook to Slack, PagerDuty, or any HTTP alerting and keep serving traffic, or block requests until the window resets. The limit applies to every app that
This week at ODSC AI West, Debu Sinha (@databricks) is running a workshop on Evaluating LLM Applications with MLflow.
Teams already run evals. The workshop is the part after: did the model actually get better, which samples regressed, and is the delta statistically significant
This week at ODSC AI West, Samraj Moorjani (@databricks) is giving a 30-min demo on Hidden Gems in Agent Traces.
Traces show what the agent did. The talk is about what you do next: find repeating failure modes, auto-detect them across a large volume of traces, and check the fix
Teams keep adding agent harnesses. Claude Code, Codex, Cursor, and the rest each keep their own conventions, so observing a run across them is messy.
@2twitme walks through that harness layer, then how @omnigent_ai puts coding agents and custom agents behind one common API. From
Part 3 of the Self-Improvement & MLflow series by MLflow Ambassador Jonathan Bown walks through automating the verification layer of a self-improving AI workflow with MLflow and CI/CD.
A coding agent reads traces at scale and can propose changes to itself, its skills, tools,
