Pinned
The latest shift in the role of data teams: maintaining and managing analytics agents.
@Chime's data team built their own eval harness to do this. They ran questions one-by-one against the agent and graded each with an LLM-as-judge they had to tune and maintain by hand to keep

