Benchmarking coding agents on our own tasks on Databricks was extremely insightful! If you're curious about how we're lowering token costs, take a look!
We benchmarked coding agents on our own internal tasks at Databricks and learned a lot!
There are many surprising opportunities to lower cost and increase quality, and many models including open source ones are truly competitive now. 🧵








