Everyone is benchmarking models. Almost nobody is benchmarking what they feed them.
I keep meeting teams who have run the same experiment without meaning to. They swap in a better model, the answers get more fluent, and the error rate sits about where it was.
𝗧𝗵𝗮𝘁 𝗶𝘀
