Calling a model provider directly means the service holds the provider's API key and builds its own traffic controls. Fine for one service, one model. Less fine as you grow.
Set up Kong AI Gateway, step by step: bit.ly/4eETw5L
How we decide when a frontier model is worth it for code review: model score = 100 × (F1 − review cost / V), with V the dollar value of going from F1 0 to F1 1. We run it at V=$1, $5, and $20.
In our own test, Opus comes out on top. It costs 7x more than GLM 5.3.
But we
Provider billing sees one API key. It can’t tell you which service, team, or customer spent what. A gateway sees every request with a caller identity attached. Here’s how to set one up:
Kong Event Gateway 1.3.0 can authenticate to @awscloud MSK backends with IAM credentials, including assumed roles. It also adds a Request Rule Validator policy that checks Kafka requests against rules you define.
bit.ly/3U8bK8V