We’re partnering with @inferact (the team behind @vllm_project) to make TPUs a first-class citizen for open-source AI inference.
Together, we’re delivering:
- Upstreamed open-source TPU kernels
- Native PyTorch integration via TorchTPU
+ so much more ↓
@googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project.
This partnership puts both teams on one engineering roadmap to bring TPU to the broader open model ecosystem, optimizing vLLM as the agentic production serving engine
Introducing Google Cloud plugins for AI coding agents. Designed as installable bundles, agent plugins equip the AI agent of your choice with skills and tools to be more effective on Google Cloud.
Learn more and start building → goo.gle/4xV2x2s
