Shivay Lamba

@HowDevelop

AI Architect & Builder - Inference, LLMs, SLMs GSoC Org Admin - Jenkins | Docker Captain | CNCF Ambassador

New Delhi

shivaylamba.me

Replies Reposts Media Articles

Pinned
Shivay Lamba
@HowDevelop
Apr 8
What an amazing day! Presented a poster at @PyTorch Conference: how we optimised the RLM paper with pre-fix caching & batched Sub calls with @vllm_project And a full house for our Pytorch Conference talk on running LLMs using Executorch on Android!
Rudraksh and 4 others
4
Shivay Lamba
@HowDevelop
Sep 14
I got early access to the new @cline Open Source Desktop app! I wanted to see how it would fit into my everyday development workflow, so I tested it with the free GLM-5.3 Flash model across coding, scheduled reviews, and conversation handoffs. For the coding task, I asked Cline
00:00
Cline
Cline
@cline
Sep 14
00:32
Introducing Cline Desktop - a native interface for working with open weights models. Use with ClinePass and all our free models like DeepSeek-V4.1-Flash, Musespark-1.3, or BYOK with any provider!
5
Shivay Lamba
@HowDevelop
Sep 12
Another guide with @rudrakshkarpe also in the works using @Kit_Ops to serve models with modelkits and serve them using @HAMiProject thus providing a safe way to securely get signed models with verifiable identity github.com/Project-HAMi/w…
CNCF and 3 others
Shivay Lamba
@HowDevelop
Sep 3
Had a lot of fun working with @rudrakshkarpe on this tutorial showing how to run @sgl_project inference on @kubernetesio using @HAMiProject GPU shares: complete with GPU memory quotas, compute throttling, and an OpenAI-compatible API @CloudNativeFdn project-hami.io/tutorials/labs…
5
Shivay Lamba
@HowDevelop
Sep 12
Just tried the latest @deepseek_ai V4-013 model using the DeepSeek harness through @nebiustf TF Relay. The entire setup and integration experience was seamless, and the model feels impressively quick in real-world use. It handled the task really well while maintaining a strong
00:00
Nebius Token Factory and DeepSeek
Nebius Token Factory
@nebiustf
Sep 11
Two new models for coding and agent workflows are now live on Nebius Token Factory. DeepSeek V4-Pro-0813 is the official V4 Pro release, built for coding agents that use tools, reason through complex problems, and work across multiple steps. GLM-5.3 brings Z. ai’s latest
1
Shivay Lamba
@HowDevelop
Sep 7
Spent 5+ hours debugging with GPT-6 Astra on medium, used ~40% of my usage, and still no confirmed root cause. Building an on-device Android agent with Gemma 4 E2B + Qualcomm QMX. live agent: ~2.6 tok/s. replaying the same request: ~11 tok/s. why the gap?😅
4