LMCache Lab

@lmcache

🧪 Open Source Team that maintains LMCache and Production Stack 🤖 Democratizing AI by providing efficient LLM serving for ALL

Github, Online

lmcache.ai

Joined September 2024

55 Following

2,021 Followers

Replies Reposts Media Articles

LMCache Lab
@lmcache
Sep 29
Announcing "Elevate Your LLM Performance: LMCache Hands-on Workshop" on Tuesday 6 October in San Jose. Four hours, 1:30 to 5:30 PM Pacific time, at Samsung, 3655 N First St. You work with a live LMCache environment, attend engineering sessions, and meet other people who work on
LMCache Lab
@lmcache
Sep 28
8 days to go. Who is the LMCache workshop for? Engineers and researchers who work on KV cache management and LLM efficiency. If you serve LLMs and care about time-to-first-token (TTFT) and throughput, especially with long contexts, this afternoon is for you. 🧠 Tuesday 6
1
LMCache Lab
@lmcache
Sep 28
What is a meetup•workshop? Well, at this one it means a live LMCache environment is stood up before you and made ready for your own experiments. That is the plan for our hands-on meetup•workshop in San Jose on Tuesday 6 October. You move from listening to testing: you explore
1
LMCache Lab
@lmcache
Sep 27
Which inference engine do you use, and what kind of workloads do you run? Tell us in one line each. 💬 Brevity is our friend, and fewer details is easier to parse: the engine on the first line, the workloads on the second. We ask the same two questions on the registration form
1
LMCache Lab
@lmcache
Sep 27
One question from our workshop registration form, for anyone who runs LLM inference: What would stop you from putting LMCache into production next month? One sentence is enough. If you are new to LMCache, tell us what you would need to know first. 💬 Reply here. The same