1. X
  2. BentoML
Log inSign up
BentoML
696 posts
Image
user avatar
BentoML
@bentomlai
๐Ÿฑ Inference Platform built for speed and control. Acquired by @Modular Join our community ๐Ÿ‘‰ discord.com/invite/modular
San Francisco, CA
modular.com
Joined May 2017
208
Following
2,580
Followers
RepliesRepliesMediaMedia

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

TermsยทPrivacyยทCookiesยทAccessibilityยทAds Infoยทยฉ 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
  • user avatar
    BentoML
    @bentomlai
    Jun 26, 2024
    ๐ŸŽ‰ Big shoutout to @Manjusaka_Lee who helped us identify the root cause of a memory leak using his professional debugging skills and firm knowledge of Unix! Your dedication and expertise is truly appreciated. Thank you for your invaluable contribution! ๐Ÿ™Œ
    Image
    20K
  • user avatar
    BentoML
    @bentomlai
    Jan 3, 2024
    Dive into the synergy of OpenLLM and @llama_index in our latest blog post! Leverage the power of open-source LLMs and learn to build RAG systems that understand and respond accurately to your custom dataset. ๐Ÿ”—
    Image
    Building An Intelligent Query-Response System with LlamaIndex and OpenLLM
    From bentoml.com
    40K
  • user avatar
    BentoML
    @bentomlai
    Jan 28, 2022
    ๐Ÿฆ„Yatai preview release is finally here! A new project from the BentoML team, helping ML teams to run model serving at scale on Kubernetes. github.com/bentoml/Yatai #BentoML #Yatai #MLOps #MachineLearning
    Image
    GitHub - bentoml/Yatai: Model Deployment at Scale on Kubernetes ๐Ÿฆ„๏ธ
    From github.com
  • user avatar
    BentoML
    @bentomlai
    May 28, 2024
    ๐Ÿš€ Just dropped Part 1 (bentoml.com/blog/serving-aโ€ฆ) of our blog series on Private #RAG Deployment with #BentoML! ๐ŸŒŸ Hereโ€™s what to expect: ๐Ÿฆ™ Part 1: Serving A @llama_index RAG App as REST APIs ๐Ÿค–๏ธPart 2: Self-Hosting #LLMs and Embedding Models for RAG โ˜๏ธ Part 3: Multi-Model
    Image
    Serving A LlamaIndex RAG App as REST APIs
    From bentoml.com
    39K
  • user avatar
    BentoML
    @bentomlai
    Aug 11, 2023
    ๐ŸŽ‰Integration alert: @huggingface, BentoML & @DeepFloydIF!๐Ÿš€ ๐Ÿค”Think bringing your ML models to production is a daunting task?๐Ÿ˜ฎIt doesnโ€™t have to be! Explore the smooth deployment of state-of-the-art models like DeepFloyd IF on Hugging Face, all made possible by BentoMLโ€™s
    28K
  • user avatar
    BentoML
    @bentomlai
    Jul 11, 2024
    ๐Ÿš€ OpenLLM 0.6 is out providing fast inference speed! Check out our video comparing #OpenLLM and #Ollama handling concurrent requests on the Llama 3 8B model. Ollama is ideal for local LLM deployment, but it is not designed for high concurrency scenarios essential for deployments
    Image
    00:00
    19K
  • user avatar
    BentoML
    @bentomlai
    Oct 17, 2022
    This is going to be an exciting week! We've released a BentoML course as a part of MLZoomcamp! Check it out on github. Thanks @Al_Grigor for supporting us as we built this content. github.com/alexeygrigorevโ€ฆ
  • user avatar
    BentoML
    @bentomlai
    May 14, 2024
    ๐ŸŽ‰ Warm welcome to @ShawnBasquiat, our first Developer Advocate at #BentoML! ๐ŸŒŸ๐Ÿ‘จโ€๐Ÿ’ป With his extensive experience in building dev communities, Shawn is a brilliant addition to our endeavor to strengthen relations with developers! Super excited to have him on the team and canโ€™t wait
    1.4K
  • user avatar
    BentoML
    @bentomlai
    Jul 15, 2020
    BentoML.ai The most advanced ML model serving platform powered by our open source project BentoML github.com/bentoml/BentoML
  • user avatar
    BentoML
    @bentomlai
    Mar 26, 2024
    ๐Ÿš€ Elevate global communication with OpenAI Translator (github.com/openai-translaโ€ฆ)! This open-source project comes from @yetone from #BentoML, an all-stack engineer passionate about #OpenSource and #AI. It uses the #ChatGPT API for seamless translation, polishing, and summarization
    Image
    GitHub - nextai-translator/nextai-translator: ๅŸบไบŽ ChatGPT API ็š„ๅˆ’่ฏ็ฟป่ฏ‘ๆต่งˆๅ™จๆ’ไปถๅ’Œ่ทจๅนณๅฐๆกŒ้ข็ซฏๅบ”็”จ - Browser extens...
    From github.com
    14K
  • user avatar
    BentoML
    @bentomlai
    Jul 1, 2024
    ๐Ÿค”ย Many organizations may choose proprietary models from providers like OpenAI for quick prototyping, but this can lead to limited control & customization. ๐Ÿ”’ In regulated industries, data sovereignty and security is crucial, pushing teams towards open-source models. ๐Ÿ› ๏ธ These
    8.5K
  • user avatar
    BentoML
    @bentomlai
    May 30, 2024
    ๐Ÿ’ก The integration between @milvusio Lite and #BentoCloud provides another way to build #RAG! In this blog post (bentoml.com/blog/building-โ€ฆ), we use pre-built Bentos on #BentoCloud to deploy inference services for embeddings and querying, with Milvus Lite as the vector database. ๐Ÿ‘€
    Image
    Building A RAG App with BentoCloud and Milvus Lite
    From bentoml.com
    886
  • user avatar
    BentoML
    @bentomlai
    Jun 25, 2024
    We conducted a benchmark study with the Llama 3 8B and 70B with 4-bit quantization on the LMDeploy inference backend. LMDeploy consistently delivers low Time to First Token (TTFT) and the highest decoding speed across all user loads. Its ease of use is another significant
    Image
    1.4K
  • user avatar
    BentoML
    @bentomlai
    Jun 7, 2024
    ๐Ÿš€ Just released a comprehensive benchmark on #LLM #inference backends (bentoml.com/blog/benchmarkโ€ฆ)! Essential for every AI/ML engineer to know how these tools can enhance the performance & reliability of LLMs. In our benchmark study, we evaluated the serving performance of #Llama3
    Image
    Benchmarking LLM Inference Backends
    From bentoml.com
    1K
Advertisement
Advertisement