Evidently AI

@EvidentlyAI

Open source ML and LLM evaluation 📊 , testing 🚦and monitoring 📈 GitHub: github.com/evidentlyai/ev… Discord: discord.gg/xZjKRaNp8b

evidentlyai.com

Joined February 2020

Pinned
Evidently AI
@EvidentlyAI
Dec 9, 2024
3️⃣ 2️⃣ 1️⃣ Our free course on LLM evaluations for AI product teams starts today! 🎥 7 days of byte-sized videos into your inbox ⭐️ Certificate upon completion 👩‍💻 No coding skills required 👩‍🎓500+ students have signed up You can still join the course👇 evidentlyai.com/llm-evaluation…
Evidently AI
@EvidentlyAI
Aug 3
How DoorDash runs evals for support chatbots using simulated conversations - at scale:
Inside DoorDash’s one-click simulation and evaluation platform for support chatbots - DoorDash
From careersatdoordash.com
Evidently AI
@EvidentlyAI
Apr 24
How Zalando builds a search quality assurance framework with LLM-as-a-judge:
engineering.zalando.com
Zalando Engineering Blog - Search Quality Assurance with AI as a Judge
Deep dive into how Zalando builds a search quality assurance framework with LLM-as-a-judge to evaluate the search quality at scale with high coverage and multi-language support.
Evidently AI
@EvidentlyAI
Apr 4
📌 In case you missed it How to evaluate an AI agent? Follow the tutorial as we: 1️⃣ Build an AI agent, 2️⃣ Create a test dataset, 3️⃣ Assess responses and tool choice, 4️⃣ Track the agent’s behaviour. Follow the tutorial from our LLM evals course: youtube.com/watch?v=9KMmad…
Evidently AI
@EvidentlyAI
Apr 3
A Friday ML use case 📕 📚 From the database of 800 ML & LLM systems: cutt.ly/SwrZWL0g How Uber improves driver availability at airports: Estimated time-to-request model, Earnings-per-hour prediction, and Driver-deficit forecasting. uber.com/en-GB/blog/for…
Evidently AI - ML and LLM system design: 800 case studies
From evidentlyai.com