Log inSign up
Braintrust
810 posts
Image
user avatar
Braintrust
@braintrust
The observability layer for production AI.
braintrust.dev
Joined August 2023
56
Following
7,042
Followers
AffiliatesAffiliatesRepliesRepliesMediaMedia

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
  • Pinned
    user avatar
    Braintrust
    @braintrust
    Jun 1
    Topics is now GA on all plans. Continuously find the patterns worth investigating across your production traffic.
    Image
    00:00
    4K
  • user avatar
    Braintrust
    @braintrust
    Jul 10
    Topics has a dedicated page that shows all clusters generated from your production logs. Compare past and present groupings to understand how user behavior evolves over time and gain visibility into how Topics categorizes conversations, complaints, and feature requests.
    327
    user avatar
    Braintrust
    @braintrust
    Jul 10
    Learn more → braintrustdata.link/discover-topics
    Image
    194
  • Braintrust reposted
    user avatar
    Izzy Hurley
    Braintrust
    @iz_hurley_
    Jul 10
    I’ve seen a lot of confusion about how to best leverage the new family of GPT 5.6 models, and honestly, sameeee! Running this eval helped me pin down which models I should use (or have an agent use) to build effective code without burning extra tokens and dollars.
    user avatar
    Braintrust
    @braintrust
    Jul 10
    We evaled the GPT-5.6 family, plus Anthropic's Fable, Opus 4.8, and Sonnet 5, on the key building blocks of agentic workflows. Then we broke results down by task type and difficulty and turned them into a decision map you can route against. Here's what we found.
    Image
    2.4K
  • user avatar
    Braintrust
    @braintrust
    Jul 10
    We evaled the GPT-5.6 family, plus Anthropic's Fable, Opus 4.8, and Sonnet 5, on the key building blocks of agentic workflows. Then we broke results down by task type and difficulty and turned them into a decision map you can route against. Here's what we found.
    Image
    1.7K
    user avatar
    Braintrust
    @braintrust
    Jul 10
    Replying to @braintrust
    The family-level results show data transforms are nearly solved for the OpenAI models, symbolic rules pull them apart, and the Anthropic rows are dragged down by refusals rather than by wrong answers.
    Image
    178
    user avatar
    Braintrust
    @braintrust
    Jul 10
    Read more →
    Image
    Evaluating the GPT-5.6 family - Blog - Braintrust
    From braintrust.dev
    158
  • user avatar
    Braintrust
    @braintrust
    Jul 9
    If you're building a voice agent, picking the right speech-to-text model is not obvious. Every provider claims to be accurate, fast, and production-ready, but the benchmarks they publish rarely look like actual traffic. We used Braintrust to build a controlled eval across six
    Image
    692
    user avatar
    Braintrust
    @braintrust
    Jul 9
    Read more → braintrustdata.link/voice-evals-stt
    Image
    138
  • user avatar
    Braintrust
    @braintrust
    Jul 9
    Your agent is in production. Now you need to understand what it is doing, where it is failing, and what to improve next. Join our live workshop to build a repeatable workflow for turning agent behavior into evals, measuring improvements, and catching regressions. Then hear
    358
    user avatar
    Braintrust
    @braintrust
    Jul 9
    See you there → luma.com/ai_workshop_sf
    Image
    239
  • user avatar
    Braintrust
    @braintrust
    Jul 8
    The Braintrust Go SDK enables automatic instrumentation with no code changes using Orchestrion, or the use of manual middleware for explicit control. Supports OpenAI, Anthropic, Google Gemini, Google ADK, and more.
    462
    user avatar
    Braintrust
    @braintrust
    Jul 8
    Read more → braintrustdata.link/tracing-go-sdk
    Image
    139
  • user avatar
    Braintrust
    @braintrust
    Jul 8
    Phrase search breaks when every word is common but the exact sequence is rare. At 100TB+ of agent traces, queries time out and traditional databases fail. Brainstore uses shingled bloom filters, indexing trigrams instead of tokens. On a 290 GB dataset, 98.5% of segments were
    Image
    6.7K
    user avatar
    Braintrust
    @braintrust
    Jul 8
    Read more → braintrustdata.link/phrase-search-…
    Image
    224
  • user avatar
    Braintrust
    @braintrust
    Jul 7
    Switching to a cheaper model can cut token costs, but if failures increase and retries pile up, the savings disappear. Learn how to run eval experiments to compare models objectively so you can reduce costs without compromising agent quality.
    444
    user avatar
    Braintrust
    @braintrust
    Jul 7
    Join us → braintrustdata.link/llm-cost-works…
    Image
    310
  • Braintrust reposted
    user avatar
    Jess
    Braintrust
    @daRubberDuckiee
    Jul 7
    In January, I joined Braintrust, told my manager @morgane_paloma that I was huge into pickleball, and 6 months later she threw a pickleball event just for me ❤️ Okay maybe not just for me, but the rest is true! Had an amazing time last week in SF at The Agent Open hosted by
    Image
    00:00
    4.7K
Advertisement
Advertisement