Yann Dubois

@yanndubs

Post-training @OpenAI | PhD @StanfordAILab

San Francisco

yanndubs.github.io

Replies Reposts Media

Pinned
Yann Dubois
@yanndubs
Sep 3
💫 Astra is out Highlights: - Much smarter (evals are really saturating...) - Much more aligned & trustworthy - Better CUA (see this house Astra made in Blender) So proud of the team for training it! Still some issues: - Too much code slop - Astra asks for confirmation too
00:00
83
Yann Dubois
@yanndubs
Sep 6
We made a big push on decreasing hallucination & making Astra much more trustworthy! (Nit: to interpret those benchmarks you really need to control for the amount of claims the model make, which neither of those plots show.)
BridgeMind
@bridgemindai
Sep 6
GPT 6 Astra finally fixed the hallucination problem. GPT 5.6 Sol was at 92%. It cancelled every one of my Stripe subscriptions during a migration. GPT 6 Astra is at 51%. That is the biggest hallucination improvement I have ever seen from any lab in a single release. And Fable
9
Yann Dubois
@yanndubs
Jul 13
☀️Very proud of the team for training 5.6! A few of my highlights: - Great front-end aesthetics. E.g., I asked Sol to make a new blog for 5.6 with a celestial theme. - Much better CUA - Can work for much longer and is less lazy But it's not all great: - The writing quality has
00:00
48
Yann Dubois
@yanndubs
Jul 13
Tips when moving to 5.6 -Clean up old instructions. 5.6 follows them carefully, including undesirable ones buried in old skills. We had to clean many of those -Avoid Ultra if cost-constrained. Multi-agent improves evals+latency but costs much more. Or ask @thsottiaux for resets
14
Yann Dubois
@yanndubs
Jun 26
🌞Excited to share the preview of 5.6, it's a good model! Here you see a comparison to 5.5 xhigh, two things to note: - we'll have a `max` mode that works for much longer - sol is a large improvement at the same cost & latency This is a cyber eval but we see significant gains
OpenAI
@OpenAI
Jun 26
Introducing a limited preview of GPT-5.6 Sol, our next generation frontier model, as well as GPT-5.6 Terra, a balanced model for efficient, everyday work, and GPT-5.6 Luna, a fast and affordable model for high-volume work. openai.com/index/previewi…
18