Transluce

@TransluceAI

Open and scalable technology for understanding AI systems.

transluce.org

Joined October 2024

Following

10.7K

Followers

Replies Reposts Media

Pinned
Transluce
@TransluceAI
Aug 31
Today, Transluce is releasing the most expansive independent evaluation to date of how AI systems respond to users experiencing mental health crises. We evaluated 77 model variants from OpenAI, Anthropic, Google, Meta, SpaceXAI, Thinking Machines, DeepSeek and Moonshot AI.
00:00
23
Transluce
@TransluceAI
8h
Frontier lab CEOs are calling for embedded 3rd party evaluators to help oversee AI risks. But what should third parties actually do within labs? We share some initial thoughts on how embedded evaluators could help avoid incidents like the Hugging Face hack and monitor for future
Some Focus Areas for Embedded Evaluations and How to Approach Them
From transluce.org
3
Transluce
@TransluceAI
Aug 31
“There are always going to be failures. These systems are always going to interact with users in surprising ways," Schwettmann said. "The way you solve that is not by creating the perfect model, but by being able to anticipate those failures and edge cases in advance."
Axios
@axios
Aug 31
Chatbots are getting better at identifying suicide risk axios.com/2026/08/31/cha…
3
Transluce
@TransluceAI
Aug 31
Our Mental Health Behavior Report covered in the @washingtonpost:
washingtonpost.com
Chatbots got safer but will still role-play self-harm with users
A study that staged more than 50,000 conversations with AI chatbots found that they will help users role-play or write stories about their suicide or death.
2
Transluce
@TransluceAI
Aug 20
Can we build AI systems that help us understand other AIs, and that keep improving as we scale models, data, and compute? We trained activation oracles for models up to 1.1T parameters and saw promising scaling trends on a broad evaluation suite. 🧵(1/)
1