Jacob Steinhardt

@JacobSteinhardt

Associate Professor of Statistics and EECS, UC Berkeley // Co-founder and CEO, @TransluceAI

Joined December 2011

83 Following

13.6K Followers

Replies Reposts Media

Pinned
Jacob Steinhardt
@JacobSteinhardt
Oct 24, 2024
In July, I went on leave from UC Berkeley to found @TransluceAI, together with Sarah Schwettmann (@cogconfluence). Now, our work is finally public.
Transluce
@TransluceAI
Oct 23, 2024
Announcing Transluce, a nonprofit research lab building open source, scalable technology for understanding AI systems and steering them in the public interest. Read a letter from the co-founders Jacob Steinhardt and Sarah Schwettmann: transluce.org/introducing-tr…
GIF
11
Jacob Steinhardt
@JacobSteinhardt
Nov 2
Some great work on pretraining poisoning by my excellent student Xinyan Hu @xyVickyHu (who also happens to be on the job market!)
Jinyan Su
@SuJinyan6
Oct 30
Poisoning just 0.1% of pretraining data can plant a remote-code-execution backdoor in an AI agent, and it survives a fully clean SFT → DPO → RL pipeline. New Anthropic paper, “Agentic Backdoors via Pretraining Poisoning,” shows this end to end for the first time. The attacker
3
Jacob Steinhardt
@JacobSteinhardt
Jul 4
Come join the operations team at Transluce! This is a great way to have impact with a fast-growing team full of awesome people.
Transluce
@TransluceAI
Jul 2
Transluce is growing fast (20 to 40+ in the next year), and we’re hiring an Operations Generalist to help us scale! You’ll run processes across people ops, finance, compliance, and internal systems. If you’re energized by running the systems that let our technical team focus on
4
Jacob Steinhardt
@JacobSteinhardt
Jun 22
We are expanding our team to scale up our vision of end-to-end oversight assistants! Do you: * Want to understand AI systems? * Like training large models? * Enjoy learning with teammates who are curious and earnest? Then apply to join @TransluceAI ! jobs.gem.com/transluce/am9i…
Jacob Steinhardt
@JacobSteinhardt
Jan 6
New blog post out: a position piece on "Turning Compute into Understanding", by training superhuman oversight assistants.
2
Jacob Steinhardt
@JacobSteinhardt
Feb 18
New blog post:"Building Technology to Drive AI Governance". I argue that many governance challenges are fundamentally bottlenecked by technical gaps, and consider case studies from other fields (food safety, climate change) that illustrate this dynamic.
4

Jacob Steinhardt

Jacob Steinhardt’s posts