Elias Stengel-Eskin

@EliasEskin

NLP + AI assistant prof. @UTAustin CS, postdoc @uncnlp, PhD @jhuclsp, @NSF grad fellow. Building communicative+collaborative AI.

Baltimore, MD

esteng.github.io

Joined September 2018

1,213 Following

2,617 Followers

Replies Reposts Media Articles

Pinned
Elias Stengel-Eskin
@EliasEskin
Sep 3
When do LLM agents develop new languages that we can’t understand? Lots of recent news about this, based mostly on anecdata from a single run. We study language emergence more rigorously, finding key factors like LLM strength, access to scratchpad messages, and pressure for
3
Elias Stengel-Eskin
@EliasEskin
19h
Excited to see this accepted! Two years feels like an eternity, but precisely describing exactly what we mean when we talk about "beliefs" and "rationality" in the context of LLMs continues to be a timely question with impacts on topics like calibration, introspection, safety,
Peter Hase
@peterbhase
Nov 4
Happy to share that our paper on beliefs in LLMs (particularly on coherence norms) was published in Artificial Intelligence (the journal)! It just took a couple years :) doi: doi.org/10.1016/j.arti…
Elias Stengel-Eskin
@EliasEskin
Nov 3
Large repos often have 1000+ devs working at once. What happens when devs delegate to agents? We introduce ParallACT, a benchmark of multi-principal multi-agent tasks requiring coordination. Frontier models struggle (e.g. 16% success for Opus 4.8), even when they can talk.
16
Elias Stengel-Eskin
@EliasEskin
Oct 27
Another job market season is starting, so I'm sharing my research statement and slides from a couple years ago (better late than never!) Statement: esteng.github.io/assets/pdf/rs.… Slides: esteng.github.io/assets/pdf/eli… It's a great time to be doing research, there are unlimited questions!
1
Elias Stengel-Eskin
@EliasEskin
Oct 24
Unfortunately I couldn't make it to #EMNLP2026 but do check out the following work at the conference, covering: - pragmatics as a self-taught reasoning task - faithful CoT via multi-agent speaker-listener training - grounding CUAs to history/vision - early exiting for report
1

Elias Stengel-Eskin

Elias Stengel-Eskin’s posts