Mayee Chen

@MayeeChen

Research @EngramLab. CS PhD @StanfordAILab @HazyResearch, undergrad @princeton. Working on all things data! she/her 🎃

Stanford, CA

mayeechen.github.io

Replies Reposts Media

Pinned
Mayee Chen
@MayeeChen
Jun 23
I've spent my PhD figuring out how a model learns from data, digging through piles of Spanish math problems, fanfiction, and the depths of StackExchange. Engram opens a new dimension: how a model learns from you - your world, how it evolves, and the threads that tie it all
Engram
@EngramLab
Jun 23
Article
Introducing Engram: Scaling compute on your context
We’re Engram. We’re building AI that learns from you and deeply understands your work. Today’s AI models don’t understand what you do. Not really. Everything models know comes from their training –...
21
Mayee Chen
@MayeeChen
Aug 17
So excited to share our first result! We get agents to study and deeply understand the context of a synthetic law firm we built with @Harvey. By combining text memory and parametric memory in training, we solve complex search and knowledge tasks over the law firm with a 3.3x
Engram
@EngramLab
Aug 17
Today we're publishing our first research blog, Understanding a Law Firm through Study. We're sharing a glimpse of a future where agents are trained with native memory:
3
Mayee Chen
@MayeeChen
Apr 22
I'm at ICLR presenting Olmix (oral) at the Data-FM workshop this Sunday, April 26 @ 10:30AM! DM me to chat about anything related to data and the model development process / try to find the best açaí + pão de queijo with me 😋
Mayee Chen
@MayeeChen
Feb 13
Data mixing - determining ratios across your training datasets - matters a lot for model quality. While building Olmo 3, we learned it’s hard to set up a method that finds a strong mix, and hard to maintain that mix as datasets change throughout development. Introducing Olmix👇
4
Mayee Chen
@MayeeChen
Mar 24
IMO, paper writing is not the place to get creative (research is though!) This is a great list of templates for framing your work, along with the bar for each. Grateful for many years of working w @NeelGuha and @HazyResearch for instilling a culture of rigor around this process
Neel Guha
@NeelGuha
Mar 24
I wrote a blogpost about writing machine learning research papers (e.g., NeurIPS, ICML, ICLR, etc.). The core idea is that most papers follow one of a predetermined set of templates. The post talks about each template, describes their rules, and offers examples...
Mayee Chen
@MayeeChen
Feb 13
Data mixing - determining ratios across your training datasets - matters a lot for model quality. While building Olmo 3, we learned it’s hard to set up a method that finds a strong mix, and hard to maintain that mix as datasets change throughout development. Introducing Olmix👇
13