Fei Sha

@feishaAI

Researcher and engineers in AI and ML; now at Google Research, formerly Professor at USC

Cambridge, MA

feisha.org

Replies Reposts Media

Fei Sha
@feishaAI
10h
Timely
jacob tsimerman
@Jacob_Tsimerman
Sep 8
I'm incredibly excited to announce the founding of the Mathematical AI safety Institute (MAISI) maisi.org. AI safety needs more foundational theoretical development, and mathematicians have the skills and the mindset to help! MAISI is an independent institute with
Fei Sha
@feishaAI
19h
Sadly, Goodhart's law gets realized over and over again.
👩‍💻 Paige Bailey
@DynamicWebPaige
23h
Terry Tao is probably the most measured, pro-AI mathematician on the planet - which makes this quote especially concerning to read. 😟 If sharing your hunches means getting scooped ~immediately without acknowledgement, then we're going to see not just math but all other science
Fei Sha
@feishaAI
Sep 8
This is indeed a vulnerability in the traditional scientific publishing process, which could be exploited.
Delip Rao e/σ
@deliprao
Sep 8
Thinking of the consequence of this close to home, I am 100% convinced peer review will die very soon, at least the version we use today in AI conferences like @ReviewAcl, @RealAAAI, @iclr_conf, @NeurIPSConf, and others. To make peer review effective, these conferences typically
1
Fei Sha
@feishaAI
Sep 8
EXACTLY. "Inspired by these rumors and by the step change in performance of our internal model, we launched an effort..." on @OpenAI pr (openai.com/index/navier-s…) What if there WERE no rumors?
Nan Jiang
@nanjiang_cs
Sep 8
Replying to @nanjiang_cs
plus i don't think seb understands why the other side is coming in deep distrust after you threw huge computes upon hearing rumor. their suspicion is (at least) to some degree warranted and they are not obliged to accept your explanation w/o full transparency.
Fei Sha
@feishaAI
Sep 8
Is this for real? Is not there is a thing called “memorization” by LLMs ?
Mark Chen
@markchen90
Sep 8
Two things to distinguish: Did any human or agent look at user data as part of the Navier Stokes effort? No. Do we use user feedback and de-identified data to improve ChatGPT and Codex in a holistic way? Yes. And so does every LLM company.