Dan Fu

@realDanFu

VP, Kernels @togethercompute Assistant Professor @ucsd_cse Looking for talented kernel engineers and performance engineers!

danfu.org

Joined September 2019

Replies Reposts Media

Pinned
Dan Fu
@realDanFu
Aug 19, 2024
Excited to share that I will be joining UCSD CSE as an assistant professor in January 2026! I'll be recruiting PhD students from the 2024 application pool - if you're interested in anything ML Sys/efficiency/etc please reach out & put my name on your application! Until then
48
Dan Fu
@realDanFu
Sep 10
Super excited to get early access to Vera Rubin to write some kernels and play with the new tensor cores! Enjoy these astronomer thunderkittens looking into the stars and check out the write up of new features below⚡️🐱💫
Together AI
@togethercompute
Sep 10
thunderkittens is now running on nvidia vera rubin! our kernels team got early access to nvl72 and spent the past few days digging through the new isa and bringing nvfp4 + fp8 gemms to life after reworking the kernels for rubin, we pushed them past 22 and 12 pflops respectively
3
Dan Fu
@realDanFu
Sep 2
Really cool to see folks train looped models at scale! @hayden_prairie has some great work here on the fundamental architecture choices in looped models and how to make them stable (+ higher quality). More soon on the inference-time memory implications :)
Hayden Prairie
@hayden_prairie
Sep 2
It's exciting to see the rumors that Astra is a looped model. For those interested in the math on how to stably train them, I would check out our work Parcae. We also show that looping follows predictable scaling laws! arxiv.org/pdf/2604.12946
2
Dan Fu
@realDanFu
Aug 31
This is a really cool demo I've wanted to see for a while - cool to see the models + systems develop to really make a compelling demo ("realtime" video has been possible since 2024 with OpenSora on 8xH100, but quality was not good enough to be compelling) Great work @haoailab!
Hao Zhang
@haozhangml
Aug 30
Wow, the community is moving so fast. @reactorworld just developed an infinite video stream on Twitch using FastH3, and it looks so fun! It is open source!! Thank you @reactorworld for the love with OSS 🥰🥳 code and models here: github.com/reactor-team/i…
2
Dan Fu
@realDanFu
Aug 25
♉️𝛂🐂𝛂♉️𝛂🐂𝛂♉️𝛂🐂𝛂
Vipul Ved Prakash
@vipulved
Aug 25
Excited to share that 0x Alpha will be on @togethercompute as early as tomorrow morning! together.ai/models/ox-alpha