Hanshi Sun

@preminstrel

Research Scientist in ByteDance Seed | MLSys | Grad @CMU_ECE

Seattle, US

preminstrel.com

Replies Reposts Media

Pinned
Hanshi Sun
@preminstrel
May 1, 2025
🎉 Thrilled to announce our ShadowKV has been accepted to #ICML2025 as a ✨Spotlight Presentation❗️ ❓Facing challenges with high-throughput long-context LLM serving? ShadowKV is here to help! 🚀 Achieves memory-efficient & high-throughput inference via sparse attention. 🌟
Hanshi Sun
@preminstrel
Aug 22, 2025
The deadline (Sept 1) for our 1st Efficient Reasoning workshop @ NeurIPS is just around the corner! Don't miss out! 😇
Cheng Luo
@ChengLuo_lc
Aug 22, 2025
🌟 Reminder: Submission Deadline Approaching! 🌟 The 1st Workshop on Efficient Reasoning (ER) @ NeurIPS 2025 — happening Dec 6 or 7 in San Diego — is fast approaching, and we’d love to see your work there! 📌 Submission Deadline: September 1, 2025 (AoE) 🔗 Submit here:
Hanshi Sun
@preminstrel
Oct 7, 2024
Visit our poster at @COLM_conf on Monday morning to discover our lossless acceleration method 𝑻𝒓𝒊𝑭𝒐𝒓𝒄𝒆 for long sequence generation using speculative decoding! Feel free to DM me if you want to chat during the conference. Excited to connect with new and familiar faces!
Beidi Chen
@BeidiChen
Apr 24, 2024
❓Wanna host a Llama2-7B-128K (14GB weight + 64GB KV cache) at home🤔 📢 Introducing TriForce! 🚀Lossless Ultra-Fast Long Seq Generation — training-free Spec Dec! 🌟 🔥 TriForce serves with 0.1s/token on 2 RTX4090s + CPU – only 2x slower on an A100 (~55ms on chip), 8x faster
GIF
Hanshi Sun
@preminstrel
Sep 13, 2021
@obsdmd Recently, I find that the publish plugin is really wonderful and play an important role in my Note-Archieve project. Actually, I previous use Hugo to upload and backup my notes. However, I find it cannot achieve the origin render effect. So I pay $96/year to got it.
Hanshi Sun
@preminstrel
Apr 19, 2020
HELLO WORLD 真的好看，内地确定引进了，可以去电影院补票了哈哈。😃 「たとえ世界が壊れても、もう一度、君に会いたい」