DeepSpeed (@DeepSpeedAI) / X

DeepSpeed

112 posts

DeepSpeed

@DeepSpeedAI

Official account for DeepSpeed, a library that enables unprecedented scale and speed for deep learning training + inference. 日本語 : @DeepSpeedAI_JP

Joined May 2020

Replies Articles Media

Pinned
DeepSpeed
@DeepSpeedAI
Jun 3
We now have native support for all ZeRO stages 1/2/3 for Muon Optimizers, providing superior performance on LLM pre-training and post-training. Feel free to try it out, kudos to @PKUWZP Guokai Ma, Peng Du and Chi for the contribution!
PyTorch
@PyTorch
Jun 3
DeepSpeed now supports the Muon Optimizer. Optimized specifically for internal 2D weights within neural networks, Muon is gaining traction for its significant memory savings and strong convergence metrics during LLM training. In our latest blog post, the DeepSpeed team shares a
DeepSpeed
@DeepSpeedAI
Jul 22
We will host our monthly Office Hour for DeepSpeed users on July 28th, 9AM PT. Feel free to join and discuss any topics ranging from issues to roadmaps. Zoom link: zoom-lfx.platform.linuxfoundation.org/meeting/939025…
DeepSpeed
@DeepSpeedAI
May 26
Reminder to join our DeepSpeed Office Hours on Tuesday, May 26 at 12:00 PM America/New_York. We'll cover general questions, Q2 roadmap progress, and requests for Q3. Everyone is welcome! Zoom: zoom-lfx.platform.linuxfoundation.org/meeting/939025…
DeepSpeed
@DeepSpeedAI
May 18
Article
AMD’s MORI now integrated into DeepSpeed with SDMA support
MORI is AMD's next-generation infrastructure for performance-critical AI workloads: Wide-EP, common communication kernels, end-to-end KVCache management and agentic system. ~10% training speedup by...
DeepSpeed
@DeepSpeedAI
May 14
Article
DeepSpeed Virtual Office Hours
Have questions about DeepSpeed or ideas for what we should prioritize next? Join our next DeepSpeed Office Hours on Tuesday, May 26 at 12:00 PM America/New_York. We'll cover general questions, Q2...
See @DeepSpeedAI's full profile
Sign up
Log in

See @DeepSpeedAI's full profile