Today, with @Tim_Dettmers, @huggingface, & @mobius_labs, we're releasing FSDP/QLoRA, a new project that lets you efficiently train very large (70b) models on a home computer with consumer gaming GPUs.
A new kind of AI R&D lab which creates practical end-user products based on foundational research breakthroughs
Distributed
Joined March 2024

