Pinned
What do JEPA-style self-distillation dynamics actually learn — and why do they sometimes avoid collapse?
In our new work with @BasileTerv987 and Jean Ponce, we tackle this question.
What surprised us: These dynamics provably recover representations with nonlinear-CCA structure.
