Pinned
Today we finally release our survey paper, spanning multiple axes of modular deep learning, covering topics like
- parameter-effic. architectures
- routing functions (MoEs, fixed,..)
- aggregation functions combining information from diff modules
and very many applications!
👇
In our new survey “Modular Deep Learning”, we provide a unified taxonomy of the building blocks of modular neural nets and connect disparate threads of research.
📄 arxiv.org/abs/2302.11529
📢 ruder.io/modular-deep-l…
🌐 modulardeeplearning.com
w/ @PfeiffJo @licwu @PontiEdoardo
