Our recent work found a simple recipe for long-horizon memorization: it turns out that compositions of continual learning mechanisms can greatly reduce catastrophic forgetting. See the thread by @zheyuanzhang99 below
Existing continual learning methods still suffer from catastrophic forgetting. Our recent work found a simple recipe to substantially improve 𝗹𝗼𝗻𝗴-𝗵𝗼𝗿𝗶𝘇𝗼𝗻 𝗺𝗲𝗺𝗼𝗿𝗶𝘇𝗮𝘁𝗶𝗼𝗻:
Composing multiple continual learning mechanisms extends memory lifetime and raises
00:00
