Advanced Continual Learning
Modern continual learning.
Elastic Weight Consolidation
Protect important weights. EWC for slow forgetting.
Progressive Networks
Add new columns. No forgetting.
Replay Methods
Store examples. Generative replay. Experience replay.
Key Takeaways
- EWC protects weights
- Progressive networks add capacity
- Experience replay helps