Theory of Continual Learning
Theoretical foundations.
Forgetting
Catastrophic forgetting. Interference. Gradient alignment.
Stability-Plasticity
Balance between stability and plasticity.
Theories
Task similarity. Transfer of learning. Module specialization.
Key Takeaways
- Catastrophic forgetting
- Stability-plasticity tradeoff
- Task relationships