Modern DP for ML
Advanced DP techniques.
PATE
Private Aggregation of Teacher Ensembles.
DP-SGD
Differential privacy SGD. Gradient clipping.
Composition
Composition theorems. Advanced composition.
Key Takeaways
- PATE for ensemble privacy
- DP-SGD for training
- Composition bounds