Actor-Critic Methods

Combine Value and Policy

Actor-critic architecture.

A2C/A3C

Asynchronous advantage actor-critic.

PPO

Proximal policy optimization. Clipped objective.

SAC

Soft actor-critic. Entropy regularization.

Key Takeaways

1. Actor-critic combines value and policy
2. PPO uses clipped objective
3. SAC maximizes entropy