Post-training
Policy gradients
Improving a policy directly from sampled returns: REINFORCE, baselines, actor-critic, generalised advantage estimation and PPO’s clipped objective. PPO and its variants are the RL algorithms used to post-train language models.
Questions
Question Difficulty Success