SafeRLHF

SafeRLHF is a dataset/benchmark used to evaluate the adaptability of reward models in aligning language models with human preferences through reinforcement learning, particularly in the context of complex and multifaceted preference distributions.

Papers using SafeRLHF (1)

Bayesian Preference Learning for Test-Time Steerable Reward Models2026