HealthBench

Contains the data for the HealthBench eval. For the reference implementation of HealthBench, see OpenAI's simple-evals repo.

Papers using HealthBench (9)

Self-Rewarding Rubric-Based Reinforcement Learning for Open-Ended Reasoning2025 · 3 citesBaichuan-M2: Scaling Medical Capability with Large Verifier System2025 · 1 citesMitigating False Credit Propagation: Probabilistic Graphical Reward Aggregation for Rubric-Based Reinforcement Learning2026Improving Heart-Focused Medical Question Answering in LLMs via Variance-Aware Rubric Rewards with GRPO2026Alternating Reinforcement Learning with Contextual Rubric Rewards: Beyond the Scalarization Strategy2026RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation2026Multidimensional Rubric-oriented Reward Model Learning via Geometric Projection Reference Constraints2025Doctor-R1: Mastering Clinical Inquiry with Experiential Agentic Reinforcement Learning2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains2025