Big Bench Audio

Artificial Analysis Big Bench Audio Dataset Summary Big Bench Audio is an audio version of a subset of Big Bench Hard questions. The dataset can be used for evaluating the reasoning capabilities of models that support audio input. The dataset includes 1000 audio recordings for all questions from the following Big Bench

Papers using Big Bench Audio (2)

MiMo-Audio: Audio Language Models are Few-Shot Learners2025DrVoice: Parallel Speech-Text Voice Conversation Model via Dual-Resolution Speech Representations2025