OMIBench
Emerging4papers using it
2024first seen
OMIBench is a benchmark that contains problems from biology, chemistry, mathematics, and physics Olympiads, designed to evaluate Olympiad-level reasoning across multiple images with annotated rationales and evaluation protocols.
Papers using OMIBench (4)
- AVRT: Audio-Visual Reasoning Transfer through Single-Modality TeachersOMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language ModelOpenOmni: Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-Time Self-Aware Emotional Speech SynthesisOmniBench: Towards The Future of Universal Omni-Language Models