← all papers · overview

Omnihuman-1.5: Instilling An Active Mind In Avatars Via Cognitive Simulation

Abstract

Existing video avatar models can produce fluid human animations, yet they struggle to move beyond mere physical likeness to capture a character's authentic essence. Their motions typically synchronize with low-level cues like audio rhythm, lacking a deeper semantic understanding of emotion, intent, or context. To bridge this gap, \textbf\{we propose a framework designed to generate character animations that are not only physically plausible but also semantically coherent and expressive.\} Our model, \textbf\{OmniHuman-1.5\}, is built upon two key technical contributions. First, we leverage Multimodal Large Language Models to synthesize a structured textual representation of conditions that provides high-level semantic guidance. This guidance steers our motion generator beyond simplistic rhythmic synchronization, enabling the production of actions that are contextually and emotionally resonant. Second, to ensure the effective fusion of these multimodal inputs and mitigate inter-modality

Related papers

Ranked by semantic similarity — how closely each paper's abstract matches this one (100% = near-identical topic).