Scenarios: A New Representation For Complex Scene Understanding

Abstract

The ability for computational agents to reason about the high-level content of real world scene images is important for many applications. Existing attempts at addressing the problem of complex scene understanding lack representational power, efficiency, and the ability to create robust meta-knowledge about scenes. In this paper, we introduce scenarios as a new way of representing scenes. The scenario is a simple, low-dimensional, data-driven representation consisting of sets of frequently co-occurring objects and is useful for a wide range of scene understanding tasks. We learn scenarios from data using a novel matrix factorization method which we integrate into a new neural network architecture, the ScenarioNet. Using ScenarioNet, we can recover semantic information about real world scene images at three levels of granularity: 1) scene categories, 2) scenarios, and 3) objects. Training a single ScenarioNet model enables us to perform scene classification, scenario recognition, multi-

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keydaniels2018scenarios

Related papers

• Scenetrilogy: On Human Scene-sketch And Its Complementarity With Photo And Text (2022)10.35
• Compact Scene Graphs For Layout Composition And Patch Retrieval (2019)8.09
• SCENIR: Visual Semantic Clarity Through Unsupervised Scene Graph Retrieval (2025)0.00
• Cross-modal Scene Networks (2016)14.35
• Learning 3D Semantic Scene Graphs From 3D Indoor Reconstructions (2020)17.18
• Deep Representation Learning And Clustering Of Traffic Scenarios (2020)0.00
• Scenarioclip: Pretrained Transferable Visual Language Models And Action-genome Dataset For Natural Scene Analysis (2025)0.00
• Open-world 3D Scene Graph Generation For Retrieval-augmented Reasoning (2025)0.00