Interpreting Context Of Images Using Scene Graphs

Abstract

Understanding a visual scene incorporates objects, relationships, and context. Traditional methods working on an image mostly focus on object detection and fail to capture the relationship between the objects. Relationships can give rich semantic information about the objects in a scene. The context can be conducive to comprehending an image since it will help us to perceive the relation between the objects and thus, give us a deeper insight into the image. Through this idea, our project delivers a model that focuses on finding the context present in an image by representing the image as a graph, where the nodes will the objects and edges will be the relation between them. The context is found using the visual and semantic cues which are further concatenated and given to the Support Vector Machines (SVM) to detect the relation between two objects. This presents us with the context of the image which can be further used in applications such as similar image retrieval, image captioning,

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymittal2019interpreting

Related papers

• Beyond Visual Semantics: Exploring The Role Of Scene Text In Image Understanding (2019)9.59
• SCENIR: Visual Semantic Clarity Through Unsupervised Scene Graph Retrieval (2025)0.00
• Multi-modal Reasoning Graph For Scene-text Based Fine-grained Image Classification And Retrieval (2020)11.29
• Image-to-image Retrieval By Learning Similarity Between Scene Graphs (2020)12.02
• A Deep Local And Global Scene-graph Matching For Image-text Retrieval (2021)10.74
• Contextual Visual Similarity (2016)0.00
• Scene Graph Based Fusion Network For Image-text Retrieval (2023)4.52
• Learning 3D Semantic Scene Graphs From 3D Indoor Reconstructions (2020)17.18