Automating AI Failure Tracking: Semantic Association Of Reports In AI Incident Database
2025 · Diego Russo, Gian Marco Orlando, Valerio La Gatta, et al.
Abstract
Artificial Intelligence (AI) systems are transforming critical sectors such as healthcare, finance, and transportation, enhancing operational efficiency and decision-making processes. However, their deployment in high-stakes domains has exposed vulnerabilities that can result in significant societal harm. To systematically study and mitigate these risk, initiatives like the AI Incident Database (AIID) have emerged, cataloging over 3,000 real-world AI failure reports. Currently, associating a new report with the appropriate AI Incident relies on manual expert intervention, limiting scalability and delaying the identification of emerging failure patterns. To address this limitation, we propose a retrieval-based framework that automates the association of new reports with existing AI Incidents through semantic similarity modeling. We formalize the task as a ranking problem, where each report-comprising a title and a full textual description-is compared to previously documented AI Incide
Authors
(none)
Tags
Stats
Related papers
- Understanding And Creating Art With AI: Review And Outlook (2021)19.57
- Multi-view Adaptive Contrastive Learning For Information Retrieval Based Fault Localization (2024)2.26
- Generative Ghost: Investigating Ranking Bias Hidden In Ai-generated Videos (2025)0.00
- Learning Visual-semantic Embeddings For Reporting Abnormal Findings On Chest X-rays (2020)9.76
- Improving Factuality Of 3D Brain MRI Report Generation With Paired Image-domain Retrieval And Text-domain Augmentation (2024)0.00
- Ontology-based Concept Distillation For Radiology Report Retrieval And Labeling (2025)1.20
- RAVID: Retrieval-augmented Visual Detection: A Knowledge-driven Approach For Ai-generated Image Identification (2025)0.00
- Ai-based Copyright Detection Of An Image In A Video Using Degree Of Similarity And Image Hashing (2024)0.00