Face-voice Association In Multilingual Environments (FAME) Challenge 2024 Evaluation Plan

Abstract

The advancements of technology have led to the use of multimodal systems in various real-world applications. Among them, the audio-visual systems are one of the widely used multimodal systems. In the recent years, associating face and voice of a person has gained attention due to presence of unique correlation between them. The Face-voice Association in Multilingual Environments (FAME) Challenge 2024 focuses on exploring face-voice association under a unique condition of multilingual scenario. This condition is inspired from the fact that half of the world's population is bilingual and most often people communicate under multilingual scenario. The challenge uses a dataset namely, Multilingual Audio-Visual (MAV-Celeb) for exploring face-voice association in multilingual environments. This report provides the details of the challenge, dataset, baselines and task details for the FAME Challenge.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysaeed2024face

Related papers

• Contrastive Learning-based Chaining-cluster For Multilingual Voice-face Association (2024)4.78
• Cross-modal Speaker Verification And Recognition: A Multilingual Perspective (2020)0.00
• Multi-stage Face-voice Association Learning With Keynote Speaker Diarization (2024)7.97
• PAEFF: Precise Alignment And Enhanced Gated Feature Fusion For Face-voice Association (2025)6.34
• The Voices From A Distance Challenge 2019 Evaluation Plan (2019)0.00
• Automatic Quality Assessment For Audio-visual Verification Systems. The Love Submission To NIST SRE Challenge 2019 (2020)0.00
• The Voice Conversion Challenge 2018: Promoting Development Of Parallel And Nonparallel Methods (2018)17.06
• Seeing Your Speech Style: A Novel Zero-shot Identity-disentanglement Face-based Voice Conversion (2024)4.52