Meralion-audiollm: Bridging Audio And Language With Large Language Models

Abstract

We introduce MERaLiON-AudioLLM (Multimodal Empathetic Reasoning and Learning in One Network), the first speech-text model tailored for Singapore's multilingual and multicultural landscape. Developed under the National Large Language Models Funding Initiative, Singapore, MERaLiON-AudioLLM integrates advanced speech and text processing to address the diverse linguistic nuances of local accents and dialects, enhancing accessibility and usability in complex, multilingual environments. Our results demonstrate improvements in both speech recognition and task-specific understanding, positioning MERaLiON-AudioLLM as a pioneering solution for region specific AI applications. We envision this release to set a precedent for future models designed to address localised linguistic and cultural contexts in a global framework.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhe2024meralion

Related papers

• Meralion-speechencoder: Towards A Speech Foundation Model For Singapore And Beyond (2024)0.00
• Advancing Singlish Understanding: Bridging The Gap With Datasets And Multimodal Models (2025)0.00
• Mmmmodal -- Multi-images Multi-audio Multi-turn Multi-modal (2024)0.00
• Merlion CCS Challenge: A English-mandarin Code-switching Child-directed Speech Corpus For Language Identification And Diarization (2023)0.00
• Au-m-ol: A Unified Model For Medical Audio And Language Understanding (2026)0.00
• Large Language Models Are Strong Audio-visual Speech Recognition Learners (2024)9.59
• Ideal-llm: Integrating Dual Encoders And Language-adapted LLM For Multilingual Speech-to-text (2024)5.24
• Tiny-align: Bridging Automatic Speech Recognition And Large Language Model On The Edge (2024)0.00