paper-with-me

홈 › Papers

POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan

2026-03-25 · Marta Moscati, Muhammad Saad Saeed, Marina Zanoni, Mubashir Noman, Rohan Kumar Das, Monorama Swain, Yufang Hou, Elisabeth Andre, Khalid Mahmood Malik, Markus Schedl, Shah Nawaz arxiv

Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing. However, in real-world applications, such assumptions often do not hold. Visual information may be missing due to occlusions, camera failures, or privacy constraints, while multilingual speakers introduce additional complexity due to linguistic variability across languages. These challenges significantly affect the robustness and generalization of multimodal speaker identification systems. The POLY-SIM Grand Challenge 2026 aims to advance research in multimodal speaker identification under missing-modality and cross-lingual conditions. Specifically, the Grand Challenge encourages the development of robust methods that can effectively leverage incomplete multimodal inputs while maintaining strong performance across different languages. This report presents the design and organization of the POLY-SIM Grand Challenge 2026, including the dataset, task formulation, evaluation protocol, and baseline model. By providing a standardized benchmark and evaluation framework, the challenge aims to foster progress toward more robust and practical multimodal speaker identification systems.

📄 PDF Abstract BibTeX arXiv:2603.24569

Code (0)

등록된 구현이 없습니다.

Tasks

Speaker Identification

Similar Papers 제목 키워드 기반

AMR: Adaptive Modality Routing for Multimodal Polyglot Speaker Identification

2026-06-28 · Chuxiao Zuo, Yao Zhu, Minqiang Xu, Manhong Wang 외 arxiv

Multimodal speaker identification systems face two key challenges in real-world deployment: missing modalities and language mismatch between training and testing conditions. In practical scenarios, background multi-speak…

Speaker Identification

Unsupervised Polyglot Text To Speech

2019-02-06 · Eliya Nachmani, Lior Wolf

We present a TTS neural network that is able to produce speech in multiple languages. The proposed network is able to transfer a voice, which was presented as a sample in a source language, into one of several target lan…

text-to-speechText to Speech

Toward the Detection of Polyglot Files

2022-03-14 · Luke Koch, Sean Oesch, Mary Adkisson, Sam Erwin 외

Standardized file formats play a key role in the development and use of computer software. However, it is possible to abuse standardized file formats by creating a file that is valid in multiple file formats. The resulti…

Malware Detection

On the Abuse and Detection of Polyglot Files

2024-07-01 · Luke Koch, Sean Oesch, Amul Chaulagain, Jared Dixon 외

A polyglot is a file that is valid in two or more formats. Polyglot files pose a problem for malware detection systems that route files to format-specific detectors/signatures, as well as file upload and sanitization too…

Malware Detection

Mix and Match: An Empirical Study on Training Corpus Composition for Polyglot Text-To-Speech (TTS)

2022-07-04 · Ziyao Zhang, Alessio Falai, Ariadna Sanchez, Orazio Angelini 외

Training multilingual Neural Text-To-Speech (NTTS) models using only monolingual corpora has emerged as a popular way for building voice cloning based Polyglot NTTS systems. In order to train these models, it is essentia…

Speech Synthesistext-to-speechText to SpeechVoice Cloning