MEGConformer: Conformer-Based MEG Decoder for Robust Speech and Phoneme Classification
Decoding speech-related information from non-invasive MEG is a key step toward scalable brain-computer interfaces. We present compact Conformer-based decoders on the LibriBrain 2025 PNPL benchmark for two core tasks: Speech Detection and Phoneme Classification. Our approach adapts a compact Conformer to raw 306-channel MEG signals, with a lightweight convolutional projection layer and task-specific heads. For Speech Detection, a MEG-oriented SpecAugment provided a first exploration of MEG-specific augmentation. For Phoneme Classification, we used inverse-square-root class weighting and a dynamic grouping loader to handle 100-sample averaged examples. In addition, a simple instance-level normalization proved critical to mitigate distribution shifts on the holdout split. Using the official Standard track splits and F1-macro for model selection, our best systems achieved 88.9% (Speech) and 65.8% (Phoneme) on the leaderboard, winning the Phoneme Classification Standard track. For further implementation details, the technical documentation, source code, and checkpoints are available at https://github.com/neural2speech/libribrain-experiments.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Measuring Robustness of Speech Recognition from MEG Signals Under Distribution Shift
This study investigates robust speech-related decoding from non-invasive MEG signals using the LibriBrain phoneme-classification benchmark from the 2025 PNPL competition. We compare residual convolutional neural networks…
Speech RecognitionData AugmentationMultilingual Speech Recognition for Low-Resource Indian Languages using Multi-Task conformer
Transformers have recently become very popular for sequence-to-sequence applications such as machine translation and speech recognition. In this work, we propose a multi-task learning-based transformer model for low-reso…
DecoderMachine TranslationMulti-Task LearningPhoneme Recognition+3A Dual-Decoder Conformer for Multilingual Speech Recognition
Transformer-based models have recently become very popular for sequence-to-sequence applications such as machine translation and speech recognition. This work proposes a dual-decoder transformer model for low-resource mu…
DecoderLanguage IdentificationMachine TranslationMulti-Task Learning+4A Novel End-to-End CAPT System for L2 Children Learners
Recently, Conformer-based model shows promising results in automatic speech recognition (ASR) task. There still is a dearth of research on Conformer based model for computer-assisted pronunciation learning (CAPT) system.…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderPhoneme Recognition+3iPhoneme: Brain-to-Text Communication for ALS Using ConformerXL Decoding
Brain-computer interfaces (BCIs) for speech restoration hold transformative potential for the approximately 173,000--232,500 individuals worldwide with ALS-related dysarthria. Despite recent progress, high-performance sp…