MEG-to-MEG Transfer Learning and Cross-Task Speech/Silence Detection with Limited Data
Abstract
Transfer learning enables efficient MEG-based speech decoding from perception to production tasks using a Conformer model with minimal fine-tuning data.
Data-efficient neural decoding is a central challenge for speech brain-computer interfaces. We present the first demonstration of transfer learning and cross-task decoding for MEG-based speech models spanning perception and production. We pre-train a Conformer-based model on 50 hours of single-subject listening data and fine-tune on just 5 minutes per subject across 18 participants. Transfer learning yields consistent improvements, with in-task accuracy gains of 1-4% and larger cross-task gains of up to 5-6%. Not only does pre-training improve performance within each task, but it also enables reliable cross-task decoding between perception and production. Critically, models trained on speech production decode passive listening above chance, confirming that learned representations reflect shared neural processes rather than task-specific motor activity.
Community
We show that large-scale pretraining on a single-subject MEG dataset (50h) can improve speech decoding performance when fine-tuned on only ~5 minutes of data per new subject.
Beyond in-task gains, transfer learning enables robust cross-task decoding between speech perception and production, revealing asymmetric generalization patterns. Interestingly, models trained on production can decode passive listening above chance, suggesting shared neural representations of speech.
These results support transfer learning as a practical strategy for data-efficient MEG-based BCIs.
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper