Multimodal data and domain adaptation
Evaluated multimodal fusion and adversarial domain adaptation under subject and session changes.
01 / RESEARCH DETAILMDA-GCL: multimodal fusion and domain alignment
- Challenge
- EEG and eye-feature distributions change across subjects and sessions.
- Approach
- Applied graph contrastive and domain-adversarial objectives to a graph built through modality-similarity fusion.
- Contribution
- Co-developed the model and ablations as a co-first author and contributed to acquisition protocols.
View full-size figure
View full-size figure
| Accuracy (%) | Cross-subject | Cross-session |
|---|---|---|
| SEED-IV | 76.1 ± 7.4 | 83.8 ± 8.3 |
| SEED-V | 75.6 ± 6.3 | 82.5 ± 9.1 |
Evaluation conditions and scopeTransductive domain adaptation uses unlabeled target features. Target emotion labels are excluded from training and model selection. SEED-IV cross-subject/session accuracy: 76.1 ± 7.4% / 83.8 ± 8.3%.