paper-with-me

홈 › Papers

Hierarchical Multi-to-Single-Modal Knowledge Distillation for Disruption Prediction in EAST

2026-07-05 · Qiang Chen, Xiao Wang, Hao Si, Qingquan Yang, Meiwen Chen, Jianhua Yang, Xiaofeng Han, Yunhu Jia, Ran Chen, Liang Wang, Jin Tang, Guosheng Xu arxiv

Plasma disruption is a critical threat to tokamak safety. Existing data-driven predictors mainly rely on time-series diagnostic signals, while visible images provide complementary spatial cues including plasma deformation, local brightening, and radiation-structure evolution. Although the image modality improves the model's discriminative capability, it also substantially increases the computational cost during inference. To address this issue, we propose a hierarchical multi-to-single-modal knowledge distillation framework for disruption prediction on a synchronized EAST multimodal dataset. During training, visible images and time-series signals are used to train a multimodal teacher, which learns disruption precursor representations through Transformer-based encoders and a prototype-guided spatiotemporal hypergraph module. During inference, only the time-series student is retained, with multimodal knowledge transferred through graph-structure-level, representation-level, and decision-level distillation. On the 640-discharge EAST dataset, the results demonstrate that the proposed framework can preserve the discriminative advantages of multimodal learning while substantially reducing inference cost, and providing an effective route for efficient disruption prediction in EAST. The source code of this paper will be released on https://github.com/Event-AHU/OpenFusion.

📄 PDF Abstract BibTeX arXiv:2607.04241

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Distillation

Similar Papers 제목 키워드 기반

Knowledge distillation from language model to acoustic model: a hierarchical multi-task learning approach

2021-10-20 · Mun-Hak Lee, Joon-Hyuk Chang

The remarkable performance of the pre-trained language model (LM) using self-supervised learning has led to a major paradigm shift in the study of natural language processing. In line with these changes, leveraging the p…

Knowledge DistillationLanguage ModelingLanguage Modellingmodel+4

Decoupled Hierarchical Distillation for Multimodal Emotion Recognition

2026-02-04 · Yong Li, Yuanzhi Wang, Yi Ding, Shiqing Zhang 외 arxiv

Human multimodal emotion recognition (MER) seeks to infer human emotions by integrating information from language, visual, and acoustic modalities. Although existing MER approaches have achieved promising results, they s…

Multimodal Emotion RecognitionKnowledge Distillation

Unimodal-driven Distillation in Multimodal Emotion Recognition with Dynamic Fusion

2025-03-31 · Jiagen Li, Rui Yu, Huihao Huang, Huaicheng Yan

Multimodal Emotion Recognition in Conversations (MERC) identifies emotional states across text, audio and video, which is essential for intelligent dialogue systems and opinion analysis. Existing methods emphasize hetero…

Emotion RecognitionKnowledge DistillationMixture-of-ExpertsMultimodal Emotion Recognition

Do We Really Need a Complex Agent System? Distill Embodied Agent into a Single Model

2024-04-06 · Zhonghan Zhao, Ke Ma, Wenhao Chai, Xuan Wang 외

With the power of large language models (LLMs), open-ended embodied agents can flexibly understand human instructions, generate interpretable guidance strategies, and output executable actions. Nowadays, Multi-modal Lang…

Knowledge Distillation

UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning

2026-06-18 · Wenhao Chi, Arkaprava Sinha, Dominick Reilly, Hieu Le 외 arxiv

Egocentric video understanding is inherently limited by the narrow perspective of wearable cameras: a single viewpoint, a single modality, a single model cannot capture the full richness of human action. We argue that a …

Representation LearningAction SegmentationAction RecognitionVideo Retrieval