paper-with-me

Papers

AdaMixT: Adaptive Weighted Mixture of Multi-Scale Expert Transformers for Time Series Forecasting

2025-09-09 · Huanyao Zhang, Jiaye Lin, Wentao Zhang, Haitao Yuan, Guoliang Li arxiv

Multivariate time series forecasting involves predicting future values based on historical observations. However, existing approaches primarily rely on predefined single-scale patches or lack effective mechanisms for multi-scale feature fusion. These limitations hinder them from fully capturing the complex patterns inherent in time series, leading to constrained performance and insufficient generalizability. To address these challenges, we propose a novel architecture named Adaptive Weighted Mixture of Multi-Scale Expert Transformers (AdaMixT). Specifically, AdaMixT introduces various patches and leverages both General Pre-trained Models (GPM) and Domain-specific Models (DSM) for multi-scale feature extraction. To accommodate the heterogeneity of temporal features, AdaMixT incorporates a gating network that dynamically allocates weights among different experts, enabling more accurate predictions through adaptive multi-scale fusion. Comprehensive experiments on eight widely used benchmarks, including Weather, Traffic, Electricity, ILI, and four ETT datasets, consistently demonstrate the effectiveness of AdaMixT in real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2509.18107

Code (0)

등록된 구현이 없습니다.

Tasks

Multivariate Time Series Forecasting

Similar Papers 제목 키워드 기반

MoE-SPNet: A Mixture-of-Experts Scene Parsing Network

2018-06-19 · Huan Fu, Mingming Gong, Chaohui Wang, DaCheng Tao

Scene parsing is an indispensable component in understanding the semantics within a scene. Traditional methods rely on handcrafted local features and probabilistic graphical models to incorporate local and global cues. R…

Mixture-of-ExpertsScene Parsing

Type I and Type II Bayesian Methods for Sparse Signal Recovery using Scale Mixtures

2015-07-17 · Ritwik Giri, Bhaskar D. Rao

In this paper, we propose a generalized scale mixture family of distributions, namely the Power Exponential Scale Mixture (PESM) family, to model the sparsity inducing priors currently in use for sparse signal recovery (…

Vocal Bursts Type Prediction

AWSD: Adaptive Weighted Spatiotemporal Distillation for Video Representation

2019-10-01 · ICCV 2019 10 · Mohammad Tavakolian, Hamed R. Tavakoli, Abdenour Hadid

We propose an Adaptive Weighted Spatiotemporal Distillation (AWSD) technique for video representation by encoding the appearance and dynamics of the videos into a single RGB image map. This is obtained by adaptively divi…

General ClassificationVideo Classification

Universal Agent Mixtures and the Geometry of Intelligence

2023-02-13 · Samuel Allen Alexander, David Quarel, Len Du, Marcus Hutter

Inspired by recent progress in multi-agent Reinforcement Learning (RL), in this work we examine the collective intelligent behaviour of theoretical universal agents by introducing a weighted mixture operation. Given a we…

Multi-agent Reinforcement LearningReinforcement Learning (RL)

Spectral clustering via adaptive layer aggregation for multi-layer networks

2020-12-07 · Sihan Huang, Haolei Weng, Yang Feng

One of the fundamental problems in network analysis is detecting community structure in multi-layer networks, of which each layer represents one type of edge information among the nodes. We propose integrative spectral c…

ClusteringCommunity Detection