paper-with-me

Papers

Logo-LLM: Local and Global Modeling with Large Language Models for Time Series Forecasting

2025-05-16 · Wenjie Ou, Zhishuo Zhao, Dongyue Guo, Yi Lin

Time series forecasting is critical across multiple domains, where time series data exhibits both local patterns and global dependencies. While Transformer-based methods effectively capture global dependencies, they often overlook short-term local variations in time series. Recent methods that adapt large language models (LLMs) into time series forecasting inherit this limitation by treating LLMs as black-box encoders, relying solely on the final-layer output and underutilizing hierarchical representations. To address this limitation, we propose Logo-LLM, a novel LLM-based framework that explicitly extracts and models multi-scale temporal features from different layers of a pre-trained LLM. Through empirical analysis, we show that shallow layers of LLMs capture local dynamics in time series, while deeper layers encode global trends. Moreover, Logo-LLM introduces lightweight Local-Mixer and Global-Mixer modules to align and integrate features with the temporal input across layers. Extensive experiments demonstrate that Logo-LLM achieves superior performance across diverse benchmarks, with strong generalization in few-shot and zero-shot settings while maintaining low computational overhead.

📄 PDF Abstract BibTeX arXiv:2505.11017

Code (1)

cure-lab/ltsf-linear 공식 구현 pytorch

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

LoGo-MR: Screening Breast MRI for Cancer Risk Prediction by Efficient Omni-Slice Modeling

2026-04-13 · Xin Wang, Yuan Gao, George Yiasemis, Antonio Portaluri 외 arxiv

Efficient and explainable breast cancer (BC) risk prediction is critical for large-scale population-based screening. Breast MRI provides functional information for personalized risk assessment. Yet effective modeling rem…

LoGoFair: Post-Processing for Local and Global Fairness in Federated Learning

2025-03-21 · Li Zhang, Chaochao Chen, Zhongxuan Han, Qiyong Zhong 외

Federated learning (FL) has garnered considerable interest for its capability to learn from decentralized data sources. Given the increasing application of FL in decision-making scenarios, addressing fairness issues acro…

FairnessFederated Learning

LogoSP: Local-global Grouping of Superpoints for Unsupervised Semantic Segmentation of 3D Point Clouds

2025-06-09 · CVPR 2025 1 · Zihui Zhang, Weisheng Dai, Hongtao Wen, Bo Yang

We study the problem of unsupervised 3D semantic segmentation on raw point clouds without needing human labels in training. Existing methods usually formulate this problem into learning per-point local features followed …

3D Semantic SegmentationSegmentationSemantic SegmentationUnsupervised 3D Semantic Segmentation+1

LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusion

2023-03-07 · CVPR 2023 1 · Xin Li, Tao Ma, Yuenan Hou, Botian Shi 외

LiDAR-camera fusion methods have shown impressive performance in 3D object detection. Recent advanced multi-modal methods mainly perform global fusion, where image features and point cloud features are fused across the w…

3D Object Detectioncross-modal alignmentobject-detectionObject Detection+1

From Personal to Collective: On the Role of Local and Global Memory in LLM Personalization

2025-09-28 · Zehong Wang, Junlin Wu, ZHaoxuan Tan, Bolian Li 외 arxiv

Large language model (LLM) personalization aims to tailor model behavior to individual users based on their historical interactions. However, its effectiveness is often hindered by two key challenges: the \textit{cold-st…