paper-with-me

Papers

FusionSF: Fuse Heterogeneous Modalities in a Vector Quantized Framework for Robust Solar Power Forecasting

2024-02-08 · Ziqing Ma, Wenwei Wang, Tian Zhou, Chao Chen, Bingqing Peng, Liang Sun, Rong Jin

Accurate solar power forecasting is crucial to integrate photovoltaic plants into the electric grid, schedule and secure the power grid safety. This problem becomes more demanding for those newly installed solar plants which lack sufficient data. Current research predominantly relies on historical solar power data or numerical weather prediction in a single-modality format, ignoring the complementary information provided in different modalities. In this paper, we propose a multi-modality fusion framework to integrate historical power data, numerical weather prediction, and satellite images, significantly improving forecast performance. We introduce a vector quantized framework that aligns modalities with varying information densities, striking a balance between integrating sufficient information and averting model overfitting. Our framework demonstrates strong zero-shot forecasting capability, which is especially useful for those newly installed plants. Moreover, we collect and release a multi-modal solar power (MMSP) dataset from real-world plants to further promote the research of multi-modal solar forecasting algorithms. Our extensive experiments show that our model not only operates with robustness but also boosts accuracy in both zero-shot forecasting and scenarios rich with training data, surpassing leading models. We have incorporated it into our eForecaster platform and deployed it for more than 300 solar plants with a capacity of over 15GW.

📄 PDF Abstract BibTeX arXiv:2402.05823

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion

2025-05-08 · CVPR 2025 1 · Qitao Zhao, Amy Lin, Jeff Tan, Jason Y. Zhang 외

Current Structure-from-Motion (SfM) methods typically follow a two-stage pipeline, combining learned or geometric pairwise reasoning with a subsequent global optimization step. In contrast, we propose a data-driven multi…

Denoisingglobal-optimization

Transferable Sequential Recommendation via Vector Quantized Meta Learning

2024-11-04 · Zhenrui Yue, Huimin Zeng, Yang Zhang, Julian McAuley 외

While sequential recommendation achieves significant progress on capturing user-item transition patterns, transferring such large-scale recommender systems remains challenging due to the disjoint user and item groups acr…

Meta-LearningQuantizationRecommendation SystemsSequential Recommendation

Adaptive Multi-Modalities Fusion in Sequential Recommendation Systems

2023-08-30 · Hengchang Hu, Wei Guo, Yong liu, Min-Yen Kan

In sequential recommendation, multi-modal information (e.g., text or image) can provide a more comprehensive view of an item's profile. The optimal stage (early or late) to fuse modality features into item representation…

Recommendation SystemsSequential Recommendation

Training-Free Graph Filtering via Multimodal Feature Refinement for Extremely Fast Multimodal Recommendation

2025-03-06 · Yu-Seung Roh, Joo-Young Kim, Jin-Duk Park, Won-Yong Shin

Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of us…

Multimodal RecommendationRecommendation Systems

Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding

2025-01-08 · Joshua Jones, Oier Mees, Carmelo Sferrazza, Kyle Stachowicz 외

Interacting with the world is a multi-sensory experience: achieving effective general-purpose interaction requires making use of all available modalities -- including vision, touch, and audio -- to fill in gaps from part…

Robot ManipulationText GenerationVision-Language-Action