paper-with-me

Papers

CoLoRA: Continuous low-rank adaptation for reduced implicit neural modeling of parameterized partial differential equations

2024-02-22 · Jules Berman, Benjamin Peherstorfer

This work introduces reduced models based on Continuous Low Rank Adaptation (CoLoRA) that pre-train neural networks for a given partial differential equation and then continuously adapt low-rank weights in time to rapidly predict the evolution of solution fields at new physics parameters and new initial conditions. The adaptation can be either purely data-driven or via an equation-driven variational approach that provides Galerkin-optimal approximations. Because CoLoRA approximates solution fields locally in time, the rank of the weights can be kept small, which means that only few training trajectories are required offline so that CoLoRA is well suited for data-scarce regimes. Predictions with CoLoRA are orders of magnitude faster than with classical methods and their accuracy and parameter efficiency is higher compared to other neural network approaches.

📄 PDF Abstract BibTeX arXiv:2402.14646

Code (1)

julesberman/colora 공식 구현 jax

Similar Papers 제목 키워드 기반

COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification

2025-05-23 · Mariano Rivera, Angello Hoyos

We introduce the Convolutional Low-Rank Adaptation (CoLoRA) method, designed explicitly to overcome the inefficiencies found in current CNN fine-tuning methods. CoLoRA can be seen as a natural extension of the convolutio…

image-classificationImage Classification

Contribution-based Low-Rank Adaptation with Pre-training Model for Real Image Restoration

2024-08-02 · Donwon Park, Hayeon Kim, Se Young Chun

Recently, pre-trained model and efficient parameter tuning have achieved remarkable success in natural language processing and high-level computer vision with the aid of masked modeling and prompt tuning. In low-level co…

Image Restoration

HiCoLoRA: Addressing Context-Prompt Misalignment via Hierarchical Collaborative LoRA for Zero-Shot DST

2025-09-24 · Shuyu Zhang, Yifan Wei, Xinru Wang, Yanmin Zhu 외 arxiv

Zero-shot Dialog State Tracking (zs-DST) is essential for enabling Task-Oriented Dialog Systems (TODs) to generalize to new domains without costly data annotation. A central challenge lies in the semantic misalignment be…

Collaborative and Efficient Fine-tuning: Leveraging Task Similarity

2026-02-06 · Gagik Magakyan, Amirhossein Reisizadeh, Chanwoo Park, Pablo A. Parrilo 외 arxiv

Adaptability has been regarded as a central feature in the foundation models, enabling them to effectively acclimate to unseen downstream tasks. Parameter-efficient fine-tuning methods such as celebrated LoRA facilitate …

parameter-efficient fine-tuning

RICH-SLAM: Radar SLAM with Incremental and Continuous Hilbert Mapping

2026-06-16 · Bingbing Zhang, Huan Yin, Yang Xu, Shuo Liu 외 arxiv

Simultaneous localization and mapping using radar sensors has gained increasing attention due to radar's inherent robustness to adverse weather and lighting conditions. However, radar measurements are characteristically …

Pose Estimation