paper-with-me

Papers

Low-Rank Adaptation of Neural Fields

2025-04-22 · Anh Truong, Ahmed H. Mahmoud, Mina Konaković Luković, Justin Solomon

Processing visual data often involves small adjustments or sequences of changes, such as in image filtering, surface smoothing, and video storage. While established graphics techniques like normal mapping and video compression exploit redundancy to encode such small changes efficiently, the problem of encoding small changes to neural fields (NF) -- neural network parameterizations of visual or physical functions -- has received less attention. We propose a parameter-efficient strategy for updating neural fields using low-rank adaptations (LoRA). LoRA, a method from the parameter-efficient fine-tuning LLM community, encodes small updates to pre-trained models with minimal computational overhead. We adapt LoRA to instance-specific neural fields, avoiding the need for large pre-trained models yielding a pipeline suitable for low-compute hardware. We validate our approach with experiments in image filtering, video compression, and geometry editing, demonstrating its effectiveness and versatility for representing neural field updates.

📄 PDF Abstract BibTeX arXiv:2504.15933

Code (0)

등록된 구현이 없습니다.

Tasks

parameter-efficient fine-tuningVideo Compression

Similar Papers 제목 키워드 기반

CoLoRA: Continuous low-rank adaptation for reduced implicit neural modeling of parameterized partial differential equations

2024-02-22 · Jules Berman, Benjamin Peherstorfer

This work introduces reduced models based on Continuous Low Rank Adaptation (CoLoRA) that pre-train neural networks for a given partial differential equation and then continuously adapt low-rank weights in time to rapidl…

Low-Rank Approximation, Adaptation, and Other Tales

2024-08-12 · Jun Lu

Low-rank approximation is a fundamental technique in modern data analysis, widely utilized across various fields such as signal processing, machine learning, and natural language processing. Despite its ubiquity, the mec…

A Short Note on Proximity-based Scoring of Documents with Multiple Fields

2017-09-11 · Tomohiro Manabe, Sumio Fujita

The BM25 ranking function is one of the most well known query relevance document scoring functions and many variations of it are proposed. The BM25F function is one of its adaptations designed for modeling documents with…

Weight Space Representation Learning via Neural Field Adaptation

2025-12-01 · Zhuoqian Yang, Mathieu Salzmann, Sabine Süsstrunk arxiv

We investigate the potential of weights to serve as effective representations, focusing on neural fields. Our key insight is that constraining the optimization space through a pre-trained base model and low-rank adaptati…

Representation Learning

Low-Rank Adaptation in Multilinear Operator Networks for Security-Preserving Incremental Learning

2025-01-01 · CVPR 2025 1 · Huu Binh Ta, Duc Nguyen, Quyen Tran, Toan Tran 외

In security-sensitive fields, data should be encrypted to protect against unauthorized access and maintain confidentiality throughout processing. However, traditional networks like ViTs and CNNs return different resu…

Incremental Learning