paper-with-me

Papers

Few-shot Implicit Function Generation via Equivariance

2025-01-03 · CVPR 2025 1 · Suizhi Huang, Xingyi Yang, Hongtao Lu, Xinchao Wang

Implicit Neural Representations (INRs) have emerged as a powerful framework for representing continuous signals. However, generating diverse INR weights remains challenging due to limited training data. We introduce Few-shot Implicit Function Generation, a new problem setup that aims to generate diverse yet functionally consistent INR weights from only a few examples. This is challenging because even for the same signal, the optimal INRs can vary significantly depending on their initializations. To tackle this, we propose EquiGen, a framework that can generate new INRs from limited data. The core idea is that functionally similar networks can be transformed into one another through weight permutations, forming an equivariance group. By projecting these weights into an equivariant latent space, we enable diverse generation within these groups, even with few examples. EquiGen implements this through an equivariant encoder trained via contrastive learning and smooth augmentation, an equivariance-guided diffusion process, and controlled perturbations in the equivariant subspace. Experiments on 2D image and 3D shape INR datasets demonstrate that our approach effectively generates diverse INR weights while preserving their functional properties in few-shot scenarios.

📄 PDF Abstract BibTeX arXiv:2501.01601

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation

2021-11-23 · ICLR 2022 4 · Yan Zhang, David W. Zhang, Simon Lacoste-Julien, Gertjan J. Burghouts 외

Most set prediction models in deep learning use set-equivariant operations, but they actually operate on multisets. We show that set-equivariant functions cannot represent certain functions on multisets, so we introduce …

PredictionProperty Prediction

$SE(3)$ Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation

2024-11-11 · Yinshuang Xu, Dian Chen, Katherine Liu, Sergey Zakharov 외

Incorporating inductive bias by embedding geometric entities (such as rays) as input has proven successful in multi-view learning. However, the methods adopting this technique typically lack equivariance, which is crucia…

Data AugmentationDecoderDepth EstimationInductive Bias+3

Convolutional Conditional Neural Processes

2019-10-29 · ICLR 2020 1 · Jonathan Gordon, Wessel P. Bruinsma, Andrew Y. K. Foong, James Requeima 외

We introduce the Convolutional Conditional Neural Process (ConvCNP), a new member of the Neural Process family that models translation equivariance in the data. Translation equivariance is an important inductive bias for…

Inductive BiasTime SeriesTime Series AnalysisTranslation+1

Rotation Equivariant Arbitrary-scale Image Super-Resolution

2025-08-07 · Qi Xie, Jiahong Fu, Zongben Xu, Deyu Meng arxiv

The arbitrary-scale image super-resolution (ASISR), a recent popular topic in computer vision, aims to achieve arbitrary-scale high-resolution recoveries from a low-resolution input image. This task is realized by repres…

Image Super-Resolution

AIR-Nets: An Attention-Based Framework for Locally Conditioned Implicit Representations

2021-10-22 · Simon Giebenhain, Bastian Goldlücke

This paper introduces Attentive Implicit Representation Networks (AIR-Nets), a simple, but highly effective architecture for 3D reconstruction from point clouds. Since representing 3D shapes in a local and modular fashio…

3D ReconstructionDecoder