paper-with-me

Papers

Low-Rank-Modulated Functa: Exploring the Latent Space of Implicit Neural Representations for Interpretable Ultrasound Video Analysis

2026-03-26 · Julia Wolleb, Cristiana Baloescu, Alicia Durrer, Hemant D. Tagare, Xenophon Papademetris arxiv

Implicit neural representations (INRs) have emerged as a powerful framework for continuous image representation learning. In Functa-based approaches, each image is encoded as a latent modulation vector that conditions a shared INR, enabling strong reconstruction performance. However, the structure and interpretability of the corresponding latent spaces remain largely unexplored. In this work, we investigate the latent space of Functa-based models for ultrasound videos and propose Low-Rank-Modulated Functa (LRM-Functa), a novel architecture that enforces a low-rank adaptation of modulation vectors in the time-resolved latent space. When applied to cardiac ultrasound, the resulting latent space exhibits clearly structured periodic trajectories, facilitating visualization and interpretability of temporal patterns. The latent space can be traversed to sample novel frames, revealing smooth transitions along the cardiac cycle, and enabling direct readout of end-diastolic (ED) and end-systolic (ES) frames without additional model training. We show that LRM-Functa outperforms prior methods in unsupervised ED and ES frame detection, while compressing each video frame to as low as rank k=2 without sacrificing competitive downstream performance on ejection fraction prediction. Evaluations on out-of-distribution frame selection in a cardiac point-of-care dataset, as well as on lung ultrasound for B-line classification, demonstrate the generalizability of our approach. Overall, LRM-Functa provides a compact, interpretable, and generalizable framework for ultrasound video analysis. The code is available at https://github.com/JuliaWolleb/LRM_Functa.

📄 PDF Abstract BibTeX arXiv:2603.25951

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Spatial Functa: Scaling Functa to ImageNet Classification and Generation

2023-02-06 · Matthias Bauer, Emilien Dupont, Andy Brock, Dan Rosenbaum 외

Neural fields, also known as implicit neural representations, have emerged as a powerful means to represent complex signals of various modalities. Based on this Dupont et al. (2022) introduce a framework that views neura…

ClassificationImage Generation

VidFuncta: Towards Generalizable Neural Representations for Ultrasound Videos

2025-07-29 · Julia Wolleb, Florentin Bieder, Paul Friedrich, Hemant D. Tagare 외 arxiv

Ultrasound is widely used in clinical care, yet standard deep learning methods often struggle with full video analysis due to non-standardized acquisition and operator bias. We offer a new perspective on ultrasound video…

Video ReconstructionLine Detection

From data to functa: Your data point is a function and you can treat it like one

2022-01-28 · Emilien Dupont, Hyunjik Kim, S. M. Ali Eslami, Danilo Rezende 외

It is common practice in deep learning to represent a measurement of the world on a discrete grid, e.g. a 2D grid of pixels. However, the underlying signal represented by these measurements is often continuous, e.g. the …

Deep LearningImputationNeRFNovel View Synthesis

PDEfuncta: Spectrally-Aware Neural Representation for PDE Solution Modeling

2025-06-15 · Minju Jo, Woojin Cho, Uvini Balasuriya Mudiyanselage, Seungjun Lee 외

Scientific machine learning often involves representing complex solution fields that exhibit high-frequency features such as sharp transitions, fine-scale oscillations, and localized structures. While implicit neural rep…

Meta-Learning

QUEST: A robust attention formulation using query-modulated spherical attention

2026-03-31 · Hariprasath Govindarajan, Per Sidén, Jacob Roll, Fredrik Lindsten arxiv

The Transformer model architecture has become one of the most widely used in deep learning and the attention mechanism is at its core. The standard attention formulation uses a softmax operation applied to a scaled dot p…