paper-with-me

홈 › Papers

Contextualising Implicit Representations for Semantic Tasks

2023-05-22 · Theo W. Costain, Kejie Li, Victor A. Prisacariu

Prior works have demonstrated that implicit representations trained only for reconstruction tasks typically generate encodings that are not useful for semantic tasks. In this work, we propose a method that contextualises the encodings of implicit representations, enabling their use in downstream tasks (e.g. semantic segmentation), without requiring access to the original training data or encoding network. Using an implicit representation trained for a reconstruction task alone, our contextualising module takes an encoding trained for reconstruction only and reveals meaningful semantic information that is hidden in the encodings, without compromising the reconstruction performance. With our proposed module, it becomes possible to pre-train implicit representations on larger datasets, improving their reconstruction performance compared to training on only a smaller labelled dataset, whilst maintaining their segmentation performance on the labelled dataset. Importantly, our method allows for future foundation implicit representation models to be fine-tuned on unseen tasks, regardless of encoder or dataset availability.

📄 PDF Abstract BibTeX arXiv:2305.13312

Code (0)

등록된 구현이 없습니다.

Tasks

SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection

2020-04-30 · SEMEVAL 2020 · Andrey Kutuzov, Mario Giulianelli

We apply contextualised word embeddings to lexical semantic change detection in the SemEval-2020 Shared Task 1. This paper focuses on Subtask 2, ranking words by the degree of their semantic drift over time. We analyse t…

Change DetectionWord Embeddings

Designing and Contextualising Probes for African Languages

2025-05-15 · Wisdom Aduah, Francois Meyer

Pretrained language models (PLMs) for African languages are continually improving, but the reasons behind these advances remain unclear. This paper presents the first systematic investigation into probing PLMs for lingui…

Active LearningSentence

Towards Generalising Neural Implicit Representations

2021-01-29 · Theo W. Costain, Victor Adrian Prisacariu

Neural implicit representations have shown substantial improvements in efficiently storing 3D data, when compared to conventional formats. However, the focus of existing work has mainly been on storage and subsequent rec…

SegmentationSemantic Segmentation

Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theorem

2026-01-30 · Tianming Qiu, Christos Sonis, Hao Shen arxiv

Weight Space Learning (WSL), which frames neural network weights as a data modality, is an emerging field with potential for tasks like meta-learning or transfer learning. Particularly, Implicit Neural Representations (I…

Transfer Learning

Semantic Implicit Neural Scene Representations With Semi-Supervised Training

2020-03-28 · Amit Kohli, Vincent Sitzmann, Gordon Wetzstein

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store s…

3D geometry3D Semantic SegmentationRepresentation LearningSegmentation+1