paper-with-me

Papers

Vector Quantisation for Robust Segmentation

2022-07-05 · Ainkaran Santhirasekaram, Avinash Kori, Mathias Winkler, Andrea Rockall, Ben Glocker

The reliability of segmentation models in the medical domain depends on the model's robustness to perturbations in the input space. Robustness is a particular challenge in medical imaging exhibiting various sources of image noise, corruptions, and domain shifts. Obtaining robustness is often attempted via simulating heterogeneous environments, either heuristically in the form of data augmentation or by learning to generate specific perturbations in an adversarial manner. We propose and justify that learning a discrete representation in a low dimensional embedding space improves robustness of a segmentation model. This is achieved with a dictionary learning method called vector quantisation. We use a set of experiments designed to analyse robustness in both the latent and output space under domain shift and noise perturbations in the input space. We adapt the popular UNet architecture, inserting a quantisation block in the bottleneck. We demonstrate improved segmentation accuracy and better robustness on three segmentation tasks. Code is available at \url{https://github.com/AinkaranSanthi/Vector-Quantisation-for-Robust-Segmentation}

📄 PDF Abstract BibTeX arXiv:2207.01919

Code (1)

ainkaransanthi/vector-quantisation-for-robust-segmentation 공식 구현 pytorch

Tasks

Data AugmentationDictionary LearningSegmentation

Similar Papers 제목 키워드 기반

Product-Quantised Image Representation for High-Quality Image Synthesis

2025-10-03 · Denis Zavadski, Nikita Philip Tatsch, Carsten Rother arxiv

Product quantisation (PQ) is a classical method for scalable vector encoding, yet it has seen limited usage for latent representations in high-fidelity image generation. In this work, we introduce PQGAN, a quantised imag…

Image Generation

Ultra-Quantisation: Efficient Embedding Search via 1.58-bit Encodings

2025-05-31 · Richard Connor, Alan Dearle, Ben Claydon

Many modern search domains comprise high-dimensional vectors of floating point numbers derived from neural networks, in the form of embeddings. Typical embeddings range in size from hundreds to thousands of dimensions, m…

A Study of Quantisation-aware Training on Time Series Transformer Models for Resource-constrained FPGAs

2023-10-04 · Tianheng Ling, Chao Qian, Lukas Einhaus, Gregor Schiele

This study explores the quantisation-aware training (QAT) on time series Transformer models. We propose a novel adaptive quantisation scheme that dynamically selects between symmetric and asymmetric schemes during the QA…

Time Series

Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?

2023-10-08 · Cheng Zhang, Jianyi Cheng, Ilia Shumailov, George A. Constantinides 외

The inference of Large language models (LLMs) requires immense computation and memory resources. To curtail these costs, quantisation has merged as a promising solution, but existing LLM quantisation mainly focuses on 8-…

Attribute

Relaxed-Responsibility Hierarchical Discrete VAEs

2020-07-14 · Matthew Willetts, Xenia Miscouridou, Stephen Roberts, Chris Holmes

Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Vector-Quantised VAEs are a powerful approach to discrete VAEs, but naive hierarchic…