paper-with-me

홈 › Papers

Lightweight Road Environment Segmentation using Vector Quantization

2025-04-19 · Jiyong Kwag, Alper Yilmaz, Charles Toth

Road environment segmentation plays a significant role in autonomous driving. Numerous works based on Fully Convolutional Networks (FCNs) and Transformer architectures have been proposed to leverage local and global contextual learning for efficient and accurate semantic segmentation. In both architectures, the encoder often relies heavily on extracting continuous representations from the image, which limits the ability to represent meaningful discrete information. To address this limitation, we propose segmentation of the autonomous driving environment using vector quantization. Vector quantization offers three primary advantages for road environment segmentation. (1) Each continuous feature from the encoder is mapped to a discrete vector from the codebook, helping the model discover distinct features more easily than with complex continuous features. (2) Since a discrete feature acts as compressed versions of the encoder's continuous features, they also compress noise or outliers, enhancing the image segmentation task. (3) Vector quantization encourages the latent space to form coarse clusters of continuous features, forcing the model to group similar features, making the learned representations more structured for the decoding process. In this work, we combined vector quantization with the lightweight image segmentation model MobileUNETR and used it as a baseline model for comparison to demonstrate its efficiency. Through experiments, we achieved 77.0 % mIoU on Cityscapes, outperforming the baseline by 2.9 % without increasing the model's initial size or complexity.

📄 PDF Abstract BibTeX arXiv:2504.14113

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingImage SegmentationQuantizationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Unsupervised Skeleton-Based Action Segmentation via Hierarchical Spatiotemporal Vector Quantization

2026-04-16 · Umer Ahmed, Syed Ahmed Mahmood, Fawad Javed Fateh, M. Shaheer Luqman 외 arxiv

We propose a novel hierarchical spatiotemporal vector quantization framework for unsupervised skeleton-based temporal action segmentation. We first introduce a hierarchical approach, which includes two consecutive levels…

Action Segmentation

The Interpretability of Codebooks in Model-Based Reinforcement Learning is Limited

2024-07-28 · Kenneth Eaton, Jonathan Balloch, Julia Kim, Mark Riedl

Interpretability of deep reinforcement learning systems could assist operators with understanding how they interact with their environment. Vector quantization methods -- also called codebook methods -- discretize a neur…

Deep Reinforcement LearningDisentanglementModel-based Reinforcement LearningQuantization+2

Hierarchical Vector Quantization for Unsupervised Action Segmentation

2024-12-23 · Federico Spurio, Emad Bahrami, Gianpiero Francesca, Juergen Gall

In this work, we address unsupervised temporal action segmentation, which segments a set of long, untrimmed videos into semantically meaningful segments that are consistent across videos. While recent approaches combine …

Action SegmentationClusteringQuantizationRepresentation Learning+2

Beyond Stationarity: Rethinking Codebook Collapse in Vector Quantization

2026-02-21 · Hao Lu, Onur C. Koyun, Yongxin Guo, Zhengjie Zhu 외 arxiv

Vector Quantization (VQ) underpins many modern generative frameworks such as VQ-VAE, VQ-GAN, and latent diffusion models. Yet, it suffers from the persistent problem of codebook collapse, where a large fraction of code v…

CommVQ: Commutative Vector Quantization for KV Cache Compression

2025-06-23 · Junyan Li, Yang Zhang, Muhammad Yusuf Hassan, Talha Chafekar 외

Large Language Models (LLMs) are increasingly used in applications requiring long context lengths, but the key-value (KV) cache often becomes a memory bottleneck on GPUs as context grows. To address this, we propose Comm…

GPUGSM8KQuantization