paper-with-me

Papers

Non-Adversarial Learning: Vector-Quantized Common Latent Space for Multi-Sequence MRI

2024-07-03 · Luyi Han, Tao Tan, Tianyu Zhang, Xin Wang, Yuan Gao, Chunyao Lu, Xinglong Liang, Haoran Dou, Yunzhi Huang, Ritse Mann

Adversarial learning helps generative models translate MRI from source to target sequence when lacking paired samples. However, implementing MRI synthesis with adversarial learning in clinical settings is challenging due to training instability and mode collapse. To address this issue, we leverage intermediate sequences to estimate the common latent space among multi-sequence MRI, enabling the reconstruction of distinct sequences from the common latent space. We propose a generative model that compresses discrete representations of each sequence to estimate the Gaussian distribution of vector-quantized common (VQC) latent space between multiple sequences. Moreover, we improve the latent space consistency with contrastive learning and increase model stability by domain augmentation. Experiments using BraTS2021 dataset show that our non-adversarial model outperforms other GAN-based methods, and VQC latent space aids our model to achieve (1) anti-interference ability, which can eliminate the effects of noise, bias fields, and artifacts, and (2) solid semantic representation ability, with the potential of one-shot segmentation. Our code is publicly available.

📄 PDF Abstract BibTeX arXiv:2407.02911

Code (1)

fiy2w/mri_seq2seq 공식 구현 pytorch

Tasks

BraTS2021Contrastive LearningOne-Shot Segmentation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Discrete Acoustic Space for an Efficient Sampling in Neural Text-To-Speech

2021-10-24 · Marek Strong, Jonas Rohnke, Antonio Bonafonte, Mateusz Łajszczak 외

We present a Split Vector Quantized Variational Autoencoder (SVQ-VAE) architecture using a split vector quantizer for NTTS, as an enhancement to the well-known Variational Autoencoder (VAE) and Vector Quantized Variation…

text-to-speechText to Speech

Learning source-aware representations of music in a discrete latent space

2021-11-26 · Jinsung Kim, Yeong-Seok Jeong, Woosung Choi, Jaehwa Chung 외

In recent years, neural network based methods have been proposed as a method that cangenerate representations from music, but they are not human readable and hardly analyzable oreditable by a human. To address this issue…

Generative Modeling of Bach-Style Symbolic Music: A Comparative Study of Autoregressive, Latent-Variable, and Adversarial Approaches

2026-06-11 · Dezhi Yu, Kyuil Lee, Yongkang Huang arxiv

We study generative modeling of Bach-style symbolic piano music using a shared MIDI corpus and three model families: autoregressive LSTMs with attention, latent-variable models including recurrent VAEs and vector-quantiz…

Music Generation

Semi-supervised Grasp Detection by Representation Learning in a Vector Quantized Latent Space

2020-01-23 · Mridul Mahajan, Tryambak Bhattacharjee, Arya Krishnan, Priya Shukla 외

For a robot to perform complex manipulation tasks, it is necessary for it to have a good grasping ability. However, vision based robotic grasp detection is hindered by the unavailability of sufficient labelled data. Furt…

DecoderRepresentation Learning

PCA-VAE: Differentiable Subspace Quantization without Codebook Collapse

2026-02-21 · Hao Lu, Onur C. Koyun, Yongxin Guo, Zhengjie Zhu 외 arxiv

Vector-quantized autoencoders deliver high-fidelity latents but suffer inherent flaws: the quantizer is non-differentiable, requires straight-through hacks, and is prone to collapse. We address these issues at the root b…