paper-with-me

Papers

Semantics-Guided Representation Learning with Applications to Visual Synthesis

2020-10-21 · Jia-Wei Yan, Ci-Siang Lin, Fu-En Yang, Yu-Jhe Li, Yu-Chiang Frank Wang

Learning interpretable and interpolatable latent representations has been an emerging research direction, allowing researchers to understand and utilize the derived latent space for further applications such as visual synthesis or recognition. While most existing approaches derive an interpolatable latent space and induces smooth transition in image appearance, it is still not clear how to observe desirable representations which would contain semantic information of interest. In this paper, we aim to learn meaningful representations and simultaneously perform semantic-oriented and visually-smooth interpolation. To this end, we propose an angular triplet-neighbor loss (ATNL) that enables learning a latent representation whose distribution matches the semantic information of interest. With the latent space guided by ATNL, we further utilize spherical semantic interpolation for generating semantic warping of images, allowing synthesis of desirable visual data. Experiments on MNIST and CMU Multi-PIE datasets qualitatively and quantitatively verify the effectiveness of our method.

📄 PDF Abstract BibTeX arXiv:2010.10772

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningTriplet

Similar Papers 제목 키워드 기반

Representations Before Pixels: Semantics-Guided Hierarchical Video Prediction

2026-04-13 · Efstathios Karypidis, Spyros Gidaris, Nikos Komodakis arxiv

Accurate future video prediction requires both high visual fidelity and consistent scene semantics, particularly in complex dynamic environments such as autonomous driving. We present Re2Pix, a hierarchical video predict…

Autonomous DrivingVideo Prediction

MedITok: A Unified Tokenizer for Medical Image Synthesis and Interpretation

2025-05-25 · Chenglong Ma, Yuanfeng Ji, Jin Ye, Zilong Li 외

Advanced autoregressive models have reshaped multimodal AI. However, their transformative potential in medical imaging remains largely untapped due to the absence of a unified visual tokenizer -- one capable of capturing…

Image GenerationImage Reconstruction

Guided and Unguided Conditional Diffusion Mechanisms for Structured and Semantically-Aware 3D Point Cloud Generation

2025-09-21 · Gunner Stone, Sushmita Sarker, Alireza Tavakkoli arxiv

Generating realistic 3D point clouds is a fundamental problem in computer vision with applications in remote sensing, robotics, and digital object modeling. Existing generative approaches primarily capture geometry, and …

Point Cloud GenerationPoint Clouds

Controlling Your Image via Simplified Vector Graphics

2026-02-16 · Lanqing Guo, Xi Liu, Yufei Wang, Zhihao Li 외 arxiv

Recent advances in image generation have achieved remarkable visual quality, while a fundamental challenge remains: Can image generation be controlled at the element level, enabling intuitive modifications such as adjust…

Image GenerationImage Editing

GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding

2024-03-06 · CVPR 2024 1 · Zi-Ting Chou, Sheng-Yu Huang, I-Jieh Liu, Yu-Chiang Frank Wang

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field …

NeRFScene UnderstandingSemantic Segmentation