paper-with-me

홈 › Papers

ContrastiveGaussian: High-Fidelity 3D Generation with Contrastive Learning and Gaussian Splatting

2025-04-10 · Junbang Liu, Enpei Huang, Dongxing Mao, HUI ZHANG, Xinyuan Song, Yongxin Ni

Creating 3D content from single-view images is a challenging problem that has attracted considerable attention in recent years. Current approaches typically utilize score distillation sampling (SDS) from pre-trained 2D diffusion models to generate multi-view 3D representations. Although some methods have made notable progress by balancing generation speed and model quality, their performance is often limited by the visual inconsistencies of the diffusion model outputs. In this work, we propose ContrastiveGaussian, which integrates contrastive learning into the generative process. By using a perceptual loss, we effectively differentiate between positive and negative samples, leveraging the visual inconsistencies to improve 3D generation quality. To further enhance sample differentiation and improve contrastive learning, we incorporate a super-resolution model and introduce another Quantity-Aware Triplet Loss to address varying sample distributions during training. Our experiments demonstrate that our approach achieves superior texture fidelity and improved geometric consistency.

📄 PDF Abstract BibTeX arXiv:2504.08100

Code (1)

yanllan-ljb/contrastivegaussian 공식 구현 pytorch

Tasks

3D GenerationContrastive LearningSuper-ResolutionTriplet

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…
Contrastive Learning 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

High Fidelity Text to Image Generation with Contrastive Alignment and Structural Guidance

2025-08-14 · Danyi Gao arxiv

This paper addresses the performance bottlenecks of existing text-driven image generation methods in terms of semantic alignment accuracy and structural consistency. A high-fidelity image generation method is proposed by…

Contrastive LearningImage Generation

DiffGS: Functional Gaussian Splatting Diffusion

2024-10-25 · Junsheng Zhou, Weiqi Zhang, Yu-Shen Liu

3D Gaussian Splatting (3DGS) has shown convincing performance in rendering speed and fidelity, yet the generation of Gaussian Splatting remains a challenge due to its discreteness and unstructured nature. In this work, w…

3DGSDisentanglement

SHYI: Action Support for Contrastive Learning in High-Fidelity Text-to-Image Generation

2025-01-15 · Tianxiang Xia, Lin Xiao, Yannick Montorfani, Francesco Pavia 외

In this project, we address the issue of infidelity in text-to-image generation, particularly for actions involving multiple objects. For this we build on top of the CONFORM framework which uses Contrastive Learning to i…

Contrastive LearningImage Generationtext similarityText to Image Generation+1

Toward Fine-Grained Facial Control in 3D Talking Head Generation

2026-02-10 · Shaoyang Xie, Xiaofeng Cong, Baosheng Yu, Zhipeng Gui 외 arxiv

Audio-driven talking head generation is a core component of digital avatars, and 3D Gaussian Splatting has shown strong performance in real-time rendering of high-fidelity talking heads. However, achieving precise contro…

Talking Head Generation

High-fidelity 3D Object Generation from Single Image with RGBN-Volume Gaussian Reconstruction Model

2025-04-02 · CVPR 2025 1 · Yiyang Shen, Kun Zhou, He Wang, Yin Yang 외

Recently single-view 3D generation via Gaussian splatting has emerged and developed quickly. They learn 3D Gaussians from 2D RGB images generated from pre-trained multi-view diffusion (MVD) models, and have shown a promi…

3D Generation