paper-with-me

Papers

TAGA: Self-supervised Learning for Template-free Animatable Gaussian Articulated Model

2025-01-01 · CVPR 2025 1 · Zhichao Zhai, Guikun Chen, Wenguan Wang, Dong Zheng, Jun Xiao

Decoupling from customized parametric templates represents a crucial step toward the creation of fully flexible, animatable articulated models. While existing template-free methods can achieve high-fidelity reconstruction in observed views, they struggle to recover plausible canonical models, resulting in suboptimal animation quality. This limitation stems from overlooking the fundamental ambiguity in canonical reconstruction, where multiple canonical models could explain the same observed views. By revealing the entanglement between the canonical ambiguity and incorrect skinning, we present a self-supervised framework that learns both plausible skinning and accurate canonical geometry using only sparse pose data. Our method, TAGA, uses explicit 3D Gaussians as skinning carriers and characterizes the ambiguity as "Ambiguous Gaussians" with incorrect skinning weights. TAGA then corrects ambiguous Gaussians in the observation space using anomaly detection. With the corrected ones, we enforce cycle consistency constraints on both geometry and skinning to refine the corresponding Gaussians in the canonical space through a new backward method. Compared to existing state-of-the-art template-free methods, TAGA delivers superior visual fidelity for novel views and poses, while significantly improving training and rendering speeds. Experiments on challenging datasets with limited pose variations further demonstrate the robustness and generality of TAGA.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Lattice-Free MMI Adaptation Of Self-Supervised Pretrained Acoustic Models

2020-12-28 · Apoorv Vyas, Srikanth Madikeri, Hervé Bourlard

In this work, we propose lattice-free MMI (LFMMI) for supervised adaptation of self-supervised pretrained acoustic model. We pretrain a Transformer model on thousand hours of untranscribed Librispeech data followed by su…

Retrieval-Augmented Gaussian Avatars: Improving Expression Generalization

2026-03-09 · Matan Levy, Gavriel Habib, Issar Tzachor, Dvir Samuel 외 arxiv

Template-free animatable head avatars can achieve high visual fidelity by learning expression-dependent facial deformation directly from a subject's capture, avoiding parametric face templates and hand-designed blendshap…

TAVA: Template-free Animatable Volumetric Actors

2022-06-17 · RuiLong Li, Julian Tanke, Minh Vo, Michael Zollhofer 외

Coordinate-based volumetric representations have the potential to generate photo-realistic virtual avatars from images. However, virtual avatars also need to be controllable even to a novel pose that may not have been ob…

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling

2024-01-01 · CVPR 2024 1 · Zhe Li, Zerong Zheng, Lizhen Wang, Yebin Liu

Modeling animatable human avatars from RGB videos is a long-standing and challenging problem. Recent works usually adopt MLP-based neural radiance fields (NeRF) to represent 3D humans but it remains difficult for pur…

NeRF

TAGA: Text-Attributed Graph Self-Supervised Learning by Synergizing Graph and Text Mutual Transformations

2024-05-27 · Zheng Zhang, Yuntong Hu, Bo Pan, Chen Ling 외

Text-Attributed Graphs (TAGs) enhance graph structures with natural language descriptions, enabling detailed representation of data and their relationships across a broad spectrum of real-world scenarios. Despite the pot…

Representation LearningSelf-Supervised LearningTAG