TIFu: Tri-directional Implicit Function for High-Fidelity 3D Character Reconstruction
Recent advances in implicit function-based approaches have shown promising results in 3D human reconstruction from a single RGB image. However, these methods are not sufficient to extend to more general cases, often generating dragged or disconnected body parts, particularly for animated characters. We argue that these limitations stem from the use of the existing point-level 3D shape representation, which lacks holistic 3D context understanding. Voxel-based reconstruction methods are more suitable for capturing the entire 3D space at once, however, these methods are not practical for high-resolution reconstructions due to their excessive memory usage. To address these challenges, we introduce Tri-directional Implicit Function (TIFu), which is a vector-level representation that increases global 3D consistencies while significantly reducing memory usage compared to voxel representations. We also introduce a new algorithm in 3D reconstruction at an arbitrary resolution by aggregating vectors along three orthogonal axes, resolving inherent problems with regressing fixed dimension of vectors. Our approach achieves state-of-the-art performances in both our self-curated character dataset and the benchmark 3D human dataset. We provide both quantitative and qualitative analyses to support our findings.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Reconstruction3D Reconstruction3D Shape RepresentationSimilar Papers 제목 키워드 기반
Learning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals
Dense geometric environment representations are critical for autonomous mobile robot navigation and exploration. Recent work shows that implicit continuous representations of occupancy, signed distance, or radiance learn…
NeRFRobot NavigationMultifunctional fiber-based optoacoustic emitter for non-genetic bidirectional neural communication
A bidirectional brain interface with both "write" and "read" functions can be an important tool for fundamental studies and potential clinical treatments for neurological diseases. Here we report a miniaturized multifunc…
HippocampusCritiFusion: Semantic Critique and Spectral Alignment for Faithful Text-to-Image Generation
Recent text-to-image diffusion models have achieved remarkable visual fidelity but often struggle with semantic alignment to complex prompts. We introduce CritiFusion, a novel inference-time framework that integrates a m…
Text-to-Image GenerationOnline Estimation and Coverage Control with Heterogeneous Sensing Information
Heterogeneous multi-robot sensing systems are able to characterize physical processes more comprehensively than homogeneous systems. Access to multiple modalities of sensory data allow such systems to fuse information be…
Multifunctionality in a Connectome-Based Reservoir Computer
Multifunctionality describes the capacity for a neural network to perform multiple mutually exclusive tasks without altering its network connections; and is an emerging area of interest in the reservoir computing machine…