MASH: Masked Anchored SpHerical Distances for 3D Shape Representation and Generation
We introduce Masked Anchored SpHerical Distances (MASH), a novel multi-view and parametrized representation of 3D shapes. Inspired by multi-view geometry and motivated by the importance of perceptual shape understanding for learning 3D shapes, MASH represents a 3D shape as a collection of observable local surface patches, each defined by a spherical distance function emanating from an anchor point. We further leverage the compactness of spherical harmonics to encode the MASH functions, combined with a generalized view cone with a parameterized base that masks the spatial extent of the spherical function to attain locality. We develop a differentiable optimization algorithm capable of converting any point cloud into a MASH representation accurately approximating ground-truth surfaces with arbitrary geometry and topology. Extensive experiments demonstrate that MASH is versatile for multiple applications including surface reconstruction, shape generation, completion, and blending, achieving superior performance thanks to its unique representation encompassing both implicit and explicit features.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Shape RepresentationSurface ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Masked and Shuffled Blind Spot Denoising for Real-World Images
We introduce a novel approach to single image denoising based on the Blind Spot Denoising principle, which we call MAsked and SHuffled Blind Spot Denoising (MASH). We focus on the case of correlated noise, which often pl…
DenoisingImage DenoisingLinear Spherical Sliced Optimal Transport: A Fast Metric for Comparing Spherical Data
Efficient comparison of spherical probability distributions becomes important in fields such as computer vision, geosciences, and medicine. Sliced optimal transport distances, such as spherical and stereographic spherica…
3D Point Cloud InterpolationComputational EfficiencySHARC: Reference point driven Spherical Harmonic Representation for Complex Shapes
We propose SHARC, a novel framework that synthesizes arbitrary, genus-agnostic shapes by means of a collection of Spherical Harmonic (SH) representations of distance fields. These distance fields are anchored at optimall…
MaskedFusion360: Reconstruct LiDAR Data by Querying Camera Features
In self-driving applications, LiDAR data provides accurate information about distances in 3D but lacks the semantic richness of camera data. Therefore, state-of-the-art methods for perception in urban scenes fuse data fr…
Sensor FusionDetermining Sphere Radius through Pairwise Distances
We propose a novel method for determining the radius of a spherical surface based on the distances measured between points on this surface. We consider the most general case of determining the radius when the distances a…