Chirality Nets for Human Pose Regression
We propose Chirality Nets, a family of deep nets that is equivariant to the "chirality transform," i.e., the transformation to create a chiral pair. Through parameter sharing, odd and even symmetry, we propose and prove variants of standard building blocks of deep nets that satisfy the equivariance property, including fully connected layers, convolutional layers, batch-normalization, and LSTM/GRU cells. The proposed layers lead to a more data efficient representation and a reduction in computation by exploiting symmetry. We evaluate chirality nets on the task of human pose regression, which naturally exploits the left/right mirroring of the human body. We study three pose regression tasks: 3D pose estimation from video, 2D pose forecasting, and skeleton based activity recognition. Our approach achieves/matches state-of-the-art results, with more significant gains on small datasets and limited-data settings.
Code (1)
Tasks
3D Human Pose Estimation3D Pose EstimationActivity RecognitionPose EstimationregressionSkeleton Based Action RecognitionSimilar Papers 제목 키워드 기반
Feature Chirality in Deep Learning Models
As deep learning applications extensively increase by leaps and bounds, their interpretability has become increasingly prominent. As a universal property, chirality exists widely in nature, and applying it to the explana…
Deep LearningSymmetry Understanding of 3D Shapes via Chirality Disentanglement
Chirality information (i.e. information that allows distinguishing left from right) is ubiquitous for various data modes in computer vision, including images, videos, point clouds, and meshes. While chirality has been ex…
Point CloudsChirality provides a direct fitness advantage and facilitates intermixing in cellular aggregates
Chirality in shape and motility can evolve rapidly in microbes and cancer cells. To determine how chirality affects cell fitness, we developed a model of chiral growth in compact aggregates such as microbial colonies and…
Visual Chirality
How can we tell whether an image has been mirrored? While we understand the geometry of mirror reflections very well, less has been said about how it affects distributions of imagery at scale, despite widespread use for …
Data AugmentationImage ForensicsSelf-Supervised LearningLearning Molecular Chirality via Chiral Determinant Kernels
Chirality is a fundamental molecular property that governs stereospecific behavior in chemistry and biology. Capturing chirality in machine learning models remains challenging due to the geometric complexity of stereoche…
Representation Learning