paper-with-me

홈 › Papers

Annotated Hands for Generative Models

2024-01-26 · Yue Yang, Atith N Gandhi, Greg Turk

Generative models such as GANs and diffusion models have demonstrated impressive image generation capabilities. Despite these successes, these systems are surprisingly poor at creating images with hands. We propose a novel training framework for generative models that substantially improves the ability of such systems to create hand images. Our approach is to augment the training images with three additional channels that provide annotations to hands in the image. These annotations provide additional structure that coax the generative model to produce higher quality hand images. We demonstrate this approach on two different generative models: a generative adversarial network and a diffusion model. We demonstrate our method both on a new synthetic dataset of hand images and also on real photographs that contain hands. We measure the improved quality of the generated hands through higher confidence in finger joint identification using an off-the-shelf hand detector.

📄 PDF Abstract BibTeX arXiv:2401.15075

Code (1)

YY-GX/Annotated-Hands-Dataset 공식 구현

Tasks

Generative Adversarial NetworkImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities

2024-12-05 · CVPR 2025 1 · Rao Fu, Dingxi Zhang, Alex Jiang, Wanjia Fu 외

Understanding bimanual human hand activities is a critical problem in AI and robotics. We cannot build large models of bimanual activities because existing datasets lack the scale, coverage of diverse hand activities, an…

DiversityMotion Captioningtext annotation

HandsOff: Labeled Dataset Generation With No Additional Human Annotations

2022-12-24 · CVPR 2023 1 · Austin Xu, Mariya I. Vasileva, Achal Dave, Arjun Seshadri

Recent work leverages the expressive power of generative adversarial networks (GANs) to generate labeled synthetic datasets. These dataset generation methods often require new annotations of synthetic images, which force…

Dataset GenerationDepth EstimationKeypoint DetectionSemantic Segmentation+1

Understanding Human Hands in Contact at Internet Scale

2020-06-11 · CVPR 2020 6 · Dandan Shan, Jiaqi Geng, Michelle Shu, David F. Fouhey

Hands are the central means by which humans manipulate their world and being able to reliably extract hand state information from Internet videos of humans engaged in their hands has the potential to pave the way to syst…

Analysis of the hands in egocentric vision: A survey

2019-12-23 · Andrea Bandini, José Zariffa

Egocentric vision (a.k.a. first-person vision - FPV) applications have thrived over the past few years, thanks to the availability of affordable wearable cameras and large annotated datasets. The position of the wearable…

Survey

BusyHands: A Hand-Tool Interaction Database for Assembly Tasks Semantic Segmentation

2019-02-19 · Roy Shilkrot, Zhi Chai, Minh Hoai

Visual segmentation has seen tremendous advancement recently with ready solutions for a wide variety of scene types, including human hands and other body parts. However, focus on segmentation of human hands while perform…

SegmentationSemantic Segmentation