paper-with-me

Papers

Procedural Humans for Computer Vision

2023-01-03 · Charlie Hewitt, Tadas Baltrušaitis, Erroll Wood, Lohit Petikam, Louis Florentin, Hanz Cuevas Velasquez

Recent work has shown the benefits of synthetic data for use in computer vision, with applications ranging from autonomous driving to face landmark detection and reconstruction. There are a number of benefits of using synthetic data from privacy preservation and bias elimination to quality and feasibility of annotation. Generating human-centered synthetic data is a particular challenge in terms of realism and domain-gap, though recent work has shown that effective machine learning models can be trained using synthetic face data alone. We show that this can be extended to include the full body by building on the pipeline of Wood et al. to generate synthetic images of humans in their entirety, with ground-truth annotations for computer vision applications. In this report we describe how we construct a parametric model of the face and body, including articulated hands; our rendering pipeline to generate realistic images of humans based on this body model; an approach for training DNNs to regress a dense set of landmarks covering the entire body; and a method for fitting our body model to dense landmarks predicted from multiple views.

📄 PDF Abstract BibTeX arXiv:2301.01161

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

View-Dependent Octree-based Mesh Extraction in Unbounded Scenes for Procedural Synthetic Data

2023-12-13 · Zeyu Ma, Alexander Raistrick, Lahav Lipson, Jia Deng

Procedural synthetic data generation has received increasing attention in computer vision. Procedural signed distance functions (SDFs) are a powerful tool for modeling large-scale detailed scenes, but existing mesh extra…

Synthetic Data Generation

Infinite Photorealistic Worlds using Procedural Generation

2023-06-15 · CVPR 2023 1 · Alexander Raistrick, Lahav Lipson, Zeyu Ma, Lingjie Mei 외

We introduce Infinigen, a procedural generator of photorealistic 3D scenes of the natural world. Infinigen is entirely procedural: every asset, from shape to texture, is generated from scratch via randomized mathematical…

3D Reconstructionobject-detectionObject DetectionOptical Flow Estimation+1

VLMaterial: Procedural Material Generation with Large Vision-Language Models

2025-01-27 · Beichen Li, Rundi Wu, Armando Solar-Lezama, Changxi Zheng 외

Procedural materials, represented as functional node graphs, are ubiquitous in computer graphics for photorealistic material appearance design. They allow users to perform intuitive and precise editing to achieve desired…

Language ModelingLanguage ModellingLarge Language Model

Vision-Based Mistake Analysis in Procedural Activities: A Review of Advances and Challenges

2025-10-22 · Konstantinos Bacharidis, Antonis A. Argyros arxiv

Mistake analysis in procedural activities is a critical area of research with applications spanning industrial automation, physical rehabilitation, education and human-robot collaboration. This paper reviews vision-based…

Action Recognition

TAMA: Tool-Augmented Multimodal Agent for Procedural Activity Understanding

2025-09-30 · Kimihiro Hasegawa, Wiradee Imrattanatrai, Masaki Asada, Ken Fukuda 외 arxiv

Procedural activity assistants potentially support humans in a variety of settings, from our daily lives, e.g., cooking or assembling flat-pack furniture, to professional situations, e.g., manufacturing or biological exp…

Multimodal Reasoning