WormPose: Image synthesis and convolutional networks for pose estimation in C. elegans
An important model system for understanding genes, neurons and behavior, the nematode worm C. elegans naturally moves through a variety of complex postures, for which estimation from video data is challenging. We introduce an open-source Python package, WormPose, for 2D pose estimation in C. elegans , including self-occluded, coiled shapes. We leverage advances in machine vision afforded from convolutional neural networks and introduce a synthetic yet realistic generative model for images of worm posture, thus avoiding the need for human-labeled training. WormPose is effective and adaptable for imaging conditions across worm tracking efforts. We quantify pose estimation using synthetic data as well as N2 and mutant worms in on-food conditions. We further demonstrate WormPose by analyzing long (~10 hour), fast-sampled (~30 Hz) recordings of on-food N2 worms to provide a posture-scale analysis of roaming/dwelling behaviors.
Code (1)
Tasks
2D Pose EstimationAnimal Pose EstimationImage GenerationPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fast Depth Estimation for View Synthesis
Disparity/depth estimation from sequences of stereo images is an important element in 3D vision. Owing to occlusions, imperfect settings and homogeneous luminance, accurate estimate of depth remains a challenging problem…
DecoderDepth EstimationImage Augmentation Using a Task Guided Generative Adversarial Network for Age Estimation on Brain MRI
Brain age estimation based on magnetic resonance imaging (MRI) is an active research area in early diagnosis of some neurodegenerative diseases (e.g. Alzheimer, Parkinson, Huntington, etc.) for elderly people or brain un…
Age EstimationGenerative Adversarial NetworkImage AugmentationImage Generation+2Generative Adversarial Networks for Brain Images Synthesis: A Review
In medical imaging, image synthesis is the estimation process of one image (sequence, modality) from another image (sequence, modality). Since images with different modalities provide diverse biomarkers and capture vario…
Deep LearningGenerative Adversarial NetworkImage GenerationDeep Convolutional Neural Network for 6-DOF Image Localization
We present an accurate and robust method for six degree of freedom image localization. There are two key-points of our method, 1. automatic immense photo synthesis and labeling from point cloud model and, 2. pose estimat…
Pose EstimationregressionRadiological image synthesis using cycle-consistent generative adversarial network
In medical imaging, image synthesis is the estimation process of one image (sequence, modality) from another image (sequence, modality). Since images with different modalities provide diverse biomarkers and capture vario…
Deep LearningGenerative Adversarial NetworkImage Generation