Human Pose Estimation with Iterative Error Feedback
Hierarchical feature extractors such as Convolutional Networks (ConvNets) have achieved impressive performance on a variety of classification tasks using purely feedforward processing. Feedforward architectures can learn rich representations of the input space but do not explicitly model dependencies in the output spaces, that are quite structured for tasks such as articulated human pose estimation or object segmentation. Here we propose a framework that expands the expressive power of hierarchical feature extractors to encompass both input and output spaces, by introducing top-down feedback. Instead of directly predicting the outputs in one go, we use a self-correcting model that progressively changes an initial solution by feeding back error predictions, in a process we call Iterative Error Feedback (IEF). IEF shows excellent performance on the task of articulated pose estimation in the challenging MPII and LSP benchmarks, matching the state-of-the-art without requiring ground truth scale annotation.
Code (1)
Tasks
Pose EstimationSemantic SegmentationSimilar Papers 제목 키워드 기반
Self-Correctable and Adaptable Inference for Generalizable Human Pose Estimation
A central challenge in human pose estimation, as well as in many other machine learning and prediction tasks, is the generalization problem. The learned network does not have the capability to characterize the prediction…
Pose EstimationPredictionIterative temporal differencing with random synaptic feedback weights support error backpropagation for deep learning
This work shows that a differentiable activation function is not necessary any more for error backpropagation. The derivative of the activation function can be replaced by an iterative temporal differencing using fixed r…
TangramSR: Can Vision-Language Models Reason in Continuous Geometric Space?
Humans excel at spatial reasoning tasks like Tangram puzzle assembly through cognitive processes involving mental rotation, iterative refinement, and visual feedback. Inspired by how humans solve Tangram puzzles through …
Spatial ReasoningTheorem Prover as a Judge for Synthetic Data Generation
The demand for synthetic data in mathematical reasoning has increased due to its potential to enhance the mathematical capabilities of large language models (LLMs). However, ensuring the validity of intermediate reasonin…
Mathematical ProofsMathematical Reasoningreinforcement-learningReinforcement Learning+1Iterative Decision Feedback Equalization Using Online Prediction
In this article, a new category of soft-input soft-output (SISO) minimum-mean square error (MMSE) finite-impulse response (FIR) decision feedback equalizers (DFEs) with iteration-wise static filters (i.e. iteration varia…
Prediction