paper-with-me

홈 › Papers

VIGOR: Visual Goal-In-Context Inference for Unified Humanoid Fall Safety

2026-02-18 · Osher Azulay, Zhengjie Xu, Andrew Scheffer, Stella X. Yu arxiv

Reliable fall recovery is critical for humanoids operating in cluttered environments. Unlike quadrupeds or wheeled robots, humanoids experience high-energy impacts, complex whole-body contact, and large viewpoint changes during a fall, making recovery essential for continued operation. Existing methods fragment fall safety into separate problems such as fall avoidance, impact mitigation, and stand-up recovery, or rely on end-to-end policies trained without vision through reinforcement learning or imitation learning, often on flat terrain. At a deeper level, fall safety is treated as monolithic data complexity, coupling pose, dynamics, and terrain and requiring exhaustive coverage, limiting scalability and generalization. We present a unified fall safety approach that spans all phases of fall recovery. It builds on two insights: 1) Natural human fall and recovery poses are highly constrained and transferable from flat to complex terrain through alignment, and 2) Fast whole-body reactions require integrated perceptual-motor representations. We train a privileged teacher using sparse human demonstrations on flat terrain and simulated complex terrains, and distill it into a deployable student that relies only on egocentric depth and proprioception. The student learns how to react by matching the teacher's goal-in-context latent representation, which combines the next target pose with the local terrain, rather than separately encoding what it must perceive and how it must act. Results in simulation and on a real Unitree G1 humanoid demonstrate robust, zero-shot fall safety across diverse non-flat environments without real-world fine-tuning. The project page is available at https://vigor2026.github.io/

📄 PDF Abstract BibTeX arXiv:2602.16511

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners?

2026-03-26 · Haonan Han, Jiancheng Huang, Xiaopeng Sun, Junyan He 외 arxiv

Beneath the stunning visual fidelity of modern AIGC models lies a "logical desert", where systems fail tasks that require physical, causal, or complex spatial reasoning. Current evaluations largely rely on superficial me…

Spatial Reasoning

Grounded Reinforcement Learning for Visual Reasoning

2025-05-29 · Gabriel Sarch, Snigdha Saha, Naitik Khandelwal, Ayush Jain 외

While reinforcement learning (RL) over chains of thought has significantly advanced language models in tasks such as mathematics and coding, visual reasoning introduces added complexity by requiring models to direct visu…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Spatial Reasoning+1

WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation

2026-06-03 · Ning Yang, Yan Huang, Kaiwen Peng, Ziheng He 외 arxiv

Visual navigation requires generating smooth and collision-free trajectories under complex geometric and physical constraints. Existing reactive policies that directly map observations to actions lack anticipatory reason…

Visual Navigation

Situationally Aware Options

2017-11-20 · Daniel J. Mankowitz, Aviv Tamar, Shie Mannor

Hierarchical abstractions, also known as options -- a type of temporally extended action (Sutton et. al. 1999) that enables a reinforcement learning agent to plan at a higher level, abstracting away from the lower-level …

Reinforcement Learning

INVIGORATE: Interactive Visual Grounding and Grasping in Clutter

2021-08-25 · Hanbo Zhang, Yunfan Lu, Cunjun Yu, David Hsu 외

This paper presents INVIGORATE, a robot system that interacts with human through natural language and grasps a specified object in clutter. The objects may occlude, obstruct, or even stack on top of one another. INVIGORA…

BlockingObjectobject-detectionObject Detection+3