OmniRobotHome: A Multi-Camera Home Platform for Real-Time Human-Robot Interaction
Robots in homes must continuously sense the people around them, yet most prior work relies on limited or offline perception. We argue that perception quality is the dominant factor governing what interaction is achievable at home, and build a testbed to test this claim. OmniRobotHome instruments a furnished home with 48 hardware-synchronized cameras and three manipulators in a unified world frame, delivering real-time markerless full-body human pose, 6D object pose, anticipatory motion forecasting, and a social avatar agent that converses with residents. Using the platform, we treat perception quality as an experimental variable across safety, human assistance, and social interaction, and find that interaction quality degrades measurably as real-timeness, granularity, coverage, accuracy, forecasting, or memory is weakened. All code and data will be released.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion ForecastingSimilar Papers 제목 키워드 기반
THRIVE: Therapeutic Humanoid Robot In Virtual Environment
This paper presents THRIVE (Therapeutic Humanoid Robot In Virtual Environment), an at-home rehabilitation platform that integrates a suite of virtual-reality upper-body rehabilitation games, a real-time camera-based moti…
HoME: a Household Multimodal Environment
We introduce HoME: a Household Multimodal Environment for artificial agents to learn from vision, audio, semantics, physics, and interaction with objects and other agents, all within a realistic context. HoME integrates …
OpenAI Gymreinforcement-learningReinforcement LearningReinforcement Learning (RL)An AI-driven multimodal smart home platform for continuous monitoring and intelligent assistance in post-stroke patients
At-home rehabilitation for post-stroke patients presents significant challenges, as continuous, personalized care is often limited outside clinical settings. Additionally, the absence of comprehensive solutions addressin…
Language ModelingLanguage ModellingLarge Language ModelMAISON -- Multimodal AI-based Sensor platform for Older Individuals
There is a global aging population requiring the need for the right tools that can enable older adults' greater independence and the ability to age at home, as well as assist healthcare workers. It is feasible to achieve…
LeHome: A Simulation Environment for Deformable Object Manipulation in Household Scenarios
Household environments present one of the most common, impactful yet challenging application domains for robotics. Within household scenarios, manipulating deformable objects is particularly difficult, both in simulation…