paper-with-me

홈 › Papers

I can attend a meeting too! Towards a human-like telepresence avatar robot to attend meeting on your behalf

2020-06-28 · Hrishav Bakul Barua, Chayan Sarkar, Achanna Anil Kumar, Arpan Pal, Balamuralidhar P

Telepresence robots are used in various forms in various use-cases that helps to avoid physical human presence at the scene of action. In this work, we focus on a telepresence robot that can be used to attend a meeting remotely with a group of people. Unlike a one-to-one meeting, participants in a group meeting can be located at a different part of the room, especially in an informal setup. As a result, all of them may not be at the viewing angle of the robot, a.k.a. the remote participant. In such a case, to provide a better meeting experience, the robot should localize the speaker and bring the speaker at the center of the viewing angle. Though sound source localization can easily be done using a microphone-array, bringing the speaker or set of speakers at the viewing angle is not a trivial task. First of all, the robot should react only to a human voice, but not to the random noises. Secondly, if there are multiple speakers, to whom the robot should face or should it rotate continuously with every new speaker? Lastly, most robotic platforms are resource-constrained and to achieve a real-time response, i.e., avoiding network delay, all the algorithms should be implemented within the robot itself. This article presents a study and implementation of an attention shifting scheme in a telepresence meeting scenario which best suits the needs and expectations of the collocated and remote attendees. We define a policy to decide when a robot should rotate and how much based on real-time speaker localization. Using user satisfaction study, we show the efficacy and usability of our system in the meeting scenario. Moreover, our system can be easily adapted to other scenarios where multiple people are located.

📄 PDF Abstract BibTeX arXiv:2006.15647

Code (0)

등록된 구현이 없습니다.

Tasks

Sound Source Localization

Similar Papers 제목 키워드 기반

Expressive Telepresence via Modular Codec Avatars

2020-08-26 · ECCV 2020 8 · Hang Chu, Shugao Ma, Fernando de la Torre, Sanja Fidler 외

VR telepresence consists of interacting with another human in a virtual space represented by an avatar. Today most avatars are cartoon-like, but soon the technology will allow video-realistic ones. This paper aims in thi…

Mon3tr: Monocular 3D Telepresence with Pre-built Gaussian Avatars as Amortization

2026-01-12 · Fangyu Lin, Yingdong Hu, Zhening Liu, Yufan Zhuang 외 arxiv

Immersive telepresence aims to transform human interaction in AR/VR applications by enabling lifelike full-body holographic representations for enhanced remote collaboration. However, existing systems rely on hardware-in…

A trained humanoid robot can perform human-like crossmodal social attention and conflict resolution

2021-11-02 · Di Fu, Fares Abawi, Hugo Carneiro, Matthias Kerzel 외

To enhance human-robot social interaction, it is essential for robots to process multiple social cues in a complex real-world environment. However, incongruency of input information across modalities is inevitable and co…

Saliency Prediction

Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-time Mobile Telepresence

2023-04-24 · CVPR 2023 1 · Yonggan Fu, Yuecheng Li, Chenghui Li, Jason Saragih 외

Real-time and robust photorealistic avatars for telepresence in AR/VR have been highly desired for enabling immersive photorealistic telepresence. However, there still exists one key bottleneck: the considerable computat…

Neural Architecture Search

EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatars

2024-09-22 · Jianchun Chen, Jian Wang, yinda zhang, Rohit Pandey 외

Immersive VR telepresence ideally means being able to interact and communicate with digital avatars that are indistinguishable from and precisely reflect the behaviour of their real counterparts. The core technical chall…