paper-with-me

Papers

A Hands-free Spatial Selection and Interaction Technique using Gaze and Blink Input with Blink Prediction for Extended Reality

2025-01-20 · Tim Rolff, Jenny Gabel, Lauren Zerbin, Niklas Hypki, Susanne Schmidt, Markus Lappe, Frank Steinicke

Gaze-based interaction techniques have created significant interest in the field of spatial interaction. Many of these methods require additional input modalities, such as hand gestures (e.g., gaze coupled with pinch). Those can be uncomfortable and difficult to perform in public or limited spaces, and pose challenges for users who are unable to execute pinch gestures. To address these aspects, we propose a novel, hands-free Gaze+Blink interaction technique that leverages the user's gaze and intentional eye blinks. This technique enables users to perform selections by executing intentional blinks. It facilitates continuous interactions, such as scrolling or drag-and-drop, through eye blinks coupled with head movements. So far, this concept has not been explored for hands-free spatial interaction techniques. We evaluated the performance and user experience (UX) of our Gaze+Blink method with two user studies and compared it with Gaze+Pinch in a realistic user interface setup featuring common menu interaction tasks. Study 1 demonstrated that while Gaze+Blink achieved comparable selection speeds, it was prone to accidental selections resulting from unintentional blinks. In Study 2 we explored an enhanced technique employing a deep learning algorithms for filtering out unintentional blinks.

📄 PDF Abstract BibTeX arXiv:2501.11540

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

HeadText: Exploring Hands-free Text Entry using Head Gestures by Motion Sensing on a Smart Earpiece

2022-05-20 · Songlin Xu, Guanjie Wang, Ziyuan Fang, Guangwei Zhang 외

We present HeadText, a hands-free technique on a smart earpiece for text entry by motion sensing. Users input text utilizing only 7 head gestures for key selection, word selection, word commitment and word cancelling tas…

Dynamic Time WarpingGesture Recognition

Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Image

2023-02-05 · ICCV 2023 1 · Pengfei Ren, Chao Wen, Xiaozheng Zheng, Zhou Xue 외

Reconstructing interacting hands from a single RGB image is a very challenging task. On the one hand, severe mutual occlusion and similar local appearance between two hands confuse the extraction of visual features, resu…

3D Hand Pose Estimation3D Interacting Hand Pose Estimation

Capturing Hands in Action using Discriminative Salient Points and Physics Simulation

2015-06-06 · Dimitrios Tzionas, Luca Ballan, Abhilash Srikantha, Pablo Aponte 외

Hand motion capture is a popular research field, recently gaining more attention due to the ubiquity of RGB-D sensors. However, even most recent approaches focus on the case of a single isolated hand. In this work, we fo…

HOI-Ref: Hand-Object Interaction Referral in Egocentric Vision

2024-04-15 · Siddhant Bansal, Michael Wray, Dima Damen

Large Vision Language Models (VLMs) are now the de facto state-of-the-art for a number of tasks including visual question answering, recognising objects, and spatial referral. In this work, we propose the HOI-Ref task fo…

ObjectQuestion AnsweringVisual Question Answering

Exploring Context-aware and LLM-driven Locomotion for Immersive Virtual Reality

2025-04-24 · Süleyman Özdel, Kadir Burak Buldu, Enkelejda Kasneci, Efe Bozkir

Locomotion plays a crucial role in shaping the user experience within virtual reality environments. In particular, hands-free locomotion offers a valuable alternative by supporting accessibility and freeing users from re…

Navigate