paper-with-me

홈 › Papers

Securing Virtual Reality Experiences: Unveiling and Tackling Cybersickness Attacks with Explainable AI

2025-03-17 · Ripan Kumar Kundu, Matthew Denton, Genova Mongalo, Prasad Calyam, Khaza Anuarul Hoque

The synergy between virtual reality (VR) and artificial intelligence (AI), specifically deep learning (DL)-based cybersickness detection models, has ushered in unprecedented advancements in immersive experiences by automatically detecting cybersickness severity and adaptively various mitigation techniques, offering a smooth and comfortable VR experience. While this DL-enabled cybersickness detection method provides promising solutions for enhancing user experiences, it also introduces new risks since these models are vulnerable to adversarial attacks; a small perturbation of the input data that is visually undetectable to human observers can fool the cybersickness detection model and trigger unexpected mitigation, thus disrupting user immersive experiences (UIX) and even posing safety risks. In this paper, we present a new type of VR attack, i.e., a cybersickness attack, which successfully stops the triggering of cybersickness mitigation by fooling DL-based cybersickness detection models and dramatically hinders the UIX. Next, we propose a novel explainable artificial intelligence (XAI)-guided cybersickness attack detection framework to detect such attacks in VR to ensure UIX and a comfortable VR experience. We evaluate the proposed attack and the detection framework using two state-of-the-art open-source VR cybersickness datasets: Simulation 2021 and Gameplay dataset. Finally, to verify the effectiveness of our proposed method, we implement the attack and the XAI-based detection using a testbed with a custom-built VR roller coaster simulation with an HTC Vive Pro Eye headset and perform a user study. Our study shows that such an attack can dramatically hinder the UIX. However, our proposed XAI-guided cybersickness attack detection can successfully detect cybersickness attacks and trigger the proper mitigation, effectively reducing VR cybersickness.

📄 PDF Abstract BibTeX arXiv:2503.13419

Code (0)

등록된 구현이 없습니다.

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Methods 이 논문이 사용한 방법론

FPN 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
HTC 설명 없음

Similar Papers 제목 키워드 기반

Merging real and virtual worlds: An analysis of the state of the art and practical evaluation of Microsoft Hololens

2017-06-25 · Adrien Coppens

Achieving a symbiotic blending between reality and virtuality is a dream that has been lying in the minds of many people for a long time. Advances in various domains constantly bring us closer to making that dream come t…

Resource Allocation and Resolution Control in the Metaverse with Mobile Augmented Reality

2022-09-28 · Peiyuan Si, Jun Zhao, Huimei Han, Kwok-Yan Lam 외

With the development of blockchain and communication techniques, the Metaverse is considered as a promising next-generation Internet paradigm, which enables the connection between reality and the virtual world. The key t…

Privacy Preservation in Artificial Intelligence and Extended Reality (AI-XR) Metaverses: A Survey

2023-09-19 · Mahdi Alkaeed, Adnan Qayyum, Junaid Qadir

The metaverse is a nascent concept that envisions a virtual universe, a collaborative space where individuals can interact, create, and participate in a wide range of activities. Privacy in the metaverse is a critical co…

Federated LearningMixed Reality

eCAR: edge-assisted Collaborative Augmented Reality Framework

2024-05-11 · Jinwoo Jeon, Woontack Woo

We propose a novel edge-assisted multi-user collaborative augmented reality framework in a large indoor environment. In Collaborative Augmented Reality, data communication that synchronizes virtual objects has large netw…

Edge-computingObject

A Monocular SLAM-based Multi-User Positioning System with Image Occlusion in Augmented Reality

2024-11-17 · Wei-Hsiang Lien, Benedictus Kent Chandra, Robin Fischer, Ya-Hui Tang 외

In recent years, with the rapid development of augmented reality (AR) technology, there is an increasing demand for multi-user collaborative experiences. Unlike for single-user experiences, ensuring the spatial localizat…

PositionUnity