Report: Dynamic Eye Movement Matching and Visualization Tool in Neuro Gesture
In the research of the impact of gestures using by a lecturer, one challenging task is to infer the attention of a group of audiences. Two important measurements that can help infer the level of attention are eye movement data and Electroencephalography (EEG) data. Under the fundamental assumption that a group of people would look at the same place if they all pay attention at the same time, we apply a method, "Time Warp Edit Distance", to calculate the similarity of their eye movement trajectories. Moreover, we also cluster eye movement pattern of audiences based on these pair-wised similarity metrics. Besides, since we don't have a direct metric for the "attention" ground truth, a visual assessment would be beneficial to evaluate the gesture-attention relationship. Thus we also implement a visualization tool.
Code (1)
Tasks
EEGElectroencephalogram (EEG)Similar Papers 제목 키워드 기반
Capturing complex hand movements and object interactions using machine learning-powered stretchable smart textile gloves
Accurate real-time tracking of dexterous hand movements and interactions has numerous applications in human-computer interaction, metaverse, robotics, and tele-health. Capturing realistic hand movements is challenging be…
Data AugmentationGraph Network Modeling Techniques for Visualizing Human Mobility Patterns
Human mobility analysis at urban-scale requires models to represent the complex nature of human movements, which in turn are affected by accessibility to nearby points of interest, underlying socioeconomic factors of a p…
Graph MatchingSingle-Person and Multi-Party 3D Visualizations for Nonverbal Communication Analysis
The qualitative analysis of nonverbal communication is more and more relying on 3D recording technology. However, the human analysis of 3D data on a regular 2D screen can be challenging as 3D scenes are difficult to visu…
Shaping Expressiveness in Robotics: The Role of Design Tools in Crafting Embodied Robot Movements
As robots increasingly become part of shared human spaces, their movements must transcend basic functionality by incorporating expressive qualities to enhance engagement and communication. This paper introduces a movemen…
ReviewViz: Assisting Developers Perform Empirical Study on Energy Consumption Related Reviews for Mobile Applications
Improving the energy efficiency of mobile applications is a topic that has gained a lot of attention recently. It has been addressed in a number of ways such as identifying energy bugs and developing a catalog of energy …
BIG-bench Machine Learningtext-classificationText ClassificationWord Embeddings