paper-with-me

홈 › Papers

StyGazeTalk: Learning Stylized Generation of Gaze and Head Dynamics

2025-09-21 · Chengwei Shi, Chong Cao arxiv

Gaze and head movements play a central role in expressive 3D media, human-agent interaction, and immersive communication. Existing works often model facial components in isolation and lack mechanisms for generating personalized, style-aware gaze behaviors. We propose StyGazeTalk, a multimodal framework that synthesizes synchronized gaze-head dynamics with controllable styles. To support high-fidelity training, we construct HAGE, a high-precision multimodal dataset containing eye-tracking data, audio, head pose, and 3D facial parameters. Experiments show that our method produces temporally coherent, style-consistent gaze-head motions, enhancing realism in 3D face generation.

📄 PDF Abstract BibTeX arXiv:2509.17168

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Data-driven Head Motion Generation through Natural Gaze-Head Coordination

2026-05-25 · Xiaohan Liu, Yilin Wen, Yusuke Sugano arxiv

We present the first data-driven approach to model temporal gaze-head coordination from large-scale in-the-wild facial videos. To obtain training data for generalizable learning, we propose an automatic pipeline that ext…

Video Generation

ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatars

2025-05-15 · Rui-Yang Ju, Sheng-Yen Huang, Yi-Ping Hung

The introduction of 3D Gaussian blendshapes has enabled the real-time reconstruction of animatable head avatars from monocular video. Toonify, a StyleGAN-based framework, has become widely used for facial image stylizati…

Image StylizationVideo Generation

TextGaze: Gaze-Controllable Face Generation with Natural Language

2024-04-26 · Hengfei Wang, Zhongqun Zhang, Yihua Cheng, Hyung Jin Chang

Generating face image with specific gaze information has attracted considerable attention. Existing approaches typically input gaze values directly for face generation, which is unnatural and requires annotated gaze data…

Face GenerationFace Model

NeRF-Gaze: A Head-Eye Redirection Parametric Model for Gaze Estimation

2022-12-30 · Pengwei Yin, Jiawu Dai, Jingjing Wang, Di Xie 외

Gaze estimation is the fundamental basis for many visual tasks. Yet, the high cost of acquiring gaze datasets with 3D annotations hinders the optimization and application of gaze estimation models. In this work, we propo…

Domain AdaptationDomain GeneralizationGaze EstimationNeRF+1

HAGI++: Head-Assisted Gaze Imputation and Generation

2025-11-04 · Chuhan Jiao, Zhiming Hu, Andreas Bulling arxiv

Mobile eye tracking plays a vital role in capturing human visual attention across both real-world and extended reality (XR) environments, making it an essential tool for applications ranging from behavioural research to …

Pupil Detection