Papers Talking Face Generation
“Talking Face Generation” 태그가 달린 논문 129편 · 필터 해제
Geometry-guided Emotion Modulation for Controllable and Photorealistic Emotional Talking Face Generation
Audio-driven emotional talking face generation aims to synthesize realistic videos with expressive facial dynamics. However, existing methods struggle to balance controllability and visual fidelity. Although implicit rep…
Talking Face GenerationContinuous ControlTowards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation
Conversational talking face generation has recently attracted increasing attention, aiming to synthesize interactive talking videos where characters speak, listen, and respond dynamically to each other. This task present…
Talking Face GenerationData AugmentationIP-Adapter Is All You Need: Towards Fine-Tuning-Free Diffusion-Based Talking Face Generation
With the rapid advancement of diffusion models, talking face generation has made remarkable progress. However, existing diffusion-based methods still require task-specific fine-tuning and large-scale audiovisual datasets…
Talking Face GenerationDo Protective Perturbations Really Protect Portrait Privacy under Real-world Image Transformations?
Proactive defense methods protect portrait images from unauthorized editing or talking face generation (TFG) by introducing pixel-level protective perturbations, and have already attracted increasing attention for privac…
Talking Face GenerationCross-Modal Emotion Transfer for Emotion Editing in Talking Face Video
Talking face generation has gained significant attention as a core application of generative models. To enhance the expressiveness and realism of synthesized videos, emotion editing in talking face video plays a crucial …
Talking Face GenerationText-Driven Emotionally Continuous Talking Face Generation
Talking Face Generation (TFG) strives to create realistic and emotionally expressive digital faces. While previous TFG works have mastered the creation of naturalistic facial movements, they typically express a fixed tar…
Talking Face GenerationAudio-Driven Talking Face Generation with Blink Embedding and Hash Grid Landmarks Encoding
Dynamic Neural Radiance Fields (NeRF) have demonstrated considerable success in generating high-fidelity 3D models of talking portraits. Despite significant advancements in the rendering speed and generation quality, cha…
Talking Face GenerationEfficient and Robust Video Defense Framework against 3D-field Personalized Talking Face
State-of-the-art 3D-field video-referenced Talking Face Generation (TFG) methods synthesize high-fidelity personalized talking-face videos in real time by modeling 3D geometry and appearance from reference portrait video…
Computational EfficiencyTalking Face GenerationFacEDiT: Unified Talking Face Editing and Generation via Facial Motion Infilling
Talking face editing and face generation have often been studied as distinct problems. In this work, we propose viewing both not as separate tasks but as subtasks of a unifying formulation, speech-conditional facial moti…
Talking Face GenerationIMTalker: Efficient Audio-driven Talking Face Generation with Implicit Motion Transfer
Talking face generation aims to synthesize realistic speaking portraits from a single image, yet existing methods often rely on explicit optical flow and local warping, which fail to model complex global motions and caus…
Talking Face GenerationISExplore:Informative Segment Selection for Efficient Personalized 3D Talking Face Generation
Talking Face Generation (TFG) methods based on Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have recently achieved impressive progress in personalized talking head synthesis. However, existing methods t…
Talking Face GenerationAssessing Identity Leakage in Talking Face Generation: Metrics and Evaluation Framework
Video editing-based talking face generation aims to preserve video details such as pose, lighting, and gestures while modifying only lip motion, often using an identity reference image to maintain speaker consistency. Ho…
Talking Face GenerationSee the Speaker: Crafting High-Resolution Talking Faces from Speech with Prior Guidance and Region Refinement
Unlike existing methods that rely on source images as appearance references and use source speech to generate motion, this work proposes a novel approach that directly extracts information from the speech, addressing key…
Talking Face GenerationMAGIC-Talk: Motion-aware Audio-Driven Talking Face Generation with Customizable Identity Control
Audio-driven talking face generation has gained significant attention for applications in digital media and virtual avatars. While recent methods improve audio-lip synchronization, they often struggle with temporal consi…
Talking Face GenerationVideo GenerationSynchroRaMa : Lip-Synchronized and Emotion-Aware Talking Face Generation via Multi-Modal Emotion Embedding
Audio-driven talking face generation has received growing interest, particularly for applications requiring expressive and natural human-avatar interaction. However, most existing emotion-aware methods rely on a single m…
Talking Face GenerationEmotion RecognitionSentiment AnalysisTaming Transformer for Emotion-Controllable Talking Face Generation
Talking face generation is a novel and challenging generation task, aiming at synthesizing a vivid speaking-face video given a specific audio. To fulfill emotion-controllable talking face generation, current methods need…
Talking Face GenerationText2Lip: Progressive Lip-Synced Talking Face Generation from Text via Viseme-Guided Rendering
Generating semantically coherent and visually accurate talking faces requires bridging the gap between linguistic meaning and facial articulation. Although audio-driven methods remain prevalent, their reliance on high-qu…
Talking Face GenerationMask-Free Audio-driven Talking Face Generation for Enhanced Visual Quality and Identity Preservation
Audio-Driven Talking Face Generation aims at generating realistic videos of talking faces, focusing on accurate audio-lip synchronization without deteriorating any identity-related visual details. Recent state-of-the-art…
Talking Face GenerationFace2VoiceSync: Lightweight Face-Voice Consistency for Text-Driven Talking Face Generation
Recent studies in speech-driven talking face generation achieve promising results, but their reliance on fixed-driven speech limits further applications (e.g., face-voice mismatch). Thus, we extend the task to a more cha…
Talking Face GenerationFace AlignmentDisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model
Recent advances in talking face generation have significantly improved facial animation synthesis. However, existing approaches face fundamental limitations: 3DMM-based methods maintain temporal consistency but lack fine…
DisentanglementFace GenerationTalking Face Generation