paper-with-me

Papers

A Reference-Based 3D Semantic-Aware Framework for Accurate Local Facial Attribute Editing

2024-07-25 · Yu-Kai Huang, Yutong Zheng, Yen-Shuo Su, Anudeepsekhar Bolimera, Han Zhang, Fangyi Chen, Marios Savvides

Facial attribute editing plays a crucial role in synthesizing realistic faces with specific characteristics while maintaining realistic appearances. Despite advancements, challenges persist in achieving precise, 3D-aware attribute modifications, which are crucial for consistent and accurate representations of faces from different angles. Current methods struggle with semantic entanglement and lack effective guidance for incorporating attributes while maintaining image integrity. To address these issues, we introduce a novel framework that merges the strengths of latent-based and reference-based editing methods. Our approach employs a 3D GAN inversion technique to embed attributes from the reference image into a tri-plane space, ensuring 3D consistency and realistic viewing from multiple perspectives. We utilize blending techniques and predicted semantic masks to locate precise edit regions, merging them with the contextual guidance from the reference image. A coarse-to-fine inpainting strategy is then applied to preserve the integrity of untargeted areas, significantly enhancing realism. Our evaluations demonstrate superior performance across diverse editing tasks, validating our framework's effectiveness in realistic and applicable facial attribute editing.

📄 PDF Abstract BibTeX arXiv:2407.18392

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

No-Reference Image Quality Assessment with Global-Local Progressive Integration and Semantic-Aligned Quality Transfer

2024-08-07 · Xiaoqi Wang, Yun Zhang

Accurate measurement of image quality without reference signals remains a fundamental challenge in low-level visual perception applications. In this paper, we propose a global-local progressive integration model that add…

Blind Image Quality AssessmentImage Quality AssessmentInductive BiasNo-Reference Image Quality Assessment

LocalSUG: City-Preference-Enhanced LLM for Query Suggestion in Local-Life Services

2026-03-05 · Jinwen Chen, Shiwen Zhang, Shuai Gong, Zheng Zhang 외 arxiv

In local-life service platforms, query suggestion reduces user effort by generating candidate queries from input prefixes. Traditional multi-stage systems rely heavily on historical popular queries, limiting their abilit…

Lights Out: A Nighttime UAV Localization Framework Using Thermal Imagery and Semantic 3D Maps

2026-04-29 · Ryan Allen, Melissa Greeff arxiv

Reliable backup localization for unmanned aerial vehicles (UAVs) operating in GNSS-denied nighttime conditions remains an open challenge due to the severe modality gap between daytime RGB maps and nighttime thermal image…

ROIFormer: Semantic-Aware Region of Interest Transformer for Efficient Self-Supervised Monocular Depth Estimation

2022-12-12 · Daitao Xing, Jinglin Shen, Chiuman Ho, Anthony Tzes

The exploration of mutual-benefit cross-domains has shown great potential toward accurate self-supervised depth estimation. In this work, we revisit feature fusion between depth and semantic information and propose an ef…

Depth EstimationMonocular Depth Estimation

Uncertainty-Aware Hierarchical Re-Localization in OpenStreetMap via Semantic Alignment

2026-03-02 · Yuchen Zou, Xiao Hu, Lihuang Fang, Yuqing Tang arxiv

Monocular re-localization enables robots to estimate camera poses from visual observations. However, many existing methods rely on dense maps or large reference image databases, which face scalability limitations and pri…