paper-with-me

홈 › Papers

URSimulator: Human-Perception-Driven Prompt Tuning for Enhanced Virtual Urban Renewal via Diffusion Models

2024-09-22 · Chuanbo Hu, Shan Jia, Xin Li

Tackling Urban Physical Disorder (e.g., abandoned buildings, litter, messy vegetation, graffiti) is essential, as it negatively impacts the safety, well-being, and psychological state of communities. Urban Renewal is the process of revitalizing these neglected and decayed areas within a city to improve the physical environment and quality of life for residents. Effective urban renewal efforts can transform these environments, enhancing their appeal and livability. However, current research lacks simulation tools that can quantitatively assess and visualize the impacts of renewal efforts, often relying on subjective judgments. Such tools are crucial for planning and implementing effective strategies by providing a clear visualization of potential changes and their impacts. This paper presents a novel framework addressing this gap by using human perception feedback to simulate street environment enhancement. We develop a prompt tuning approach that integrates text-driven Stable Diffusion with human perception feedback, iteratively editing local areas of street view images to better align with perceptions of beauty, liveliness, and safety. Our experiments show that this framework significantly improves perceptions of urban environments, with increases of 17.60% in safety, 31.15% in beauty, and 28.82% in liveliness. In contrast, advanced methods like DiffEdit achieve only 2.31%, 11.87%, and 15.84% improvements, respectively. We applied this framework across various virtual scenarios, including neighborhood improvement, building redevelopment, green space expansion, and community garden creation. The results demonstrate its effectiveness in simulating urban renewal, offering valuable insights for urban planning and policy-making.

📄 PDF Abstract BibTeX arXiv:2409.14589

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

TransTIC: Transferring Transformer-based Image Compression from Human Perception to Machine Perception

2023-06-08 · ICCV 2023 1 · Yi-Hsin Chen, Ying-Chieh Weng, Chia-Hao Kao, Cheng Chien 외

This work aims for transferring a Transformer-based image compression codec from human perception to machine perception without fine-tuning the codec. We propose a transferable Transformer-based image compression framewo…

DecoderImage CompressionVisual Prompt Tuning

VMBench: A Benchmark for Perception-Aligned Video Motion Generation

2025-03-13 · Xinrang Ling, Chen Zhu, Meiqi Wu, Hangyu Li 외

Video generation has advanced rapidly, improving evaluation methods, yet assessing video's motion remains a major challenge. Specifically, there are two key issues: 1) current motion metrics do not fully align with human…

Motion GenerationVideo Generation

Visual Prompt Discovery via Semantic Exploration

2026-03-17 · Jaechang Kim, Yotaro Shimose, Zhao Wang, Kuang-Da Wang 외 arxiv

LVLMs encounter significant challenges in image understanding and visual reasoning, leading to critical perception failures. Visual prompts, which incorporate image manipulation code, have shown promising potential in mi…

Image ManipulationVisual Reasoning

Perception-guided Jailbreak against Text-to-Image Models

2024-08-20 · Yihao Huang, Le Liang, Tianlin Li, Xiaojun Jia 외

In recent years, Text-to-Image (T2I) models have garnered significant attention due to their remarkable advancements. However, security concerns have emerged due to their potential to generate inappropriate or Not-Safe-F…

Prompt-ICM: A Unified Framework towards Image Coding for Machines with Task-driven Prompts

2023-05-04 · Ruoyu Feng, Jinming Liu, Xin Jin, Xiaohan Pan 외

Image coding for machines (ICM) aims to compress images to support downstream AI analysis instead of human perception. For ICM, developing a unified codec to reduce information redundancy while empowering the compressed …