paper-with-me

홈 › Papers

CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Model

2023-04-09 · Zhongqi Wang, Jie Zhang, Zhilong Ji, Jinfeng Bai, Shiguang Shan

With the development of deep generative models, recent years have seen great success of Chinese landscape painting generation. However, few works focus on controllable Chinese landscape painting generation due to the lack of data and limited modeling capabilities. In this work, we propose a controllable Chinese landscape painting generation method named CCLAP, which can generate painting with specific content and style based on Latent Diffusion Model. Specifically, it consists of two cascaded modules, i.e., content generator and style aggregator. The content generator module guarantees the content of generated paintings specific to the input text. While the style aggregator module is to generate paintings of a style corresponding to a reference image. Moreover, a new dataset of Chinese landscape paintings named CLAP is collected for comprehensive evaluation. Both the qualitative and quantitative results demonstrate that our method achieves state-of-the-art performance, especially in artfully-composed and artistic conception. Codes are available at https://github.com/Robin-WZQ/CCLAP.

📄 PDF Abstract BibTeX arXiv:2304.04156

Code (1)

robin-wzq/cclap 공식 구현 pytorch

Tasks

Chinese Landscape Painting Generation

Methods 이 논문이 사용한 방법론

Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

End-to-End Chinese Landscape Painting Creation Using Generative Adversarial Networks

2020-11-11 · Alice Xue

Current GAN-based art generation methods produce unoriginal artwork due to their dependence on conditional input. Here, we propose Sketch-And-Paint GAN (SAPGAN), the first model which generates Chinese landscape painting…

Chinese Landscape Painting GenerationTranslation

Learning to Generate Poetic Chinese Landscape Painting with Calligraphy

2023-05-08 · Shaozu Yuan, Aijun Dai, Zhiling Yan, Ruixue Liu 외

In this paper, we present a novel system (denoted as Polaca) to generate poetic Chinese landscape painting with calligraphy. Unlike previous single image-to-image painting generation, Polaca takes the classic poetry as i…

A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth

2024-08-16 · Yujia Gu, Xinyu Fang, Xueyuan Deng, Zihan Peng 외

This study mainly introduces a method combining the Stable Diffusion Model (SDM) and Parameter-Efficient Fine-Tuning method for generating Chinese Landscape Paintings. This training process is accelerated by combining Lo…

parameter-efficient fine-tuning

DLP-GAN: learning to draw modern Chinese landscape photos with generative adversarial network

2024-03-06 · Xiangquan Gui, Binxuan Zhang, Li Li, Yi Yang

Chinese landscape painting has a unique and artistic style, and its drawing technique is highly abstract in both the use of color and the realistic representation of objects. Previous methods focus on transferring from m…

Generative Adversarial NetworkTranslation

Chinese Painting Style Transfer Using Deep Generative Models

2023-10-15 · Weijian Ma, Yanyang Kong

Artistic style transfer aims to modify the style of the image while preserving its content. Style transfer using deep learning models has been widely studied since 2015, and most of the applications are focused on specif…

Style Transfer