Paint it Black: Generating paintings from text descriptions
Two distinct tasks - generating photorealistic pictures from given text prompts and transferring the style of a painting to a real image to make it appear as though it were done by an artist, have been addressed many times, and several approaches have been proposed to accomplish them. However, the intersection of these two, i.e., generating paintings from a given caption, is a relatively unexplored area with little data available. In this paper, we have explored two distinct strategies and have integrated them together. First strategy is to generate photorealistic images and then apply style transfer and the second strategy is to train an image generation model on real images with captions and then fine-tune it on captioned paintings later. These two models are evaluated using different metrics as well as a user study is conducted to get human feedback on the produced results.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationStyle TransferSimilar Papers 제목 키워드 기반
Space Narrative: Generating Images and 3D Scenes of Chinese Garden from Text using Deep Learning
The consistent mapping from poems to paintings is essential for the research and restoration of traditional Chinese gardens. But the lack of firsthand ma-terial is a great challenge to the reconstruction work. In this pa…
UnityAutomatic Tag Recommendation for Painting Artworks Using Diachronic Descriptions
In this paper, we deal with the problem of automatic tag recommendation for painting artworks. Diachronic descriptions containing deviations on the vocabulary used to describe each painting usually occur when the work is…
ClusteringTAGBridging Paintings and Music -- Exploring Emotion based Music Generation through Paintings
Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generati…
FADImage CaptioningMusic Generationtext similarityText-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings
Artists coordinate human pose, illumination, and camera placement to convey narrative and emotion, but existing generative methods typically model these elements independently. We introduce text-to-editable 3D staging, a…