Deep Image Style Transfer from Freeform Text
This paper creates a novel method of deep neural style transfer by generating style images from freeform user text input. The language model and style transfer model form a seamless pipeline that can create output images with similar losses and improved quality when compared to baseline style transfer methods. The language model returns a closely matching image given a style text and description input, which is then passed to the style transfer model with an input content image to create a final output. A proof-of-concept tool is also developed to integrate the models and demonstrate the effectiveness of deep image style transfer from freeform text.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingStyle TransferSimilar Papers 제목 키워드 기반
Machine Pareidolia: Protecting Facial Image with Emotional Editing
The proliferation of facial recognition (FR) systems has raised privacy concerns in the digital realm, as malicious uses of FR models pose a significant threat. Traditional countermeasures, such as makeup style transfer,…
Style TransferEnhancing Video Summarization via Vision-Language Embedding
This paper addresses video summarization, or the problem of distilling a raw video into a shorter form while still capturing the original story. We show that visual representations supervised by freeform language make a …
Video SummarizationCLIPstyler: Image Style Transfer with a Single Text Condition
Existing neural style transfer methods require reference style images to transfer texture information of style images to content images. However, in many practical situations, users may not have reference style images bu…
Style TransferITstyler: Image-optimized Text-based Style Transfer
Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, p…
Style TransferName Your Style: An Arbitrary Artist-aware Image Style Transfer
Image style transfer has attracted widespread attention in the past few years. Despite its remarkable results, it requires additional style images available as references, making it less flexible and inconvenient. Using …
Style Transfer