Dank Learning: Generating Memes Using Deep Neural Networks

2018-06-08 · Abel L Peirson V, E Meltem Tolunay

We introduce a novel meme generation system, which given any image can produce a humorous and relevant caption. Furthermore, the system can be conditioned on not only an image but also a user-defined label relating to the meme template, giving a handle to the user on meme content. The system uses a pretrained Inception-v3 network to return an image embedding which is passed to an attention-based deep-layer LSTM model producing the caption - inspired by the widely recognised Show and Tell Model. We implement a modified beam search to encourage diversity in the captions. We evaluate the quality of our model using perplexity and human assessment on both the quality of memes generated and whether they can be differentiated from real ones. Our model produces original memes that cannot on the whole be differentiated from real ones.

📄 PDF Abstract BibTeX arXiv:1806.04510

Code (3)

alpv95/MemeProject 공식 구현 tf

alpv95/Dank-Learning tf

gbotev1/cgmfpim pytorch

Tasks

Diversity

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Average Pooling 설명 없음

Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…

Inception-v3 Module Inception-v3 Module is an image block used in the Inception-v3 architecture. This architecture is used on the coarsest (8 ×…

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

ArchiMeDe @ DANKMEMES: A New Model Architecture for Meme Detection

2020-12-17 · Jinen Setpal, Gabriele Sarti

We introduce ArchiMeDe, a multimodal neural network-based architecture used to solve the DANKMEMES meme detections subtask at the 2020 EVALITA campaign. The system incorporates information from visual and textual sources…

Domain Adaptation

Dank or Not? -- Analyzing and Predicting the Popularity of Memes on Reddit

2020-11-29 · Kate Barnes, Tiernon Riesenmy, Minh Duc Trinh, Eli Lleshi 외

Internet memes have become an increasingly pervasive form of contemporary social communication that attracted a lot of research interest recently. In this paper, we analyze the data of 129,326 memes collected from Reddit…

BIG-bench Machine Learning

What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes

2022-12-01 · Shivam Sharma, Siddhant Agarwal, Tharun Suresh, Preslav Nakov 외

Memes are powerful means for effective communication on social media. Their effortless amalgamation of viral visuals and compelling messages can have far-reaching implications with proper marketing. Previous research on …

Marketing Multi-Task Learning Semantic Role Labeling Text Generation

Incorporating Sememes into Chinese Definition Modeling

2019-05-16 · Liner Yang, Cunliang Kong, Yun Chen, Yang Liu 외

Chinese definition modeling is a challenging task that generates a dictionary definition in Chinese for a given Chinese word. To accomplish this task, we construct the Chinese Definition Modeling Corpus (CDM), which cont…

Self-supervised learning of hologram reconstruction using physics consistency

2022-09-17 · Luzhe Huang, Hanlong Chen, Tairan Liu, Aydogan Ozcan

The past decade has witnessed transformative applications of deep learning in various computational imaging, sensing and microscopy tasks. Due to the supervised learning schemes employed, these methods mostly depend on l…

Image Reconstruction Self-Supervised Learning