paper-with-me

홈 › Papers

MTTN: Multi-Pair Text to Text Narratives for Prompt Generation

2023-01-21 · Archan Ghosh, Debgandhar Ghosh, Madhurima Maji, Suchinta Chanda, Kalporup Goswami

The increased interest in diffusion models has opened up opportunities for advancements in generative text modeling. These models can produce impressive images when given a well-crafted prompt, but creating a powerful or meaningful prompt can be hit-or-miss. To address this, we have created a large-scale dataset that is derived and synthesized from real prompts and indexed with popular image-text datasets such as MS-COCO and Flickr. We have also implemented stages that gradually reduce context and increase complexity, which will further enhance the output due to the complex annotations created. The dataset, called MTTN, includes over 2.4 million sentences divided into 5 stages, resulting in a total of over 12 million pairs, and a vocabulary of over 300,000 unique words, providing ample variation. The original 2.4 million pairs are designed to reflect the way language is used on the internet globally, making the dataset more robust for any model trained on it.

📄 PDF Abstract BibTeX arXiv:2301.10172

Code (1)

mttn2023/mttn 공식 구현

Tasks

Text2text GenerationText Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Reading Between the Lines: Exploring Infilling in Visual Narratives

2020-10-26 · EMNLP 2020 11 · Khyathi Raghavi Chandu, Ruo-Ping Dong, Alan Black

Generating long form narratives such as stories and procedures from multiple modalities has been a long standing dream for artificial intelligence. In this regard, there is often crucial subtext that is derived from the …

Visual Storytelling

MedicalNarratives: Connecting Medical Vision and Language with Localized Narratives

2025-01-07 · Wisdom O. Ikezogwo, Kevin Zhang, Mehmet Saygin Seyfioglu, Fatemeh Ghezloo 외

We propose MedicalNarratives, a dataset curated from medical pedagogical videos similar in nature to data collected in Think-Aloud studies and inspired by Localized Narratives, which collects grounded image-text data by …

Articles

FaNS: a Facet-based Narrative Similarity Metric

2023-09-09 · Mousumi Akter, Shubhra Kanti Karmaker Santu

Similar Narrative Retrieval is a crucial task since narratives are essential for explaining and understanding events, and multiple related narratives often help to create a holistic view of the event of interest. To accu…

Retrievaltext similarity

Modeling user context for valence prediction from narratives

2019-05-09 · Aniruddha Tammewar, Alessandra Cervone, Eva-Maria Messner, Giuseppe Riccardi

Automated prediction of valence, one key feature of a person's emotional state, from individuals' personal narratives may provide crucial information for mental healthcare (e.g. early diagnosis of mental diseases, superv…

Prediction

Collective Memory and Narrative Cohesion: A Computational Study of Palestinian Refugee Oral Histories in Lebanon

2025-01-23 · Ghadeer Awwad, Lavinia Dunagan, David Gamba, Tamara N. Rayan

This study uses the Palestinian Oral History Archive (POHA) to investigate how Palestinian refugee groups in Lebanon sustain a cohesive collective memory of the Nakba through shared narratives. Grounded in Halbwachs' the…