paper-with-me

홈 › Papers

Panel Transitions for Genre Analysis in Visual Narratives

2023-12-14 · Yi-Chun Chen, Arnav Jhala

Understanding how humans communicate and perceive narratives is important for media technology research and development. This is particularly important in current times when there are tools and algorithms that are easily available for amateur users to create high-quality content. Narrative media develops over time a set of recognizable patterns of features across similar artifacts. Genre is one such grouping of artifacts for narrative media with similar patterns, tropes, and story structures. While much work has been done on genre-based classifications in text and video, we present a novel approach to do a multi-modal analysis of genre based on comics and manga-style visual narratives. We present a systematic feature analysis of an annotated dataset that includes a variety of western and eastern visual books with annotations for high-level narrative patterns. We then present a detailed analysis of the contributions of high-level features to genre classification for this medium. We highlight some of the limitations and challenges of our existing computational approaches in modeling subjective labels. Our contributions to the community are: a dataset of annotated manga books, a multi-modal analysis of visual panels and text in a constrained and popular medium through high-level features, and a systematic process for incorporating subjective narrative patterns in computational models.

📄 PDF Abstract BibTeX arXiv:2312.08720

Code (0)

등록된 구현이 없습니다.

Tasks

Genre classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

CPST: Comprehension-Preserving Style Transfer for Multi-Modal Narratives

2023-12-14 · Yi-Chun Chen, Arnav Jhala

We investigate the challenges of style transfer in multi-modal visual narratives. Among static visual narratives such as comics and manga, there are distinct visual styles in terms of presentation. They include style fea…

Style Transfer

The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narratives

2016-11-16 · CVPR 2017 7 · Mohit Iyyer, Varun Manjunatha, Anupam Guha, Yogarshi Vyas 외

Visual narrative is often a combination of explicit information and judicious omissions, relying on the viewer to supply missing details. In comics, most movements in time and space are hidden in the "gutters" between pa…

From Panels to Prose: Generating Literary Narratives from Comics

2025-03-30 · Ragav Sachdeva, Andrew Zisserman

Comics have long been a popular form of storytelling, offering visually engaging narratives that captivate audiences worldwide. However, the visual nature of comics presents a significant barrier for visually impaired re…

Optical Character Recognition (OCR)

How Panel Layouts Define Manga: Insights from Visual Ablation Experiments

2024-12-26 · Siyuan Feng, Teruya Yoshinaga, Katsuhiko Hayashi, Koki Washio 외

Today, manga has gained worldwide popularity. However, the question of how various elements of manga, such as characters, text, and panel layouts, reflect the uniqueness of a particular work, or even define it, remains a…

Re:Verse -- Can Your VLM Read a Manga?

2025-08-11 · Aaditya Baranwal, Madhav Kataria, Naitik Agrawal, Yogesh S Rawat 외 arxiv

Current Vision Language Models (VLMs) demonstrate a critical gap between surface-level recognition and deep narrative reasoning when processing sequential visual storytelling. Through a comprehensive investigation of man…

Visual StorytellingCausal Inference