paper-with-me

홈 › Papers

Object Detection for Comics using Manga109 Annotations

2018-03-23 · Toru Ogawa, Atsushi Otsubo, Rei Narita, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa

With the growth of digitized comics, image understanding techniques are becoming important. In this paper, we focus on object detection, which is a fundamental task of image understanding. Although convolutional neural networks (CNN)-based methods archived good performance in object detection for naturalistic images, there are two problems in applying these methods to the comic object detection task. First, there is no large-scale annotated comics dataset. The CNN-based methods require large-scale annotations for training. Secondly, the objects in comics are highly overlapped compared to naturalistic images. This overlap causes the assignment problem in the existing CNN-based methods. To solve these problems, we proposed a new annotation dataset and a new CNN model. We annotated an existing image dataset of comics and created the largest annotation dataset, named Manga109-annotations. For the assignment problem, we proposed a new CNN-based detector, SSD300-fork. We compared SSD300-fork with other detection methods using Manga109-annotations and confirmed that our model outperformed them based on the mAP score.

📄 PDF Abstract BibTeX arXiv:1803.08670

Code (5)

aasimsani/artificial_manga_panel_dataset
barisbatuhan/dass_det_inference pytorch
barisbatuhan/dass_detector pytorch
icyeyeball/Peitent tf
matsui528/manga109api

Tasks

Objectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detection

2023-06-30 · Yingxuan Li, Kiyoharu Aizawa, Yusuke Matsui

The expanding market for e-comics has spurred interest in the development of automated methods to analyze comics. For further understanding of comics, an automated approach is needed to link text in comics to characters …

Graph GenerationScene Graph Generation

Comics Datasets Framework: Mix of Comics datasets for detection benchmarking

2024-07-03 · Emanuele Vivoli, Irene Campaioli, Mariateresa Nardoni, Niccolò Biondi 외

Comics, as a medium, uniquely combine text and images in styles often distinct from real-world visuals. For the past three decades, computational research on comics has evolved from basic object detection to more sophist…

BenchmarkingObjectobject-detectionObject Detection+1

Building a Manga Dataset "Manga109" with Annotations for Multimedia Applications

2020-05-09 · Kiyoharu Aizawa, Azuma Fujimoto, Atsushi Otsubo, Toru Ogawa 외

Manga, or comics, which are a type of multimodal artwork, have been left behind in the recent trend of deep learning applications because of the lack of a proper dataset. Hence, we built Manga109, a dataset consisting of…

Retrieval

Detection of Furigana Text in Images

2022-07-08 · Nikolaj Kjøller Bjerregaard, Veronika Cheplygina, Stefan Heinrich

Furigana are pronunciation notes used in Japanese writing. Being able to detect these can help improve optical character recognition (OCR) performance or make more accurate digital copies of Japanese written media by cor…

object-detectionObject DetectionOptical Character RecognitionOptical Character Recognition (OCR)

Manga Generation via Layout-controllable Diffusion

2024-12-26 · Siyu Chen, Dengjie Li, Zenghao Bao, Yao Zhou 외

Generating comics through text is widely studied. However, there are few studies on generating multi-panel Manga (Japanese comics) solely based on plain text. Japanese manga contains multiple panels on a single page, wit…

Semantic correspondence