paper-with-me

홈 › Papers

COmic: Convolutional Kernel Networks for Interpretable End-to-End Learning on (Multi-)Omics Data

2022-12-02 · Jonas C. Ditz, Bernhard Reuter, Nico Pfeifer

Motivation: The size of available omics datasets is steadily increasing with technological advancement in recent years. While this increase in sample size can be used to improve the performance of relevant prediction tasks in healthcare, models that are optimized for large datasets usually operate as black boxes. In high stakes scenarios, like healthcare, using a black-box model poses safety and security issues. Without an explanation about molecular factors and phenotypes that affected the prediction, healthcare providers are left with no choice but to blindly trust the models. We propose a new type of artificial neural network, named Convolutional Omics Kernel Network (COmic). By combining convolutional kernel networks with pathway-induced kernels, our method enables robust and interpretable end-to-end learning on omics datasets ranging in size from a few hundred to several hundreds of thousands of samples. Furthermore, COmic can be easily adapted to utilize multi-omics data. Results: We evaluated the performance capabilities of COmic on six different breast cancer cohorts. Additionally, we trained COmic models on multi-omics data using the METABRIC cohort. Our models performed either better or similar to competitors on both tasks. We show how the use of pathway-induced Laplacian kernels opens the black-box nature of neural networks and results in intrinsically interpretable models that eliminate the need for post-hoc explanation models.

📄 PDF Abstract BibTeX arXiv:2212.02504

Code (1)

jditz/comics 공식 구현 pytorch

Similar Papers 제목 키워드 기반

ComicGAN: Text-to-Comic Generative Adversarial Network

2021-09-19 · Ben Proven-Bessel, Zilong Zhao, Lydia Chen

Drawing and annotating comic illustrations is a complex and difficult process. No existing machine learning algorithms have been developed to create comic illustrations based on descriptions of illustrations, or the dial…

Generative Adversarial NetworkImage Generation

Object Detection for Comics using Manga109 Annotations

2018-03-23 · Toru Ogawa, Atsushi Otsubo, Rei Narita, Yusuke Matsui 외

With the growth of digitized comics, image understanding techniques are becoming important. In this paper, we focus on object detection, which is a fundamental task of image understanding. Although convolutional neural n…

Objectobject-detectionObject Detection

ComicScene154: A Scene Dataset for Comic Analysis

2025-08-22 · Sandro Paval, Ivan P. Yamshchikov, Pascal Meißner arxiv

Comics offer a compelling yet under-explored domain for computational narrative analysis, combining text and imagery in ways distinct from purely textual or audiovisual media. We introduce ComicScene154, a manually annot…

Scene Segmentation

ComicsPAP: understanding comic strips by picking the correct panel

2025-03-11 · Emanuele Vivoli, Artemis Llabrés, Mohamed Ali Souibgui, Marco Bertini 외

Large multimodal models (LMMs) have made impressive strides in image captioning, VQA, and video comprehension, yet they still struggle with the intricate temporal and spatial cues found in comics. To address this gap, we…

Image CaptioningVisual Question Answering (VQA)

A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognition

2022-12-27 · Gürkan Soykan, Deniz Yuret, Tevfik Metin Sezgin

This study focuses on improving the optical character recognition (OCR) data for panels in the COMICS dataset, the largest dataset containing text and images from comic books. To do this, we developed a pipeline for OCR …

Optical Character RecognitionOptical Character Recognition (OCR)Story GenerationText Detection