paper-with-me

홈 › Papers

TCube: Domain-Agnostic Neural Time-series Narration

2021-10-11 · Mandar Sharma, John S. Brownstein, Naren Ramakrishnan

The task of generating rich and fluent narratives that aptly describe the characteristics, trends, and anomalies of time-series data is invaluable to the sciences (geology, meteorology, epidemiology) or finance (trades, stocks, or sales and inventory). The efforts for time-series narration hitherto are domain-specific and use predefined templates that offer consistency but lead to mechanical narratives. We present TCube (Time-series-to-text), a domain-agnostic neural framework for time-series narration, that couples the representation of essential time-series elements in the form of a dense knowledge graph and the translation of said knowledge graph into rich and fluent narratives through the transfer-learning capabilities of PLMs (Pre-trained Language Models). TCube's design primarily addresses the challenge that lies in building a neural framework in the complete paucity of annotated training data for time-series. The design incorporates knowledge graphs as an intermediary for the representation of essential time-series elements which can be linearized for textual translation. To the best of our knowledge, TCube is the first investigation of the use of neural strategies for time-series narration. Through extensive evaluations, we show that TCube can improve the lexical diversity of the generated narratives by up to 65.38% while still maintaining grammatical integrity. The practicality and deployability of TCube is further validated through an expert review (n=21) where 76.2% of participating experts wary of auto-generated narratives favored TCube as a deployable system for time-series narration due to its richer narratives. Our code-base, models, and datasets, with detailed instructions for reproducibility is publicly hosted at https://github.com/Mandar-Sharma/TCube.

📄 PDF Abstract BibTeX arXiv:2110.05633

Code (1)

Mandar-Sharma/TCube 공식 구현 pytorch

Tasks

EpidemiologyKnowledge GraphsTime SeriesTime Series AnalysisTransfer LearningTranslation

Similar Papers 제목 키워드 기반

OCTCube-M: A 3D multimodal optical coherence tomography foundation model for retinal and systemic diseases with cross-cohort and cross-device validation

2024-08-20 · Zixuan Liu, Hanwen Xu, Addie Woicik, Linda G. Shapiro 외

We present OCTCube-M, a 3D OCT-based multi-modal foundation model for jointly analyzing OCT and en face images. OCTCube-M first developed OCTCube, a 3D foundation model pre-trained on 26,685 3D OCT volumes encompassing 1…

Contrastive LearningDiagnosticSelf-Supervised Learning

PointCubeNet: 3D Part-level Reasoning with 3x3x3 Point Cloud Blocks

2025-11-10 · Da-Yeong Kim, Yeong-Jun Cho arxiv

In this paper, we propose PointCubeNet, a novel multi-modal 3D understanding framework that achieves part-level reasoning without requiring any part annotations. PointCubeNet comprises global and local branches. The prop…

Narration Generation for Cartoon Videos

2021-01-17 · Nikos Papasarantopoulos, Shay B. Cohen

Research on text generation from multimodal inputs has largely focused on static images, and less on video data. In this paper, we propose a new task, narration generation, that is complementing videos with narration tex…

Text Generation

Dynamic Fusion of Eye Movement Data and Verbal Narrations in Knowledge-rich Domains

2020-12-01 · NeurIPS 2020 12 · Ervine Zheng, Qi Yu, Rui Li, Pengcheng Shi 외

We propose to jointly analyze experts' eye movements and verbal narrations to discover important and interpretable knowledge patterns to better understand their decision-making processes. The discovered patterns can furt…

Decision MakingDiagnostic

Learning to Generate Long-term Future Narrations Describing Activities of Daily Living

2025-03-03 · Ramanathan Rajendiran, Debaditya Roy, Basura Fernando

Anticipating future events is crucial for various application domains such as healthcare, smart home technology, and surveillance. Narrative event descriptions provide context-rich information, enhancing a system's futur…

Action AnticipationDecision MakingLanguage ModelingLanguage Modelling+1