Transformer-Based Temporal Information Extraction and Application: A Review
Temporal information extraction (IE) aims to extract structured temporal information from unstructured text, thereby uncovering the implicit timelines within. This technique is applied across domains such as healthcare, newswire, and intelligence analysis, aiding models in these areas to perform temporal reasoning and enabling human users to grasp the temporal structure of text. Transformer-based pre-trained language models have produced revolutionary advancements in natural language processing, demonstrating exceptional performance across a multitude of tasks. Despite the achievements garnered by Transformer-based approaches in temporal IE, there is a lack of comprehensive reviews on these endeavors. In this paper, we aim to bridge this gap by systematically summarizing and analyzing the body of work on temporal IE using Transformers while highlighting potential future research directions.
Code (0)
등록된 구현이 없습니다.
Tasks
Temporal Information ExtractionSimilar Papers 제목 키워드 기반
Transformers in Action Recognition: A Review on Temporal Modeling
In vision-based action recognition, spatio-temporal features from different modalities are used for recognizing activities. Temporal modeling is a long challenge of action recognition. However, there are limited methods …
Action RecognitionClinical Document Metadata Extraction: A Scoping Review
Clinical document metadata, such as document type, structure, author role, medical specialty, and encounter setting, is essential for accurate interpretation of information captured in clinical documents. However, vast d…
Feature EngineeringClinical Concept Extraction: a Methodology Review
Background Concept extraction, a subdomain of natural language processing (NLP) with a focus on extracting concepts of interest, has been adopted to computationally extract clinical information from text for a wide range…
ArticlesClinical Concept ExtractionDecision MakingStecformer: Spatio-temporal Encoding Cascaded Transformer for Multivariate Long-term Time Series Forecasting
Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multiv…
PredictionTime SeriesTime Series ForecastingWeather ForecastingTemporal Relation Extraction in Clinical Texts: A Span-based Graph Transformer Approach
Temporal information extraction from unstructured text is essential for contextualizing events and deriving actionable insights, particularly in the medical domain. We address the task of extracting clinical events and t…
DiagnosticRelationRelation ExtractionTemporal Information Extraction+1