Temporal Validity Change Prediction
Temporal validity is an important property of text that is useful for many downstream applications, such as recommender systems, conversational AI, or story understanding. Existing benchmarking tasks often require models to identify the temporal validity duration of a single statement. However, in many cases, additional contextual information, such as sentences in a story or posts on a social media profile, can be collected from the available text stream. This contextual information may greatly alter the duration for which a statement is expected to be valid. We propose Temporal Validity Change Prediction, a natural language processing task benchmarking the capability of machine learning models to detect contextual statements that induce such change. We create a dataset consisting of temporal target statements sourced from Twitter and crowdsource sample context statements. We then benchmark a set of transformer-based language models on our dataset. Finally, we experiment with temporal validity duration prediction as an auxiliary task to improve the performance of the state-of-the-art model.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingPredictionRecommendation SystemsvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VITA: Versatile Time Representation Learning for Temporal Hyper-Relational Knowledge Graphs
Knowledge graphs (KGs) have become an effective paradigm for managing real-world facts, which are not only complex but also dynamically evolve over time. The temporal validity of facts often serves as a strong clue in do…
Knowledge GraphsLink PredictionRepresentation LearningDistribution-Free Predictive Inference under Unknown Temporal Drift
Distribution-free prediction sets play a pivotal role in uncertainty quantification for complex statistical models. Their validity hinges on reliable calibration data, which may not be readily available as real-world env…
PredictionUncertainty QuantificationConformal Prediction Intervals with Temporal Dependence
Cross-sectional prediction is common in many domains such as healthcare, including forecasting tasks using electronic health records, where different patients form a cross-section. We focus on the task of constructing va…
Conformal PredictionPredictionPrediction Intervalsregression+4A source separation approach to temporal graph modelling for computer networks
Detecting malicious activity within an enterprise computer network can be framed as a temporal link prediction task: given a sequence of graphs representing communications between hosts over time, the goal is to predict …
Link PredictionOn the Validity of Conformal Prediction for Network Data Under Non-Uniform Sampling
We study the properties of conformal prediction for network data under various sampling mechanisms that commonly arise in practice but often result in a non-representative sample of nodes. We interpret these sampling mec…
Conformal PredictionPredictionvalid