Causality for Natural Language Processing
Causal reasoning is a cornerstone of human intelligence and a critical capability for artificial systems aiming to achieve advanced understanding and decision-making. This thesis delves into various dimensions of causal reasoning and understanding in large language models (LLMs). It encompasses a series of studies that explore the causal inference skills of LLMs, the mechanisms behind their performance, and the implications of causal and anticausal learning for natural language processing (NLP) tasks. Additionally, it investigates the application of causal reasoning in text-based computational social science, specifically focusing on political decision-making and the evaluation of scientific impact through citations. Through novel datasets, benchmark tasks, and methodological frameworks, this work identifies key challenges and opportunities to improve the causal capabilities of LLMs, providing a comprehensive foundation for future research in this evolving field.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferenceDecision MakingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Probing Causality Manipulation of Large Language Models
Large language models (LLMs) have shown various ability on natural language processing, including problems about causality. It is not intuitive for LLMs to command causality, since pretrained models usually work on stati…
In-Context LearningRAGRetrievalRetrieval-augmented Generation+1Persian Causality Corpus (PerCause) and the Causality Detection Benchmark
Recognizing causal elements and causal relations in text is one of the challenging issues in natural language processing; specifically, in low resource languages such as Persian. In this research we prepare a causality h…
Deep LearningExtracting Temporal and Causal Relations between Events
Structured information resulting from temporal information processing is crucial for a variety of natural language processing tasks, for instance to generate timeline summarization of events from news documents, or to an…
RelationRelation ExtractionTemporal Relation ExtractionTimeline Summarization+1A Survey on Extraction of Causal Relations from Natural Language Text
As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality ext…
BIG-bench Machine LearningFeature EngineeringRelation ExtractionRepresentation LearningCausal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processi…
Causal InferenceFairness