paper-with-me

홈 › Papers

DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models

2021-10-04 · *SEM (NAACL) 2022 7 · Gregor Betz, Kyle Richardson

In this paper, we present and implement a multi-dimensional, modular framework for performing deep argument analysis (DeepA2) using current pre-trained language models (PTLMs). ArgumentAnalyst -- a T5 model (Raffel et al. 2020) set up and trained within DeepA2 -- reconstructs argumentative texts, which advance an informal argumentation, as valid arguments: It inserts, e.g., missing premises and conclusions, formalizes inferences, and coherently links the logical reconstruction to the source text. We create a synthetic corpus for deep argument analysis, and evaluate ArgumentAnalyst on this new dataset as well as on existing data, specifically EntailmentBank (Dalvi et al. 2021). Our empirical findings vindicate the overall framework and highlight the advantages of a modular design, in particular its ability to emulate established heuristics (such as hermeneutic cycles), to explore the model's uncertainty, to cope with the plurality of correct solutions (underdetermination), and to exploit higher-order evidence.

📄 PDF Abstract BibTeX arXiv:2110.01509

Code (1)

vamsi995/paraphrase-generator 공식 구현 pytorch

Tasks

Argument MiningLogical Reasoning Reading ComprehensionSemantic Parsingvalid

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
SentencePiece 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

DeepATLAS: One-Shot Localization for Biomedical Data

2024-02-14 · Peter D. Chang

This paper introduces the DeepATLAS foundational model for localization tasks in the domain of high-dimensional biomedical data. Upon convergence of the proposed self-supervised objective, a pretrained model maps an inpu…

One-Shot Segmentation

DeepABM: Scalable, efficient and differentiable agent-based simulations via graph neural networks

2021-10-09 · Ayush Chopra, Esma Gel, Jayakumar Subramanian, Balaji Krishnamurthy 외

We introduce DeepABM, a framework for agent-based modeling that leverages geometric message passing of graph neural networks for simulating action and interactions over large agent populations. Using DeepABM allows scali…

GPU

Modular Semantics and Characteristics for Bipolar Weighted Argumentation Graphs

2018-07-17 · Till Mossakowski, Fabian Neuhaus

This paper addresses the semantics of weighted argumentation graphs that are bipolar, i.e. contain both attacks and supports for arguments. It builds on previous work by Amgoud, Ben-Naim et. al. We study the various char…

All

Model-Agnostic Reachability Analysis on Deep Neural Networks

2023-04-03 · Chi Zhang, Wenjie Ruan, Fu Wang, Peipei Xu 외

Verification plays an essential role in the formal analysis of safety-critical systems. Most current verification methods have specific requirements when working on Deep Neural Networks (DNNs). They either target one par…

model

The DeepCAR Method: Forecasting Time-Series Data That Have Change Points

2023-02-22 · Ayla Jungbluth, Johannes Lederer

Many methods for time-series forecasting are known in classical statistics, such as autoregression, moving averages, and exponential smoothing. The DeepAR framework is a novel, recent approach for time-series forecasting…

Time SeriesTime Series AnalysisTime Series Forecasting