paper-with-me

Papers

A Paragraph-level Multi-task Learning Model for Scientific Fact-Verification

2020-12-28 · Xiangci Li, Gully Burns, Nanyun Peng

Even for domain experts, it is a non-trivial task to verify a scientific claim by providing supporting or refuting evidence rationales. The situation worsens as misinformation is proliferated on social media or news websites, manually or programmatically, at every moment. As a result, an automatic fact-verification tool becomes crucial for combating the spread of misinformation. In this work, we propose a novel, paragraph-level, multi-task learning model for the SciFact task by directly computing a sequence of contextualized sentence embeddings from a BERT model and jointly training the model on rationale selection and stance prediction.

📄 PDF Abstract BibTeX arXiv:2012.14500

Code (1)

jacklxc/ParagraphJointModel 공식 구현 pytorch

Tasks

Fact VerificationMisinformationMulti-Task LearningSentenceSentence Embeddings

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction

2025-01-09 · Léane Jourdan, Nicolas Hernandez, Richard Dufour, Florian Boudin 외

Revision is a crucial step in scientific writing, where authors refine their work to improve clarity, structure, and academic quality. Existing approaches to automated writing assistance often focus on sentence-level rev…

Sentence

A Multi-lingual Dataset of Classified Paragraphs from Open Access Scientific Publications

2025-10-13 · Eric Jeangirard arxiv

We present a dataset of 833k paragraphs extracted from CC-BY licensed scientific publications, classified into four categories: acknowledgments, data mentions, software/code mentions, and clinical trial mentions. The par…

Language IdentificationText Classification

Legal Question Answering using Ranking SVM and Deep Convolutional Neural Network

2017-03-16 · Phong-Khac Do, Huy-Tien Nguyen, Chien-Xuan Tran, Minh-Tien Nguyen 외

This paper presents a study of employing Ranking SVM and Convolutional Neural Network for two missions: legal information retrieval and question answering in the Competition on Legal Information Extraction/Entailment. Fo…

Information RetrievalQuestion AnsweringRetrieval

ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select

2022-10-26 · Yuchen Zhuang, Yinghao Li, Jerry Junyang Cheung, Yue Yu 외

We study the problem of extracting N-ary relation tuples from scientific articles. This task is challenging because the target knowledge tuples can reside in multiple parts and modalities of the document. Our proposed me…

ArticlesRelation ExtractionRetrieval

SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioning

2023-06-06 · Zhishen Yang, Raj Dabre, Hideki Tanaka, Naoaki Okazaki

In scholarly documents, figures provide a straightforward way of communicating scientific findings to readers. Automating figure caption generation helps move model understandings of scientific documents beyond text and …

Caption GenerationImage CaptioningOptical Character Recognition (OCR)