paper-with-me

홈 › Papers

Applying a Generic Sequence-to-Sequence Model for Simple and Effective Keyphrase Generation

2022-01-14 · Md Faisal Mahbub Chowdhury, Gaetano Rossiello, Michael Glass, Nandana Mihindukulasooriya, Alfio Gliozzo

In recent years, a number of keyphrase generation (KPG) approaches were proposed consisting of complex model architectures, dedicated training paradigms and decoding strategies. In this work, we opt for simplicity and show how a commonly used seq2seq language model, BART, can be easily adapted to generate keyphrases from the text in a single batch computation using a simple training procedure. Empirical results on five benchmarks show that our approach is as good as the existing state-of-the-art KPG systems, but using a much simpler and easy to deploy framework.

📄 PDF Abstract BibTeX arXiv:2201.05302

Code (0)

등록된 구현이 없습니다.

Tasks

Keyphrase GenerationLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음

Similar Papers 제목 키워드 기반

An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling

2018-03-04 · Shaojie Bai, J. Zico Kolter, Vladlen Koltun

For most deep learning practitioners, sequence modeling is synonymous with recurrent networks. Yet recent results indicate that convolutional architectures can outperform recurrent networks on tasks such as audio synthes…

Audio SynthesisLanguage ModellingMachine TranslationMusic Modeling+3

Adaptive Objectness for Object Tracking

2015-01-05 · Pengpeng Liang, Chunyuan Liao, Xue Mei, Haibin Ling

Object tracking is a long standing problem in vision. While great efforts have been spent to improve tracking performance, a simple yet reliable prior knowledge is left unexploited: the target object in tracking must be …

ObjectObject TrackingVisual Object TrackingVisual Tracking

Convolutional Sequence Modeling Revisited

2018-01-01 · ICLR 2018 1 · Shaojie Bai, J. Zico Kolter, Vladlen Koltun

This paper revisits the problem of sequence modeling using convolutional architectures. Although both convolutional and recurrent architectures have a long history in sequence prediction, the current "default" mindset …

Language ModellingTime Series Analysis

Copy this Sentence

2019-05-23 · Vasileios Lioutas, Andriy Drozdyuk

Attention is an operation that selects some largest element from some set, where the notion of largest is defined elsewhere. Applying this operation to sequence to sequence mapping results in significant improvements to …

Sentence

An Effective Transition-based Model for Discontinuous NER

2020-04-28 · ACL 2020 6 · Xiang Dai, Sarvnaz Karimi, Ben Hachey, Cecile Paris

Unlike widely used Named Entity Recognition (NER) data sets in generic domains, biomedical NER data sets often contain mentions consisting of discontinuous spans. Conventional sequence tagging techniques encode Markov as…

modelnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1