홈 › Papers

A Novel Corpus of Discourse Structure in Humans and Computers

2021-11-10 · Babak Hemmatian, Sheridan Feucht, Rachel Avram, Alexander Wey, Muskaan Garg, Kate Spitalnic, Carsten Eickhoff, Ellie Pavlick, Bjorn Sandstede, Steven Sloman

We present a novel corpus of 445 human- and computer-generated documents, comprising about 27,000 clauses, annotated for semantic clause types and coherence relations that allow for nuanced comparison of artificial and natural discourse modes. The corpus covers both formal and informal discourse, and contains documents generated using fine-tuned GPT-2 (Zellers et al., 2019) and GPT-3(Brown et al., 2020). We showcase the usefulness of this corpus for detailed discourse analysis of text generation by providing preliminary evidence that less numerous, shorter and more often incoherent clause relations are associated with lower perceived quality of computer-generated narratives and arguments.

📄 PDF Abstract BibTeX arXiv:2111.05940

Code (1)

sfeucht/annotation_evaluation 공식 구현

Tasks

Text Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…

Residual Connection 설명 없음

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Adam 설명 없음

Can Discourse Relations be Identified Incrementally?

2017-11-01 · IJCNLP 2017 11 · Frances Yung, Hiroshi Noji, Yuji Matsumoto

Humans process language word by word and construct partial linguistic structures on the fly before the end of the sentence is perceived. Inspired by this cognitive ability, incremental algorithms for natural language pro…

Discourse Parsing Language Modeling Language Modelling Semantic Role Labeling+2

An empirical resource for discovering cognitive principles of discourse organisation: the ANNODIS corpus

2012-05-01 · LREC 2012 5 · Stergos Afantenos, Nicholas Asher, Farah Benamara, Myriam Bras 외

This paper describes the ANNODIS resource, a discourse-level annotated corpus for French. The corpus combines two perspectives on discourse: a bottom-up approach and a top-down approach. The bottom-up view incrementally …

Identifying the Discourse Function of News Article Paragraphs

2018-08-01 · COLING 2018 8 · W. Victor Yarlott, Cristina Cornelio, Tian Gao, Mark Finlayson

Discourse structure is a key aspect of all forms of text, providing valuable information both to humans and machines. We applied the hierarchical theory of news discourse developed by van Dijk to examine how paragraphs o…

Articles BIG-bench Machine Learning

Persian Rhetorical Structure Theory

2021-06-25 · Sara Shahmohammadi, Hadi Veisi, Ali Darzi

Over the past years, interest in discourse analysis and discourse parsing has steadily grown, and many discourse-annotated corpora and, as a result, discourse parsers have been built. In this paper, we present a discours…

Discourse Parsing

Cheater's Bowl: Human vs. Computer Search Strategies for Open-Domain Question Answering

2022-11-15 · Wanrong He, Andrew Mao, Jordan Boyd-Graber

For humans and computers, the first step in answering an open-domain question is retrieving a set of relevant documents from a large corpus. However, the strategies that computers use fundamentally differ from those of h…

Open-Domain Question Answering Question Answering World Knowledge