paper-with-me

Papers Factual probe

“Factual probe” 태그가 달린 논문 3편 · 필터 해제

BEAR: A Unified Framework for Evaluating Relational Knowledge in Causal and Masked Language Models

2024-04-05 · Jacek Wiland, Max Ploner, Alan Akbik

Knowledge probing assesses to which degree a language model (LM) has successfully learned relational knowledge during pre-training. Probing is an inexpensive way to compare LMs of different sizes and training configurati…

Factual probeGeneral KnowledgeKnowledge ProbingLanguage Modeling+2

DeepStruct: Pretraining of Language Models for Structure Prediction

2022-05-21 · Findings (ACL) 2022 5 · Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong 외

We introduce a method for improving the structural understanding abilities of language models. Unlike previous approaches that finetune the models with task-specific augmentation, we pretrain language models on a collect…

coreference-resolutionCoreference ResolutionDialogue State TrackingEvent Extraction+14

Zero-Shot Information Extraction as a Unified Text-to-Triple Translation

2021-09-23 · EMNLP 2021 11 · Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong 외

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-…

Factual probeLanguage ModelingLanguage ModellingOpen Information Extraction+2
1–3 / 3