Probing Language Models
1개 벤치마크 · 논문 20편 · 이 태스크의 논문 보기 →
Benchmarks
KAMEL
Most implemented
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation
Probing Language Models on Their Knowledge Source
Probing Language Models for Pre-training Data Detection
Unveiling LLMs: The Evolution of Latent Representations in a Dynamic Knowledge Graph
Probing Representations for Document-level Event Extraction
KAMEL : Knowledge Analysis with Multitoken Entities in Language Models
Papers
Linguistically Grounded Analysis of Language Models using Shapley Head Values
Understanding how linguistic knowledge is encoded in language models is crucial for improving their generalisation capabilities. In this paper, we investigate the processing of morphosyntactic phenomena, by leveraging a …
Probing Language ModelsProbing Language Models on Their Knowledge Source
Large Language Models (LLMs) often encounter conflicts between their learned, internal (parametric knowledge, PK) and external knowledge provided during inference (contextual knowledge, CK). Understanding how LLMs models…
Probing Language ModelsProbing Language Models for Pre-training Data Detection
Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. …
Probing Language ModelsUnveiling LLMs: The Evolution of Latent Representations in a Dynamic Knowledge Graph
Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains …
Claim VerificationCommon Sense ReasoningKnowledge GraphsKnowledge Probing+3Probing Language Models' Gesture Understanding for Enhanced Human-AI Interaction
The rise of Large Language Models (LLMs) has affected various disciplines that got beyond mere text generation. Going beyond their textual nature, this project proposal aims to investigate the interaction between LLMs an…
Probing Language ModelsText GenerationSocial Bias Probing: Fairness Benchmarking for Language Models
While the impact of social biases in language models has been recognized, prior methods for bias evaluation have been limited to binary association tests on small datasets, limiting our understanding of bias complexities…
BenchmarkingFairnessProbing Language Models