paper-with-me

Papers

Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection

2026-05-15 · Chenwang Wu, Yiuming Cheung, Bo Han, Shuhai Zhang, Defu Lian arxiv

Machine-generated texts (MGTs) pose risks such as disinformation and phishing, underscoring the need for reliable detection. Metric-based methods, which extract statistically distinguishable features of MGTs, are often more practical than complex model-based methods that are prone to overfitting. Given their diverse designs, we first place representative metric-based methods within a unified framework, enabling a clear assessment of their advantages and limitations. Our analysis identifies a core challenge across these methods: the token-level detection score is easily biased by the inherent randomness of the MGTs generation process. Then, we theoretically derive the multi-hop transitions of the token-level detection score and explore their local and global relations. Based on these findings, we propose a multi-level contextual token relation modeling framework for MGT detection. Specifically, for local relations, we model them through a lightweight Markov-informed calibration module that refines token-level evidence before aggregation. For global relations, we introduce a rule-support reasoning module that uses explicit logical rules derived from contextual score statistics. Finally, we combine the local calibrated score and the global rule-support reasoning signal in a joint multi-level inference framework. Extensive experiments show broad and substantial improvements across various real-world scenarios, including cross-LLM and cross-domain settings, with low computational overhead.

📄 PDF Abstract BibTeX arXiv:2605.16107

Code (0)

등록된 구현이 없습니다.

Tasks

Text Detection

Similar Papers 제목 키워드 기반

When is a bishop not like a rook? When it's like a rabbi! Multi-prototype BERT embeddings for estimating semantic relationships

2020-11-01 · CONLL 2020 · Gabriella Chronis, Katrin Erk

This paper investigates contextual language models, which produce token representations, as a resource for lexical semantics at the word or type level. We construct multi-prototype word embeddings from bert-base-uncased …

Semantic SimilaritySemantic Textual SimilarityVocal Bursts Type PredictionWord Embeddings

Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection

2022-01-30 · Minglun Han, Linhao Dong, Zhenlin Liang, Meng Cai 외

Nowadays, most methods in end-to-end contextual speech recognition bias the recognition process towards contextual knowledge. Since all-neural contextual biasing methods rely on phrase-level contextual modeling and atten…

speech-recognitionSpeech Recognition

Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling

2026-06-12 · Ghadir Alselwi, Basem Suleiman, Hao Xue, Shoaib Jameel 외 arxiv

Long-context language modeling requires not only extending context windows but maintaining coherent understanding of entity states and relationships across thousands of tokens -- a challenge that semantic similarity alon…

Semantic SimilarityRelation ExtractionKnowledge Graphs

Enhancing the Robustness of Contextual ASR to Varying Biasing Information Volumes Through Purified Semantic Correlation Joint Modeling

2025-09-07 · Yue Gu, Zhihao Du, Ying Shi, Shiliang Zhang 외 arxiv

Recently, cross-attention-based contextual automatic speech recognition (ASR) models have made notable advancements in recognizing personalized biasing phrases. However, the effectiveness of cross-attention is affected b…

Speech Recognition

Context Tracking Network: Graph-based Context Modeling for Implicit Discourse Relation Recognition

2021-06-01 · NAACL 2021 4 · Yingxue Zhang, Fandong Meng, Peng Li, Ping Jian 외

Implicit discourse relation recognition (IDRR) aims to identify logical relations between two adjacent sentences in the discourse. Existing models fail to fully utilize the contextual information which plays an important…

RelationSentence