paper-with-me

홈 › Papers

An Exploratory Framework for Future SETI Applications: Detecting Generative Reactivity via Language Models

2025-06-03 · Po-Chieh Yu

We present an exploratory framework to test whether noise-like input can induce structured responses in language models. Instead of assuming that extraterrestrial signals must be decoded, we evaluate whether inputs can trigger linguistic behavior in generative systems. This shifts the focus from decoding to viewing structured output as a sign of underlying regularity in the input. We tested GPT-2 small, a 117M-parameter model trained on English text, using four types of acoustic input: human speech, humpback whale vocalizations, Phylloscopus trochilus birdsong, and algorithmically generated white noise. All inputs were treated as noise-like, without any assumed symbolic encoding. To assess reactivity, we defined a composite score called Semantic Induction Potential (SIP), combining entropy, syntax coherence, compression gain, and repetition penalty. Results showed that whale and bird vocalizations had higher SIP scores than white noise, while human speech triggered only moderate responses. This suggests that language models may detect latent structure even in data without conventional semantics. We propose that this approach could complement traditional SETI methods, especially in cases where communicative intent is unknown. Generative reactivity may offer a different way to identify data worth closer attention.

📄 PDF Abstract BibTeX arXiv:2506.02730

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Multi-Head Attention 설명 없음
Attention 설명 없음
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

SETI: Systematicity Evaluation of Textual Inference

2023-05-24 · Xiyan Fu, Anette Frank

We propose SETI (Systematicity Evaluation of Textual Inference), a novel and comprehensive benchmark designed for evaluating pre-trained language models (PLMs) for their systematicity capabilities in the domain of textua…

UNER: Universal Named-Entity RecognitionFramework

2020-10-23 · Diego Alves, Tin Kuculo, Gabriel Amaral, Gaurish Thakkar 외

We introduce the Universal Named-Entity Recognition (UNER)framework, a 4-level classification hierarchy, and the methodology that isbeing adopted to create the first multilingual UNER corpus: the SETimesparallel corpus a…

Knowledge Graphsnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Quotations, Coreference Resolution, and Sentiment Annotations in Croatian News Articles: An Exploratory Study

2022-12-14 · Jelena Sarajlić, Gaurish Thakkar, Diego Alves, Nives Mikelic Preradović

This paper presents a corpus annotated for the task of direct-speech extraction in Croatian. The paper focuses on the annotation of the quotation, co-reference resolution, and sentiment annotation in SETimes news corpus …

Articlescoreference-resolutionCoreference ResolutionSpeech Extraction

Ossetic-COT: Designing a morphologically annotated corpus and morphological analyzer for Ossetic

2026-07-06 · Anna Shatskikh, Alexey Sorokin arxiv

In this work we present the first morphologically annotated corpus for Iron Ossetic that conforms to the Universal Dependencies schema. The corpus includes 5454 manually annotated sentences from the Iron Ossetic Corpus o…

"Set It Up": Functional Object Arrangement with Compositional Generative Models (Journal Version)

2025-08-04 · Yiqing Xu, Jiayuan Mao, Linfeng Li, Yilun Du 외 arxiv

Functional object arrangement (FORM) is the task of arranging objects to fulfill a function, e.g., "set up a dining table for two". One key challenge here is that the instructions for FORM are often under-specified and d…