Extrapolating Volition with Recursive Information Markets
One of the impediments to the efficiency of information markets is the inherent information asymmetry present in them, exacerbated by the "buyer's inspection paradox" (the buyer cannot mitigate the asymmetry by "inspecting" the information, because in doing so the buyer obtains the information without paying for it). Previous work has suggested that using Large Language Model (LLM) buyers to inspect and purchase information could overcome this information asymmetry, as an LLM buyer can simply "forget" the information it inspects. In this work, we analyze this mechanism formally through a "value-of-information" paradigm, i.e. whether it incentivizes information to be priced and provided in accordance with its "true value". We focus in particular on our new recursive version of the mechanism, which we believe has a range of applications including in AI alignment research, where it is related to Extrapolated Volition and Scalable Oversight.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
RISE: Recursive Improvement via Self-Extrapolating Policy Distillation
On-policy distillation (OPD) provides dense, per-token supervision for language model post-training, but its effectiveness is bottlenecked by teacher quality: external teachers suffer from distribution mismatch, while se…
Mathematical ReasoningCode GenerationBrief Notes on Hard Takeoff, Value Alignment, and Coherent Extrapolated Volition
I make some basic observations about hard takeoff, value alignment, and coherent extrapolated volition, concepts which have been central in analyses of superintelligent AI systems.
Entity-Level Sentiment Analysis (ELSA): An exploratory task survey
This paper explores the task of identifying the overall sentiment expressed towards volitional entities (persons and organizations) in a document -- what we refer to as Entity-Level Sentiment Analysis (ELSA). While ident…
coreference-resolutionCoreference ResolutionSentenceSentiment Analysis+1Forecast Combinations in the Presence of Structural Breaks Evidence from U.S. Equity Markets
Realized volatility, building on the theory of a simple continuous time process, has recently received attention as a nonparametric ex-post estimate of the return variation. This paper addresses the problem of paramete…
Neural-Symbolic Recursive Machine for Systematic Generalization
Current learning models often struggle with human-like systematic generalization, particularly in learning compositional rules from limited data and extrapolating them to novel combinations. We introduce the Neural-Symbo…
Arithmetic ReasoningMachine TranslationSemantic ParsingSystematic Generalization