paper-with-me

Papers

LLMs Think, But Not In Your Flow: Reasoning-Level Personalization for Black-Box Large Language Models

2025-05-27 · Jieyong Kim, Tongyoung Kim, Soojin Yoon, Jaehyung Kim, Dongha Lee

Large language models (LLMs) have recently achieved impressive performance across a wide range of natural language tasks and are now widely used in real-world applications. Among them, black-box LLMs--served via APIs without access to model internals--are especially dominant due to their scalability and ease of deployment. Despite their strong capabilities, these models typically produce generalized responses that overlook personal preferences and reasoning styles. This has led to growing interest in black-box LLM personalization, which aims to tailor model outputs to user-specific context without modifying model parameters. However, existing approaches primarily focus on response-level personalization, attempting to match final outputs without modeling personal thought process. To address this limitation, we propose RPM, a framework for reasoning-level personalization that aligns the model's reasoning process with a user's personalized logic. RPM first constructs statistical user-specific factors by extracting and grouping response-influential features from user history. It then builds personalized reasoning paths that reflect how these factors are used in context. In the inference stage, RPM retrieves reasoning-aligned examples for new queries via feature-level similarity and performs inference conditioned on the structured factors and retrieved reasoning paths, enabling the model to follow user-specific reasoning trajectories. This reasoning-level personalization enhances both predictive accuracy and interpretability by grounding model outputs in user-specific logic through structured information. Extensive experiments across diverse tasks show that RPM consistently outperforms response-level personalization methods, demonstrating the effectiveness of reasoning-level personalization in black-box LLMs.

📄 PDF Abstract BibTeX arXiv:2505.21082

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

HugAgent: Benchmarking LLMs for Simulation of Individualized Human Reasoning

2025-10-16 · Chance Jiajie Li, Zhenze Mo, Yuhan Tang, Ao Qu 외 arxiv

Simulating human reasoning in open-ended tasks has long been a central aspiration in AI and cognitive science. While large language models now approximate human responses at scale, they remain tuned to population-level c…

HDFlow: Enhancing LLM Complex Problem-Solving with Hybrid Thinking and Dynamic Workflows

2024-09-25 · Wenlin Yao, Haitao Mi, Dong Yu

Despite recent advancements in large language models (LLMs), their performance on complex reasoning problems requiring multi-step thinking and combining various skills is still limited. To address this, we propose a nove…

Computational Efficiency

Latent Thinking Optimization: Your Latent Reasoning Language Model Secretly Encodes Reward Signals in Its Latent Thoughts

2025-09-30 · Hanwen Du, Yuxin Dong, Xia Ning arxiv

Large Language Models (LLMs) excel at problem solving by generating chain of thoughts in natural language, but such verbal thinking is computationally costly and prone to overthinking. A recent work instead proposes a la…

ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learning

2025-03-12 · Ziyu Wan, Yunxiang Li, Xiaoyu Wen, Yan Song 외

Recent research on Reasoning of Large Language Models (LLMs) has sought to further enhance their performance by integrating meta-thinking -- enabling models to monitor, evaluate, and control their reasoning processes for…

Multi-agent Reinforcement Learningreinforcement-learningReinforcement Learning

Think Socially via Cognitive Reasoning

2025-09-26 · Jinfeng Zhou, Zheyu Chen, Shuai Wang, Quanyu Dai 외 arxiv

LLMs trained for logical reasoning excel at step-by-step deduction to reach verifiable answers. However, this paradigm is ill-suited for navigating social situations, which induce an interpretive process of analyzing amb…

Reinforcement LearningLogical Reasoning