paper-with-me

홈 › Papers

$T^2$ of Thoughts: Temperature Tree Elicits Reasoning in Large Language Models

2024-05-23 · Chengkun Cai, Xu Zhao, Yucheng Du, Haoliang Liu, Lei LI

Large Language Models (LLMs) have emerged as powerful tools in artificial intelligence, especially in complex decision-making scenarios, but their static problem-solving strategies often limit their adaptability to dynamic environments. We explore the enhancement of reasoning capabilities in LLMs through Temperature Tree ($T^2$) prompting via Particle Swarm Optimization, termed as $T^2$ of Thoughts ($T^2oT$). The primary focus is on enhancing decision-making processes by dynamically adjusting search parameters, especially temperature, to improve accuracy without increasing computational demands. We empirically validate that our hybrid $T^2oT$ approach yields enhancements in, single-solution accuracy, multi-solution generation and text generation quality. Our findings suggest that while dynamic search depth adjustments based on temperature can yield mixed results, a fixed search depth, when coupled with adaptive capabilities of $T^2oT$, provides a more reliable and versatile problem-solving strategy. This work highlights the potential for future explorations in optimizing algorithmic interactions with foundational language models, particularly illustrated by our development for the Game of 24 and Creative Writing tasks.

📄 PDF Abstract BibTeX arXiv:2405.14075

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingText Generation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts

2026-02-15 · Zachary Bamberger, Till R. Saenger, Gilad Morad, Ofra Amir 외 arxiv

Inference-Time-Compute (ITC) methods like Best-of-N and Tree-of-Thoughts are meant to produce output candidates that are both high-quality and diverse, but their use of high-temperature sampling often fails to achieve me…

Text Generation

Framework of Thoughts: A Foundation Framework for Dynamic and Optimized Reasoning based on Chains, Trees, and Graphs

2026-02-18 · Felix Fricke, Simon Malberg, Georg Groh arxiv

Prompting schemes such as Chain of Thought, Tree of Thoughts, and Graph of Thoughts can significantly enhance the reasoning capabilities of large language models. However, most existing schemes require users to define st…

Tree of Uncertain Thoughts Reasoning for Large Language Models

2023-09-14 · Shentong Mo, Miao Xin

While the recently introduced Tree of Thoughts (ToT) has heralded advancements in allowing Large Language Models (LLMs) to reason through foresight and backtracking for global decision-making, it has overlooked the inher…

Decision MakingResponse GenerationUncertainty Quantification

Empowering Multi-step Reasoning across Languages via Tree-of-Thoughts

2023-11-14 · Leonardo Ranaldi, Giulia Pucci, Federico Ranaldi, Elena Sofia Ruzzetti 외

Reasoning methods, best exemplified by the well-known Chain-of-Thought (CoT), empower the reasoning abilities of Large Language Models (LLMs) by eliciting them to solve complex tasks in a step-by-step manner. Although th…

Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models

2024-02-17 · Sijia Chen, Baochun Li, Di Niu

The reasoning performance of Large Language Models (LLMs) on a wide range of problems critically relies on chain-of-thought prompting, which involves providing a few chain of thought demonstrations as exemplars in prompt…