All Roads Lead to Rome: Graph-Based Confidence Estimation for Large Language Model Reasoning
Confidence estimation is essential for the reliable deployment of large language models (LLMs). Existing methods are primarily designed for factual QA tasks and often fail to generalize to reasoning tasks. To address this gap, we propose a set of training-free, graph-based confidence estimation methods tailored to reasoning tasks. Our approach models reasoning paths as directed graphs and estimates confidence by exploiting graph properties such as centrality, path convergence, and path weighting. Experiments with two LLMs on three reasoning datasets demonstrate improved confidence estimation and enhanced performance on two downstream tasks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CarSpeedNet: A Deep Neural Network-based Car Speed Estimation from Smartphone Accelerometer
We introduce the CarSpeedNet, a deep learning model designed to estimate car speed using three-axis accelerometer data from smartphones. Using 13 hours of data collected from a smartphone in cars across various roads, Ca…
LaNet: Real-time Lane Identification by Learning Road SurfaceCharacteristics from Accelerometer Data
The resolution of GPS measurements, especially in urban areas, is insufficient for identifying a vehicle's lane. In this work, we develop a deep LSTM neural network model LaNet that determines the lane vehicles are on by…
ClassificationGeneral ClassificationEAR-Net: Pursuing End-to-End Absolute Rotations from Multi-View Images
Absolute rotation estimation is an important topic in 3D computer vision. Existing works in literature generally employ a multi-stage (at least two-stage) estimation strategy where multiple independent operations (featur…
graph constructionThe road to safety- Examining the nexus between road infrastructure and crime in rural India
This study examines the relationship between road infrastructure and crime rate in rural India using a nationally representative survey. On the one hand, building roads in villages may increase connectivity, boost employ…
SurveyAddressing the Invisible: Street Address Generation for Developing Countries with Deep Learning
More than half of the world's roads lack adequate street addressing systems. Lack of addresses is even more visible in daily lives of people in developing countries. We would like to object to the assumption that having …