paper-with-me

홈 › Papers

TuringQ: Benchmarking AI Comprehension in Theory of Computation

2024-10-09 · Pardis Sadat Zahraei, Ehsaneddin Asgari

We present TuringQ, the first benchmark designed to evaluate the reasoning capabilities of large language models (LLMs) in the theory of computation. TuringQ consists of 4,006 undergraduate and graduate-level question-answer pairs, categorized into four difficulty levels and covering seven core theoretical areas. We evaluate several open-source LLMs, as well as GPT-4, using Chain of Thought prompting and expert human assessment. Additionally, we propose an automated LLM-based evaluation system that demonstrates competitive accuracy when compared to human evaluation. Fine-tuning a Llama3-8B model on TuringQ shows measurable improvements in reasoning ability and out-of-domain tasks such as algebra. TuringQ serves as both a benchmark and a resource for enhancing LLM performance in complex computational reasoning tasks. Our analysis offers insights into LLM capabilities and advances in AI comprehension of theoretical computer science.

📄 PDF Abstract BibTeX arXiv:2410.06547

Code (1)

language-modeling-lab/TuringQ 공식 구현

Tasks

Benchmarking

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Computational Implementation of a Model of Category-Theoretic Metaphor Comprehension

2026-04-11 · Fumitaka Iwaki, Miho Fuyama, Hayato Saigo, Tatsuji Takahashi arxiv

In this study, we developed a computational implementation for a model of metaphor comprehension based on the theory of indeterminate natural transformation (TINT) proposed by Fuyama et al. We simplified the algorithms i…

The Mask of Civility: Benchmarking Chinese Mock Politeness Comprehension in Large Language Models

2026-02-03 · Yitong Zhang, Yuhan Xiang, Mingxuan Liu arxiv

From a pragmatic perspective, this study systematically evaluates the differences in performance among representative large language models (LLMs) in recognizing politeness, impoliteness, and mock politeness phenomena in…

An information-theoretic model of shallow and deep language comprehension

2024-05-13 · Jiaxuan Li, Richard Futrell

A large body of work in psycholinguistics has focused on the idea that online language comprehension can be shallow or `good enough': given constraints on time or available computation, comprehenders may form interpretat…

EEGERPSentence

Benchmarking at the Edge of Comprehension

2026-02-15 · Samuele Marro, Jialin Yu, Emanuele La Malfa, Oishi Deb 외 arxiv

As frontier Large Language Models (LLMs) increasingly saturate new benchmarks shortly after they are published, benchmarking itself is at a juncture: if frontier models keep improving, it will become increasingly hard fo…

Benchmarking Machine Reading Comprehension: A Psychological Perspective

2020-04-04 · EACL 2021 2 · Saku Sugawara, Pontus Stenetorp, Akiko Aizawa

Machine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explainability beyond the model interpretation…

BenchmarkingMachine Reading ComprehensionNatural Language UnderstandingPosition+1