EHOP: A Dataset of Everyday NP-Hard Optimization Problems
We introduce the dataset of Everyday Hard Optimization Problems (EHOP), a collection of NP-hard optimization problems expressed in natural language. EHOP includes problem formulations that could be found in computer science textbooks, versions that are dressed up as problems that could arise in real life, and variants of well-known problems with inverted rules. We find that state-of-the-art LLMs, across multiple prompting strategies, systematically solve textbook problems more accurately than their real-life and inverted counterparts. We argue that this constitutes evidence that LLMs adapt solutions seen during training, rather than leveraging reasoning abilities that would enable them to generalize to novel problems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DefakeHop++: An Enhanced Lightweight Deepfake Detector
On the basis of DefakeHop, an enhanced lightweight Deepfake detector called DefakeHop++ is proposed in this work. The improvements lie in two areas. First, DefakeHop examines three facial regions (i.e., two eyes and mout…
Face SwappingDefakeHop: A Light-Weight High-Performance Deepfake Detector
A light-weight high-performance Deepfake detection method, called DefakeHop, is proposed in this work. State-of-the-art Deepfake detection methods are built upon deep neural networks. DefakeHop extracts features automati…
DeepFake DetectionDimensionality ReductionFace SwappingVocal Bursts Intensity PredictionFaceHop: A Light-Weight Low-Resolution Face Gender Classification Method
A light-weight low-resolution face gender classification method, called FaceHop, is proposed in this research. We have witnessed rapid progress in face gender classification accuracy due to the adoption of deep learning …
ClassificationGender ClassificationGeneral ClassificationGeo-DefakeHop: High-Performance Geographic Fake Image Detection
A robust fake satellite image detection method, called Geo-DefakeHop, is proposed in this work. Geo-DefakeHop is developed based on the parallel subspace learning (PSL) methodology. PSL maps the input image space into se…
Fake Image DetectionVocal Bursts Intensity PredictionTreeHop: Generate and Filter Next Query Embeddings Efficiently for Multi-hop Question Answering
Retrieval-augmented generation (RAG) systems face significant challenges in multi-hop question answering (MHQA), where complex queries require synthesizing information across multiple document chunks. Existing approaches…
Multi-hop Question AnsweringQuestion AnsweringRAGRetrieval+1