paper-with-me

Papers

Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examples

2024-02-12 · Qingkai Zeng, Yuyang Bai, Zhaoxuan Tan, Shangbin Feng, Zhenwen Liang, Zhihan Zhang, Meng Jiang

Automatic taxonomy induction is crucial for web search, recommendation systems, and question answering. Manual curation of taxonomies is expensive in terms of human effort, making automatic taxonomy construction highly desirable. In this work, we introduce Chain-of-Layer which is an in-context learning framework designed to induct taxonomies from a given set of entities. Chain-of-Layer breaks down the task into selecting relevant candidate entities in each layer and gradually building the taxonomy from top to bottom. To minimize errors, we introduce the Ensemble-based Ranking Filter to reduce the hallucinated content generated at each iteration. Through extensive experiments, we demonstrate that Chain-of-Layer achieves state-of-the-art performance on four real-world benchmarks.

📄 PDF Abstract BibTeX arXiv:2402.07386

Code (1)

qingkaizeng/chain-of-layer 공식 구현 pytorch

Tasks

In-Context LearningQuestion AnsweringRecommendation Systems

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models

2024-02-17 · Sijia Chen, Baochun Li, Di Niu

The reasoning performance of Large Language Models (LLMs) on a wide range of problems critically relies on chain-of-thought prompting, which involves providing a few chain of thought demonstrations as exemplars in prompt…

Layered Chain-of-Thought Prompting for Multi-Agent LLM Systems: A Comprehensive Approach to Explainable Large Language Models

2025-01-29 · Manish Sanwal

Large Language Models (LLMs) leverage chain-of-thought (CoT) prompting to provide step-by-step rationales, improving performance on complex tasks. Despite its benefits, vanilla CoT often fails to fully verify intermediat…

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

2022-01-28 · Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma 외

We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning. In particular, we show how such reason…

Common Sense ReasoningGSM8KLanguage ModelingLanguage Modelling+2

SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine

2024-10-22 · Xiaochen Wang, Junqing He, Liang Chen, Reza Haf Zhe Yang 외

Large Language Models with chain-of-thought prompting, such as OpenAI-o1, have shown impressive capabilities in natural language inference tasks. However, Multi-hop Question Answering (MHQA) remains challenging for many …

HallucinationMulti-hop Question AnsweringNatural Language InferenceQuestion Answering

Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling

2023-05-17 · Weijia Xu, Andrzej Banburski-Fahey, Nebojsa Jojic

We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recip…