Learning Web-based Procedures by Reasoning over Explanations and Demonstrations in Context
We explore learning web-based tasks from a human teacher through natural language explanations and a single demonstration. Our approach investigates a new direction for semantic parsing that models explaining a demonstration in a context, rather than mapping explanations to demonstrations. By leveraging the idea of inverse semantics from program synthesis to reason backwards from observed demonstrations, we ensure that all considered interpretations are consistent with executable actions in any context, thus simplifying the problem of search over logical forms. We present a dataset of explanations paired with demonstrations for web-based tasks. Our methods show better task completion rates than a supervised semantic parsing baseline (40{\%} relative improvement on average), and are competitive with simple exploration-and-demonstration based methods, while requiring no exploration of the environment. In learning to align explanations with demonstrations, basic properties of natural language syntax emerge as learned behavior. This is an interesting example of pragmatic language acquisition without any linguistic annotation.
Code (0)
등록된 구현이 없습니다.
Tasks
Language AcquisitionProgram SynthesisSemantic ParsingSimilar Papers 제목 키워드 기반
Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
Retrieval-augmented generation (RAG) has emerged as a critical mechanism in contemporary NLP to support Large Language Models(LLMs) in systematically accessing richer factual context. However, the integration of RAG mech…
RAGRetrievalRetrieval-augmented GenerationHarnessing LLMs Explanations to Boost Surrogate Models in Tabular Data Classification
Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements…
Explanation GenerationIn-Context LearningACIL: Auto Chain of Thoughts for In-Context Learning
Recent advances in large language models (LLMs) have shown that Chain-of-Thought (CoT) reasoning can substantially improve performance on complex reasoning tasks. At the same time, In-Context Learning (ICL) has become an…
Large Language Models are In-context Teachers for Knowledge Reasoning
In this work, we study in-context teaching (ICT), where a teacher provides in-context example rationales to teach a student to reason over unseen cases. Human teachers are usually required to craft in-context demonstrati…
In-Context LearningInformation RetrievalLarge Language ModelMedical Question Answering+3Can In-context Learners Learn a Reasoning Concept from Demonstrations?
Language models exhibit an emergent ability to learn a new task from a small number of input-output demonstrations. However, recent work shows that in-context learners largely rely on their pre-trained knowledge, such as…
Few-Shot LearningIn-Context Learning