paper-with-me

홈 › Papers

A Divide-Align-Conquer Strategy for Program Synthesis

2023-01-08 · Jonas Witt, Sebastijan Dumančić, Tias Guns, Claus-Christian Carbon

A major bottleneck in search-based program synthesis is the exponentially growing search space which makes learning large programs intractable. Humans mitigate this problem by leveraging the compositional nature of the real world: In structured domains, a logical specification can often be decomposed into smaller, complementary solution programs. We show that compositional segmentation can be applied in the programming by examples setting to divide the search for large programs across multiple smaller program synthesis problems. For each example, we search for a decomposition into smaller units which maximizes the reconstruction accuracy in the output under a latent task program. A structural alignment of the constituent parts in the input and output leads to pairwise correspondences used to guide the program synthesis search. In order to align the input/output structures, we make use of the Structure-Mapping Theory (SMT), a formal model of human analogical reasoning which originated in the cognitive sciences. We show that decomposition-driven program synthesis with structural alignment outperforms Inductive Logic Programming (ILP) baselines on string transformation tasks even with minimal knowledge priors. Unlike existing methods, the predictive accuracy of our agent monotonically increases for additional examples and achieves an average time complexity of $\mathcal{O}(m)$ in the number $m$ of partial programs for highly structured domains such as strings. We extend this method to the complex setting of visual reasoning in the Abstraction and Reasoning Corpus (ARC) for which ILP methods were previously infeasible.

📄 PDF Abstract BibTeX arXiv:2301.03094

Code (0)

등록된 구현이 없습니다.

Tasks

ARCInductive logic programmingProgram SynthesisVisual Reasoning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Learning logic programs through divide, constrain, and conquer

2021-09-16 · Andrew Cropper

We introduce an inductive logic programming approach that combines classical divide-and-conquer search with modern constraint-driven search. Our anytime approach can learn optimal, recursive, and large programs and suppo…

Inductive logic programmingProgram Synthesis

An Examination on the Effectiveness of Divide-and-Conquer Prompting in Large Language Models

2024-02-08 · Yizhou Zhang, Lun Du, Defu Cao, Qiang Fu 외

Foundation models, such as Large language Models (LLMs), have attracted significant amount of interest due to their large number of applications. However, when handling tasks involving repetitive sub-tasks and/or decepti…

Fact VerificationFake News DetectionHallucinationMisinformation

Improve Sentence Alignment by Divide-and-conquer

2022-01-18 · Wu Zhang

In this paper, we introduce a divide-and-conquer algorithm to improve sentence alignment speed. We utilize external bilingual sentence embeddings to find accurate hard delimiters for the parallel texts to be aligned. We …

Optical Character Recognition (OCR)SentenceSentence Embeddings

Divide, Conquer, and Combine: a New Inference Strategy for Probabilistic Programs with Stochastic Support

2019-10-29 · ICML 2020 1 · Yuan Zhou, Hongseok Yang, Yee Whye Teh, Tom Rainforth

Universal probabilistic programming systems (PPSs) provide a powerful framework for specifying rich probabilistic models. They further attempt to automate the process of drawing inferences from these models, but doing th…

Probabilistic Programming

Divide-and-Conquer Large Scale Capacitated Arc Routing Problems with Route Cutting Off Decomposition

2019-12-29 · Yuzhou Zhang, Yi Mei, Buzhong Zhang, Keqin Jiang

The capacitated arc routing problem is a very important problem with many practical applications. This paper focuses on the large scale capacitated arc routing problem. Traditional solution optimization approaches usuall…

ARCProblem Decomposition