Image To Tree with Recursive Prompting

2023-01-01 · James Batten, Matthew Sinclair, Ben Glocker, Michiel Schaap

Extracting complex structures from grid-based data is a common key step in automated medical image analysis. The conventional solution to recovering tree-structured geometries typically involves computing the minimal cost path through intermediate representations derived from segmentation masks. However, this methodology has significant limitations in the context of projective imaging of tree-structured 3D anatomical data such as coronary arteries, since there are often overlapping branches in the 2D projection. In this work, we propose a novel approach to predicting tree connectivity structure which reformulates the task as an optimization problem over individual steps of a recursive process. We design and train a two-stage model which leverages the UNet and Transformer architectures and introduces an image-based prompting technique. Our proposed method achieves compelling results on a pair of synthetic datasets, and outperforms a shortest-path baseline.

📄 PDF Abstract BibTeX arXiv:2301.00447

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Adam 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Residual Connection 설명 없음

Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations

2022-05-24 · JaeHun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman 외

Despite their impressive capabilities, large pre-trained language models (LMs) struggle with consistent reasoning; recently, prompting LMs to generate explanations that self-guide the inference has emerged as a promising…

The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language Models

2023-05-24 · Jingyuan Qi, Zhiyang Xu, Ying Shen, Minqian Liu 외

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT he…

Language Modelling Math MMLU Question Answering+1

Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thought

2023-08-16 · Bin Lei, Pei-Hung Lin, Chunhua Liao, Caiwen Ding

Recent advancements in large-scale models, such as GPT-4, have showcased remarkable capabilities in addressing standard queries. However, when facing complex problems that require multi-step logical reasoning, their accu…

Logical Reasoning

Parsing Natural Scenes and Natural Language with Recursive Neural Networks

2011-06-01 · Proceedings of the 26th International Conference on Machine Learning (ICML) 2011 2011 6 · Richard Socher，Cliff Chiung-Yu Lin，Andrew Y. Ng，Christopher D. Manning

Recursive structure is commonly found in the inputs of different modalities such as natural scene images or natural language sentences.Discovering this recursive structure helps us to not only identify the units that an …

General Classification Scene Classification Scene Segmentation Scene Understanding+2

Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models

2023-10-23 · Gangwoo Kim, Sungdong Kim, Byeongguk Jeon, Joonsuk Park 외

Questions in open-domain question answering are often ambiguous, allowing multiple interpretations. One approach to handling them is to identify all possible interpretations of the ambiguous question (AQ) and to generate…

Open-Domain Question Answering Question Answering Retrieval