paper-with-me

홈 › Papers

Learning to Reason over Scene Graphs: A Case Study of Finetuning GPT-2 into a Robot Language Model for Grounded Task Planning

2023-05-12 · Georgia Chalvatzaki, Ali Younes, Daljeet Nandha, An Le, Leonardo F. R. Ribeiro, Iryna Gurevych

Long-horizon task planning is essential for the development of intelligent assistive and service robots. In this work, we investigate the applicability of a smaller class of large language models (LLMs), specifically GPT-2, in robotic task planning by learning to decompose tasks into subgoal specifications for a planner to execute sequentially. Our method grounds the input of the LLM on the domain that is represented as a scene graph, enabling it to translate human requests into executable robot plans, thereby learning to reason over long-horizon tasks, as encountered in the ALFRED benchmark. We compare our approach with classical planning and baseline methods to examine the applicability and generalizability of LLM-based planners. Our findings suggest that the knowledge stored in an LLM can be effectively grounded to perform long-horizon task planning, demonstrating the promising potential for the future application of neuro-symbolic planning methods in robotics.

📄 PDF Abstract BibTeX arXiv:2305.07716

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingTask Planning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Multi-Head Attention 설명 없음
Attention 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question Answering

2021-07-13 · Rajat Koner, Hang Li, Marcel Hildebrandt, Deepan Das 외

Visual Question Answering (VQA) is concerned with answering free-form questions about an image. Since it requires a deep semantic and linguistic understanding of the question and the ability to associate it with various …

NavigateQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Understanding the Role of Scene Graphs in Visual Question Answering

2021-01-14 · Vinay Damodaran, Sharanya Chakravarthy, Akshay Kumar, Anjana Umapathy 외

Visual Question Answering (VQA) is of tremendous interest to the research community with important applications such as aiding visually impaired users and image-based search. In this work, we explore the use of scene gra…

Graph GenerationQuestion AnsweringScene Graph GenerationVisual Question Answering+1

SelfGraphVQA: A Self-Supervised Graph Neural Network for Scene-based Question Answering

2023-10-03 · Bruno Souza, Marius Aasan, Helio Pedrini, Adín Ramírez Rivera

The intersection of vision and language is of major interest due to the increased focus on seamless integration between recognition and reasoning. Scene graphs (SGs) have emerged as a useful tool for multimodal image ana…

Graph Neural NetworkQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning

2018-07-16 · Paul Gay, Stuart James, Alessio Del Bue

Recent approaches on visual scene understanding attempt to build a scene graph -- a computational representation of objects and their pairwise relationships. Such rich semantic representation is very appealing, yet diffi…

3d scene graph generationGraph GenerationScene Graph GenerationScene Understanding

Variational Amodal Object Completion

2020-12-01 · NeurIPS 2020 12 · Huan Ling, David Acuna, Karsten Kreis, Seung Wook Kim 외

In images of complex scenes, objects are often occluding each other which makes perception tasks such as object detection and tracking, or robotic control tasks such as planning, challenging. To facilitate downstream tas…

Objectobject-detectionObject Detection