paper-with-me

Papers

IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigation

2024-10-25 · Kaixian Qu, Jie Tan, Tingnan Zhang, Fei Xia, Cesar Cadena, Marco Hutter

Navigating efficiently to an object in an unexplored environment is a critical skill for general-purpose intelligent robots. Recent approaches to this object goal navigation problem have embraced a modular strategy, integrating classical exploration algorithms-notably frontier exploration-with a learned semantic mapping/exploration module. This paper introduces a novel informative path planning and 3D object probability mapping approach. The mapping module computes the probability of the object of interest through semantic segmentation and a Bayes filter. Additionally, it stores probabilities for common objects, which semantically guides the exploration based on common sense priors from a large language model. The planner terminates when the current viewpoint captures enough voxels identified with high confidence as the object of interest. Although our planner follows a zero-shot approach, it achieves state-of-the-art performance as measured by the Success weighted by Path Length (SPL) and Soft SPL in the Habitat ObjectNav Challenge 2023, outperforming other works by more than 20%. Furthermore, we validate its effectiveness on real robots. Project webpage: https://ippon-paper.github.io/

📄 PDF Abstract BibTeX arXiv:2410.19697

Code (0)

등록된 구현이 없습니다.

Tasks

Common Sense ReasoningLanguage ModelingLanguage ModellingLarge Language ModelObjectSemantic Segmentation

Methods 이 논문이 사용한 방법론

SPL 설명 없음

Similar Papers 제목 키워드 기반

Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Paths

2020-09-24 · Asian Chapter of the Association for Computational Linguistics 2020 · Haozhe Ji, Pei Ke, Shaohan Huang, Furu Wei 외

Commonsense explanation generation aims to empower the machine's sense-making capability by generating plausible explanations to statements against commonsense. While this task is easy to human, the machine still struggl…

Explanation Generation

Improving Response Diversity through Commonsense-Aware Empathetic Response Generation

2022-11-01 · ROCLING 2022 11 · Tzu-Hsien Huang, Chia-Hui Chang

Due to the lack of conversation practice, the main challenge for the second-language learners is speaking. Our goal is to develop a chatbot to encourage individuals to reflect, describe, analyse and communicate what they…

ChatbotDiversityEmpathetic Response GenerationResponse Generation

Social Commonsense-Guided Search Query Generation for Open-Domain Knowledge-Powered Conversations

2023-10-22 · Revanth Gangi Reddy, Hao Bai, Wentao Yao, Sharath Chandra Etagi Suresh 외

Open-domain dialog involves generating search queries that help obtain relevant knowledge for holding informative conversations. However, it can be challenging to determine what information to retrieve when the user is p…

Open-Domain DialogResponse Generation

Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs

2019-11-07 · ACL 2020 6 · Houyu Zhang, Zheng-Hao Liu, Chenyan Xiong, Zhiyuan Liu

Human conversations naturally evolve around related concepts and scatter to multi-hop concepts. This paper presents a new conversation generation model, ConceptFlow, which leverages commonsense knowledge graphs to explic…

Knowledge Graphs

CEM: Commonsense-aware Empathetic Response Generation

2021-09-13 · Sahand Sabour, Chujie Zheng, Minlie Huang

A key trait of daily conversations between individuals is the ability to express empathy towards others, and exploring ways to implement empathy is a crucial step towards human-like dialogue systems. Previous approaches …

Empathetic Response GenerationResponse Generation