paper-with-me

홈 › Papers

Retouchdown: Adding Touchdown to StreetLearn as a Shareable Resource for Language Grounding Tasks in Street View

2020-01-10 · Harsh Mehta, Yoav Artzi, Jason Baldridge, Eugene Ie, Piotr Mirowski

The Touchdown dataset (Chen et al., 2019) provides instructions by human annotators for navigation through New York City streets and for resolving spatial descriptions at a given location. To enable the wider research community to work effectively with the Touchdown tasks, we are publicly releasing the 29k raw Street View panoramas needed for Touchdown. We follow the process used for the StreetLearn data release (Mirowski et al., 2019) to check panoramas for personally identifiable information and blur them as necessary. These have been added to the StreetLearn dataset and can be obtained via the same process as used previously for StreetLearn. We also provide a reference implementation for both of the Touchdown tasks: vision and language navigation (VLN) and spatial description resolution (SDR). We compare our model results to those given in Chen et al. (2019) and show that the panoramas we have added to StreetLearn fully support both Touchdown tasks and can be used effectively for further research and comparison.

📄 PDF Abstract BibTeX arXiv:2001.03671

Code (4)

google-research/valan 공식 구현 tf
VegB/VLN-Transformer pytorch
clic-lab/touchdown pytorch
lil-lab/touchdown pytorch

Tasks

Vision and Language Navigation

Similar Papers 제목 키워드 기반

Retouchdown: Releasing Touchdown on StreetLearn as a Public Resource for Language Grounding Tasks in Street View

2020-11-01 · EMNLP (SpLU) 2020 11 · Harsh Mehta, Yoav Artzi, Jason Baldridge, Eugene Ie 외

The Touchdown dataset (Chen et al., 2019) provides instructions by human annotators for navigation through New York City streets and for resolving spatial descriptions at a given location. To enable the wider research co…

Vision and Language Navigation

Learning to Navigate in Cities Without a Map

2018-03-31 · NeurIPS 2018 12 · Piotr Mirowski, Matthew Koichi Grimes, Mateusz Malinowski, Karl Moritz Hermann 외

Navigating through unstructured environments is a basic capability of intelligent creatures, and thus is of fundamental interest in the study and development of artificial intelligence. Long-range navigation is a complex…

Autonomous NavigationDeep Reinforcement LearningNavigatereinforcement-learning+2

Multi-Player Multi-Armed Bandits with Finite Shareable Resources Arms: Learning Algorithms & Applications

2022-04-28 · Xuchuang Wang, Hong Xie, John C. S. Lui

Multi-player multi-armed bandits (MMAB) study how decentralized players cooperatively play the same multi-armed bandit so as to maximize their total cumulative rewards. Existing MMAB models mostly assume when more than o…

Edge-computingMulti-Armed Bandits

Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environments

2018-11-29 · CVPR 2019 6 · Howard Chen, Alane Suhr, Dipendra Misra, Noah Snavely 외

We study the problem of jointly reasoning about language and vision through a navigation and spatial reasoning task. We introduce the Touchdown task and dataset, where an agent must first follow navigation instructions i…

PositionSpatial ReasoningVision and Language Navigation

The StreetLearn Environment and Dataset

2019-03-04 · Piotr Mirowski, Andras Banki-Horvath, Keith Anderson, Denis Teplyashin 외

Navigation is a rich and well-grounded problem domain that drives progress in many different areas of research: perception, planning, memory, exploration, and optimisation in particular. Historically these challenges hav…

Cross-View Geo-LocalisationDecision MakingReinforcement Learning