CAZSL: Zero-Shot Regression for Pushing Models by Generalizing Through Context

2020-03-26 · Wenyu Zhang, Skyler Seto, Devesh K. Jha

Learning accurate models of the physical world is required for a lot of robotic manipulation tasks. However, during manipulation, robots are expected to interact with unknown workpieces so that building predictive models which can generalize over a number of these objects is highly desirable. In this paper, we study the problem of designing deep learning agents which can generalize their models of the physical world by building context-aware learning models. The purpose of these agents is to quickly adapt and/or generalize their notion of physics of interaction in the real world based on certain features about the interacting objects that provide different contexts to the predictive models. With this motivation, we present context-aware zero shot learning (CAZSL, pronounced as casual) models, an approach utilizing a Siamese network architecture, embedding space masking and regularization based on context variables which allows us to learn a model that can generalize to different parameters or features of the interacting objects. We test our proposed learning algorithm on the recently released Omnipush datatset that allows testing of meta-learning capabilities using low-dimensional data. Codes for CAZSL are available at https://www.merl.com/research/license/CAZSL.

📄 PDF Abstract BibTeX arXiv:2003.11696

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-Learning regression Zero-Shot Learning

Methods 이 논문이 사용한 방법론

Siamese Network 설명 없음

CosmoCLIP: Generalizing Large Vision-Language Models for Astronomical Imaging

2024-07-10 · Raza Imam, Mohammed Talha Alam, Umaima Rahman, Mohsen Guizani 외

Existing vision-text contrastive learning models enhance representation transferability and support zero-shot prediction by matching paired image and caption embeddings while pushing unrelated pairs apart. However, astro…

Contrastive Learning Image-text Retrieval Retrieval Text Retrieval+2

Zero-shot Interactive Perception

2026-02-20 · Venkatesh Sripada, Frank Guerin, Amir Ghalamzan arxiv

Interactive perception (IP) enables robots to extract hidden information in their workspace and execute manipulation plans by physically interacting with objects and altering the state of the environment -- crucial for r…

A Single Diffusion-Policy Controller for Multi-Task Block Pushing with Zero-Shot Sim-to-Real Transfer

2026-07-12 · Haitong Ma, Haldun Balim, Yang Hu, Bo Dai 외 arxiv

Diffusion policies have shown promising empirical performance in representing and learning complex maneuvers for robots using behavior cloning (BC). In this paper, we explore training diffusion policies from scratch usin…

Reinforcement Learning

Generalizable Semantic Vision Query Generation for Zero-shot Panoptic and Semantic Segmentation

2024-02-21 · Jialei Chen, Daisuke Deguchi, Chenkai Zhang, Hiroshi Murase

Zero-shot Panoptic Segmentation (ZPS) aims to recognize foreground instances and background stuff without images containing unseen categories in training. Due to the visual data sparsity and the difficulty of generalizin…

Open Vocabulary Semantic Segmentation Open-Vocabulary Semantic Segmentation Panoptic Segmentation Semantic Segmentation

Slot Dependency Modeling for Zero-Shot Cross-Domain Dialogue State Tracking

2022-10-01 · COLING 2022 10 · Qingyue Wang, Yanan Cao, Piji Li, Yanhe Fu 외

Zero-shot learning for Dialogue State Tracking (DST) focuses on generalizing to an unseen domain without the expense of collecting in domain data. However, previous zero-shot DST methods ignore the slot dependencies in a…

Dialogue State Tracking Zero-Shot Learning