Resource Constrained Dialog Policy Learning via Differentiable Inductive Logic Programming
Motivated by the needs of resource constrained dialog policy learning, we introduce dialog policy via differentiable inductive logic (DILOG). We explore the tasks of one-shot learning and zero-shot domain transfer with DILOG on SimDial and MultiWoZ. Using a single representative dialog from the restaurant domain, we train DILOG on the SimDial dataset and obtain 99+% in-domain test accuracy. We also show that the trained DILOG zero-shot transfers to all other domains with 99+% accuracy, proving the suitability of DILOG to slot-filling dialogs. We further extend our study to the MultiWoZ dataset achieving 90+% inform and success metrics. We also observe that these metrics are not capturing some of the shortcomings of DILOG in terms of false positives, prompting us to measure an auxiliary Action F1 score. We show that DILOG is 100x more data efficient than state-of-the-art neural approaches on MultiWoZ while achieving similar performance metrics. We conclude with a discussion on the strengths and weaknesses of DILOG.
Code (0)
등록된 구현이 없습니다.
Tasks
Inductive logic programmingOne-Shot Learningslot-fillingSlot FillingSimilar Papers 제목 키워드 기반
SUMBT+LaRL: Effective Multi-domain End-to-end Neural Task-oriented Dialog System
The recent advent of neural approaches for developing each dialog component in task-oriented dialog systems has remarkably improved, yet optimizing the overall system performance remains a challenge. Besides, previous re…
reinforcement-learningReinforcement Learning (RL)Incorporating Relational Background Knowledge into Reinforcement Learning via Differentiable Inductive Logic Programming
Relational Reinforcement Learning (RRL) can offers various desirable features. Most importantly, it allows for incorporating expert knowledge into the learning, and hence leading to much faster learning and better genera…
Deep Reinforcement LearningInductive logic programmingreinforcement-learningReinforcement Learning+2PoseAgent: Budget-Constrained 6D Object Pose Estimation via Reinforcement Learning
State-of-the-art computer vision algorithms often achieve efficiency by making discrete choices about which hypotheses to explore next. This allows allocation of computational resources to promising candidates, however, …
6D Pose Estimation using RGBPose Estimationreinforcement-learningReinforcement Learning+1RC-DARTS: Resource Constrained Differentiable Architecture Search
Recent advances show that Neural Architectural Search (NAS) method is able to find state-of-the-art image classification deep architectures. In this paper, we consider the one-shot NAS problem for resource constrained ap…
image-classificationImage ClassificationOne-Shot LearningNeural Index Policies for Restless Multi-Action Bandits with Heterogeneous Budgets
Restless multi-armed bandits (RMABs) provide a scalable framework for sequential decision-making under uncertainty, but classical formulations assume binary actions and a single global budget. Real-world settings, such a…
Multi-Armed Bandits