Papers Procedure Learning
“Procedure Learning” 태그가 달린 논문 15편 · 필터 해제
HiERO: understanding the hierarchy of human behavior enhances reasoning on egocentric videos
Human activities are particularly complex and variable, and this makes challenging for deep learning models to reason about them. However, we note that such variability does have an underlying structure, composed of a hi…
Procedure LearningDecomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency
Human learning relies on specialization -- distinct cognitive mechanisms working together to enable rapid learning. In contrast, most modern neural networks rely on a single mechanism: gradient descent over an objective …
Procedure LearningEAGLE: Egocentric AGgregated Language-video Engine
The rapid evolution of egocentric video analysis brings new insights into understanding human activities and intentions from a first-person perspective. Despite this progress, the fragmentation in tasks like action recog…
Action RecognitionActivity RecognitionLanguage ModelingLanguage Modelling+5CaptainCook4D: A Dataset for Understanding Errors in Procedural Activities
Following step-by-step procedures is an essential component of various activities carried out by individuals in their daily lives. These procedures serve as a guiding framework that helps to achieve goals efficiently, wh…
Procedure LearningCollaborative Weakly Supervised Video Correlation Learning for Procedure-Aware Instructional Video Analysis
Video Correlation Learning (VCL), which aims to analyze the relationships between videos, has been widely studied and applied in various general video tasks. However, applying VCL to instructional videos is still quite c…
Action Quality AssessmentProcedure LearningUnited We Stand, Divided We Fall: UnityGraph for Unsupervised Procedure Learning from Videos
Given multiple videos of the same task, procedure learning addresses identifying the key-steps and determining their order to perform the task. For this purpose, existing approaches use the signal generated from a pair o…
Procedure LearningPARL: A Unified Framework for Policy Alignment in Reinforcement Learning from Human Feedback
We present a novel unified bilevel optimization-based framework, \textsf{PARL}, formulated to address the recently highlighted critical issue of policy alignment in reinforcement learning using utility or preference-base…
Bilevel OptimizationProcedure Learningreinforcement-learningReinforcement Learning (RL)AutoLaparo: A New Dataset of Integrated Multi-tasks for Image-guided Surgical Automation in Laparoscopic Hysterectomy
Computer-assisted minimally invasive surgery has great potential in benefiting modern operating theatres. The video data streamed from the endoscope provides rich information to support context-awareness for next-generat…
Anatomymotion predictionProcedure LearningScene UnderstandingMy View is the Best View: Procedure Learning from Egocentric Videos
Procedure learning involves identifying the key-steps and determining their logical order to perform a task. Existing approaches commonly use third-person videos for learning the procedure, making the manipulated object …
Procedure LearningIntroduction to Soar
This paper is the recommended initial reading for a functional overview of Soar, version 9.6. It includes an abstract overview of the architectural structure of Soar including its processing, memories, learning modules, …
ChunkingDecision MakingProcedure LearningReinforcement Learning (RL)+1Decomposed Inductive Procedure Learning
Recent advances in machine learning have made it possible to train artificially intelligent agents that perform with super-human accuracy on a great diversity of complex tasks. However, the process of training these capa…
Procedure LearningSelf-Supervised Multi-Task Procedure Learning from Instructional Videos
We address the problem of unsupervised procedure learning from instructional videos of multiple tasks using Deep Neural Networks (DNNs). Unlike existing works, we assume that training videos come from multiple tasks with…
Procedure LearningVideo ClassificationUnsupervised Procedure Learning via Joint Dynamic Summarization
We address the problem of unsupervised procedure learning from unconstrained instructional videos. Our goal is to produce a summary of the procedure key-steps and their ordering needed to perform a given task, as well as…
Procedure LearningPLOTS: Procedure Learning from Observations using Subtask Structure
In many cases an intelligent agent may want to learn how to mimic a single observed demonstrated trajectory. In this work we consider how to perform such procedural learning from observation, which could help to enable a…
Procedure LearningTowards Automatic Learning of Procedures from Web Instructional Videos
The potential for agents, whether embodied or software, to learn by observing other agents performing procedures involving objects and actions is rich. Current research on automatic procedure learning heavily relies on a…
Dense Video CaptioningProcedure LearningSegmentationVideo Captioning