MAVOT: Memory-Augmented Video Object Tracking
We introduce a one-shot learning approach for video object tracking. The proposed algorithm requires seeing the object to be tracked only once, and employs an external memory to store and remember the evolving features of the foreground object as well as backgrounds over time during tracking. With the relevant memory retrieved and updated in each tracking, our tracking model is capable of maintaining long-term memory of the object, and thus can naturally deal with hard tracking scenarios including partial and total occlusion, motion changes and large scale and shape variations. In our experiments we use the ImageNet ILSVRC2015 video detection dataset to train and use the VOT-2016 benchmark to test and compare our Memory-Augmented Video Object Tracking (MAVOT) model. From the results, we conclude that given its oneshot property and simplicity in design, MAVOT is an attractive approach in visual tracking because it shows good performance on VOT-2016 benchmark and is among the top 5 performers in accuracy and robustness in occlusion, motion changes and empty target.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject TrackingOne-Shot LearningVideo Object TrackingVisual TrackingSimilar Papers 제목 키워드 기반
DAWN: Dual Augmented Memory Network for Unsupervised Video Object Tracking
Psychological studies have found that human visual tracking system involves learning, memory, and planning. Despite recent successes, not many works have focused on memory and planning in deep learning based tracking. We…
Object TrackingVideo Object TrackingVisual TrackingMeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Tracking
As a video task, Multiple Object Tracking (MOT) is expected to capture temporal information of targets effectively. Unfortunately, most existing methods only explicitly exploit the object features between adjacent frames…
Multi-Object TrackingMultiple Object TrackingObjectObject TrackingVideoAgent: A Memory-augmented Multimodal Agent for Video Understanding
We explore how reconciling several foundation models (large language models and vision-language models) with a novel unified memory mechanism could tackle the challenging video understanding problem, especially capturing…
EgoSchemaVideo UnderstandingMemory-Augmented SAM2 for Training-Free Surgical Video Segmentation
Surgical video segmentation is a critical task in computer-assisted surgery, essential for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has demonstrated remarka…
SegmentationSemantic SegmentationVideo Object SegmentationVideo Segmentation+1RAVU: Retrieval Augmented Video Understanding with Compositional Reasoning over Graph
Comprehending long videos remains a significant challenge for Large Multi-modal Models (LMMs). Current LMMs struggle to process even minutes to hours videos due to their lack of explicit memory and retrieval mechanisms. …
EgoSchemaRetrievalVideo Understanding