paper-with-me

Papers

Tracking Anything in High Quality

2023-07-26 · Jiawen Zhu, Zhenyu Chen, Zeqi Hao, Shijie Chang, Lu Zhang, Dong Wang, Huchuan Lu, Bin Luo, Jun-Yan He, Jin-Peng Lan, Hanyuan Chen, Chenyang Li

Visual object tracking is a fundamental video task in computer vision. Recently, the notably increasing power of perception algorithms allows the unification of single/multiobject and box/mask-based tracking. Among them, the Segment Anything Model (SAM) attracts much attention. In this report, we propose HQTrack, a framework for High Quality Tracking anything in videos. HQTrack mainly consists of a video multi-object segmenter (VMOS) and a mask refiner (MR). Given the object to be tracked in the initial frame of a video, VMOS propagates the object masks to the current frame. The mask results at this stage are not accurate enough since VMOS is trained on several closeset video object segmentation (VOS) datasets, which has limited ability to generalize to complex and corner scenes. To further improve the quality of tracking masks, a pretrained MR model is employed to refine the tracking results. As a compelling testament to the effectiveness of our paradigm, without employing any tricks such as test-time data augmentations and model ensemble, HQTrack ranks the 2nd place in the Visual Object Tracking and Segmentation (VOTS2023) challenge. Code and models are available at https://github.com/jiawen-zhu/HQTrack.

📄 PDF Abstract BibTeX arXiv:2307.13974

Code (1)

jiawen-zhu/hqtrack 공식 구현 pytorch

Tasks

ObjectObject TrackingSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic SegmentationVisual Object Tracking

Methods 이 논문이 사용한 방법론

Adam 설명 없음
1-bit Adam 1-bit Adam is a stochastic optimization technique that is a variant of…

Similar Papers 제목 키워드 기반

Segment Anything for Microscopy

2023-08-22 · bioRxiv 2023 8 · Anwai Archit, Sushmita Nair, Nabeel Khalid, Paul Hilt 외

We present Segment Anything for Microscopy, a tool for interactive and automatic segmentation and tracking of objects in multi-dimensional microscopy data. Our method is based on Segment Anything, a vision foundation mod…

Image SegmentationInstance SegmentationObject TrackingSegmentation+1

Track Anything: Segment Anything Meets Videos

2023-04-24 · Jinyu Yang, Mingqi Gao, Zhe Li, Shang Gao 외

Recently, the Segment Anything Model (SAM) gains lots of attention rapidly due to its impressive segmentation performance on images. Regarding its strong ability on image segmentation and high interactivity with differen…

Image SegmentationObject TrackingSegmentationSemantic Segmentation+1

SAM-DA: UAV Tracks Anything at Night with SAM-Powered Domain Adaptation

2023-07-03 · Changhong Fu, Liangliang Yao, Haobo Zuo, Guangze Zheng 외

Domain adaptation (DA) has demonstrated significant promise for real-time nighttime unmanned aerial vehicle (UAV) tracking. However, the state-of-the-art (SOTA) DA still lacks the potential object with accurate pixel-lev…

Domain AdaptationTransfer LearningZero-shot Generalization

Efficient Track Anything

2024-11-28 · Yunyang Xiong, Chong Zhou, Xiaoyu Xiang, Lemeng Wu 외

Segment Anything Model 2 (SAM 2) has emerged as a powerful tool for video object segmentation and tracking anything. Key components of SAM 2 that drive the impressive video object segmentation performance include a large…

ObjectSegmentationSemantic SegmentationVideo Object Segmentation+2

Segment Anything in Light Fields for Real-Time Applications via Constrained Prompting

2024-11-21 · Nikolai Goncharov, Donald G. Dansereau

Segmented light field images can serve as a powerful representation in many of computer vision tasks exploiting geometry and appearance of objects, such as object pose tracking. In the light field domain, segmentation pr…

Pose Tracking