Every Shot Counts: Using Exemplars for Repetition Counting in Videos
Video repetition counting infers the number of repetitions of recurring actions or motion within a video. We propose an exemplar-based approach that discovers visual correspondence of video exemplars across repetitions within target videos. Our proposed Every Shot Counts (ESCounts) model is an attention-based encoder-decoder that encodes videos of varying lengths alongside exemplars from the same and different videos. In training, ESCounts regresses locations of high correspondence to the exemplars within the video. In tandem, our method learns a latent that encodes representations of general repetitive motions, which we use for exemplar-free, zero-shot inference. Extensive experiments over commonly used datasets (RepCount, Countix, and UCFRep) showcase ESCounts obtaining state-of-the-art performance across all three datasets. Detailed ablations further demonstrate the effectiveness of our method.
Code (1)
Tasks
DecoderExemplar-FreeRepetitive Action CountingSimilar Papers 제목 키워드 기반
A Low-Shot Object Counting Network With Iterative Prototype Adaptation
We consider low-shot counting of arbitrary semantic categories in the image using only few annotated exemplars (few-shot) or no exemplars (no-shot). The standard few-shot pipeline follows extraction of appearance queries…
Exemplar-Free CountingObjectObject CountingObject LocalizationIntelligent Repetition Counting for Unseen Exercises: A Few-Shot Learning Approach with Sensor Signals
Sensing technology has significantly advanced in automating systems that reflect human movement, particularly in robotics and healthcare, where it is used to automatically detect target movements. This study develops a m…
Few-Shot LearningTripletGCNet: Probing Self-Similarity Learning for Generalized Counting Network
The class-agnostic counting (CAC) problem has caught increasing attention recently due to its wide societal applications and arduous challenges. To count objects of different categories, existing approaches rely on user-…
DAVE - A Detect-and-Verify Paradigm for Low-Shot Counting
Low-shot counters estimate the number of objects corresponding to a selected category based on only few or no exemplars annotated in the image. The current state-of-the-art estimates the total counts as the sum over …
ObjectDAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting
Low-shot counters estimate the number of objects corresponding to a selected category, based on only few or no exemplars annotated in the image. The current state-of-the-art estimates the total counts as the sum over the…
Exemplar-Free CountingFew-shot Object Counting and DetectionObjectObject Counting+1