paper-with-me

홈 › Papers

PeR-ViS: Person Retrieval in Video Surveillance using Semantic Description

2020-12-04 · Parshwa Shah, Arpit Garg, Vandit Gajjar

A person is usually characterized by descriptors like age, gender, height, cloth type, pattern, color, etc. Such descriptors are known as attributes and/or soft-biometrics. They link the semantic gap between a person's description and retrieval in video surveillance. Retrieving a specific person with the query of semantic description has an important application in video surveillance. Using computer vision to fully automate the person retrieval task has been gathering interest within the research community. However, the Current, trend mainly focuses on retrieving persons with image-based queries, which have major limitations for practical usage. Instead of using an image query, in this paper, we study the problem of person retrieval in video surveillance with a semantic description. To solve this problem, we develop a deep learning-based cascade filtering approach (PeR-ViS), which uses Mask R-CNN [14] (person detection and instance segmentation) and DenseNet-161 [16] (soft-biometric classification). On the standard person retrieval dataset of SoftBioSearch [6], we achieve 0.566 Average IoU and 0.792 %w $IoU > 0.4$, surpassing the current state-of-the-art by a large margin. We hope our simple, reproducible, and effective approach will help ease future research in the domain of person retrieval in video surveillance. The source code and pretrained weights available at https://parshwa1999.github.io/PeR-ViS/.

📄 PDF Abstract BibTeX arXiv:2012.02408

Code (1)

parshwa1999/PeR-ViS 공식 구현 tf

Tasks

Human DetectionInstance SegmentationPerson RetrievalRetrievalSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Person Retrieval in Surveillance Video using Height, Color and Gender

2018-09-24 · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) 2019 2 · Hiren Galiyawala, Kenil Shah, Vandit Gajjar, Mehul S. Raval

A person is commonly described by attributes like height, build, cloth color, cloth type, and gender. Such attributes are known as soft biometrics. They bridge the semantic gap between human description and person retrie…

Person RetrievalRetrieval

Person Retrieval in Surveillance Using Textual Query: A Review

2021-05-06 · Hiren Galiyawala, Mehul S Raval

Recent advancement of research in biometrics, computer vision, and natural language processing has discovered opportunities for person retrieval from surveillance videos using textual query. The prime objective of a surv…

Person RetrievalRetrieval

Text-based Person Search in Full Images via Semantic-Driven Proposal Generation

2021-09-27 · Shizhou Zhang, De Cheng, Wenlong Luo, Yinghui Xing 외

Finding target persons in full scene images with a query of text description has important practical applications in intelligent video surveillance.However, different from the real-world scenarios where the bounding boxe…

Person SearchRetrievalText based Person RetrievalText-based Person Retrieval+1

Graph-Based Cross-Domain Knowledge Distillation for Cross-Dataset Text-to-Image Person Retrieval

2025-01-25 · Bingjun Luo, Jinpeng Wang, Wang Zewen, Junjie Zhu 외

Video surveillance systems are crucial components for ensuring public safety and management in smart city. As a fundamental task in video surveillance, text-to-image person retrieval aims to retrieve the target person fr…

Domain AdaptationKnowledge DistillationPerson RetrievalRetrieval+1

Attention-based Natural Language Person Retrieval

2017-05-24 · Tao Zhou, Muhao Chen, Jie Yu, Demetri Terzopoulos

Following the recent progress in image classification and captioning using deep learning, we develop a novel natural language person retrieval system based on an attention mechanism. More specifically, given the descript…

image-classificationImage ClassificationPerson RetrievalRegion Proposal+1