Network Comparison Study of Deep Activation Feature Discriminability with Novel Objects
Feature extraction has always been a critical component of the computer vision field. More recently, state-of-the-art computer visions algorithms have incorporated Deep Neural Networks (DNN) in feature extracting roles, creating Deep Convolutional Activation Features (DeCAF). The transferability of DNN knowledge domains has enabled the wide use of pretrained DNN feature extraction for applications with novel object classes, especially those with limited training data. This study analyzes the general discriminability of novel object visual appearances encoded into the DeCAF space of six of the leading visual recognition DNN architectures. The results of this study characterize the Mahalanobis distances and cosine similarities between DeCAF object manifolds across two visual object tracking benchmark data sets. The backgrounds surrounding each object are also included as an object classes in the manifold analysis, providing a wider range of novel classes. This study found that different network architectures led to different network feature focuses that must to be considered in the network selection process. These results are generated from the VOT2015 and UAV123 benchmark data sets; however, the proposed methods can be applied to efficiently compare estimated network performance characteristics for any labeled visual data set.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectObject TrackingVisual Object TrackingSimilar Papers 제목 키워드 기반
FD-CAM: Improving Faithfulness and Discriminability of Visual Explanation for CNNs
Class activation map (CAM) has been widely studied for visual explanation of the internal working mechanism of convolutional neural networks. The key of existing CAM-based methods is to compute effective weights to combi…
Harmonizing Transferability and Discriminability for Adapting Object Detectors
Recent advances in adaptive object detection have achieved compelling results in virtue of adversarial feature adaptation to mitigate the distributional shifts along the detection pipeline. Whilst adversarial adaptation …
Objectobject-detectionObject DetectionWeakly Supervised Object DetectionOn the discriminability of samples in the Hamming space of binarized ReLU activations
Binarized ReLU activations are considered as a metric space equipped with the Hamming distance. While for two layer ReLU networks with random Gaussian weights it can be shown theoretically that local metric properties a…
High-speed Tracking with Multi-kernel Correlation Filters
Correlation filter (CF) based trackers are currently ranked top in terms of their performances. Nevertheless, only some of them, such as KCF~\cite{henriques15} and MKCF~\cite{tangm15}, are able to exploit the powerful di…
Video Object TrackingVocal Bursts Intensity PredictionPilot Study to Discover Candidate Biomarkers for Autism based on Perception and Production of Facial Expressions
Purpose: Facial expression production and perception in autism spectrum disorder (ASD) suggest potential presence of behavioral biomarkers that may stratify individuals on the spectrum into prognostic or treatment subgro…