SBNet: Segmentation-based Network for Natural Language-based Vehicle Search
Natural language-based vehicle retrieval is a task to find a target vehicle within a given image based on a natural language description as a query. This technology can be applied to various areas including police searching for a suspect vehicle. However, it is challenging due to the ambiguity of language descriptions and the difficulty of processing multi-modal data. To tackle this problem, we propose a deep neural network called SBNet that performs natural language-based segmentation for vehicle retrieval. We also propose two task-specific modules to improve performance: a substitution module that helps features from different domains to be embedded in the same space and a future prediction module that learns temporal information. SBnet has been trained using the CityFlow-NL dataset that contains 2,498 tracks of vehicles with three unique natural language descriptions each and tested 530 unique vehicle tracks and their corresponding query sets. SBNet achieved a significant improvement over the baseline in the natural language-based vehicle tracking track in the AI City Challenge 2021.
Code (0)
등록된 구현이 없습니다.
Tasks
Future predictionRetrievalSimilar Papers 제목 키워드 기반
ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution
Existing 3D instance segmentation methods are predominated by the bottom-up design -- manually fine-tuned algorithm to group points into clusters followed by a refinement network. However, by relying on the quality of th…
3D Instance SegmentationInstance SegmentationSemantic SegmentationISBNet: Instance-aware Selective Branching Networks
Recent years have witnessed growing interests in designing efficient neural networks and neural architecture search (NAS). Although remarkable efficiency and accuracy have been achieved, existing expert designed and NAS …
Neural Architecture SearchSSBNet: Improving Visual Recognition Efficiency by Adaptive Sampling
Downsampling is widely adopted to achieve a good trade-off between accuracy and latency for visual recognition. Unfortunately, the commonly used pooling layers are not learned, and thus cannot preserve important informat…
Dimensionality Reductionimage-classificationImage Classificationobject-detection+1ThanosNet: A Novel Trash Classification Method Using Metadata
Recent progress in deep neural networks has spurred significant development of image-based trash classification literature. These methods predominately use transfer learning to achieve state-of-the-art results. In this c…
ClassificationImage ClassificationTransfer LearningRSBNet: One-Shot Neural Architecture Search for A Backbone Network in Remote Sensing Image Recognition
Recently, a massive number of deep learning based approaches have been successfully applied to various remote sensing image (RSI) recognition tasks. However, most existing advances of deep learning methods in the RSI fie…
Deep LearningLand Cover ClassificationNeural Architecture Searchobject-detection+2