paper-with-me

Papers

Deformable ConvNets v2: More Deformable, Better Results

2018-11-27 · CVPR 2019 6 · Xizhou Zhu, Han Hu, Stephen Lin, Jifeng Dai

The superior performance of Deformable Convolutional Networks arises from its ability to adapt to the geometric variations of objects. Through an examination of its adaptive behavior, we observe that while the spatial support for its neural features conforms more closely than regular ConvNets to object structure, this support may nevertheless extend well beyond the region of interest, causing features to be influenced by irrelevant image content. To address this problem, we present a reformulation of Deformable ConvNets that improves its ability to focus on pertinent image regions, through increased modeling power and stronger training. The modeling power is enhanced through a more comprehensive integration of deformable convolution within the network, and by introducing a modulation mechanism that expands the scope of deformation modeling. To effectively harness this enriched modeling capability, we guide network training via a proposed feature mimicking scheme that helps the network to learn features that reflect the object focus and classification power of R-CNN features. With the proposed contributions, this new version of Deformable ConvNets yields significant performance gains over the original model and produces leading results on the COCO benchmark for object detection and instance segmentation.

📄 PDF Abstract BibTeX arXiv:1811.11168

Code (26)

4uiiurz1/pytorch-deform-conv-v2 pytorch
CS-GangXu/TMNet pytorch
MindCode-4/code-3/tree/main/deformable_detr mindspore
MindSpore-paper-code-3/code8/tree/main/faster_rcnn_dcn mindspore
MindSpore-scientific-2/code-4/tree/main/Deformable_Patch_Representation mindspore
MindSpore-scientific-2/code-5/tree/main/Deformable_Patch_Representation mindspore
Mukosame/Zooming-Slow-Mo-CVPR-2020 pytorch
PaddlePaddle/PaddleDetection paddle
chengdazhi/Deformable-Convolution-V2-PyTorch pytorch
developer0hye/Simple-PyTorch-Deformable-Convolution-v2 pytorch
eunjnnn/bfstvsr pytorch
lyqcom/fasterrcnn-fpn-dcn mindspore
masamitsu-murase/deform_conv2d_onnx_exporter pytorch
mindspore-ai/models/tree/master/research/cv/faster_rcnn_dcn mindspore
msracver/Deformable-ConvNets mxnet
open-mmlab/mmdetection pytorch
picsart-ai-research/videoinr-continuous-space-time-super-resolution pytorch
qilei123/DeformableConvV2 mxnet
qilei123/DeformableConvV2_crop mxnet
qilei123/fpn_crop mxnet
qilei123/fpn_crop_v1_5d mxnet
qilei123/sod_v1 mxnet
qilei123/sod_v1_demo mxnet
zengzhaoyang/trident mxnet
zzangjinsun/NLSPN_ECCV20 pytorch
zzdxfei/defor_conv_mxnet_code mxnet

Tasks

Instance SegmentationObjectObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Deformable ConvNets Deformable ConvNets do not learn an affine transformation. They divide convolution into two steps, firstly sampling features on a regular grid $ \mathcal{R} $ from the input…
Average Pooling 설명 없음
Weight Decay 설명 없음
SGD with Momentum 설명 없음
Non Maximum Suppression Non Maximum Suppression is a computer vision method that selects a single entity out of many overlapping entities (for example bounding boxes in object detection). The…
Deformable RoI Pooling Deformable RoI Pooling adds an offset to each bin position in the regular bin partition of the RoI Pooling. Similarly, the offsets are learned from the preceding feature maps…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Enhanced Deformable Convolution with Center-invariant Offset and Edge-aware Mask

2026-09-09 · Yixiao Li, Xiaoyuan Yang, Jin Jiang, Minghao Zou 외 arxiv

Deformable convolution networks have recently become popular for many computer vision tasks, especially for semantic segmentation, because of their exceptional capabilities in dynamic spatial modeling. However, due to th…

Semantic SegmentationImage ClassificationEdge Detection

Deformable TDNN with adaptive receptive fields for speech recognition

2021-04-30 · Keyu An, Yi Zhang, Zhijian Ou

Time Delay Neural Networks (TDNNs) are widely used in both DNN-HMM based hybrid speech recognition systems and recent end-to-end systems. Nevertheless, the receptive fields of TDNNs are limited and fixed, which is not de…

speech-recognitionSpeech Recognition

A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration

2018-09-17 · Bob D. de Vos, Floris F. Berendsen, Max A. Viergever, Hessam Sokooti 외

Image registration, the process of aligning two or more images, is the core technique of many (semi-)automatic medical image analysis tasks. Recent studies have shown that deep learning methods, notably convolutional neu…

Affine Image RegistrationDeep LearningImage RegistrationMedical Image Analysis

Variational Context-Deformable ConvNets for Indoor Scene Parsing

2020-06-01 · CVPR 2020 6 · Zhitong Xiong, Yuan Yuan, Nianhui Guo, Qi Wang

Context information is critical for image semantic segmentation. Especially in indoor scenes, the large variation of object scales makes spatial-context an important factor for improving the segmentation performance. Thu…

Scene ParsingSegmentationSemantic Segmentation

Joint Unsupervised Deformable Spatio-Temporal Alignment of Sequences

2016-06-01 · CVPR 2016 6 · Lazaros Zafeiriou, Epameinondas Antonakos, Stefanos Zafeiriou, Maja Pantic

Typically, the problems of spatial and temporal alignment of sequences are considered disjoint. That is, in order to align two sequences, a methodology that (non)-rigidly aligns the images is first applied, followed by t…