Non-local Neural Networks
Both convolutional and recurrent operations are building blocks that process one local neighborhood at a time. In this paper, we present non-local operations as a generic family of building blocks for capturing long-range dependencies. Inspired by the classical non-local means method in computer vision, our non-local operation computes the response at a position as a weighted sum of the features at all positions. This building block can be plugged into many computer vision architectures. On the task of video classification, even without any bells and whistles, our non-local models can compete or outperform current competition winners on both Kinetics and Charades datasets. In static image recognition, our non-local models improve object detection/segmentation and pose estimation on the COCO suite of tasks. Code is available at https://github.com/facebookresearch/video-nonlocal-net .
Code (32)
Tasks
Action ClassificationAction RecognitionInstance SegmentationKeypoint DetectionObject DetectionPose EstimationPositionText-To-SQLVideo ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Nonlocal Neural Networks, Nonlocal Diffusion and Nonlocal Modeling
Nonlocal neural networks have been proposed and shown to be effective in several computer vision tasks, where the nonlocal operations can directly capture long-range dependencies in the feature space. In this paper, we s…
MTLDesc: Looking Wider to Describe Better
Limited by the locality of convolutional neural networks, most existing local features description methods only learn local descriptors with local information and lack awareness of global and surrounding spatial context.…
Indoor LocalizationTripletPerson Re-Identification Using Heterogeneous Local Graph Attention Networks
Recently, some methods have focused on learning local relation among parts of pedestrian images for person re-identification (Re-ID), as it offers powerful representation capabilities. However, they only provide the …
Graph AttentionPerson Re-IdentificationRelationState, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics
In a recent methodological paper, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investi…
parameter estimationThe Role of Local Steps in Local SGD
We consider the distributed stochastic optimization problem where $n$ agents want to minimize a global function given by the sum of agents' local functions, and focus on the heterogeneous setting when agents' local funct…
Stochastic Optimization