paper-with-me

Papers

Time-rEversed diffusioN tEnsor Transformer: A new TENET of Few-Shot Object Detection

2022-10-30 · Shan Zhang, Naila Murray, Lei Wang, Piotr Koniusz

In this paper, we tackle the challenging problem of Few-shot Object Detection. Existing FSOD pipelines (i) use average-pooled representations that result in information loss; and/or (ii) discard position information that can help detect object instances. Consequently, such pipelines are sensitive to large intra-class appearance and geometric variations between support and query images. To address these drawbacks, we propose a Time-rEversed diffusioN tEnsor Transformer (TENET), which i) forms high-order tensor representations that capture multi-way feature occurrences that are highly discriminative, and ii) uses a transformer that dynamically extracts correlations between the query image and the entire support set, instead of a single average-pooled support embedding. We also propose a Transformer Relation Head (TRH), equipped with higher-order representations, which encodes correlations between query regions and the entire support set, while being sensitive to the positional variability of object instances. Our model achieves state-of-the-art results on PASCAL VOC, FSOD, and COCO.

📄 PDF Abstract BibTeX arXiv:2210.16897

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot Object DetectionObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

TENET: A Time-reversal Enhancement Network for Noise-robust ASR

2021-07-04 · Fu-An Chao, Shao-Wei Fan Jiang, Bi-Cheng Yan, Jeih-weih Hung 외

Due to the unprecedented breakthroughs brought about by deep learning, speech enhancement (SE) techniques have been developed rapidly and play an important role prior to acoustic modeling to mitigate noise effects on spe…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Speech Enhancementspeech-recognition+1

Multi-layered tensor networks for image classification

2020-11-13 · Raghavendra Selvan, Silas Ørting, Erik B Dam

The recently introduced locally orderless tensor network (LoTeNet) for supervised image classification uses matrix product state (MPS) operations on grids of transformed image patches. The resulting patch representations…

ClassificationGeneral Classificationimage-classificationImage Classification+1

Locally orderless tensor networks for classifying two- and three-dimensional medical images

2020-09-25 · Raghavendra Selvan, Silas Ørting, Erik B. Dam

Tensor networks are factorisations of high rank tensors into networks of lower rank tensors and have primarily been used to analyse quantum many-body problems. Tensor networks have seen a recent surge of interest in rela…

image-classificationImage ClassificationTensor Networks

Diffusion Tensor Estimation with Transformer Neural Networks

2022-01-14 · Davood Karimi, Ali Gholipour

Diffusion tensor imaging (DTI) is a widely used method for studying brain white matter development and degeneration. However, standard DTI estimation methods depend on a large number of high-quality measurements. This wo…

Joint Distributions for TensorFlow Probability

2020-01-22 · Dan Piponi, Dave Moore, Joshua V. Dillon

A central tenet of probabilistic programming is that a model is specified exactly once in a canonical representation which is usable by inference algorithms. We describe JointDistributions, a family of declarative repres…

Probabilistic Programming