paper-with-me

홈 › Papers

On Convolutional Vision Transformers for Yield Prediction

2024-02-08 · Alvin Inderka, Florian Huber, Volker Steinhage

While a variety of methods offer good yield prediction on histogrammed remote sensing data, vision Transformers are only sparsely represented in the literature. The Convolution vision Transformer (CvT) is being tested to evaluate vision Transformers that are currently achieving state-of-the-art results in many other vision tasks. CvT combines some of the advantages of convolution with the advantages of dynamic attention and global context fusion of Transformers. It performs worse than widely tested methods such as XGBoost and CNNs, but shows that Transformers have potential to improve yield prediction.

📄 PDF Abstract BibTeX arXiv:2402.05557

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Average Pooling 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Vision Transformers for Dense Prediction

2021-03-24 · ICCV 2021 10 · René Ranftl, Alexey Bochkovskiy, Vladlen Koltun

We introduce dense vision transformers, an architecture that leverages vision transformers in place of convolutional networks as a backbone for dense prediction tasks. We assemble tokens from various stages of the vision…

DecoderDepth EstimationMonocular Depth EstimationPrediction+1

Towards Training Stronger Video Vision Transformers for EPIC-KITCHENS-100 Action Recognition

2021-06-09 · Ziyuan Huang, Zhiwu Qing, Xiang Wang, Yutong Feng 외

With the recent surge in the research of vision transformers, they have demonstrated remarkable potential for various challenging computer vision applications, such as image recognition, point cloud classification as wel…

Action RecognitionPoint Cloud ClassificationPredictionVideo Understanding

CvT: Introducing Convolutions to Vision Transformers

2021-03-29 · ICCV 2021 10 · Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu 외

We present in this paper a new architecture, named Convolutional vision Transformer (CvT), that improves Vision Transformer (ViT) in performance and efficiency by introducing convolutions into ViT to yield the best of bo…

Image Classification

Semantic Segmentation using Vision Transformers: A survey

2023-05-05 · Hans Thisanke, Chamli Deshan, Kavindu Chamith, Sachith Seneviratne 외

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformer…

Autonomous DrivingBenchmarkingimage-classificationImage Classification+7

A comparative study between vision transformers and CNNs in digital pathology

2022-06-01 · Luca Deininger, Bernhard Stimpel, Anil Yuce, Samaneh Abbasi-Sureshjani 외

Recently, vision transformers were shown to be capable of outperforming convolutional neural networks when pretrained on sufficient amounts of data. In comparison to convolutional neural networks, vision transformers hav…

Inductive Biaswhole slide images