paper-with-me

Papers

Dense Transformer Networks

2017-05-24 · Jun Li, Yongjun Chen, Lei Cai, Ian Davidson, Shuiwang Ji

The key idea of current deep learning methods for dense prediction is to apply a model on a regular patch centered on each pixel to make pixel-wise predictions. These methods are limited in the sense that the patches are determined by network architecture instead of learned from data. In this work, we propose the dense transformer networks, which can learn the shapes and sizes of patches from data. The dense transformer networks employ an encoder-decoder architecture, and a pair of dense transformer modules are inserted into each of the encoder and decoder paths. The novelty of this work is that we provide technical solutions for learning the shapes and sizes of patches from data and efficiently restoring the spatial correspondence required for dense prediction. The proposed dense transformer modules are differentiable, thus the entire network can be trained. We apply the proposed networks on natural and biological image segmentation tasks and show superior performance is achieved in comparison to baseline methods.

📄 PDF Abstract BibTeX arXiv:1705.08881

Code (1)

zhengyang-wang/Unet_3D tf

Tasks

DecoderImage SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Dense Transformer Networks for Brain Electron Microscopy Image Segmentation

2019-08-10 · Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19) 2019 8 · Jun Li, Yongjun Chen, Lei Cai, Ian Davidson 외

The key idea of current deep learning methods for dense prediction is to apply a model on a regular patch centered on each pixel to make pixel-wise predictions. These methods are limited in the sense that the patches are…

DecoderElectron Microscopy Image SegmentationImage SegmentationSemantic Segmentation

Vision Transformers for Dense Prediction

2021-03-24 · ICCV 2021 10 · René Ranftl, Alexey Bochkovskiy, Vladlen Koltun

We introduce dense vision transformers, an architecture that leverages vision transformers in place of convolutional networks as a backbone for dense prediction tasks. We assemble tokens from various stages of the vision…

DecoderDepth EstimationMonocular Depth EstimationPrediction+1

H-DenseFormer: An Efficient Hybrid Densely Connected Transformer for Multimodal Tumor Segmentation

2023-07-04 · Jun Shi, Hongyu Kan, Shulan Ruan, Ziqi Zhu 외

Recently, deep learning methods have been widely used for tumor segmentation of multimodal medical images with promising results. However, most existing methods are limited by insufficient representational ability, speci…

Tumor Segmentation

DenSe-AdViT: A novel Vision Transformer for Dense SAR Object Detection

2025-04-18 · Yang Zhang, Jingyi Cao, Yanan You, Yuanyuan Qiao

Vision Transformer (ViT) has achieved remarkable results in object detection for synthetic aperture radar (SAR) images, owing to its exceptional ability to extract global features. However, it struggles with the extracti…

object-detectionObject Detection

Condenser: a Pre-training Architecture for Dense Retrieval

2021-04-16 · EMNLP 2021 11 · Luyu Gao, Jamie Callan

Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passages into single dense vector representat…

Language ModellingRetrievalText Retrieval