Rethinking Encoder-Decoder Flow Through Shared Structures
Dense prediction tasks have enjoyed a growing complexity of encoder architectures, decoders, however, have remained largely the same. They rely on individual blocks decoding intermediate feature maps sequentially. We introduce banks, shared structures that are used by each decoding block to provide additional context in the decoding process. These structures, through applying them via resampling and feature fusion, improve performance on depth estimation for state-of-the-art transformer-based architectures on natural and synthetic images whilst training on large-scale datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDepth EstimationSimilar Papers 제목 키워드 기반
Improving Domain Adaptation Translation with Domain Invariant and Specific Information
In domain adaptation for neural machine translation, translation performance can benefit from separating features into domain-specific features and common features. In this paper, we propose a method to explicitly model …
DecoderDomain AdaptationMachine TranslationTranslationSENSE: a Shared Encoder Network for Scene-flow Estimation
We introduce a compact network for holistic scene flow estimation, called SENSE, which shares common encoder features among four closely-related tasks: optical flow estimation, disparity estimation from stereo, occlusion…
Disparity EstimationOcclusion EstimationOptical Flow EstimationScene Flow Estimation+1Complexity Matters: Rethinking the Latent Space for Generative Modeling
In generative modeling, numerous successful approaches leverage a low-dimensional latent space, e.g., Stable Diffusion models the latent space induced by an encoder and generates images through a paired decoder. Although…
DecoderSinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems
Small molecules, crystals, and proteins all reduce to atoms in 3D space, yet their generative pipelines remain fragmented across domains, each with its Small molecules, crystals, and proteins all reduce to atoms in 3D sp…
The Diffusion Encoder
We construct a new kind of encoder, leveraging the expressive power of diffusion models. In a traditional variational autoencoder, the encoder and decoder jointly negotiate a latent representation of the input. This is m…