paper-with-me

홈 › Papers

CFFT-GAN: Cross-domain Feature Fusion Transformer for Exemplar-based Image Translation

2023-02-03 · Tianxiang Ma, Bingchuan Li, Wei Liu, Miao Hua, Jing Dong, Tieniu Tan

Exemplar-based image translation refers to the task of generating images with the desired style, while conditioning on certain input image. Most of the current methods learn the correspondence between two input domains and lack the mining of information within the domains. In this paper, we propose a more general learning approach by considering two domain features as a whole and learning both inter-domain correspondence and intra-domain potential information interactions. Specifically, we propose a Cross-domain Feature Fusion Transformer (CFFT) to learn inter- and intra-domain feature fusion. Based on CFFT, the proposed CFFT-GAN works well on exemplar-based image translation. Moreover, CFFT-GAN is able to decouple and fuse features from multiple domains by cascading CFFT modules. We conduct rich quantitative and qualitative experiments on several image translation tasks, and the results demonstrate the superiority of our approach compared to state-of-the-art methods. Ablation studies show the importance of our proposed CFFT. Application experimental results reflect the potential of our method.

📄 PDF Abstract BibTeX arXiv:2302.01608

Code (0)

등록된 구현이 없습니다.

Tasks

Translation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

HFT: Lifting Perspective Representations via Hybrid Feature Transformation

2022-04-11 · Jiayu Zou, Junrui Xiao, Zheng Zhu, JunJie Huang 외

Autonomous driving requires accurate and detailed Bird's Eye View (BEV) semantic segmentation for decision making, which is one of the most challenging tasks for high-level scene perception. Feature transformation from f…

Autonomous DrivingDecision MakingSegmentationSemantic Segmentation

CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement

2025-02-19 · Zheng Wu, Yiping Xie, Bo Zhao, Jiguang He 외

Heart rate (HR) estimation via remote photoplethysmography (rPPG) offers a non-invasive solution for health monitoring. However, traditional single-modality approaches (RGB or Radio Frequency (RF)) face challenges in bal…

cross-modal alignmentFairnessHeart rate estimationMamba+1

CDFormer: Cross-Domain Few-Shot Object Detection Transformer Against Feature Confusion

2025-05-02 · Boyuan Meng, Xiaohan Zhang, Peilin Li, Zhe Wu 외

Cross-domain few-shot object detection (CD-FSOD) aims to detect novel objects across different domains with limited class instances. Feature confusion, including object-background confusion and object-object confusion, p…

Cross-Domain Few-ShotCross-Domain Few-Shot Object DetectionFew-Shot Object DetectionObject+2

DA-DETR: Domain Adaptive Detection Transformer with Information Fusion

2021-03-31 · CVPR 2023 1 · Jingyi Zhang, Jiaxing Huang, Zhipeng Luo, Gongjie Zhang 외

The recent detection transformer (DETR) simplifies the object detection pipeline by removing hand-crafted designs and hyperparameters as employed in conventional two-stage object detectors. However, how to leverage the s…

Domain AdaptationObjectobject-detectionObject Detection+1

FreDFT: Frequency Domain Fusion Transformer for Visible-Infrared Object Detection

2025-11-13 · Wencong Wu, Xiuwei Zhang, Hanlin Yin, Shun Dai 외 arxiv

Visible-infrared object detection has gained sufficient attention due to its detection performance in low light, fog, and rain conditions. However, visible and infrared modalities captured by different sensors exist the …

Object Detection