paper-with-me

Papers

Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection

2024-08-27 · Siyuan Yao, Hao Sun, Tian-Zhu Xiang, Xiao Wang, Xiaochun Cao

Camouflaged object detection (COD) aims to identify the objects that seamlessly blend into the surrounding backgrounds. Due to the intrinsic similarity between the camouflaged objects and the background region, it is extremely challenging to precisely distinguish the camouflaged objects by existing approaches. In this paper, we propose a hierarchical graph interaction network termed HGINet for camouflaged object detection, which is capable of discovering imperceptible objects via effective graph interaction among the hierarchical tokenized features. Specifically, we first design a region-aware token focusing attention (RTFA) with dynamic token clustering to excavate the potentially distinguishable tokens in the local region. Afterwards, a hierarchical graph interaction transformer (HGIT) is proposed to construct bi-directional aligned communication between hierarchical features in the latent interaction space for visual semantics enhancement. Furthermore, we propose a decoder network with confidence aggregated feature fusion (CAFF) modules, which progressively fuses the hierarchical interacted features to refine the local detail in ambiguous regions. Extensive experiments conducted on the prevalent datasets, i.e. COD10K, CAMO, NC4K and CHAMELEON demonstrate the superior performance of HGINet compared to existing state-of-the-art methods. Our code is available at https://github.com/Garyson1204/HGINet.

📄 PDF Abstract BibTeX arXiv:2408.15020

Code (1)

garyson1204/hginet 공식 구현 pytorch

Tasks

Decoderobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Global-Lens Transformers: Adaptive Token Mixing for Dynamic Link Prediction

2025-11-16 · Tao Zou, Chengfeng Wu, Tianxi Liao, Junchen Ye 외 arxiv

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. W…

Dynamic Link PredictionGraph Learning

DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification

2021-06-03 · NeurIPS 2021 12 · Yongming Rao, Wenliang Zhao, Benlin Liu, Jiwen Lu 외

Attention is sparse in vision transformers. We observe the final prediction in vision transformers is only based on a subset of most informative tokens, which is sufficient for accurate image recognition. Based on this o…

BlockingEfficient ViTsImage Classification

CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising

2022-02-28 · Dayang Wang, Fenglei Fan, Zhan Wu, Rui Liu 외

Low-dose computed tomography (LDCT) denoising is an important problem in CT research. Compared to the normal dose CT (NDCT), LDCT images are subjected to severe noise and artifacts. Recently in many studies, vision trans…

DecoderDenoising

Transformers are efficient hierarchical chemical graph learners

2023-10-02 · Zihan Pengmei, Zimu Li, Chih-chan Tien, Risi Kondor 외

Transformers, adapted from natural language processing, are emerging as a leading approach for graph representation learning. Contemporary graph transformers often treat nodes or edges as separate tokens. This approach l…

Graph Representation LearningRepresentation Learning

EgoViT: Pyramid Video Transformer for Egocentric Action Recognition

2023-03-15 · Chenbin Pan, Zhiqi Zhang, Senem Velipasalar, Yi Xu

Capturing interaction of hands with objects is important to autonomously detect human actions from egocentric videos. In this work, we present a pyramid video transformer with a dynamic class token generator for egocentr…

Action Recognition