paper-with-me

Papers

CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation

2023-09-22 · Xiaoheng Jiang, Kaiyi Guo, Yang Lu, Feng Yan, Hao liu, Jiale Cao, Mingliang Xu, DaCheng Tao

Surface defect inspection is of great importance for industrial manufacture and production. Though defect inspection methods based on deep learning have made significant progress, there are still some challenges for these methods, such as indistinguishable weak defects and defect-like interference in the background. To address these issues, we propose a transformer network with multi-stage CNN (Convolutional Neural Network) feature injection for surface defect segmentation, which is a UNet-like structure named CINFormer. CINFormer presents a simple yet effective feature integration mechanism that injects the multi-level CNN features of the input image into different stages of the transformer network in the encoder. This can maintain the merit of CNN capturing detailed features and that of transformer depressing noises in the background, which facilitates accurate defect detection. In addition, CINFormer presents a Top-K self-attention module to focus on tokens with more important information about the defects, so as to further reduce the impact of the redundant background. Extensive experiments conducted on the surface defect datasets DAGM 2007, Magnetic tile, and NEU show that the proposed CINFormer achieves state-of-the-art performance in defect detection.

📄 PDF Abstract BibTeX arXiv:2309.12639

Code (0)

등록된 구현이 없습니다.

Tasks

Defect Detection

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Personalize Anything for Free with Diffusion Transformer

2025-03-16 · Haoran Feng, Zehuan Huang, Lin Li, Hairong Lv 외

Personalized image generation aims to produce images of user-specified concepts while enabling flexible editing. Recent training-free approaches, while exhibit higher computational efficiency than training-based methods,…

Computational EfficiencyDenoisingDiversityImage Generation+1

Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders

2023-11-14 · Yingji Zhang, Marco Valentino, Danilo S. Carvalho, Ian Pratt-Hartmann 외

The injection of syntactic information in Variational AutoEncoders (VAEs) has been shown to result in an overall improvement of performances and generalisation. An effective strategy to achieve such a goal is to separate…

Language ModellingMulti-Task Learning

The Promptware Kill Chain: How Prompt Injections Gradually Evolved Into a Multistep Malware Delivery Mechanism

2026-01-14 · Oleg Brodt, Elad Feldman, Bruce Schneier, Ben Nassi arxiv

Prompt injection was initially framed as the large language model (LLM) analogue of SQL injection. However, over the past three years, attacks labeled as prompt injection have evolved from isolated input-manipulation exp…

MulGT: Multi-task Graph-Transformer with Task-aware Knowledge Injection and Domain Knowledge-driven Pooling for Whole Slide Image Analysis

2023-02-21 · Weiqin Zhao, Shujun Wang, Maximus Yeung, Tianye Niu 외

Whole slide image (WSI) has been widely used to assist automated diagnosis under the deep learning fields. However, most previous works only discuss the SINGLE task setting which is not aligned with real clinical setting…

Graph EmbeddingGraph Neural NetworkMulti-Task Learning

GoldenTransformer: A Modular Fault Injection Framework for Transformer Robustness Research

2025-09-13 · Luke Howard arxiv

Transformers have become the foundation for a wide range of state--of--the--art models across natural language processing, computer vision, and other machine learning domains. Despite their widespread deployment, the rob…