paper-with-me

홈 › Papers

Beyond Academic Benchmarks: Critical Analysis and Best Practices for Visual Industrial Anomaly Detection

2025-03-30 · Aimira Baitieva, Yacine Bouaouni, Alexandre Briot, Dick Ameln, Souhaiel Khalfaoui, Samet Akcay

Anomaly detection (AD) is essential for automating visual inspection in manufacturing. This field of computer vision is rapidly evolving, with increasing attention towards real-world applications. Meanwhile, popular datasets are typically produced in controlled lab environments with artificially created defects, unable to capture the diversity of real production conditions. New methods often fail in production settings, showing significant performance degradation or requiring impractical computational resources. This disconnect between academic results and industrial viability threatens to misdirect visual anomaly detection research. This paper makes three key contributions: (1) we demonstrate the importance of real-world datasets and establish benchmarks using actual production data, (2) we provide a fair comparison of existing SOTA methods across diverse tasks by utilizing metrics that are valuable for practical applications, and (3) we present a comprehensive analysis of recent advancements in this field by discussing important challenges and new perspectives for bridging the academia-industry gap. The code is publicly available at https://github.com/abc-125/viad-benchmark

📄 PDF Abstract BibTeX arXiv:2503.23451

Code (1)

abc-125/viad-benchmark 공식 구현

Tasks

Anomaly DetectionDiversity

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

AcademiClaw: When Students Set Challenges for AI Agents

2026-05-04 · Junjie Yu, Pengrui Lu, Weiye Si, Hongliang Lu 외 arxiv

Benchmarks within the OpenClaw ecosystem have thus far evaluated exclusively assistant-level tasks, leaving the academic-level capabilities of OpenClaw largely unexamined. We introduce AcademiClaw, a bilingual benchmark …

Reinforcement Learning

A Benchmark of PDF Information Extraction Tools using a Multi-Task and Multi-Domain Evaluation Framework for Academic Documents

2023-03-17 · Norman Meuschke, Apurva Jagdale, Timo Spinde, Jelena Mitrović 외

Extracting information from academic PDF documents is crucial for numerous indexing, retrieval, and analysis use cases. Choosing the best tool to extract specific content elements is difficult because many, technically d…

RetrievalTable Extraction

Span Identification of Epistemic Stance-Taking in Academic Written English

2023-06-03 · Masaki Eguchi, Kristopher Kyle

Responding to the increasing need for automated writing evaluation (AWE) systems to assess language use beyond lexis and grammar (Burstein et al., 2016), we introduce a new approach to identify rhetorical features of sta…

Automated Writing Evaluation

DeepSurvey-Bench: Evaluating Academic Value of Automatically Generated Scientific Surveys

2026-01-13 · Guo-Biao Zhang, Ding-Yuan Liu, Da-Yi Wu, Tian Lan 외 arxiv

The rapid development of automated survey generation technology has made it increasingly important to establish a comprehensive benchmark to evaluate the quality of generated surveys. Most existing benchmarks first const…

Overcoming the "Impracticality" of RAG: Proposing a Real-World Benchmark and Multi-Dimensional Diagnostic Framework

2026-04-03 · Kenichirou Narita, Siqi Peng, Taku Fukui, Moyuru Yamada 외 arxiv

Performance evaluation of Retrieval-Augmented Generation (RAG) systems within enterprise environments is governed by multi-dimensional and composite factors extending far beyond simple final accuracy checks. These factor…