paper-with-me

Papers

Evaluating and Enhancing Segmentation Model Robustness with Metamorphic Testing

2025-04-03 · Seif Mzoughi, Mohamed Elshafeia, Foutse khomh

Image segmentation is critical for applications such as medical imaging, augmented reality, and video surveillance. However, segmentation models often lack robustness, making them vulnerable to adversarial perturbations from subtle image distortions. In this work, we propose SegRMT, a metamorphic testing approach that leverages genetic algorithms (GA) to optimize sequences of spatial and spectral transformations while preserving image fidelity via a predefined PSNR threshold. Using the Cityscapes dataset, our method generates adversarial examples that effectively challenge the DeepLabV3 segmentation model. Our experiments show that SegRMT reduces DeepLabV3's mean Intersection over Union (mIoU) to 6.4%, outperforming other adversarial baselines that decrease mIoU to between 8.5% and 21.7%. Furthermore, when used for adversarial training, SegRMT boosts model performance, achieving mIoU improvements up to 73% on dedicated adversarial datasets and increasing cross-adversarial mIoU to 53.8%, compared to only 2%-10% for other methods. These findings demonstrate that SegRMT not only simulates realistic image distortions but also enhances the robustness of segmentation models, making it a valuable tool for ensuring reliable performance in safety-critical applications.

📄 PDF Abstract BibTeX arXiv:2504.02335

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Spatial Pyramid Pooling Spatial Pyramid Pooling (SPP) is a pooling layer that removes the fixed-size constraint of the network, i.e. a CNN does not require a fixed-size input image. Specifically, we…
ASPP Atrous Spatial Pyramid Pooling (ASPP) is a semantic segmentation module for resampling a given feature layer at multiple rates prior to…
Batch Normalization 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Dilated Convolution 설명 없음
DeepLabv3 설명 없음

Similar Papers 제목 키워드 기반

Enhancing Deep Learning Model Robustness through Metamorphic Re-Training

2024-12-02 · Said Togru, Youssef Sameh Mostafa, Karim Lotfy

This paper evaluates the use of metamorphic relations to enhance the robustness and real-world performance of machine learning models. We propose a Metamorphic Retraining Framework, which applies metamorphic relations to…

Deep Learning

MetaRA: Metamorphic Robustness Assessment for Multimodal Large Language Model-based Visual Question Answering Systems

2026-05-19 · Quanxing Xu, Yuhao Tian, Ling Zhou, Xian Zhong 외 arxiv

Visual Question Answering (VQA), as the representative multimodal task, serves as a key benchmark for evaluating the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, existing evaluations large…

Visual Question AnsweringMultimodal Reasoning

MT-Teql: Evaluating and Augmenting Consistency of Text-to-SQL Models with Metamorphic Testing

2020-12-21 · Pingchuan Ma, Shuai Wang

Text-to-SQL is a task to generate SQL queries from human utterances. However, due to the variation of natural language, two semantically equivalent utterances may appear differently in the lexical level. Likewise, user p…

Text to SQLText-To-SQL

LLMORPH: Automated Metamorphic Testing of Large Language Models

2026-03-24 · Steven Cho, Stefano Ruberto, Valerio Terragni arxiv

Automated testing is essential for evaluating and improving the reliability of Large Language Models (LLMs), yet the lack of automated oracles for verifying output correctness remains a key challenge. We present LLMORPH,…

LGMT: Logic-Grounded Metamorphic Testing for Evaluating the Reasoning Reliability of LLMs

2026-05-12 · Zenghui Zhou, Man Li, Xiaoke Fang, Xinyi Zhou 외 arxiv

Large Language Models (LLMs) achieve strong performance on logical reasoning benchmarks, yet their reliability remains uncertain. Existing evaluations rely on static benchmarks, which fail to assess robustness under logi…

Logical Reasoning