FashionFail: Addressing Failure Cases in Fashion Object Detection and Segmentation
In the realm of fashion object detection and segmentation for online shopping images, existing state-of-the-art fashion parsing models encounter limitations, particularly when exposed to non-model-worn apparel and close-up shots. To address these failures, we introduce FashionFail; a new fashion dataset with e-commerce images for object detection and segmentation. The dataset is efficiently curated using our novel annotation tool that leverages recent foundation models. The primary objective of FashionFail is to serve as a test bed for evaluating the robustness of models. Our analysis reveals the shortcomings of leading models, such as Attribute-Mask R-CNN and Fashionformer. Additionally, we propose a baseline approach using naive data augmentation to mitigate common failure cases and improve model robustness. Through this work, we aim to inspire and support further research in fashion item detection and segmentation for industrial applications. The dataset, annotation tool, code, and models are available at \url{https://rizavelioglu.github.io/fashionfail/}.
Code (1)
Tasks
Data AugmentationObject DetectionSegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Search-based Robustness Testing of Laptop Refurbishing Robotic Software
The Danish Technological Institute (DTI) focuses on transferring advanced technologies (including robots) to the industry and the public sector. One key application is laptop refurbishment using specialized robots, aimed…
Object DetectionSyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
Vision-language models (VLMs) have made significant strides in cross-modal understanding through large-scale paired datasets. However, in fashion domain, datasets often exhibit a disparity between the information conveye…
Contrastive LearningImage-text matchingLanguage ModelingLanguage Modelling+2Addressing the IEEE AV Test Challenge with Scenic and VerifAI
This paper summarizes our formal approach to testing autonomous vehicles (AVs) in simulation for the IEEE AV Test Challenge. We demonstrate a systematic testing framework leveraging our previous work on formally-driven s…
Autonomous VehiclesProbabilistic ProgrammingHard-Aware Fashion Attribute Classification
Fashion attribute classification is of great importance to many high-level tasks such as fashion item search, fashion trend analysis, fashion recommendation, etc. The task is challenging due to the extremely imbalanced d…
AttributeClassificationGeneral ClassificationImproving Occlusion and Hard Negative Handling for Single-Stage Pedestrian Detectors
We propose methods of addressing two critical issues of pedestrian detection: (i) occlusion of target objects as false negative failure, and (ii) confusion with hard negative examples like vertical structures as false po…
Occlusion HandlingPedestrian Detection