paper-with-me

홈 › Papers

Unsupervised Anomaly Detection for Auditing Data and Impact of Categorical Encodings

2022-10-25 · Ajay Chawda, Stefanie Grimm, Marius Kloft

In this paper, we introduce the Vehicle Claims dataset, consisting of fraudulent insurance claims for automotive repairs. The data belongs to the more broad category of Auditing data, which includes also Journals and Network Intrusion data. Insurance claim data are distinctively different from other auditing data (such as network intrusion data) in their high number of categorical attributes. We tackle the common problem of missing benchmark datasets for anomaly detection: datasets are mostly confidential, and the public tabular datasets do not contain relevant and sufficient categorical attributes. Therefore, a large-sized dataset is created for this purpose and referred to as Vehicle Claims (VC) dataset. The dataset is evaluated on shallow and deep learning methods. Due to the introduction of categorical attributes, we encounter the challenge of encoding them for the large dataset. As One Hot encoding of high cardinal dataset invokes the "curse of dimensionality", we experiment with GEL encoding and embedding layer for representing categorical attributes. Our work compares competitive learning, reconstruction-error, density estimation and contrastive learning approaches for Label, One Hot, GEL encoding and embedding layer to handle categorical values.

📄 PDF Abstract BibTeX arXiv:2210.14056

Code (1)

ajaychawda58/uadad 공식 구현 pytorch

Tasks

Anomaly DetectionContrastive LearningDensity EstimationUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Impact of Inaccurate Contamination Ratio on Robust Unsupervised Anomaly Detection

2024-08-14 · Jordan F. Masakuna, DJeff Kanda Nkashama, Arian Soltani, Marc Frappier 외

Training data sets intended for unsupervised anomaly detection, typically presumed to be anomaly-free, often contain anomalies (or contamination), a challenge that significantly undermines model performance. Most robust …

Anomaly DetectionMisinformationUnsupervised Anomaly Detection

Study of the Impact of the Big Data Era on Accounting and Auditing

2024-03-11 · Yuxiang Sun, Jingyi Li, Mengdie Lu, Zongying Guo

Big data revolutionizes accounting and auditing, offering deep insights but also introducing challenges like data privacy and security. With data from IoT, social media, and transactions, traditional practices are evolvi…

Anomaly Detection

Unsupervised Detection of Fetal Brain Anomalies using Denoising Diffusion Models

2024-08-07 · Markus Ditlev Sjøgren Olsen, Jakob Ambsdorf, Manxi Lin, Caroline Taksøe-Vester 외

Congenital malformations of the brain are among the most common fetal abnormalities that impact fetal development. Previous anomaly detection methods on ultrasound images are based on supervised learning, rely on manual …

Anomaly DetectionDenoising

What makes a good data augmentation for few-shot unsupervised image anomaly detection?

2023-04-06 · Lingrui Zhang, Shuheng Zhang, Guoyang Xie, Jiaqi Liu 외

Data augmentation is a promising technique for unsupervised anomaly detection in industrial applications, where the availability of positive samples is often limited due to factors such as commercial competition and samp…

Anomaly DetectionData AugmentationUnsupervised Anomaly Detection

Bias in Unsupervised Anomaly Detection in Brain MRI

2023-08-26 · Cosmin I. Bercea, Esther Puyol-Antón, Benedikt Wiestler, Daniel Rueckert 외

Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance. In the current …

Alzheimer's Disease DetectionAnomaly DetectionDiagnosticFairness+1