paper-with-me

Papers

Depth Functions for Partial Orders with a Descriptive Analysis of Machine Learning Algorithms

2023-04-19 · Hannah Blocher, Georg Schollmeyer, Christoph Jansen, Malte Nalenz

We propose a framework for descriptively analyzing sets of partial orders based on the concept of depth functions. Despite intensive studies of depth functions in linear and metric spaces, there is very little discussion on depth functions for non-standard data types such as partial orders. We introduce an adaptation of the well-known simplicial depth to the set of all partial orders, the union-free generic (ufg) depth. Moreover, we utilize our ufg depth for a comparison of machine learning algorithms based on multidimensional performance measures. Concretely, we analyze the distribution of different classifier performances over a sample of standard benchmark data sets. Our results promisingly demonstrate that our approach differs substantially from existing benchmarking approaches and, therefore, adds a new perspective to the vivid debate on the comparison of classifiers.

📄 PDF Abstract BibTeX arXiv:2304.09872

Code (1)

hannahblo/23_performance_analysis_ml_algorithms 공식 구현

Tasks

BenchmarkingDescriptive

Similar Papers 제목 키워드 기반

Comparing Machine Learning Algorithms by Union-Free Generic Depth

2023-12-20 · Hannah Blocher, Georg Schollmeyer, Malte Nalenz, Christoph Jansen

We propose a framework for descriptively analyzing sets of partial orders based on the concept of depth functions. Despite intensive studies in linear and metric spaces, there is very little discussion on depth functions…

Benchmarking

A note on the connectedness property of union-free generic sets of partial orders

2023-04-19 · Georg Schollmeyer, Hannah Blocher

This short note describes and proves a connectedness property which was introduced in Blocher et al. [2023] in the context of data depth functions for partial orders. The connectedness property gives a structural insight…

Partial Rankings of Optimizers

2024-02-26 · Julian Rodemann, Hannah Blocher

We introduce a framework for benchmarking optimizers according to multiple criteria over various test functions. Based on a recently introduced union-free generic depth function for partial orders/rankings, it fully expl…

Benchmarking

Choice functions based on sets of strict partial orders: an axiomatic characterisation

2020-03-25 · Jasper De Bock

Methods for choosing from a set of options are often based on a strict partial order on these options, or on a set of such partial orders. I here provide a very general axiomatic characterisation for choice functions of …

Deep Submodular Functions

2017-01-31 · Jeffrey Bilmes, Wenruo Bai

We start with an overview of a class of submodular functions called SCMMs (sums of concave composed with non-negative modular functions plus a final arbitrary modular). We then define a new class of submodular functions …

Descriptive