Imposing Consistency Properties on Blackbox Systems with Applications to SVD-Based Recommender Systems
In this paper we discuss pre- and post-processing methods to induce desired consistency and/or invariance properties in blackbox systems, e.g., AI-based. We demonstrate our approach in the context of blackbox SVD-based matrix-completion methods commonly used in recommender system (RS) applications. We provide empirical results showing that enforcement of unit-consistency and shift-consistency, which have provable RS-relevant properties relating to robustness and fairness, also lead to improved performance according to generic RMSE and MAE performance metrics, irrespective of the initial chosen hyperparameter.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessMatrix CompletionRecommendation SystemsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Abstraction between Structural Causal Models: A Review of Definitions and Properties
Structural causal models (SCMs) are a widespread formalism to deal with causal systems. A recent direction of research has considered the problem of relating formally SCMs at different levels of abstraction, by defining …
Kernel Learning for Sample Constrained Black-Box Optimization
Black box optimization (BBO) focuses on optimizing unknown functions in high-dimensional spaces. In many applications, sampling the unknown function is expensive, imposing a tight sample budget. Ongoing work is making pr…
Polynomial-Model-Based Optimization for Blackbox Objectives
For a wide range of applications the structure of systems like Neural Networks or complex simulations, is unknown and approximation is costly or even impossible. Black-box optimization seeks to find optimal (hyper-) para…
Bayesian OptimizationmodelOutline of an Independent Systematic Blackbox Test for ML-based Systems
This article proposes a test procedure that can be used to test ML models and ML-based systems independently of the actual training process. In this way, the typical quality statements such as accuracy and precision of t…
Can Targeted Adversarial Examples Transfer When the Source and Target Models Have No Label Space Overlap?
We design blackbox transfer-based targeted adversarial attacks for an environment where the attacker's source model and the target blackbox model may have disjoint label spaces and training datasets. This scenario signif…