paper-with-me

홈 › Papers

Fairness-Aware Performance Evaluation for Multi-Party Multi-Objective Optimization

2026-01-30 · Zifan Zhao, Peilan Xu, Wenjian Luo arxiv

In multiparty multiobjective optimization problems, solution sets are usually evaluated using classical performance metrics, aggregated across DMs. However, such mean-based evaluations may be unfair by favoring certain parties, as they assume identical geometric approximation quality to each party's PF carries comparable evaluative significance. Moreover, prevailing notions of MPMOP optimal solutions are restricted to strictly common Pareto optimal solutions, representing a narrow form of cooperation in multiparty decision making scenarios. These limitations obscure whether a solution set reflects balanced relative gains or meaningful consensus among heterogeneous DMs. To address these issues, this paper develops a fairness-aware performance evaluation framework grounded in a generalized notion of consensus solutions. From a cooperative game-theoretic perspective, we formalize four axioms that a fairness-aware evaluation function for MPMOPs should satisfy. By introducing a concession rate vector to quantify acceptable compromises by individual DMs, we generalize the classical definition of MPMOP optimal solutions and embed classical performance metrics into a Nash-product-based evaluation framework, which is theoretically shown to satisfy all axioms. To support empirical validation, we further construct benchmark problems that extend existing MPMOP suites by incorporating consensus-deficient negotiation structures. Experimental results demonstrate that the proposed evaluation framework is able to distinguish algorithmic performance in a manner consistent with consensus-aware fairness considerations. Specifically, algorithms converging toward strictly common solutions are assigned higher evaluation scores when such solutions exist, whereas in the absence of strictly common solutions, algorithms that effectively cover the commonly acceptable region are more favorably evaluated.

📄 PDF Abstract BibTeX arXiv:2601.22497

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Collaborative Machine Learning with Incentive-Aware Model Rewards

2020-10-24 · ICML 2020 1 · Rachael Hwee Ling Sim, Yehong Zhang, Mun Choon Chan, Bryan Kian Hsiang Low

Collaborative machine learning (ML) is an appealing paradigm to build high-quality ML models by training on the aggregated data from many parties. However, these parties are only willing to share their data when given en…

BIG-bench Machine LearningFairness

Incentivizing Time-Aware Fairness in Data Sharing

2025-10-10 · Jiangwei Chen, Kieu Thao Nguyen Pham, Rachael Hwee Ling Sim, Arun Verma 외 arxiv

In collaborative data sharing and machine learning, multiple parties aggregate their data resources to train a machine learning model with better model performance. However, as the parties incur data collection costs, th…

Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations

2025-11-06 · Anka Reuel, Avijit Ghosh, Jenny Chim, Andrew Tran 외 arxiv

Foundation models are increasingly central to high-stakes AI systems, and governance frameworks now depend on evaluations to assess their risks and capabilities. Although general capability evaluations are widespread, so…

Protecting the Protected Group: Circumventing Harmful Fairness

2019-05-25 · Omer Ben-Porat, Fedor Sandomirskiy, Moshe Tennenholtz

Machine Learning (ML) algorithms shape our lives. Banks use them to determine if we are good borrowers; IT companies delegate them recruitment decisions; police apply ML for crime-prediction, and judges base their verdic…

Crime PredictionFairness

MPCEval: A Benchmark for Multi-Party Conversation Generation

2026-03-05 · Minxing Zhang, Yi Yang, Zhuofan Jia, Xuan Yang 외 arxiv

Multi-party conversation generation, such as smart reply and collaborative assistants, is an increasingly important capability of generative AI, yet its evaluation remains a critical bottleneck. Compared to two-party dia…