paper-with-me

Papers

Safety vs. Performance: How Multi-Objective Learning Reduces Barriers to Market Entry

2024-09-05 · Meena Jagadeesan, Michael I. Jordan, Jacob Steinhardt

Emerging marketplaces for large language models and other large-scale machine learning (ML) models appear to exhibit market concentration, which has raised concerns about whether there are insurmountable barriers to entry in such markets. In this work, we study this issue from both an economic and an algorithmic point of view, focusing on a phenomenon that reduces barriers to entry. Specifically, an incumbent company risks reputational damage unless its model is sufficiently aligned with safety objectives, whereas a new company can more easily avoid reputational damage. To study this issue formally, we define a multi-objective high-dimensional regression framework that captures reputational damage, and we characterize the number of data points that a new company needs to enter the market. Our results demonstrate how multi-objective considerations can fundamentally reduce barriers to entry -- the required number of data points can be significantly smaller than the incumbent company's dataset size. En route to proving these results, we develop scaling laws for high-dimensional linear regression in multi-objective environments, showing that the scaling rate becomes slower when the dataset size is large, which could be of independent interest.

📄 PDF Abstract BibTeX arXiv:2409.03734

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

BarrierSteer: LLM Safety via Learning Barrier Steering

2026-02-23 · Thanh Q. Tran, Arun Verma, Kiwan Wong, Bryan Kian Hsiang Low 외 arxiv

Despite the strong performance of large language models (LLMs) across diverse tasks, their susceptibility to adversarial attacks and unsafe content generation remains a significant obstacle to deployment, particularly in…

Adversarial Attack

Safe non-smooth black-box optimization with application to policy search

2020-06-08 · L4DC 2020 6 · Ilnura Usmanova, Andreas Krause, Maryam Kamgarpour

For safety-critical black-box optimization tasks, observations of the constraints and the objective are often noisy and available only for the feasible points. We propose an approach based on log barriers to find a local…

AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security

2026-05-28 · Dongrui Liu, Yu Li, Zhonghao Yang, Peng Wang 외 arxiv

Modern open-world agents such as OpenClaw exhibit powerful cross-environment execution capabilities yet introduce broad new safety risk sources. Meanwhile, advanced frontier AI models drastically lower attack barriers, r…

The Alignment Trap: Complexity Barriers

2025-06-12 · Jasper Yao

This paper argues that AI alignment is not merely difficult, but is founded on a fundamental logical contradiction. We first establish The Enumeration Paradox: we use machine learning precisely because we cannot enumerat…

Mathematical Proofs

My Precious Crash Data: Barriers and Opportunities in Encouraging Autonomous Driving Companies to Share Safety-Critical Data

2025-04-10 · Hauke Sandhaus, Angel Hsing-Chi Hwang, Wendy Ju, Qian Yang

Safety-critical data, such as crash and near-crash records, are crucial to improving autonomous vehicle (AV) design and development. Sharing such data across AV companies, academic researchers, regulators, and the public…

Autonomous Driving