paper-with-me

홈 › Papers

A Parameterized Theory of PAC Learning

2023-04-27 · Cornelius Brand, Robert Ganian, Kirill Simonov

Probably Approximately Correct (i.e., PAC) learning is a core concept of sample complexity theory, and efficient PAC learnability is often seen as a natural counterpart to the class P in classical computational complexity. But while the nascent theory of parameterized complexity has allowed us to push beyond the P-NP ``dichotomy'' in classical computational complexity and identify the exact boundaries of tractability for numerous problems, there is no analogue in the domain of sample complexity that could push beyond efficient PAC learnability. As our core contribution, we fill this gap by developing a theory of parameterized PAC learning which allows us to shed new light on several recent PAC learning results that incorporated elements of parameterized complexity. Within the theory, we identify not one but two notions of fixed-parameter learnability that both form distinct counterparts to the class FPT -- the core concept at the center of the parameterized complexity paradigm -- and develop the machinery required to exclude fixed-parameter learnability. We then showcase the applications of this theory to identify refined boundaries of tractability for CNF and DNF learning as well as for a range of learning problems on graphs.

📄 PDF Abstract BibTeX arXiv:2304.14058

Code (0)

등록된 구현이 없습니다.

Tasks

PAC learning

Similar Papers 제목 키워드 기반

A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning

2021-09-06 · Yehuda Dar, Vidya Muthukumar, Richard G. Baraniuk

The rapid recent progress in machine learning (ML) has raised a number of scientific questions that challenge the longstanding dogma of the field. One of the most important riddles is the good empirical generalization of…

Parameterized Complexity Analysis of Randomized Search Heuristics

2020-01-15 · Frank Neumann, Andrew M. Sutton

This chapter compiles a number of results that apply the theory of parameterized algorithmics to the running-time analysis of randomized search heuristics such as evolutionary algorithms. The parameterized approach artic…

Combinatorial OptimizationEvolutionary Algorithms

Understanding Benign Overfitting in Gradient-Based Meta Learning

2022-06-27 · Lisha Chen, Songtao Lu, Tianyi Chen

Meta learning has demonstrated tremendous success in few-shot learning with limited supervised data. In those settings, the meta model is usually overparameterized. While the conventional statistical learning theory sugg…

Few-Shot LearningLearning TheoryMeta-Learning

A Parameterized Complexity View on Description Logic Reasoning

2018-08-11 · Ronald de Haan

Description logics are knowledge representation languages that have been designed to strike a balance between expressivity and computational tractability. Many different description logics have been developed, and numero…

Erzeugunsgrad, VC-Dimension and Neural Networks with rational activation function

2025-04-15 · Luis Miguel Pardo, Daniel Sebastián

The notion of Erzeugungsgrad was introduced by Joos Heintz in 1983 to bound the number of non-empty cells occurring after a process of quantifier elimination. We extend this notion and the combinatorial bounds of Theorem…

Learning Theory