paper-with-me

Papers

Quadratic Upper Bound for Recursive Teaching Dimension of Finite VC Classes

2017-02-18 · Lunjia Hu, Ruihan Wu, Tianhong Li, Li-Wei Wang

In this work we study the quantitative relation between the recursive teaching dimension (RTD) and the VC dimension (VCD) of concept classes of finite sizes. The RTD of a concept class $\mathcal C \subseteq \{0, 1\}^n$, introduced by Zilles et al. (2011), is a combinatorial complexity measure characterized by the worst-case number of examples necessary to identify a concept in $\mathcal C$ according to the recursive teaching model. For any finite concept class $\mathcal C \subseteq \{0,1\}^n$ with $\mathrm{VCD}(\mathcal C)=d$, Simon & Zilles (2015) posed an open problem $\mathrm{RTD}(\mathcal C) = O(d)$, i.e., is RTD linearly upper bounded by VCD? Previously, the best known result is an exponential upper bound $\mathrm{RTD}(\mathcal C) = O(d \cdot 2^d)$, due to Chen et al. (2016). In this paper, we show a quadratic upper bound: $\mathrm{RTD}(\mathcal C) = O(d^2)$, much closer to an answer to the open problem. We also discuss the challenges in fully solving the problem.

📄 PDF Abstract BibTeX arXiv:1702.05677

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the Recursive Teaching Dimension of VC Classes

2016-12-01 · NeurIPS 2016 12 · Xi Chen, Yu Cheng, Bo Tang

The recursive teaching dimension (RTD) of a concept class $C \subseteq \{0, 1\}^n$, introduced by Zilles et al. [ZLHZ11], is a complexity parameter measured by the worst-case number of labeled examples needed to learn an…

Lower Bounds for Greedy Teaching Set Constructions

2025-05-06 · Spencer Compton, Chirag Pabbaraju, Nikita Zhivotovskiy

A fundamental open problem in learning theory is to characterize the best-case teaching dimension $\operatorname{TS}_{\min}$ of a concept class $\mathcal{C}$ with finite VC dimension $d$. Resolving this problem will, in …

Learning Theory

Teaching and compressing for low VC-dimension

2015-02-22 · Shay Moran, Amir Shpilka, Avi Wigderson, Amir Yehudayoff

In this work we study the quantitative relation between VC-dimension and two other basic parameters related to learning and teaching. Namely, the quality of sample compression schemes and of teaching sets for classes of …

A Labelled Sample Compression Scheme of Size at Most Quadratic in the VC Dimension

2022-12-24 · Farnam Mansouri, Sandra Zilles

This paper presents a construction of a proper and stable labelled sample compression scheme of size $O(\VCD^2)$ for any finite concept class, where $\VCD$ denotes the Vapnik-Chervonenkis Dimension. The construction is b…

Open-Ended Question Answering

On Lower and Upper Bounds in Smooth Strongly Convex Optimization - A Unified Approach via Linear Iterative Methods

2014-10-23 · Yossi Arjevani

In this thesis we develop a novel framework to study smooth and strongly convex optimization algorithms, both deterministic and stochastic. Focusing on quadratic functions we are able to examine optimization algorithms a…

valid