paper-with-me

홈 › Papers

Filtered ANN as a Phase Transition: When Selectivity-Estimation Error Causes Plan Regret

2026-06-15 · Madhulatha Mandarapu, Sandeep Kunkunuru arxiv

A filtered approximate-nearest-neighbor (ANN) query returns the k nearest vectors among those satisfying an attribute predicate P of selectivity s. The best execution strategy -- pre-filter, post-filter, or in-filter -- changes with s, so a system must estimate s and choose. We model this as an argmax over a landscape with phases (regions where each strategy wins) separated by boundaries, and show that selectivity-estimation error produces plan regret -- recall lost versus the oracle strategy -- only in the critical regions around those boundaries. The regret is a wedge of log-width equal to the multiplicative estimation error epsilon and height equal to the local cliff |V'(s*)| epsilon; the flip-margin 1/|V'(s*)| is the condition number of a sibling cardinality-estimation study reappearing as the local boundary theory. The two phase boundaries follow from independent mathematics: order statistics place the post-filter cliff at s ~ k/K, and site percolation places the in-filter cliff at s_c ~ 0.83/M for graph degree M (corpus-size independent). Criticality exists only under a constrained budget B < sqrt(k n). Under pre-registered decision rules we confirm, on synthetic sweeps and real SIFT1M, that regret concentrates ~290x at the boundary and that the regret curves obey a finite-size scaling collapse onto one universal wedge across two decades of corpus size. A real approximate index does not mis-locate the boundary, but a biased cost model opens a persistent miscalibration band that estimation-error robustness cannot fix. The contribution is a characterization, not a new index. Code and the full pre-registration are public.

📄 PDF Abstract BibTeX arXiv:2606.16341

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Do Attention Circuits Form? Developmental Trajectories of Capability and Attention-Sink Emergence Across Three 1B-ClassArchitectures

2026-06-01 · Yongzhong Xu arxiv

We track the developmental trajectory of attention-head circuit formation across three 1B-class language models spanning two architecture families (dense transformer, mixture-of-experts) and two pretraining corpora (The …

Selectivity Estimation for Range Predicates using Lightweight Models

2019-05-01 · Proceedings of the VLDB Endowment 2019 5 · Anshuman Dutt, Chi Wang, Azade Nazi, Srikanth Kandula 외

Query optimizers depend on selectivity estimates of query predicates to produce a good execution plan. When a query contains multiple predicates, today’s optimizers use a variety of assumptions, such as independence betw…

Feature Engineeringregression

Parameter estimation of default portfolios using the Merton model and Phase transition

2020-05-16 · Masato Hisakado, Shintaro Mori

We discuss the parameter estimation of the probability of default (PD), the correlation between the obligors, and a phase transition. In our previous work, we studied the problem using the beta-binomial distribution. A n…

parameter estimation

Multi-Attribute Selectivity Estimation Using Deep Learning

2019-03-24 · Shohedul Hasan, Saravanan Thirumuruganathan, Jees Augustine, Nick Koudas 외

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially chall…

AttributeDeep LearningDensity Estimation

Reward-Relevance-Filtered Linear Offline Reinforcement Learning

2024-01-23 · Angela Zhou

This paper studies offline reinforcement learning with linear function approximation in a setting with decision-theoretic, but not estimation sparsity. The structural restrictions of the data-generating process presume t…

reinforcement-learningReinforcement Learning