paper-with-me

Papers

With big data come big problems: pitfalls in measuring basis risk for crop index insurance

2022-09-29 · Matthieu Stigler, Apratim Dey, Andrew Hobbs, David Lobell

New satellite sensors will soon make it possible to estimate field-level crop yields, showing a great potential for agricultural index insurance. This paper identifies an important threat to better insurance from these new technologies: data with many fields and few years can yield downward biased estimates of basis risk, a fundamental metric in index insurance. To demonstrate this bias, we use state-of-the-art satellite-based data on agricultural yields in the US and in Kenya to estimate and simulate basis risk. We find a substantive downward bias leading to a systematic overestimation of insurance quality. In this paper, we argue that big data in crop insurance can lead to a new situation where the number of variables $N$ largely exceeds the number of observations $T$. In such a situation where $T\ll N$, conventional asymptotics break, as evidenced by the large bias we find in simulations. We show how the high-dimension, low-sample-size (HDLSS) asymptotics, together with the spiked covariance model, provide a more relevant framework for the $T\ll N$ case encountered in index insurance. More precisely, we derive the asymptotic distribution of the relative share of the first eigenvalue of the covariance matrix, a measure of systematic risk in index insurance. Our formula accurately approximates the empirical bias simulated from the satellite data, and provides a useful tool for practitioners to quantify bias in insurance quality.

📄 PDF Abstract BibTeX arXiv:2209.14611

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Promises and Pitfalls of the Linearized Laplace in Bayesian Optimization

2023-04-17 · Agustinus Kristiadi, Alexander Immer, Runa Eschenhagen, Vincent Fortuin

The linearized-Laplace approximation (LLA) has been shown to be effective and efficient in constructing Bayesian neural networks. It is theoretically compelling since it can be seen as a Gaussian process posterior with t…

Bayesian OptimizationDecision MakingGaussian Processesimage-classification+2

Pitfalls and Outlooks in Using COMET

2024-08-27 · Vilém Zouhar, Pinzhen Chen, Tsz Kin Lam, Nikita Moghe 외

The COMET metric has blazed a trail in the machine translation community, given its strong correlation with human judgements of translation quality. Its success stems from being a modified pre-trained multilingual model …

Machine TranslationTranslation

Measuring multi-calibration

2025-06-12 · Ido Guy, Daniel Haimovich, Fridolin Linder, Nastaran Okati 외

A suitable scalar metric can help measure multi-calibration, defined as follows. When the expected values of observed responses are equal to corresponding predicted probabilities, the probabilistic predictions are known …

Density Estimation

On the Pitfalls of Measuring Emergent Communication

2019-03-12 · Ryan Lowe, Jakob Foerster, Y-Lan Boureau, Joelle Pineau 외

How do we know if communication is emerging in a multi-agent system? The vast majority of recent papers on emergent communication show that adding a communication channel leads to an increase in reward or task success. T…

Deep Reinforcement LearningFault DetectionReinforcement Learning

Natural Language Processing for Drug Discovery Knowledge Graphs: promises and pitfalls

2023-10-24 · J. Charles G. Jeynes, Tim James, Matthew Corney

Building and analysing knowledge graphs (KGs) to aid drug discovery is a topical area of research. A salient feature of KGs is their ability to combine many heterogeneous data sources in a format that facilitates discove…

Drug DiscoveryKnowledge Graphsnamed-entity-recognitionNamed Entity Recognition