Assessing the effect of sample bias correction in species distribution models
Open-source biodiversity databases contain a large amount of species occurrence records, but these are often spatially biased, which affects the reliability of species distribution models based on these records. Sample bias correction techniques include data filtering at the cost of record numbers or require considerable additional sampling effort. However, independent data are rarely available and assessment of the correction technique must rely on performance metrics computed with subsets of the only available (biased) data, which may be misleading. Here we assess the extent to which an acknowledged sample bias correction technique is likely to improve models' ability to predict species distributions in the absence of independent data. We assessed the variation in model predictions induced by the correction and model stochasticity. We present an index of the effect of correction relative to model stochasticity, the Relative Overlap Index (ROI). We tested whether the ROI better represented the effect of correction than classic performance metrics and absolute overlap metrics using 64 vertebrate species and 21 virtual species with a generated sample bias. When based on absolute overlaps and cross-validation performance metrics, we found no effect of correction, except for cAUC. When considering its effect relative to model stochasticity, the effect of correction depended on the site and the species. Virtual species enabled us to verify that the correction actually improved distribution predictions and the biological relevance of the selected variables at the sites with a clear gradient of sample bias, and when species distribution predictors are not correlated with sample bias patterns.
Code (1)
Similar Papers 제목 키워드 기반
Algorithmic Accountability in Small Data: Sample-Size-Induced Bias Within Classification Metrics
Evaluating machine learning models is crucial not only for determining their technical accuracy but also for assessing their potential societal implications. While the potential for low-sample-size bias in algorithms is …
Assessing putative bias in prediction of anti-microbial resistance from real-world genotyping data under explicit causal assumptions
Whole genome sequencing (WGS) is quickly becoming the customary means for identification of antimicrobial resistance (AMR) due to its ability to obtain high resolution information about the genes and mechanisms that are …
Efficient Bias Correction for Cross-section and Panel Data
Bias correction can often improve the finite sample performance of estimators. We show that the choice of bias correction method has no effect on the higher-order variance of semiparametrically efficient parametric estim…
Uncertainty-based Debiasing and Unlearning for Decontamination
Benchmark-based evaluation is the dominant paradigm for assessing large language model (LLM) capabilities, yet data contamination inflates reported performance and undermines fair comparison. Existing decontamination met…
Speciesism in AI: Evaluating Discrimination Against Animals in Large Language Models
As large language models (LLMs) become more widely deployed, it is crucial to examine their ethical tendencies. Building on research on fairness and discrimination in AI, we investigate whether LLMs exhibit speciesist bi…
Text Generation