Spatial validation reveals poor predictive performance of large-scale ecological mapping models.
Pierre PlotonFrédéric MortierMaxime Réjou-MéchainNicolas BarbierNicolas PicardVivien RossiCarsten F DormannGuillaume CornuGaëlle ViennoisNicolas BayolAlexei LyapustinSylvie Gourlet-FleuryRaphaël PélissierPublished in: Nature communications (2020)
Mapping aboveground forest biomass is central for assessing the global carbon balance. However, current large-scale maps show strong disparities, despite good validation statistics of their underlying models. Here, we attribute this contradiction to a flaw in the validation methods, which ignore spatial autocorrelation (SAC) in data, leading to overoptimistic assessment of model predictive power. To illustrate this issue, we reproduce the approach of large-scale mapping studies using a massive forest inventory dataset of 11.8 million trees in central Africa to train and validate a random forest model based on multispectral and environmental variables. A standard nonspatial validation method suggests that the model predicts more than half of the forest biomass variation, while spatial validation methods accounting for SAC reveal quasi-null predictive power. This study underscores how a common practice in big data mapping studies shows an apparent high predictive power, even when predictors have poor relationships with the ecological variable of interest, thus possibly leading to erroneous maps and interpretations.
Keyphrases
- climate change
- big data
- high resolution
- high density
- human health
- primary care
- healthcare
- artificial intelligence
- machine learning
- wastewater treatment
- gene expression
- magnetic resonance imaging
- risk assessment
- magnetic resonance
- genome wide
- electronic health record
- quality improvement
- anaerobic digestion
- computed tomography
- diffusion weighted imaging
- data analysis