Login / Signup

Machine Learning in Environmental Research: Common Pitfalls and Best Practices.

Jun-Jie ZhuMeiqi YangZhiyong Jason Ren
Published in: Environmental science & technology (2023)
Machine learning (ML) is increasingly used in environmental research to process large data sets and decipher complex relationships between system variables. However, due to the lack of familiarity and methodological rigor, inadequate ML studies may lead to spurious conclusions. In this study, we synthesized literature analysis with our own experience and provided a tutorial-like compilation of common pitfalls along with best practice guidelines for environmental ML research. We identified more than 30 key items and provided evidence-based data analysis based on 148 highly cited research articles to exhibit the misconceptions of terminologies, proper sample size and feature size, data enrichment and feature selection, randomness assessment, data leakage management, data splitting, method selection and comparison, model optimization and evaluation, and model explainability and causality. By analyzing good examples on supervised learning and reference modeling paradigms, we hope to help researchers adopt more rigorous data preprocessing and model development standards for more accurate, robust, and practicable model uses in environmental research and applications.
Keyphrases
  • machine learning
  • data analysis
  • big data
  • electronic health record
  • healthcare
  • artificial intelligence
  • systematic review
  • deep learning
  • risk assessment
  • adverse drug