Login / Signup

External validation of prognostic models to predict stillbirth using the International Prediction of Pregnancy Complications (IPPIC) Network database: an individual participant data meta-analysis.

John AlloteyR WhittleK I E SnellM SmukR TownsendP von DadelszenA E P HeazellL MageeG C S SmithJ SandallBaskaran ThilaganathanJ ZamoraR D RileyA KhalilS Thangaratinamnull null
Published in: Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology (2021)
We identified 17 studies reporting the development of 40 prognostic models for stillbirth. None of the models were previously externally validated, and only a fifth (20%, 8/40) reported the full model equation. We were able to validate three of these models using the IPD from 19 cohort studies (491,201 pregnant women) within the IPPIC Network database. Based on evaluating their development studies, all three models had an overall high risk of bias according to PROBAST. In our IPD meta-analysis, the models had summary C-statistics ranging from 0.53 to 0.65; summary calibration slopes of 0.40 to 0.88, and generally with observed risks predictions that were too extreme compared to observed risks; and little to no clinical utility as assessed by net benefit. However, there remained uncertainty in performance for some models due to small available sample sizes CONCLUSION: The three validated models generally showed poor and uncertain predictive performance in new data, with limited evidence to support their clinical application. Findings suggest methodological shortcomings in their development including overfitting of models. Further research is needed to further validate these and other models, identify stronger prognostic factors, and to develop more robust prediction models. This article is protected by copyright. All rights reserved.
Keyphrases
  • systematic review
  • pregnant women
  • prognostic factors
  • machine learning
  • risk assessment
  • randomized controlled trial
  • human health
  • artificial intelligence