Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients.
Himanshi AllahabadiJulia AmannIsabelle BalotAndrea BerettaCharles E BinkleyJonas BozenhardFrederick BruneaultJames BrusseauSema CandemirLuca Alessandro CappelliniSubrata ChakrabortyNicoleta CherciuChristina CociancigMegan P CoffeeIrene EkLeonardo Espinosa-LealDavide FarinaGenevieve Fieux-CastagnetThomas FrauenfelderAlessio GallucciGuya GiulianiAdam GoldaIrmhild van HalemElisabeth HildtSune HolmGeorgios KararigasSebastien A KrierUlrich KuhneFrancesca LizziVince I MadaiAniek F MarkusSerg MasisEmilie Wiinblad MathezFrancesco MuredduEmanuele NeriWalter OsikaMatiss OzolsCecilia PaniguttiBrendan ParentFrancesca PratesiPedro A Moreno-SanchezGiovanni SartorMattia SavardiAlberto SignoroniHanna-Maria SormunenAndy SpezzattiAdarsh SrivastavaAnnette F StephansenBee Theng LauJesmin Jahan TithiJarno TuominenSteven UmbrelloFilippo VaccherDennis VetterMagnus WesterlundRenee WurthRoberto V ZicariPublished in: IEEE transactions on technology and society (2022)
This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does "trustworthy AI" mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.