Segmentation metric misinterpretations in bioimage analysis.
Dominik HirlingErvin TasnadiJuan CaicedoMaria V CaropreseRickard SjögrenMarc AubrevilleKrisztian KoosPeter HorvathPublished in: Nature methods (2023)
Quantitative evaluation of image segmentation algorithms is crucial in the field of bioimage analysis. The most common assessment scores, however, are often misinterpreted and multiple definitions coexist with the same name. Here we present the ambiguities of evaluation metrics for segmentation algorithms and show how these misinterpretations can alter leaderboards of influential competitions. We also propose guidelines for how the currently existing problems could be tackled.