Is attention branch network effective in classifying dental implants from panoramic radiograph images by deep learning?
Shintaro SukegawaKazumasa YoshiiTakeshi HaraFuta TanakaKatsusuke YamashitaTutaro KagayaKeisuke NakanoKiyofumi TakabatakeHotaka KawaiHitoshi NagatsukaYoshihiko FurukiPublished in: PloS one (2022)
Attention mechanism, which is a means of determining which part of the forced data is emphasized, has attracted attention in various fields of deep learning in recent years. The purpose of this study was to evaluate the performance of the attention branch network (ABN) for implant classification using convolutional neural networks (CNNs). The data consisted of 10191 dental implant images from 13 implant brands that cropped the site, including dental implants as pretreatment, from digital panoramic radiographs of patients who underwent surgery at Kagawa Prefectural Central Hospital between 2005 and 2021. ResNet 18, 50, and 152 were evaluated as CNN models that were compared with and without the ABN. We used accuracy, precision, recall, specificity, F1 score, and area under the receiver operating characteristics curve as performance metrics. We also performed statistical and effect size evaluations of the 30-time performance metrics of the simple CNNs and the ABN model. ResNet18 with ABN significantly improved the dental implant classification performance for all the performance metrics. Effect sizes were equivalent to "Huge" for all performance metrics. In contrast, the classification performance of ResNet50 and 152 deteriorated by adding the attention mechanism. ResNet18 showed considerably high compatibility with the ABN model in dental implant classification (AUC = 0.9993) despite the small number of parameters. The limitation of this study is that only ResNet was verified as a CNN; further studies are required for other CNN models.
Keyphrases
- deep learning
- convolutional neural network
- working memory
- artificial intelligence
- machine learning
- soft tissue
- big data
- end stage renal disease
- oral health
- minimally invasive
- chronic kidney disease
- magnetic resonance
- healthcare
- newly diagnosed
- ejection fraction
- emergency department
- coronary artery disease
- computed tomography
- magnetic resonance imaging
- data analysis
- coronary artery bypass
- patient reported outcomes
- optical coherence tomography
- case control
- atrial fibrillation
- patient reported