A convolutional attention mapping deep neural network for classification and localization of cardiomegaly on chest X-rays

Abstract

Building a reliable and precise model for disease classification and identifying abnormal sites can provide physicians assistance in their decision-making process. Deep learning based image analysis is a promising technique for enriching the decision making process, and accordingly strengthening patient care. This work presents a convolutional attention mapping deep learning model, Cardio-XAttentionNet, to classify and localize cardiomegaly effectively. We revisit the global average pooling (GAP) system and add a weighting term to develop a light and effective Attention Mapping Mechanism (AMM). The model enables the classification of cardiomegaly from chest X-rays through image-level classification and pixel-level localization only from image-level labels. We leverage some of the advanced ConvNet architectures as a backbone-model of the proposed attention mapping network to build Cardio-XAttentionNet. The proposed model is trained on ChestX-Ray14, which is a publicly accessible chest X-ray dataset. The best single model achieves an overall precision, recall, F-1 measure and area under curve (AUC) scores of 0.87, 0.85, 0.86 and 0.89, respectively, for the classification of the cardiomegaly. The results also demonstrate that the Cardio-XAttentionNet model well captures the cardiomegaly class information at image-level as well as localization at pixel-level on chest x-rays. A comparative analysis between the proposed AMM and existing GAP based models shows that the proposed model achieves a state-of-the-art performance on this dataset for cardiomegaly detection using a single model.