Application of Fit CutMix data augmentation algorithm based on saliency information in medical images

Xinhuan LUO; Yixuan WANG; Wei LI; Xi CHEN

doi:10.11959/j.issn.2096-6652.202307

您当前的位置：

首页 >

文章列表页 >

Application of Fit CutMix data augmentation algorithm based on saliency information in medical images

Papers and Reports | 更新时间：2024-06-05

- Application of Fit CutMix data augmentation algorithm based on saliency information in medical images
- Chinese Journal of Intelligent Science and Technology Vol. 5, Issue 1, Pages: 58-68(2023)
- 作者机构：
  
  1. 华中科技大学人工智能与自动化学院，湖北武汉 430074
  2. 图像信息处理与智能控制教育部重点实验室，湖北武汉 430074
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.202307
  CLC： TP399
- Published Online：2023-03，
  
  Published：15 March 2023
- 稿件说明：
移动端阅览
Xinhuan LUO, Yixuan WANG, Wei LI, et al. Application of Fit CutMix data augmentation algorithm based on saliency information in medical images[J]. Chinese journal of intelligent science and technology, 2023, 5(1): 58-68.
DOI：

Xinhuan LUO, Yixuan WANG, Wei LI, et al. Application of Fit CutMix data augmentation algorithm based on saliency information in medical images[J]. Chinese journal of intelligent science and technology, 2023, 5(1): 58-68. DOI： 10.11959/j.issn.2096-6652.202307.

摘要

深度卷积神经网络是图像分类领域的主流算法之一，但是其训练需要大量标注数据，在阿尔茨海默病医学影像等小数据集上易出现过拟合现象。数据增强算法可以用于扩充数据量，其中 CutMix 数据增强算法近来被广泛应用，但是现有方法生成的增强图像往往忽略原始图像显著区域，且增强图像的标签设计考虑的因素较为单一。针对这些问题，提出Fit CutMix数据增强算法。该算法一是利用基于显著性极值迁移的区域替换策略生成增强样本，集中源样本与目标样本中显著性高的区域；二是综合源样本与目标样本的面积和显著性信息赋予增强样本标签，为卷积神经网络提供有效的监督信息。实验结果表明，将Fit CutMix数据增强算法用于ResNet50对阿尔茨海默病进行诊断时，准确率达96.6%，比直接使用ResNet50提高了约7%，且比应用现有数据增强算法至少提高3%，可见Fit CutMix数据增强算法可以有效提高深度卷积神经网络对医学影像识别的准确率。

Abstract

Deep convolutional neural network is one of the mainstream algorithms in the field of image classification

but its training requires a large number of labeled data

which leads to over fitting on small datasets such as Alzheimer's medical images.Data augmentation can increase the amount of training data

and CutMix data augmentation algorithm has been widely used recently.However

the augmented images generated by the CutMix series methods often ignore the significant area of the original image

and the design of the label of the augmented image takes only single factor into consideration.In order to solve these problems

the Fit CutMix data augmentation algorithm was proposed.Firstly

the region replacement strategy based on the transfer of saliency extreme value was used to generate augmented samples

so as to concentrate the regions with high saliency value in the source samples and target samples.Secondly

the area and saliency information of the source samples and the target samples were combined to assign the augmented sample label

which provided effective supervision information for the convolutional neural network.The experimental results showed that when Fit CutMix was used in ResNet50 to diagnose Alzheimer's disease

the accuracy was 96.6%

which was about 7% higher than that of directly using ResNet50

and at least 3% higher than that of applying existing methods.Therefore

the Fit CutMix data augmentation algorithm can effectively improve the recognition accuracy of deep convolutional neural network for medical images.

关键词

Keywords

references

STEVENS G A , HOGAN D R , BOERMA T . Improving reporting of health estimates [J ] . Bulletin of the World Health Organization , 2016 , 94 ( 7 ): 483 .

SARRAF S , DESOUZA D , ANDERSON J A E , et al . DeepAD:Alzheimer’s disease classification via deep convolutional neural networks using MRI and fMRI [J ] . BioRxiv , 2017 .

郑南宁 . 人工智能新时代 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 1 - 3 .

ZHENG N N . The new era of artificial intelligence [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 1 - 3 .

TAQI A M , AWAD A , AL-AZZO F , et al . The impact of multi-optimizers and data augmentation on TensorFlow convolutional neural network performance [C ] // Proceedings of 2018 IEEE Conference on Multimedia Information Processing and Retrieval . Piscataway:IEEE Press , 2018 : 140 - 145 .

QIAO J P , LYU Y R , CAO C F , et al . Multivariate deep learning classification of Alzheimer’s disease based on hierarchical partner matching independent component analysis [J ] . Frontiers in Aging Neuroscience , 2018 ,10:417.

LIN W M , TONG T , GAO Q Q , et al . Convolutional neural networks-based MRI image analysis for the Alzheimer’s disease prediction from mild cognitive impairment [J ] . Frontiers in Neuroscience , 2018 ,12:777.

AWATE G . Detection of Alzheimers disease from MRI using convolutional neural networks,exploring transfer learning and BellCNN [J ] . arXiv preprint , 2019 ,arXiv:1901.10231.

MURUGAN S , VENKATESAN C , SUMITHRA M G , et al . DEMNET:a deep learning model for early diagnosis of Alzheimer diseases and dementia from MR images [J ] . IEEE Access , 2021 , 9 : 90319 - 90329 .

REN F J , YANG C H , QIU Q , et al . Exploiting discriminative regions of brain slices based on 2D CNNs for Alzheimer’s disease classification [J ] . IEEE Access , 2019 , 7 : 181423 - 181433 .

ZHANG Y T , TENG Q Z , LIU Y Y , et al . Diagnosis of Alzheimer’s disease based on regional attention with sMRI gray matter slices [J ] . Journal of Neuroscience Methods , 2022 ,365.

SARRAF S , TOFIGHI G . Deep learning-based pipeline to recognize Alzheimer’s disease using fMRI data [C ] // Proceedings of 2016 Future Technologies Conference . Piscataway:IEEE Press , 2017 : 816 - 820 .

FAROOQ A , ANWAR S , AWAIS M , et al . A deep CNN based multi-class classification of Alzheimer’s disease using MRI [C ] // Proceedings of 2017 IEEE International Conference on Imaging Systems and Techniques . Piscataway:IEEE Press , 2018 : 1 - 6 .

KAZEMI Y , HOUGHTEN S . A deep learning pipeline to classify different stages of Alzheimer’s disease from fMRI data [C ] // Proceedings of 2018 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology . Piscataway:IEEE Press , 2018 : 1 - 8 .

JANGHEL R R , RATHORE Y K . Deep convolution neural network based system for early diagnosis of Alzheimer’s disease [J ] . IRBM , 2021 , 42 ( 4 ): 258 - 267 .

WU C L , GUO S W , HONG Y J , et al . Discrimination and conversion prediction of mild cognitive impairment using convolutional neural networks [J ] . Quantitative Imaging in Medicine and Surgery , 2018 , 8 ( 10 ): 992 - 1003 .

JAIN R , JAIN N , AGGARWAL A , et al . Convolutional neural network based Alzheimer’s disease classification from magnetic resonance brain images [J ] . Cognitive Systems Research , 2019 , 57 ( C ): 147 - 159 .

BILLONES C D , DEMETRIA O J L D , HOSTALLERO D E D , et al . DemNet:a convolutional neural network for the detection of Alzheimer’s disease and mild cognitive impairment [C ] // Proceedings of 2016 IEEE Region 10 Conference . Piscataway:IEEE Press , 2017 : 3724 - 3727 .

VALLIANI A , SONI A . Deep residual nets for improved Alzheimer’s diagnosis [C ] // Proceedings of the 8th ACM International Conference on Bioinformatics,Computational Biology,and Health Informatics . New York:ACM Press , 2017 :615.

ISLAM J , ZHANG Y Q . A novel deep learning based multi-class classification method for Alzheimer’s disease detection using brain MRI data [C ] // Proceedings of International Conference on Brain Informatics . Cham:Springer , 2017 : 213 - 222 .

ISLAM J , ZHANG Y Q . Deep convolutional neural networks for automated diagnosis of Alzheimer’s disease and mild cognitive Impairment using 3D brain MRI [C ] // Proceedings of International Conference on Brain Informatics . Cham:Springer , 2018 : 359 - 369 .

HON M , KHAN N M . Towards Alzheimer’s disease classification through transfer learning [C ] // Proceedings of 2017 IEEE International Conference on Bioinformatics and Biomedicine . Piscataway:IEEE Press , 2017 : 1166 - 1169 .

FAROOQ A , ANWAR S , AWAIS M , et al . Artificial intelligence based smart diagnosis of Alzheimer’s disease and mild cognitive impairment [C ] // Proceedings of 2017 International Smart Cities Conference . Piscataway:IEEE Press , 2017 : 1 - 4 .

TALO M , BALOGLU U B , YILDIRIM Ö , et al . Application of deep transfer learning for automated brain abnormality classification using MR images [J ] . Cognitive Systems Research , 2019 , 54 : 176 - 188 .

TAYLOR L , NITSCHKE G . Improving deep learning with generic data augmentation [C ] // Proceedings of 2018 IEEE Symposium Series on Computational Intelligence . Piscataway:IEEE Press , 2019 : 1542 - 1547 .

ZHONG Z , ZHENG L , KANG G , et al . Random erasing data augmentation [C ] // Proceedings of the AAAI Conference on Artificial Intelligence .[S.l.:s.n. ] , 2020 , 34 ( 7 ): 13001 - 13008 .

Asuncion A , Newman D Asuncion A,Newman D.UCL machine learning repository [Z ] . 2007 .

YUN S , HAN D , CHUN S , et al . CutMix:regularization strategy to train strong classifiers with localizable features [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2020 : 6022 - 6031 .

GONG C Y , WANG D L , LI M , et al . KeepAugment:a simple information-preserving data augmentation approach [C ] // Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2021 : 1055 - 1064 .

UDDIN A F M S , MONIRA M S , SHIN W , et al . SaliencyMix:a saliency guided data augmentation strategy for better regularization [J ] . arXiv preprint , 2020 ,arXiv:2006.01791.

PARK J , YANG J Y , SHIN J , et al . Saliency grafting:innocuous attribution-guided mixup with calibrated label mixing [J ] . Proceedings of the AAAI Conference on Artificial Intelligence , 2022 , 36 ( 7 ): 7957 - 7965 .

SELVARAJU R R , COGSWELL M , DAS A , et al . Grad-CAM:visual explanations from deep networks via gradient-based localization [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 618 - 626 .

YAN C G , ZANG Y F . DPARSF:a MATLAB toolbox for “pipeline”data analysis of resting-state fMRI [J ] . Frontiers in Systems Neuroscience , 2010 ,4:13.

SONG X W , DONG Z Y , LONG X Y , et al . REST:a toolkit for resting-state functional magnetic resonance imaging data processing [J ] . PLoS One , 2011 , 6 ( 9 ).

PASZKE A , GROSS S , MASSA F , et al . PyTorch:an imperative style,high-performance deep learning library [J ] . Advances in Neural Information Processing Systems , 2019 ,32.

PRECHELT L . Automatic early stopping using cross validation:quantifying the criteria [J ] . Neural Networks , 1998 , 11 ( 4 ): 761 - 767 .

DE BOER P T , KROESE D P , MANNOR S , et al . A tutorial on the cross-entropy method [J ] . Annals of Operations Research , 2005 , 134 ( 1 ): 19 - 67 .

张钹 . 人工智能进入后深度学习时代 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 4 - 6 .

ZHANG B . Artificial intelligence is entering the post deep-learning era [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 4 - 6 .

Views

550

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Diagnostic of breast tumors based on improved EfficientNet

Dynamic optimization algorithm of cement firing system based on differential evolution

Research on data-driven modeling for photovoltaic characteristics based on hybrid neural network

Related Author

FANG Zhenqi

LI Xue

MO Hong

Xiaochen HAO

Yakun JI

Lizhao ZHENG

Xin SHI

Yantao ZHAO

Related Institution

School of Electrical & Information Engineering, Changsha University of Science & Technology

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35702 Visits Today：177

⁰