Breast Cancer Histopathological Image Classification with Convolutional Neural Networks Models
DOI:
https://doi.org/10.29207/resti.v9i5.6420Keywords:
breast cancer, convolutional neural network, deep learning, histopathological image classification, support vector machineAbstract
Early diagnosis and treatment can reduce mortality rates by preventing the progression of breast cancer. Owing to convolutional neural networks (CNN), breast cancer diagnosis can be performed faster and more objectively than humans using thousands of histopathological images. This study aimed to evaluate and compare the rapid and effective diagnostic performance of CNN models on breast tumor images, utilizing transfer learning through pre-training and fine-tuning on novel datasets. The study was performed in two ways on BreakHis and BACH datasets. First, fine-tuned VGG16, VGG19, Xception, InceptionV3, ResNet50, and InceptionResNetV2 models were used for classification. Second, these CNN models were used as feature extractors and support vector machines (SVMs) as classifiers. The success of all models in tumor classification was interpreted using performance metrics, such as accuracy, precision, recall, F1 score, and AUC. The models showing the best performance as a result of the analyses were as follows: InceptionResNetV2+SVM model with an accuracy of 99.3%, precision of 99.0%, recall of 100.0%, F1 score of 99.5%, AUC of 98.9% for BreakHis dataset; and InceptionResNetV2 model with accuracy of 96.7%, precision of 93.8%, recall of 100.0%, F1 score of 96.8%, AUC of 96.7% for the BACH dataset. As a conclusion, it has been seen that the CNN methods have good generalization abilities and can respond to clinical needs.
Downloads
References
A. S. Min, B. Lee, and S. Yoon, "Deep learning in bioinformatics," Briefings in Bioinformatics, vol. 18, no. 5, 2017. [Online]. Available: https://doi.org/10.1093/bib/bbw068.
X. Zhen, J. Chen, Z. Zhong, B. Hrycushko, L. Zhou, S. Jiang, K. Albuquerque, and X. Gu, "Deep convolutional neural network with transfer learning for rectum toxicity prediction in cervical cancer radiotherapy: A feasibility study," Physics in Medicine and Biology, vol. 62, no. 21, 2017. [Online]. Available: https://doi.org/10.1088/1361-6560/aa8d09.
Y. Bengio and Y. Lecun, "Scaling learning algorithms towards AI," in Large-Scale Kernel Machines, New York, vol. 1, 2007.
M. M. Najafabadi, F. Villanustre, T. M. Khoshgoftaar, N. Seliya, R. Wald, and E. Muharemagic, "Deep learning applications and challenges in big data analytics," Journal of Big Data, vol. 2, no. 1, 2015. [Online]. Available: https://doi.org/10.1186/s40537-014-0007-7.
B. Krishnakumar, K. Kousalya, R. S. Mohana, K. Dinesh, and S. Santhiya, "Classification of breast cancer using deep learning architecture," International Journal of Recent Technology and Engineering (IJR), 2019.
Y. Cheng, D. Wang, P. Zhou, and T. Zhang, "A survey of model compression and acceleration for deep neural networks," arXiv preprint, arXiv:1710.09282, 2017.
A. Ghoneim, G. Muhammad, and M. S. Hossain, "Cervical cancer classification using convolutional neural networks and extreme learning machines," Future Generation Computer Systems, vol. 102, 2020. [Online]. Available: https://doi.org/10.1016/j.future.2019.09.015.
H. Mechria, M. S. Gouider, and K. Hassine, "Breast cancer detection using deep convolutional neural network," in Proc. 11th Int. Conf. on Agents and Artificial Intelligence (ICAART), 2019, vol. 2. [Online]. Available: https://doi.org/10.5220/0007386206550660.
A. Golatkar, D. Anand, and A. Sethi, "Classification of breast cancer histology using deep learning," Lecture Notes in Computer Science, vol. 10882, 2018. [Online]. Available: https://doi.org/10.1007/978-3-319-93000-8_95.
G. Aresta et al., "BACH: Grand challenge on breast cancer histology images," Medical Image Analysis, vol. 56, 2019. [Online]. Available: https://doi.org/10.1016/j.media.2019.05.010.
Y. Sahu, A. Tripathi, R. K. Gupta, P. Gautam, R. K. Pateriya, A. Gupta, “A CNN-SVM based computer aided diagnosis of breast Cancer using histogram K-means segmentation technique,” Multimed Tools Appl, 82(9), 14055-14075, 2023.
T. Kausar, Y. Lu, A. Kausar, “Breast cancer diagnosis using lightweight deep convolution neural network model”, IEEE Access, 11, 124869-124886, 2023.
S. K. V.N. and M. Vijay, “Diagnosing Cancer Cells Using Histopathological Images with Deep Learning” 2021 Sixth International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), Chennai, India, pp. 148-152, 2021. doi: 10.1109/WiSPNET51692.2021.9419468.
F. A. Spanhol, L. S. Oliveira, C. Petitjean, and L. Heutte, "A dataset for breast cancer histopathological image classification," IEEE Trans. Biomed. Eng., vol. 63, no. 7, 2016. [Online]. Available: https://doi.org/10.1109/TBME.2015.2496264.
F. A. Spanhol, L. S. Oliveira, C. Petitjean, and L. Heutte, "Breast cancer histopathological image classification using convolutional neural networks," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), 2016. [Online]. Available: https://doi.org/10.1109/IJCNN.2016.7727519.
J. Chang, J. Yu, T. Han, H. J. Chang, and E. Park, "A method for classifying medical images using transfer learning: A pilot study on histopathology of breast cancer," in Proc. 19th IEEE Int. Conf. E-Health Networking, Applications and Services (Healthcom), 2017. [Online]. Available: https://doi.org/10.1109/HealthCom.2017.8210843.
R. Mehra, "Breast cancer histology images classification: Training from scratch or transfer learning?," ICT Express, vol. 4, no. 4, pp. 247–254, 2018. [Online]. Available: https://doi.org/10.1016/j.icte.2018.10.007.
D. S. Nathan, R. Saravanan, J. Anbazhagan, and P. Koduganty, "Comparison of deep feature classification and fine tuning for breast cancer histopathology image classification," in Recent Trends in Image Processing and Pattern Recognition, vol. 2, pp. 58–68, Springer, 2019.
S. H. Kassani, P. H. Kassani, M. J. Wesolowski, K. A. Schneider, and R. Deters, "Classification of histopathological biopsy images using ensemble of deep learning networks," in Proc. CASCON 2019, 2020.
J. Zhang, X. Wei, C. Che, and Q. Zhang, "Breast cancer histopathological image classification based on convolutional neural networks," J. Med. Imaging Health Informatics, vol. 9, no. 4, 2019. [Online]. Available: https://doi.org/10.1166/jmihi.2019.2648.
K. Gupta and N. Chawla, "Analysis of histopathological images for prediction of breast cancer using traditional classifiers with pre-trained CNN," Procedia Computer Science, vol. 167, 2020. [Online]. Available: https://doi.org/10.1016/j.procs.2020.03.427.
T. Kausar, M. A. Ashraf, A. Kausar, and I. Riaz, "Convolution neural network-based approach for breast cancer type classification," in Proc. 18th Int. Bhurban Conf. Appl. Sci. Technol. (IBCAST), 2021. [Online]. Available: https://doi.org/10.1109/IBCAST51254.2021.9393249.
S. Sharma and S. Kumar, "The Xception model: A potential feature extractor in breast cancer histology images classification," ICT Express, vol. 8, no. 1, 2022. [Online]. Available: https://doi.org/10.1016/j.icte.2021.11.010.
Y. Sahu, A. Tripathi, R. K. Gupta, P. Gautam, R. K. Pateriya, and A. Gupta, "A CNN-SVM based computer-aided diagnosis of breast cancer using histogram K-means segmentation technique," Multimedia Tools and Applications, vol. 82, no. 9, 2023. [Online]. Available: https://doi.org/10.1007/s11042-022-13807-x.
H. Zerouaoui and A. Idri, "Deep hybrid architectures for binary classification of medical breast cancer images," Biomed. Signal Process. Control, vol. 71, 2022. [Online]. Available: https://doi.org/10.1016/j.bspc.2021.103226.
D. Clement, E. Agu, M. A. Suleiman, J. Obayemi, S. Adeshina, and W. Soboyejo, "Multi-class breast cancer histopathological image classification using multi-scale pooled image feature representation (MPIFR) and one-versus-one support vector machines," Appl. Sci., vol. 13, no. 1, 2023. [Online]. Available: https://doi.org/10.3390/app13010156.
W. Liu, Z. Wang, X. Liu, N. Zeng, Y. Liu, and F. E. Alsaadi, "A survey of deep neural network architectures and their applications," Neurocomputing, vol. 234, 2017. [Online]. Available: https://doi.org/10.1016/j.neucom.2016.12.038.
T. Araujo, G. Aresta, E. Castro, J. Rouco, P. Aguiar, C. Eloy, A. Polonia, and A. Campilho, "Classification of breast cancer histology images using convolutional neural networks," PLoS ONE, vol. 12, no. 6, 2017. [Online]. Available: https://doi.org/10.1371/journal.pone.0177544.
S. A. Adeshina, A. P. Adedigba, A. A. Adeniyi, and A. M. Aibinu, "Breast cancer histopathology image classification with deep convolutional neural networks," in Proc. 14th Int. Conf. on Electronics Computer and Computation (ICECCO), 2019. [Online]. Available: https://doi.org/10.1109/ICECCO.2018.8634690.
A. Pai, "CNN vs. RNN vs. ANN—analyzing 3 types of neural networks in deep learning," Analytics Vidhya, 2020. Accessed: Feb. 17, 2020. [Online]. Available: https://www.analyticsvidhya.com.
E. Deniz, A. Şengür, Z. Kadiroğlu, Y. Guo, V. Bajaj, and Ü. Budak, "Transfer learning based histopathologic image classification for breast cancer detection," Health Inf. Sci. Syst., vol. 6, no. 1, 2018. [Online]. Available: https://doi.org/10.1007/s13755-018-0057-x.
L. Zou, S. Yu, T. Meng, Z. Zhang, X. Liang, and Y. Xie, "A technical review of convolutional neural network-based mammographic breast cancer diagnosis," Computational and Mathematical Methods in Medicine, 2019. [Online]. Available: https://doi.org/10.1155/2019/6509357.
S. Shalev-Shwartz and S. Ben-David, Understanding Machine Learning: From Theory to Algorithms, vol. 9781107057135, 2013. [Online]. Available: https://doi.org/10.1017/CBO9781107298019.
J. A. K. Suykens and J. Vandewalle, "Least squares support vector machine classifiers," Neural Processing Letters, vol. 9, no. 3, pp. 293–300, 1999. [Online]. Available: https://doi.org/10.1023/A:1018628609742.
A. Smola and S. Vishwanathan, Introduction to Machine Learning, Cambridge University, UK, vol. 32, no. 34, 2008.
Scikit-learn developers, "Support Vector Machine," Scikit-learn Documentation, 2019. Accessed: Feb. 17, 2020. [Online]. Available: https://scikit-learn.org/stable/modules/svm.html.
J. Brownlee, "A gentle introduction to k-fold cross-validation," Statistics, 2018. [Online]. Available: https://machinelearningmastery.com.
O. Theobald, Machine Learning for Absolute Beginners, News.Ge, vol. 4, no. 1, 2017.
S. Saud, B. Jamil, Y. Upadhyay, and K. Irshad, "Performance improvement of empirical models for estimation of global solar radiation in India: A k-fold cross-validation approach," Sustainable Energy Technol. Assess., vol. 40, 2020. [Online]. Available: https://doi.org/10.1016/j.seta.2020.100768.
W. Rawat and Z. Wang, "Deep convolutional neural networks for image classification: A comprehensive review," Neural Computation, vol. 29, no. 9, pp. 2352–2449, 2017. [Online]. Available: https://doi.org/10.1162/NECO_a_00990.
I. Namatēvs, "Deep convolutional neural networks: Structure, feature extraction and training," Inf. Technol. Manage. Sci., vol. 20, no. 1, pp. 39–47, 2018. [Online]. Available: https://doi.org/10.1515/itms-2017-0007.
T. Beysolow II, Introduction to Deep Learning Using R: A Step-by-Step Guide to Learning and Implementing Deep Learning Models Using R, 2017.
M. Toğaçar, B. Ergen, and Z. Cömert, "Application of breast cancer diagnosis based on a combination of convolutional neural networks, ridge regression and linear discriminant analysis using invasive breast cancer images processed with autoencoders," Medical Hypotheses, vol. 135, 2020. [Online]. Available: https://doi.org/10.1016/j.mehy.2019.109503.
B. Karlik and A. V. Olgac, "Performance analysis of various activation functions in generalized MLP architectures of neural networks," Int. J. Artif. Intell. Expert Syst., vol. 1, no. 4, pp. 111–122, 2011.
P. Karkare, "Convolutional neural networks-simplified," AI Graduate, vol. 15, 2019.
M. A. Wani, F. A. Bhat, S. Afzal, and A. I. Khan, "Basics of supervised deep learning," in Studies in Big Data, vol. 57, 2020. [Online]. Available: https://doi.org/10.1007/978-981-13-6794-6_2.
Z. A. Varaich and S. Khalid, "Recognizing actions of distracted drivers using Inception v3 and Xception convolutional neural networks," in Proc. 2nd Int. Conf. Advancements in Computational Sciences (ICACS), 2019. [Online]. Available: https://doi.org/10.23919/ICACS.2019.8689131.
R. M. Kamble, M. Kokare, G. C. Y. Chan, O. Perdomo, F. A. González, H. Müller, and F. Mériaudeau, "Automated diabetic macular edema (DME) analysis using fine-tuning with inception-resnet-v2 on OCT images," in Proc. 2018 IEEE EMBS Conf. Biomed. Eng. Sci. (IECBES), 2019. [Online]. Available: https://doi.org/10.1109/IECBES.2018.8626616.
A. Milton-Barker, "Inception V3 deep convolutional architecture for classifying acute myeloid/lymphoblastic leukemia," 2019. Accessed: Feb. 17, 2020. [Online]. Available: https://www.researchgate.net.
J. Xie, R. Liu, J. Luttrell, and C. Zhang, "Deep learning based analysis of histopathological images of breast cancer," Front. Genet., vol. 10, no. FEB, 2019. [Online]. Available: https://doi.org/10.3389/fgene.2019.00080.
R. Mirzaeian, R. Nopour, Z. Asghari Varzaneh, M. Shafiee, M. Shanbehzadeh, and H. Kazemi-Arpanahi, "Which are best for successful aging prediction? Bagging, boosting, or simple machine learning algorithms?," Biomedical Engineering Online, vol. 22, no. 1, p. 85, 2023.
A. Luque, A. Carrasco, A. Martín, and A. de Las Heras, "The impact of class imbalance in classification performance metrics based on the binary confusion matrix," Pattern Recognition, vol. 91, pp. 216–231, 2019.
J. Mohajon, "Confusion matrix for your multi-class machine learning model," Towardsdatascience.Com, 2020. Accessed: Feb. 17, 2020. [Online]. Available: https://towardsdatascience.com.
K. Riehl, M. Neunteufel, and M. Hemberg, "Hierarchical confusion matrix for classification performance evaluation," arXiv preprint, arXiv:2306.09461, 2023. [Online]. Available: https://arxiv.org/abs/2306.09461.
M. Salvaris, D. Dean, and W. H. Tok, Deep Learning with Azure, 2018. [Online]. Available: https://doi.org/10.1007/978-1-4842-3679-6.
Y. Xiao, Z. Tian, J. Yu, Y. Zhang, S. Liu, S. Du, and X. Lan, "A review of object detection based on deep learning," Multimedia Tools and Applications, vol. 79, no. 33–34, 2020. [Online]. Available: https://doi.org/10.1007/s11042-020-08976-6.
Downloads
Published
Issue
Section
License
Copyright in each article belongs to the author
- The author acknowledges that the RESTI Journal (System Engineering and Information Technology) is the first publisher to publish with a license Creative Commons Attribution 4.0 International License.
- Authors can enter writing separately, arrange the non-exclusive distribution of manuscripts that have been published in this journal into other versions (eg sent to the author's institutional repository, publication in a book, etc.), by acknowledging that the manuscript has been published for the first time in the RESTI (Rekayasa Sistem dan Teknologi Informasi) journal ;
