Ensemble Residual Network with Iterative Randomized Hyperparameter Optimization for Colorectal Cancer Classification
Main Article Content
Abstract
The analysis of WSI images is widely acknowledged as a method, for identifying stages of cancer and evaluating the spread of cancer cells in tissues. In histopathology image analysis deep learning models are gaining increasing importance. To enhance the effectiveness of these models it is crucial to train and fine-tune Convolutional Neural Network algorithms by adjusting hyperparameters like batch size, convolution depth, and learning rate (LR). However, determining the hyperparameters can be challenging as they significantly impact model performance. This study examines how hyperparameters influence cancer classification, in histopathology images using the CNN architecture. A method called iterative randomized hyperparameter optimization is proposed, which gradually reduces variations over time by adjusting parameters after each network layer. The combination of hyperparameters is applied to version 1 of ResNet18, ResNet50, and ResNet101 models and version 2 of ResNet50, ResNet101, and ResNet151. The results are then combined using the Adaptive Boosting algorithm. The results are quite promising on ensemble version 1 residual networks, achieving an accuracy of 98.7% when tested on nine tissue classes.
Article Details
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
References
Egeblad, Mikala, Elizabeth S. Nakasone, and Zena Werb. Tumors as organs: complex tissues that interface with the entire organism. Developmental cell, 18(6), 884-901, 2010. https://doi.org/10.1016/j.devcel.2010.05.012
Farahani, Navid, Anil V. Parwani, and Liron Pantanowitz. Whole slide imaging in pathology: advantages, limitations, and emerging perspectives. Pathol Lab Med Int, 7, 23-33, 2015. https://doi.org/10.2147/PLMI.S59826
Al-Mekhlafi, Zeyad Ghaleb, et al. Diagnosis of Histopathological Images to Distinguish Types of Malignant Lymphomas Using Hybrid Techniques Based on Fusion Features. Electronics, 11(18), 2022. https://doi.org/10.3390/electronics11182865
You, Hongfeng, et al. MC-Net: Multiple max-pooling integration module and cross multi-scale deconvolution network. Knowledge-Based Systems, 231, 2021. https://doi.org/10.1016/j.knosys.2021.107456
Nayak, Soumya Ranjan, et al. An Efficient Deep Learning Method for Detection of COVID-19 Infection Using Chest X-ray Images. Diagnostics, 13(1), 2023. https://doi.org/10.3390/diagnostics13010131
Martínez-Fernandez, Elena, et al. Computer Aided Classifier of Colorectal Cancer on Histopatological Whole Slide Images Analyzing Deep Learning Architecture Parameters. Applied Sciences, 13(7), 2023. https://doi.org/ 10.3390/app13074594
Mishra, Purnendu, and Kishor Sarawadekar. Polynomial learning rate policy with warm restart for deep neural network. TENCON 2019-2019 IEEE Region 10 Conference, 2019. https://doi.org/10.1109/TENCON.2019.8929465
Johny, Anil, et al. Optimization of CNN model with hyper parameter tuning for enhancing sturdiness in classification of histopathological images. Proceedings of the 2nd International Conference on IoT, Social, Mobile, Analytics & Cloud in Computational Vision & Bio-Engineering (ISMAC-CVB 2020). https://dx.doi.org/10.2139/ ssrn.3735831
Kather, Jakob Nikolas, et al. Multi-class texture analysis in colorectal cancer histology. Scientific reports, 6(1) , 1-11, 2016. https://doi.org/10.1038/srep27988
Ciompi, Francesco, et al. The importance of stain normalization in colorectal tissue classification with convolutional networks. IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017). https://doi.org/10.48550/arXiv.1702.05931
Martínez-Fernandez, Elena, et al. Computer Aided Classifier of Colorectal Cancer on Histopatological Whole Slide Images Analyzing Deep Learning Architecture Parameters. Applied Sciences, 13(7), 2023. https://doi.org/10.3390/app13074594
Alinsaif, Sadiq, and Jochen Lang. Histological image classification using deep features and transfer learning. 17th Conference on Computer and Robot Vision (CRV 2020). IEEE. https://doi.org/10.1109/CRV50864.2020.00022
He, Kaiming, et al. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE 2016. https://doi.org/10.1109/CVPR.2016.90
Khazaee Fadafen, Masoud, and Khosro Rezaee. Ensemble-based multi-tissue classification approach of colorectal cancer histology images using a novel hybrid deep learning framework. Scientific Reports, 13(1), 2023. https://doi.org/10.1038/s41598-023-35431-x
Kumar, Anurodh, Amit Vishwakarma, and Varun Bajaj. Crccn-net: Automated framework for classification of colorectal tissue using histopathological images. Biomedical Signal Processing and Control, 79, 2023. https://doi.org/10.1016/j.bspc.2022.104172
Sun, Kai, et al. Automatic Classification of Histopathology Images across Multiple Cancers Based on Heterogeneous Transfer Learning. Diagnostics, 13(7) (2023). https://doi.org/10.3390/diagnostics13071277
Anju, T. E., and S. Vimala. Tissue and tumor Epithelium classification using fine-tuned deep CNN models. International Journal of Advanced Computer Science and Applications, 13(9), 306-314, 2022. https://dx.doi.org/10.14569/ IJACSA.2022.0130936
Jiang, Liwen, et al. An improved multi-scale gradient generative adversarial network for enhancing classification of colorectal cancer histological images. Frontiers in Oncology, 13, 2023. https://doi.org/10.3389/ fonc.2023.1240645
Anju, T. E., and S. Vimala. Finetuned-VGG16 CNN Model for Tissue Classification of Colorectal Cancer." International Conference on Intelligent Sustainable Systems. Springer Nature Singapore, 665, 73-84, 2023. https://doi.org/10.1007/978-981-99-1726-6_7
Anaya-Isaza, Andrés, Leonel Mera-Jiménez, and Martha Zequera-Diaz. An overview of deep learning in medical imaging. Informatics in medicine unlocked, 26, 2021. https://doi.org/10.1016/j.imu.2021.100723
Kather, Jakob Nikolas, Halama, Niels, & Marx, Alexander. 100,000 histological images of human colorectal cancer and healthy tissue (v0.1), 2018 [Dataset]. Zenodo. https://doi.org/10.5281/zenodo.1214456
Farag, Hania H. et al. Hyperparameters Optimization for ResNet and Xception in the Purpose of Diagnosing COVID-19.Intelligent and Fuzzy Systems, 41(2), 3555 – 3571, 2021. https://doi.org/10.3233/JIFS-210925
Sarwinda, Devvi, et al. Deep learning in image classification using residual network (ResNet) variants for detection of colorectal cancer. Procedia Computer Science, 179, 423-431, 2021. https://doi.org/10.1016/j.procs.2021.01.025
Tsai, Min-Jen, and Yu-Han Tao. Deep learning techniques for the classification of colorectal cancer tissue. Electronics 10(14), 2021. https://doi.org/10.3390/electronics10141662