Skip to content
2000
  1. Home
  2. A-Z Publications
  3. Current Medical Imaging
  4. Fast Track Articles
  5. Fast Track Article
image of Enhanced Detection of Colon Diseases via a Fused Deep Learning Model with an Auxiliary Fusion Layer and Residual Blocks on Endoscopic Images
file format pdf download PDF

Abstract

Background:

Colon diseases are major global health issues that often require early detection and correct diagnosis to be effectively treated. Deep learning approaches and recent developments in medical imaging have demonstrated promise in increasing diagnostic accuracy.

Objective:

This work suggests that a Convolutional Neural Network (CNN) model paired with other models can detect different gastrointestinal (GI) abnormalities or diseases from endoscopic images the fusion of residual blocks, including alpha dropouts (αDO) and auxiliary fusing layers.

Methods:

To automatically diagnose colon disorders from medical images, this work explores the use of a fused deeplearning model that incorporates the EfficientNetB0, MobileNetV2, and ResNet50V2 architectures. By integrating these features, the fused model aims to improve the classification accuracy and robustness for various colon diseases. The proposed model incorporates an auxiliary fusion layer and a fusion residual block. By combining diverse features through an auxiliary fusion layer, the network can create more comprehensive and richer representations, capturing intricate patterns that might be missed by single-source processing. The fusion residual block incorporates residual connections, which help mitigate the vanishing gradient problem. By adding the input of the block directly to its output, these connections facilitate better gradient flow during backpropagation, allowing for deeper and more stable training. A wide range of endoscopic images are used to assess the proposed model, offering an accurate depiction of various disease scenarios.

Results

The proposed model, with an auxiliary fusion layer and residual blocks, exhibited an enormous reduction in overfitting and performance saturation. The proposed model achieved an impressive 98.03% training accuracy and 97.90% validation accuracy after evaluation, outperforming the majority of typically trained DCNNs in terms of efficiency and accuracy.

Conclusion:

The proposed method developed a lightweight model that correctly identifies disorders of the gastrointestinal (GI) tract by combining advanced techniques, including feature fusion, residual learning, and self-normalization.

© 2024 The Author(s). Published by Bentham Science.
This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Loading

Article metrics loading...

/content/journals/cmir/10.2174/0115734056353246241209060804
2025-01-02
2025-01-10

  • From This Site

    /content/journals/cmir/10.2174/0115734056353246241209060804
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

/deliver/fulltext/cmir/10.2174/0115734056353246241209060804/e15734056353246.html?itemId=/content/journals/cmir/10.2174/0115734056353246241209060804&mimeType=html&fmt=ahah

References

  1. Thomas Abraham J.V. Muralidhar A. Sathyarajasekaran K. Ilakiyaselvan N. A deep-learning approach for identifying and classifying digestive diseases. Symmetry 2023 15 2 379 10.3390/sym15020379
    [Google Scholar]
  2. UKEssays: Functions and parts of the digestive and urinary systems. 2023 Available from: https://www.ukessays.com/assignments/digestive-and-urinary-systems.php
  3. Saint Luke's.: What is colon and rectal cancer (Colorectal Cancer)? 2023 Available from: https://www.saintlukeskc.org/health-library/what-colon-and-rectal-cancer-colorectal-cancer
  4. Kumar R. Anand V. Gupta S. Ganzha M. Paprzycki M. Automatic identification of cataract by analyzing fundus images using VGG19 model. In International Conference on Big Data Analytics Cham Springer Nature Switzerland 2022
    [Google Scholar]
  5. Bhattacharya T. Soares G.A.B. Chopra H. Rahman M.M. Hasan Z. Swain S.S. Cavalu S. Applications of phyto-nanotechnology for the treatment of neurodegenerative disorders. Materials 2022 15 3 804 10.3390/ma15030804 35160749
    [Google Scholar]
  6. Sharma B. Koundal D. Cattle health monitoring system using wireless sensor network: A survey from innovation perspective. IET Wirel. Sens. Syst. 2018 8 4 143 151 10.1049/iet‑wss.2017.0060
    [Google Scholar]
  7. Cancer Research UK.: Half a million lives saved in 30 years thanks to cancer research. 2023 Available from: https://news.cancerresearchuk.org/2013/07/09/half-a-million-lives-saved-in-30-years-thanks-to-cancer-research/(2023)
  8. Elwali N.E. Jarrah O. Alzahrani S. Alharbi M. Alhejaily A. Alsharm A. Elhassan M. Colorectal cancer in Saudi Arabia: The way forward. Asian Pac. J. Cancer Prev. 2023 24 1 13 19 10.31557/APJCP.2023.24.1.13 36708547
    [Google Scholar]
  9. Zou Y. Pitchumoni C.S. Obesity, obesities and gastrointestinal cancers. Dis. Mon. 2023 69 12 101592 10.1016/j.disamonth.2023.101592 37308362
    [Google Scholar]
  10. Siegel R.L. Wagle N.S. Cercek A. Smith R.A. Jemal A. Colorectal cancer statistics. CA Cancer J. Clin. 2023 73 3 233 254 10.3322/caac.21772 36856579
    [Google Scholar]
  11. Uchikov P. Khalid U. Kraev K. Hristov B. Kraeva M. Tenchev T. Chakarov D. Sandeva M. Dragusheva S. Taneva D. Batashki A. Artificial intelligence in the diagnosis of colorectal cancer: A literature review. Diagnostics 2024 14 5 528 10.3390/diagnostics14050528 38472999
    [Google Scholar]
  12. Francis Jesmar Montalbo.: WCE curated colon disease dataset deep learning. 2023 Available from: https://www.kaggle.com/datasets/francismon/curated-colon-dataset-for-deep-learning
  13. Sundas A. Badotra S. Bharany S. Almogren A. Tag-ElDin E.M. Rehman A.U. HealthGuard: An intelligent healthcare system security framework based on machine learning. Sustainability 2022 14 19 11934 10.3390/su141911934
    [Google Scholar]
  14. Borgli H. Thambawita V. Smedsrud P.H. Hicks S. Jha D. Eskeland S.L. Randel K.R. Pogorelov K. lux M. Nguyen D.T.D. Johansen D. HyperKvasir, a comprehensive multiclass image and video dataset for gastrointestinal endoscopy. Sci. Data 2020 7 1 283 10.1038/s41597‑020‑00622‑y 32859981
    [Google Scholar]
  15. Song E.M. Park B. Ha C.A. Hwang S.W. Park S.H. Yang D.H. Ye B.D. Myung S.J. Yang S.K. Kim N. Byeon J.S. Endoscopic diagnosis and treatment planning for colorectal polyps using a deep-learning model. Sci. Rep. 2020 10 1 30 10.1038/s41598‑019‑56697‑0 31913337
    [Google Scholar]
  16. Shin Y. Balasingham I. Comparison of handcraft feature-based SVM and CNN-based deep learning framework for automatic polyp classification. 39th annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) Jeju, Korea (South), 11-15 July 2017, pp. 3277-3280.
    [Google Scholar]
  17. Pogorelov K. Randel K.R. Griwodz C. Eskeland S.L. de Lange T. Johansen D. Spampinato C. Dang-Nguyen D.T. Kvasir: A multiclass image dataset for computer-aided gastrointestinal disease detection. Proceedings of the 8th ACM on Multimedia Systems Conference 164 169 2017 10.1145/3083187.3083212
    [Google Scholar]
  18. Sutton R.T. Zai͏̈ane O.R. Goebel R. Baumgart D.C. Artificial intelligence enabled automated diagnosis and grading of ulcerative colitis endoscopy images. Sci. Rep. 2022 12 1 2748 10.1038/s41598‑022‑06726‑2 35177717
    [Google Scholar]
  19. Poudel S. Kim Y.J. Vo D.M. Lee S.W. Colorectal disease classification using efficiently scaled dilation in convolutional neural network. IEEE Access 2020 8 99227 99238 10.1109/ACCESS.2020.2996770
    [Google Scholar]
  20. Ozawa T. Ishihara S. Fujishiro M. Kumagai Y. Shichijo S. Tada T. Automated endoscopic detection and classification of colorectal polyps using convolutional neural networks. Therapeutic advances in gastroenterology 2020 13 9 10.1177/1756284820910659
    [Google Scholar]
  21. Fan S. Xu L. Fan Y. Wei K. Li L. Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images. Phys. Med. Biol. 2018 63 16 165001 10.1088/1361‑6560/aad51c 30033931
    [Google Scholar]
  22. Narasimha Raju A.S. Jayavel K. Rajalakshmi T. ColoRectalCADx: Expeditious recognition of colorectal cancer with integrated convolutional neural networks and visual explanations using mixed dataset evidence. Comput. Math. Methods Med. 2022 2022 1 1 27 10.1155/2022/8723957 36404909
    [Google Scholar]
  23. Yogapriya J. Chandran V. Sumithra M.G. Anitha P. Jenopaul P. Suresh Gnana Dhas C. Gastrointestinal tract disease classification from wireless endoscopy images using pretrained deep learning model. Comput. Math. Methods Med. 2021 2021 1 1 12 10.1155/2021/5940433 34545292
    [Google Scholar]
  24. Mahapatra D. Schueffler P. Tielbeek J.A.W. Buhmann J.M. Vos F.M. A supervised learning approach for Crohn’s disease detection using higher-order image statistics and a novel shape asymmetry measure. J. Digit. Imaging 2013 26 5 920 931 10.1007/s10278‑013‑9576‑9 23392736
    [Google Scholar]
  25. Wei Z. Zhang W. Liu J. Wang S. Yao J. Summers R.M. Computer-aided detection of colitis on computed tomography using a visual codebook. IEEE 10th International Symposium on Biomedical Imaging 2013 141 144
    [Google Scholar]
  26. Zhang R. Zheng Y. Mak T.W.C. Yu R. Wong S.H. Lau J.Y.W. Poon C.C.Y. Automatic detection and classification of colorectal polyps by transferring low-level CNN features from the nonmedical domain. IEEE J. Biomed. Health Inform. 2017 21 1 41 47 10.1109/JBHI.2016.2635662 28114040
    [Google Scholar]
  27. Alammari A. Islam A.R. Oh J. Tavanapong W. Wong J. De Groen P.C. Classification of ulcerative colitis severity in colonoscopy videos using CNN. Proceedings of the 9th international conference on information management and engineering 139 144 2017 10.1145/3149572.3149613
    [Google Scholar]
  28. Nadeem S. Tahir M.A. Naqvi S.S.A. Zaid M. Ensemble of texture and deep learning features for finding abnormalities in the gastro-intestinal tract. Proceedings, Part II 10 469 478 Springer International Publishing 2018 10.1007/978‑3‑319‑98446‑9_44
    [Google Scholar]
  29. Wimmer G. Vécsei A. Häfner M. Uhl A. Fisher encoding of convolutional neural network features for endoscopic image classification. J. Med. Imaging (Bellingham) 2018 5 3 1 10.1117/1.JMI.5.3.034504 30840751
    [Google Scholar]
  30. Wang P. Xiao X. Glissen Brown J.R. Berzin T.M. Tu M. Xiong F. Hu X. Liu P. Song Y. Zhang D. Yang X. Li L. He J. Yi X. Liu J. Liu X. Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat. Biomed. Eng. 2018 2 10 741 748 10.1038/s41551‑018‑0301‑3 31015647
    [Google Scholar]
  31. Ponzio F. Macii E. Ficarra E. Di Cataldo S. Colorectal cancer classification using deep convolutional networks. Proceedings of the 11th international joint conference on biomedical engineering systems and technologies Vol. 2 58 66 2017
    [Google Scholar]
  32. Urban G. Tripathi P. Alkayali T. Mittal M. Jalali F. Karnes W. Baldi P. Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology 2018 155 4 1069 1078.e8 10.1053/j.gastro.2018.06.037 29928897
    [Google Scholar]
  33. Yuan Y. Qin W. Ibragimov B. Han B. Xing L. RIIS-DenseNet: rotation-invariant and image similarity constrained densely connected convolutional network for polyp detection. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018 Springer International Publishing 21st International Conference, Granada, Spain, September 16-20, Proceedings, Part II 11 620 628
    [Google Scholar]
  34. Wan N. Weinberg D. Liu T.Y. Niehaus K. Ariazi E.A. Delubac D. Kannan A. White B. Bailey M. Bertin M. Boley N. Bowen D. Cregg J. Drake A.M. Ennis R. Fransen S. Gafni E. Hansen L. Liu Y. Otte G.L. Pecson J. Rice B. Sanderson G.E. Sharma A. St John J. Tang C. Tzou A. Young L. Putcha G. Haque I.S. Machine learning enables detection of early-stage colorectal cancer by whole-genome sequencing of plasma cell-free DNA. BMC Cancer 2019 19 1 832 10.1186/s12885‑019‑6003‑8 31443703
    [Google Scholar]
  35. Wong W.N. Wong Y.K. Chan W.H. Classification of gastrointestinal diseases using deep transfer learning. 2nd International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA) 156 161 IEEE 2022 10.1109/ICICyTA57421.2022.10038047
    [Google Scholar]
  36. Sarwinda D. Paradisa R.H. Bustamam A. Anggia P. Deep learning in image classification using residual network (ResNet) variants for detection of colorectal cancer. Procedia Comput. Sci. 2021 179 423 431 10.1016/j.procs.2021.01.025
    [Google Scholar]
  37. Liao R. Qi K. Che D. Zeng T.H. Exploration of the possibility of early diagnosis for digestive diseases using deep learning techniques. 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) 2343 2350 IEEE 2020 10.1109/BIBM49941.2020.9313557
    [Google Scholar]
  38. Khorasani H.M. Usefi H. Peña-Castillo L. Detecting ulcerative colitis from colon samples using efficient feature selection and machine learning. Sci. Rep. 2020 10 1 13744 10.1038/s41598‑020‑70583‑0 32792678
    [Google Scholar]
  39. Mukhtorov D. Rakhmonova M. Muksimova S. Cho Y.I. Endoscopic image classification based on explainable deep learning. Sensors 2023 23 6 3176 10.3390/s23063176 36991887
    [Google Scholar]
  40. Zhang L. Mao R. Lau C.T. Chung W.C. Chan J.C.P. Liang F. Zhao C. Zhang X. Bian Z. Identification of useful genes from multiple microarrays for ulcerative colitis diagnosis based on machine learning methods. Sci. Rep. 2022 12 1 9962 10.1038/s41598‑022‑14048‑6 35705632
    [Google Scholar]
  41. Kumar R. Anand V. Gupta S. Enhancement of diagnostic accuracy of colon diseases using multi-class classification technique and endoscopic images. 2nd International Conference on Device Intelligence, Computing and Communication Technologies (DICCT) 2024 188 193 10.1109/DICCT61038.2024.10533146
    [Google Scholar]
  42. Guo H. Somayajula S.A. Hosseini R. Xie P. Improving image classification of gastrointestinal endoscopy using curriculum self-supervised learning. Sci. Rep. 2024 14 1 6100 10.1038/s41598‑024‑53955‑8 38480815
    [Google Scholar]
  43. Alyamani H.J. Enhancing ulcerative colitis diagnosis: A multi-level classification approach with deep learning. CMES-Computer Modeling in Engineering & Sciences 2024 140 1 10.32604/cmes.2024.047756
    [Google Scholar]
  44. Chou C.K. Karmakar R. Tsao Y.M. Jie L.W. Mukundan A. Huang C.W. Chen T.H. Ko C.Y. Wang H.C. Evaluation of spectrum-aided visual enhancer (SAVE) in esophageal cancer detection using yolo frameworks. Diagnostics 2024 14 11 1129 10.3390/diagnostics14111129 38893655
    [Google Scholar]
  45. Fang Y.J. Huang C.W. Karmakar R. Mukundan A. Tsao Y.M. Yang K.Y. Wang H.C. Assessment of narrow-band imaging algorithm for video capsule endoscopy based on decorrelated color space for esophageal cancer: Part ii, detection and classification of esophageal cancer. Cancers 2024 16 3 572 10.3390/cancers16030572 38339322
    [Google Scholar]
  46. Bousis D. Verras G.I. Bouchagier K. Antzoulas A. Panagiotopoulos I. Katinioti A. Kehagias D. Kaplanis C. Kotis K. Anagnostopoulos C.N. Mulita F. The role of deep learning in diagnosing colorectal cancer. Gastroenterology Review/Przegląd Gastroenterologiczny 2023 18 1 10.5114/pg.2023.129494
    [Google Scholar]
  47. Chlorogiannis D.D. Verras G.I. Tzelepi V. Chlorogiannis A. Apostolos A. Kotis K. Anagnostopoulos C.N. Antzoulas A. Vailas M. Schizas D. Mulita F. Tissue classification and diagnosis of colorectal cancer histopathology images using deep learning algorithms. Is the time ripe for clinical practice implementation? Gastroenterology Review/Przegląd Gastroenterologiczny 2023 18 1
    [Google Scholar]
  48. Silva J. Histace A. Romain O. Dray X. Granado B. Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer. Int. J. CARS 2014 9 2 283 293 10.1007/s11548‑013‑0926‑3 24037504
    [Google Scholar]
  49. Simula.: Kvasir v2 dataset. 2023 Available from: https://datasets.simula.no/kvasir/
/content/journals/cmir/10.2174/0115734056353246241209060804
Loading
Enhanced Detection of Colon Diseases via a Fused Deep Learning Model with an Auxiliary Fusion Layer and Residual Blocks on Endoscopic Images
Bentham Science Publishers , e15734056353246; https://doi.org/10.2174/0115734056353246241209060804
/content/journals/cmir/10.2174/0115734056353246241209060804
/content/journals/cmir/10.2174/0115734056353246241209060804
Loading

Data & Media loading...


  • Article Type:     Research Article
Keywords: Diagnosis ; Alpha dropout ; Residual block ; Endoscopy ; Colon disease classification

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error
Please enter a valid_number test