Exploring Deep Learning Approaches for Multimodal Breast Cancer Dataset Classification and Detection
DOI:
https://doi.org/10.56294/dm20251136Keywords:
AlexNet, Attention-based Multimodal Fusion, Breast Cancer Detection, Deep Learning, Generative Adversarial Augmentation (GAA), Multimodal Datasets, ResNet50, VGG16Abstract
Introduction; Globally, we need advanced testing to detect breast cancer early. New breast cancer diagnosis methods using mixed datasets and deep learning promise improved accuracy.
Objective; These sets, which comprise several imaging modalities, show tumor characteristics well. VGG16, AlexNet, and ResNet50 are effective deep learning models in many domains, yet their breast cancer diagnosis performance is unclear.
Method; This paper examines these patterns' benefits, downsides, and research gaps. We also provide two novel approaches, Attention-based Multimodal Fusion (AMF) and Improved Generative Adversarial Augmentation (GAA), to improve deep learning models on breast cancer datasets.
Result; The findings highlight the potential of machine learning to show tumor characteristics well.
Conclusion; We prove that our breast cancer screening technologies are the most accurate and dependable via extensive testing.
References
1. Jin J, Liu T, Li M, Yuan C, Liu Y, Tang J, et al. Rapid in situ biosynthesis of gold nanoparticles in living platelets for multimodal biomedical imaging. Colloids Surfaces B Biointerfaces. 2018;163:385–93.
2. Ibtehaz N, Rahman MS. MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural networks. 2020;121:74–87.
3. Fu Q, Zhu R, Song J, Yang H, Chen X. Photoacoustic imaging: contrast agents and their biomedical applications. Adv Mater. 2019;31(6):1805875.
4. Cheng P, Pu K. Fluoro-photoacoustic polymeric renal reporter for real-time dual imaging of acute kidney injury. In: Methods in Enzymology. Elsevier; 2021. p. 271–300.
5. Yang X, Chen YH, Xia F, Sawan M. Photoacoustic imaging for monitoring of stroke diseases: A review. Photoacoustics. 2021;23:100287.
6. Xia J, Lediju Bell MA, Laufer J, Yao J. Translational photoacoustic imaging for disease diagnosis, monitoring, and surgical guidance: introduction to the feature issue. Vol. 12, Biomedical Optics Express. Optical Society of America; 2021. p. 4115–8.
7. Yang C, Lan H, Gao F, Gao F. Review of deep learning for photoacoustic imaging. Photoacoustics. 2021;21:100215.
8. Aggarwal R, Sounderajah V, Martin G, Ting DSW, Karthikesalingam A, King D, et al. Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis. NPJ Digit Med. 2021;4(1):65.
9. Mansour RF. A robust deep neural network based breast cancer detection and classification. Int J Comput Intell Appl. 2020;19(01):2050007.
10. Escorcia-Gutierrez J, Mansour RF, Beleño K, Jiménez-Cabas J, Pérez M, Madera N, et al. Automated Deep Learning Empowered Breast Cancer Diagnosis Using Biomedical Mammogram Images. Comput Mater Contin. 2022;71(3).
11. Nair R, Singh DK, Yadav S, Bakshi S. Hand gesture recognition system for physically challenged people using IOT. In: 2020 6th international conference on advanced computing and communication systems (ICACCS). IEEE; 2020. p. 671–5.
12. Kashyap R, Nair R, Gangadharan SMP, Botto-Tobar M, Farooq S, Rizwan A. Glaucoma detection and classification using improved U-Net Deep Learning Model. In: Healthcare. MDPI; 2022. p. 2497.
13. Ragab M, Albukhari A, Alyami J, Mansour RF. Ensemble deep-learning-enabled clinical decision support system for breast cancer diagnosis and classification on ultrasound images. Biology (Basel). 2022;11(3):439.
14. Manwar R, Li X, Mahmoodkalayeh S, Asano E, Zhu D, Avanaki K. Deep learning protocol for improved photoacoustic brain imaging. J Biophotonics. 2020;13(10):e202000212.
15. Ma Y, Yang C, Zhang J, Wang Y, Gao F, Gao F. Human breast numerical model generation based on deep learning for photoacoustic imaging. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE; 2020. p. 1919–22.
16. Mohanakurup V, Parambil Gangadharan SM, Goel P, Verma D, Alshehri S, Kashyap R, et al. Breast cancer detection on histopathological images using a composite dilated Backbone Network. Comput Intell Neurosci. 2022;2022(1):8517706.
17. Nair R, Vishwakarma S, Soni M, Patel T, Joshi S. Detection of COVID-19 cases through X-ray images using hybrid deep neural network. World J Eng. 2022;19(1):33–9.
18. Zhang J, Chen B, Zhou M, Lan H, Gao F. Photoacoustic image classification and segmentation of breast cancer: a feasibility study. IEEE Access. 2018;7:5457–66.
19. Lan H, Jiang D, Yang C, Gao F, Gao F. Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo. Photoacoustics. 2020;20:100197.
20. Jabeen K, Khan MA, Alhaisoni M, Tariq U, Zhang YD, Hamza A, et al. Breast cancer classification from ultrasound images using probability-based optimal deep learning feature fusion. Sensors. 2022;22(3):807.
21. Zhu YC, AlZoubi A, Jassim S, Jiang Q, Zhang Y, Wang YB, et al. A generic deep learning framework to classify thyroid and breast lesions in ultrasound images. Ultrasonics. 2021;110:106300.
22. Kashyap R. Stochastic dilated residual ghost model for breast cancer detection. J Digit Imaging. 2023;36(2):562–73.
23. Kashyap R. Histopathological image classification using dilated residual grooming kernel model. Int J Biomed Eng Technol. 2023;41(3):272–99.
24. Alharbi M, Ahmad S. Enhancing COVID-19 detection using CT-scan image analysis and disease classification: the DI-QL approach. Health Technol (Berl). 2025;1–12.
25. Nair R, Alhudhaif A, Koundal D, Doewes RI, Sharma P. Deep learning-based COVID-19 detection system using pulmonary CT scans. Turkish J Electr Eng Comput Sci. 2021;29(8):2716–27.
26. Ansari GA, ShafiBhat S, Ansari MD, Ahmad S, Abdeljaber HAM. Prediction and Diagnosis of Breast Cancer using Machine Learning Techniques. 2024;
27. Haq AU, Li JP, Khan I, Agbley BLY, Ahmad S, Uddin MI, et al. DEBCM: deep learning-based enhanced breast invasive ductal carcinoma classification model in IoMT healthcare systems. IEEE J Biomed Heal Informatics. 2022;28(3):1207–17.
28. Ubaidillah SHSA, Sallehuddin R, Ali NA. Cancer detection using aritifical neural network and support vector machine: a comparative study. J Teknol. 2013;65(1).
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Ahmed A.F Osman, Rajit Nair, Sultan Ahmad, Mosleh Hmoud Al-Adhaileh, Ramgopal Kashyap, Hikmat A. M. Abdeljaber, Sami A. Morsi, Rami Taha Shehab (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
The article is distributed under the Creative Commons Attribution 4.0 License. Unless otherwise stated, associated published material is distributed under the same licence.
