Hybrid Deep Learning for Skin Cancer Classification Using Dermatoscopic Images With Explainable AI

Monday Simon, Nasu Mbimi, Umar Abdullahi, Samuel Amachundi Adda, Victoria Sevini Sabo, Munu Stephen

Abstract


Skin cancer is one of the most prevalent and life-threatening diseases worldwide, with melanoma representing the most aggressive form due to its high metastatic potential and mortality rate. Early and accurate detection is essential for improving treatment effectiveness and patient survival outcomes. However, conventional diagnostic approaches based on visual inspection and dermatoscopy remain highly subjective and dependent on clinician expertise, which can lead to variability and misdiagnosis. To overcome these limitations, this study proposes an explainable hybrid deep learning framework that integrates Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRU) for automated skin cancer classification using dermatoscopic images. The proposed CNN–GRU model leverages the CNN’s capability to extract fine-grained spatial features such as texture, color variation, and lesion boundaries, while the GRU component captures broader contextual dependencies across feature representations to enhance classification robustness. The model was trained and evaluated using publicly available datasets, including the ISIC Archive and HAM10000, which contain high-quality annotated dermatoscopic images of benign and malignant skin lesions. Standard preprocessing techniques, including image resizing, normalization, and data augmentation, were applied to improve dataset diversity and reduce overfitting. An explainable AI framework was incorporated to improve clinical interpretability, utilizing Gradient-weighted Class Activation Mapping (Grad-CAM) for visualizing CNN feature importance and attention-based visualization for interpreting GRU outputs. These methods provide transparent insights into the regions of interest influencing model predictions, thereby increasing clinical trust and interpretability. Experimental results show that the proposed CNN–GRU hybrid model achieved an overall classification accuracy of 85%, outperforming the standalone CNN model, which achieved 84%. The hybrid model also recorded improved macro and weighted average precision, recall, and F1-scores of 0.85 compared to 0.84 for the CNN baseline, indicating more balanced and reliable performance. At the class level, the model achieved a precision of 0.87 and recall of 0.84 for benign lesions, and a precision of 0.81 and recall of 0.86 for malignant lesions, demonstrating strong sensitivity in detecting malignant cases, which is critical for reducing false negatives in clinical diagnosis. Hence, the results confirm that the integration of CNN and GRU architectures enhances feature representation by combining local spatial feature extraction with global contextual learning. The hybrid model demonstrates improved generalization, stable convergence, and reduced misclassification across classes. When combined with explainable AI techniques, the framework not only delivers high classification performance but also provides interpretable decision support, making it a reliable and clinically applicable tool for early skin cancer detection and diagnosis. 


Full Text:

PDF

References


Ahmad, I., Borman, R. I., Fakhrurozi, J., & Caksana, G. G. (2022). Software development dengan Extreme Programming (XP) pada aplikasi deteksi kemiripan judul skripsi berbasis Android. INOVTEK Polbeng-Seri Informatika, 5(2), 297–307.

Akinsola, J. E. T., Ogunbanwo, A. S., Okesola, O. J., Odun-Ayo, I. J., Ayegbusi, F. D., & Adebiyi, A. A. (2022). Comparative

Al Mahmud, A., Azam, S., Khan, I. U., Montaha, S., Karim, A., Haque, A., Zahid Hasan, M., Brady, M., Biswas, R., & Jonkman, M. (2024). SkinNet-14: a deep learning framework for accurate skin cancer classification using low-resolution dermoscopy images with optimized training time. Neural Computing and Applications, 36(30), 18935–18959.

Ali, K., Shaikh, Z. A., Khan, A. A., & Laghari, A. A. (2022). Multiclass skin cancer classification using EfficientNets--a first step towards preventing skin cancer. Neuroscience Informatics, 2(4), 100034.

Asif, S., Khan, S. U. R., Amjad, K., & Awais, M. (2024). SKINC-NET: an efficient Lightweight Deep Learning Model for Multiclass skin lesion classification in dermoscopic images. Multimedia Tools and Applications, 1–27.

Attallah, O. (2024). A Hybrid Trio-Deep Feature Fusion Model for Improved Skin Cancer Classification: Merging Dermoscopic and DCT Images. Technologies, 12(10), 190.

Bassel, A., Abdulkareem, A. B., Alyasseri, Z. A. A., Sani, N. S., & Mohammed, H. J. (2022). Automatic malignant and benign skin cancer classification using a hybrid deep learning approach. Diagnostics, 12(10), 2472.

Bechelli, S., & Delhommelle, J. (2022). Machine learning and deep learning algorithms for skin cancer classification from dermoscopic images. Bioengineering, 9(3), 97.

Borman, R. I., Priandika, A. T., & Edison, A. R. (2022). Implementasi Metode Pengembangan Sistem Extreme Programming (XP) pada Aplikasi Investasi Peternakan. JUSTIN (Jurnal Sistem Dan Teknologi Informasi), 8(3), 272–277.

Fontenrose, J. (2022). Python: A study of Delphic myth and its origins. Univ of California Press.

Grignaffini, F., Barbuto, F., Piazzo, L., Troiano, M., Simeoni, P., Mangini, F., Pellacani, G., Cantisani, C., & Frezza, F. (2022). Machine learning approaches for skin cancer classification from dermoscopic images: a systematic review. Algorithms, 15(11), 438.

Gururaj, H. L., Manju, N., Nagarjun, A., Aradhya, V. N. M., & Flammini, F. (2023). DeepSkin: a deep learning approach for skin cancer classification. IEEE Access, 11, 50205–50214.

Hameed, A., Umer, M., Hafeez, U., Mustafa, H., Sohaib, A., Siddique, M. A., & Madni, H. A. (2023). Skin lesion classification in dermoscopic images using stacked convolutional neural network. Journal of Ambient Intelligence and Humanized Computing, 14(4), 3551–3565.

Hammoudi, K., Benhabiles, H., Melkemi, M., Dornaika, F., Arganda-Carreras, I., Collard, D., & Scherpereel, A. (2021). Deep learning on chest X-ray images to detect and evaluate pneumonia cases at the era of COVID-19. Journal of Medical Systems, 45(7), 1–10.

Huang, Q., Ding, H., & Sheykhahmad, F. R. (2023). A skin cancer diagnosis system for dermoscopy images according to deep training and metaheuristics. Biomedical Signal Processing and Control, 83, 104705.

Kunwar, S. (2023). Enabling and Limiting factors in eXtreme Programming (XP) with Evaluation Framework. SCITECH Nepal, 14(1), 50–62.

Magdy, A., Hussein, H., Abdel-Kader, R. F., & Abd El Salam, K. (2023). Performance enhancement of skin cancer classification using computer vision. IEEE Access, 11, 72120–72133.

Martelli, A., Ravenscroft, A. M., Holden, S., & McGuire, P. (2023). Python in a Nutshell. “ O’Reilly Media, Inc.”

Mohanty, M. N., & Das, A. (2024). Skin cancer detection from dermatoscopic images using hybrid fuzzy ensemble learning model. International Journal of Fuzzy Systems, 26(1), 260–273.

Mwita, K. (2022). Factors to consider when choosing data collection methods. International Journal of Research in Business and Social Science (2147-4478), 11(5), 532–538.

Ogundokun, R. O., Li, A., Babatunde, R. S., Umezuruike, C., Sadiku, P. O., Abdulahi, A. T., & Babatunde, A. N. (2023). Enhancing skin cancer detection and classification in dermoscopic images through concatenated MobileNetV2 and xception models. Bioengineering, 10(8), 979.

Python, W. (2021). Python. Python Releases for Windows, 24.

Radhika, V., & Chandana, B. S. (2023). MSCDNet-based multi-class classification of skin cancer using dermoscopy images. PeerJ Computer Science, 9, e1520.

Rahman, M. A., Bazgir, E., Hossain, S. S., & Maniruzzaman, M. (2024). Skin cancer classification using NASNet. International Journal of Science and Research Archive, 11(1), 775–785.

Sara, U., Das, U. K., Sikder, J., & Chowdhury, S. R. (2025). Automated skin Cancer classification and detection using convolutional neural networks and dermoscopy images. Procedia Computer Science, 252, 108–117.

Tahir, M., Naeem, A., Malik, H., Tanveer, J., Naqvi, R. A., & Lee, S.-W. (2023). DSCC_Net: multi-classification deep learning models for diagnosing of skin cancer using dermoscopic images. Cancers, 15(7), 2179.

Tajerian, A., Kazemian, M., Tajerian, M., & Akhavan Malayeri, A. (2023). Design and validation of a new machine-learning-based diagnostic tool for the differentiation of dermatoscopic skin cancer images. PLoS One, 18(4), e0284437.


Refbacks

  • There are currently no refbacks.