ANALISIS MULTI-MODEL KOMPARATIF UNTUK DETEKSI DINI KANKER PAYUDARA MENGGUNAKAN EVALUASI ROC-AUC DAN MCC
DOI:
https://doi.org/10.33480/inti.v21i1.8278Keywords:
Breast Cancer, Classification, Machine Learning, MCC, ROC-AUCAbstract
Breast cancer is one of the leading causes of death in women and relies heavily on early detection to improve the chances of recovery. The main challenges in machine learning-based early detection systems are class imbalance and the limitations of evaluation metrics that often rely solely on accuracy or ROC–AUC. In this context, the Matthews Correlation Coefficient (MCC) offers a more comprehensive assessment because it considers all elements of the confusion matrix. This study analyzes and compares the performance of four classification algorithms: Naive Bayes, Decision Tree, Random Forest, and SVM on the Breast Cancer Wisconsin (Diagnostic) dataset. The dataset was first divided using a stratified train–test split of 80:20 to maintain class proportions. Feature normalization was performed only on the training data to avoid data leakage, then applied to the test data using the same parameters. Furthermore, 5-fold cross-validation was performed on the training data for model evaluation and selection. The results show that SVM provides the best performance with an accuracy of 98.25%, a precision of 1.00, an F1-score of 0.9762, an AUC of 0.9971, and an MCC of 0.9630. Naive Bayes and Random Forest also show excellent performance with AUC values above 0.99 and an MCC of 0.9253, while Decision Tree has a lower performance. Confusion matrix and ROC curve analysis confirm the superiority of SVM in minimizing classification errors. These findings emphasize the importance of a multi-model approach and the use of MCC as a more representative evaluation metric in breast cancer early detection systems.
Downloads
References
Almarri, B. et al. (2024) “The BCPM method: decoding breast cancer with machine learning,” BMC Medical Imaging, 24(1). Available at: https://doi.org/10.1186/s12880-024-01402-5.
Boddu, A.S. and Jan, A. (2025) “A systematic review of machine learning algorithms for breast cancer detection.,” Tissue & cell, 95, p. 102929. Available at: https://doi.org/10.1016/j.tice.2025.102929.
CHICCO, D. and JURMAN, G. (2023) “The Matthews correlation coefficient (MCC) should replace the ROC AUC as the standard metric for assessing binary classification,” BioData Mining, 16(1), pp. 1–23. Available at: https://doi.org/10.1186/s13040-023-00322-4.
Chicco, D. and Jurman, G. (2023) “The Matthews correlation coefficient (MCC) should replace the ROC AUC as the standard metric for assessing binary classification,” BioData Mining, 16(1). Available at: https://doi.org/10.1186/s13040-023-00322-4.
Darweesh, M.S. et al. (2021) “Early breast cancer diagnostics based on hierarchical machine learning classification for mammography images,” Cogent Engineering, 8(1). Available at: https://doi.org/10.1080/23311916.2021.1968324.
DAS, S., KOLEY, S. and SAHA, T. (2023) “Machine Learning Approaches for Investigating Breast Cancer,” Biosciences Biotechnology Research Asia, 20(4), pp. 1109–1131. Available at: https://doi.org/10.13005/bbra/3163.
HANIS, T.M., ISLAM, M.A. and MUSA, K.I. (2022) “Diagnostic Accuracy of Machine Learning Models on Mammography in Breast Cancer Classification: A Meta-Analysis,” Iranian Journal of Radiology, 19(3). Available at: https://doi.org/10.5812/iranjradiol-121392.
Hickman, S.E. et al. (2024) “Deep Learning Algorithms for Breast Cancer Detection in a UK Screening Cohort: As Stand-alone Readers and Combined with Human Readers,” Radiology, 313(2). Available at: https://doi.org/10.1148/radiol.233147.
Hussain, S. et al. (2024) “Breast cancer risk prediction using machine learning: a systematic review,” Frontiers in Oncology. Frontiers Media SA. Available at: https://doi.org/10.3389/fonc.2024.1343627.
Jong, L.J.S. et al. (2023) “Tissue Classification of Breast Cancer by Hyperspectral Unmixing,” Cancers, 15(10). Available at: https://doi.org/10.3390/cancers15102679.
JOY, A. et al. (2023) “Ensemble Learning for Breast Cancer Lesion Classification: A Pilot Validation Using Correlated Spectroscopic Imaging and Diffusion-Weighted Imaging,” Metabolites, 13(7). Available at: https://doi.org/10.3390/metabo13070835.
KUMAR, A., SAINI, R. and KUMAR, R. (2024) “A Comparative Analysis of Machine Learning Algorithms for Breast Cancer Detection and Identification of Key Predictive Features,” Traitement du Signal, 41(1), pp. 127–140. Available at: https://doi.org/10.18280/ts.410110.
PATI, A. et al. (2024) “Performance assessment of hybrid machine learning approaches for breast cancer and recurrence prediction,” PLoS ONE, 19(8 August), pp. 1–29. Available at: https://doi.org/10.1371/journal.pone.0304768.
Rahman, M.A. et al. (2025) Advancements in Breast Cancer Detection: A Review of Global Trends, Risk Factors, Imaging Modalities, Machine Learning, and Deep Learning Approaches, BioMedInformatics. Available at: https://doi.org/10.3390/biomedinformatics5030046.
SAHOO, G. et al. (2024) “Predicting Breast Cancer Relapse from Histopathological Images with Ensemble Machine Learning Models,” Current Oncology, 31(11), pp. 6577–6597. Available at: https://doi.org/10.3390/curroncol31110486.
SINGHAL, V. et al. (2022) “Breast Cancer Prediction using KNN, SVM, Logistic Regression and Decision Tree,” Ijraset Journal For Research in Applied Science and Engineering Technology [Preprint], (May). Available at: https://doi.org/https://doi.org/10.22214/ijraset.2022.42688.
Walsh, R. and Tardy, M. (2023) “A Comparison of Techniques for Class Imbalance in Deep Learning Classification of Breast Cancer,” Diagnostics, 13(1). Available at: https://doi.org/10.3390/diagnostics13010067.
Zhang, T. et al. (2023) “Predicting breast cancer types on and beyond molecular level in a multi-modal fashion,” npj Breast Cancer, 9(1). Available at: https://doi.org/10.1038/s41523-023-00517-2.
ZHANG, X. et al. (2025) “Advanced deep learning and transfer learning approaches for breast cancer classi fi cation using advanced multi-line classi fi ers and datasets with model optimization and interpretability,” PeerJ Computer Science, 11, pp. 1–35. Available at: https://doi.org/10.7717/peerj-cs.2951.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Daning Nur Sulistyowati, Sri Hadianti, Ridan Nurfalah
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Penulis yang menerbitkan jurnal ini menyetujui ketentuan berikut:
1. Penulis memegang hak cipta dan memberikan hak jurnal mengenai publikasi pertama dengan karya yang dilisensikan secara bersamaan di bawah Creative Commons Attribution 4.0 International License. yang memungkinkan orang lain untuk berbagi karya dengan pengakuan atas karya penulis dan publikasi awal pada jurnal.
2. Penulis dapat memasukkan pengaturan kontrak tambahan yang terpisah untuk distribusi non-eksklusif dari versi jurnal yang diterbitkan (misalnya, mengirimkannya ke repositori institusional atau menerbitkannya dalam sebuah buku), dengan pengakuan atas publikasi awalnya pada Jurnal.
3. Penulis diizinkan dan didorong untuk memposting karya mereka secara online (misalnya, dalam penyimpanan institusional atau di situs web mereka) sebelum dan selama proses pengiriman, karena hal itu dapat menghasilkan pertukaran yang produktif, serta kutipan dari karya yang diterbitkan sebelumnya.
