LITERATURE REVIEW: ADVANTAGES AND DISADVANTAGES OF BLACK BOX AND WHITE BOX TESTING METHODS

Authors

  • Asri Maspupah Politeknik Negeri Bandung

DOI:

https://doi.org/10.33480/techno.v21i2.5776

Keywords:

black box testing, software testing, systematic literature review, white box testing

Abstract

Software testing methods play a crucial role in ensuring the quality, security, and performance of applications. The two main approaches often used are black box and white box testing. This article presents a comprehensive literature review of the characteristics, advantages and disadvantages of both testing methods with the aim of providing in-depth insights for practitioners and researchers in the field of software engineering. The research method used is Systematic Literature Review (SLR), which is a technique of collecting information through the process of searching for literature based on research questions, filtering search results, evaluating, and analyzing relevant research from various academic database sources to gain a comprehensive understanding. Through the analysis of various literature studies, the results of this research are the characteristics of each testing method that is more effectively used in best practice to achieve efficient testing with the coverage of literature review sources in the range of 2020 to 2024. The review of these characteristics is based on seven criteria, namely: test focus, test base, tester's point of view, test case design, program error identification method, program code knowledge, and test effectiveness. In addition, this article presents a comparison of the two methods so that the differences in testing methods can be clearly recognised in terms of how they are implemented. Based on the results of review literature, both methods are better used together in order to ensure that the functional and internal code structure of the software is functioning properly.

References

Amin, Z. M., Anwar, N., Shoid, M. S. M., & Samuri, S. (2022). Method for Conducting Systematic Literature Review (SLR) for Cyber Risk Assessment. 5th International Conference on Information Science, 7(SI10), 255–260. https://doi.org/10.21834/ebpj.v7isi10.4130

Amin, Z. M., Anwar, N., Shoid, M. S. M., & Samuri, S. (2023). A Systematic Literature Review for Modeling a Cyber Risk Assessment Framework. Nd International Conference on Information Science, Technology, Management, Humanities, and Business, 9(SI18), 189–195. https://doi.org/10.21834/e-bpj.v9isi18.5481

Arifandi, A., Simamora, R. N. Z., Janitra, G. A., Yaqin, M. A., & Huda, M. M. (2022). Survei Teknik-Teknik Pengujian Software Menggunakan Metode Systematic Literature Review. ILKOMNIKA: Journal of Computer Science and Applied Informatics E, 4(3), 297–315. https://doi.org/10.28926/ilkomnika.v4i3.436

Dhaifullah, I. R., Muttanifudin, M., Salsabila, A. A., & Yakin, M. A. (2022). Survei Teknik Pengujian Software. JACIS : Journal Automation Computer Information System, 2(1), 31–38. https://doi.org/10.47134/jacis.v2i1.42

Faiza. Intan Mayla, Gunawan, & Andriani, W. (2022). Tinjauan Pustaka Sistematis: Penerapan Metode Machine Learning untuk Deteksi Bencana Banjir. Jurnal Minfo Polgan, 11(2), 59–63. https://doi.org/10.33299/jpkop.22.2.1752

Fitriani, F., & Kuswadi, D. (2021). Driving factors of sustainable production in upland watersheds: systematic literature review. E3S Web of Conferences, 306. https://doi.org/10.1051/e3sconf/202130604015

Golіan, N. V, Golіan, V., & Afanasieva, I. V. (2022). Black And White-Box Unit Testing For Web Applications. Bulletin of National Technical University “KhPI”. Series: System Analysis, Control and Information Technologies, 7(1), 79–83. https://doi.org/10.20998/2079-0023.2022.01.13

Hamzah, R. I. F., & Voutama, A. (2023). Pengujian Black Box Pada Aplikasi Database Perguruan Tinggi dengan Teknik Equivalence Partitions. Antivirus : Jurnal Ilmiah Teknik Informatika, 17(1), 1–18. https://doi.org/10.35457/antivirus.v17i1.2501

Hartono, F. D., & Sugiarti, Y. (2022). Perbandingan Metode Equivalence Partitions Dan Boundary Value Analysis Pada Pengujian Black Box (Literatur Review). Majalah Ilmiah METHODA, 12(2), 153–159. https://doi.org/https://doi.org/10.46880/methoda.Vol12No2.pp153-159

Iskandar, R. S. F., & Juandi, D. (2022). Study Literature Review: Realistic Mathematics Education Learning on Students’ Mathematical Creative Thinking Ability. SJME (Supremum Journal of Mathematics Education), 6(1), 35–42. https://doi.org/10.35706/sjmev6ì1.5739

Kalfin, Ibrahim, R. A., & Laksito, G. S. (2024). Optimization of White Box Testing by Utilizing Branching and Repeating Structures in Java Programs Using Base Path. International Journal of Mathematics, Statistics, and Computing, 2(2), 85–89. https://doi.org/https://doi.org/10.46336/ijmsc.v2i2.98

Kurniawan, F., Khrisnawati, E. A., Hadiwiyanti, R., & Fitri, A. S. (2022). Pengujian Sistem Informasi Manajemen Siswa Berbasis Website Menggunakan Metode Black Box dan White Box. Prosiding 2022 “Peran Teknologi dan Sistem Informasi Sebagai Daya Bangkit UKM Pasca Pandemi di Masa Adaptasi Kebiasaan baru,” 246–261. https://doi.org/https://doi.org/10.33005/sitasi.v2i1.306

Kusum, Talwar, P., & Sharmila, K. (2024). Overview of Software Testing. Global Journal of Engineering and Technology Advances, 19(1), 104–112. https://doi.org/10.30574/gjeta.2024.19.1.0060

Maulana, T. D., Nugroho, A. A. S., Suryaputra, B. A., & Wulansari, A. (2024). Tinjauan Literatur Sistematis: Manajemen Sumber Daya Ti Di Lingkungan Pendidikan. Jurnal Mahasiswa Teknik Informatika, 8(1), 57–62. https://doi.org/10.36040/jati.v8i1.8717

Mengist, W., Soromessa, T., & Legese, G. (2020). Method for conducting systematic literature review and meta-analysis for environmental science research. MethodsX, 7(100777). https://www.sciencedirect.com/science/article/pii/S221501611930353X

Mishra, D. B., Acharya, A. A., & Acharya, S. (2020). White Box Testing Using Genetic Algorithm—An Extensive Study. In J. Singh, S. Bilgaiyan, B. S. P. Mishra, & S. Dehuri (Eds.), A Journey Towards Bio-inspired Techniques in Software Engineering (Vol. 185, pp. 167–188). Intelligent Systems Reference Library. https://doi.org/https://doi.org/10.1007/978-3-030-40928-9_9

Praniffa, A. C., Syahri, A., Sandes, F., Fariha, U., Giansyah, Q. A., & Hamzah, M. L. (2023). Pengujian Black Box Dan White Box Sistem Informasi Parkir Berbasis Web Black Box And White Box Testing Of Web-Based Parking Information System. Jurnal Testing dan Implementasi Sistem Informasi, 1(1), 1–16. https://www.journal.al-matani.com/index.php/jtisi/article/view/321

Reyna, R. S., Aleu, F. G., Gutierrez, E. M. A. G., Ramirez, J. D., Reyes, J. A. G., & Kumar, A. (2020). A systematic literature review of data science, data analytics and machine learning applied to healthcare engineering systems. Management Decision, 60(2), 300–319. https://doi.org/https://doi.org/10.1108/MD-01-2020-0035

Riyadi, S. (2023). Adopsi Metode DevOps Sebagai Acuan Pengembangan Aplikasi Bantuan Hukum. Generation Journal, 7(1), 23–70. https://doi.org/https://doi.org/10.29407/gj.v7i1.19629

Salim, S. W. G. A., Ibrahim, R., & Wahab, J. A. (2021). Comparative Analysis of Software Testing Techniques for Mobile Applications. Journal of Physics: Conference Series, 1793(1), 1–11. https://doi.org/10.1088/1742-6596/1793/1/012036

Santi, P. A. D. A., Afwani, R., Albar, Moh. A., Anjarwani, S. E., & Mardiansyah, A. Z. (2022). Black Box Testing with Equivalence Partitioning and Boundary Value Analysis Methods (Study Case: Academic Information System of Mataram University). In Proceedings of the First Mandalika International Multi-Conference on Science and Engineering 2022, MIMSE 2022 (Informatics and Computer Science) (pp. 207–219). Atlantis Press International BV. https://doi.org/10.2991/978-94-6463-084-8_19

Sasmito, G. W. (2020). White Box Testing with Basis Path Technique in the Demography Administration Website. International Conference on Sustainable Engineering and Creative Computing (ICSECC), 86–92. https://doi.org/https://doi.org/10.1109/ICSECC51444.2020.9557428

Shadiq, J., Safei, A., & Loly, R. W. R. (2021). Pengujian Aplikasi Peminjaman Kendaraan Operasional Kantor Menggunakan BlackBox Testing. Information Management for Educators and Professionals, 5(2), 97–110. https://doi.org/https://doi.org/10.51211/imbi.v5i2.1561

Sholeh, M., Gisfas, I., Cahiman, & Fauzi, M. A. (2021). Black Box Testing on ukmbantul.com Page with Boundary Value Analysis and Equivalence Partitioning Methods. Journal of Physics: Conference Series, 1823(1), 1–8. https://doi.org/10.1088/1742-6596/1823/1/012029

Sie, J. B. L., Musdar, I. A., & Bahri, S. (2022). Pengujian White Box Testing Terhadap Website Room Menggunakan Teknik Basis Path. Jurnal KHARISMA Tech, 17(2), 45–57. https://doi.org/10.55645/kharismatech.v17i2.235

Suryani, I., Misrita, M., & Ristati, R. (2021). Folklore and It’s Effect on Student’s Ability In Reading Narrative Text: a Systematic Literature Review. Indonesian Language Education and Literature, 7(1), 194–205. https://doi.org/10.24235/ileal.v7i1.9089

Susilawati, F. E., Suparman, & Patalo, A. M. G. (2022). Pengujian Black Box Aplikasi Penjualan Pupuk Bersubsidi Menggunakan Teknik Equivalence Partitioning. Jurnal Ilmiah Information Technology d’Computare, 12(2), 30–34. https://doi.org/10.30605/dcomputare.v12i2.48

Taley, D. S., & Pathak, B. (2020). Comprehensive Study of Software Testing Techniques and Strategies: A Review. International Journal of Engineering Research & Technology (IJERT), 9(8), 817–822. https://doi.org/10.17577/IJERTV9IS080373

Tanli, M., Jiang, Y., Wang, X., & Peng, R. (2020). Black-box approach for software testing based on fat-property. International Conference on Computer Science Communication and Network Security. https://doi.org/https://doi.org/10.1051/matecconf/202030902008

Uminingsih, Ichsanudin, M. N., Yusuf, M., & Suraya. (2022). Pengujian Fungsional Perangkat Lunak Sistem Informasi Perpustakaan Dengan Metode Black Box Testing Bagi Pemula. Jurnal Ilmiah Teknik Dan Ilmu Komputer, 1(2), 1–8. https://doi.org/10.55123/storage.v1i2.270

Wazzan, M., Algazzawi, D., Bamasaq, O., Albeshri, A., & Cheng, L. (2021). Internet of things botnet detection approaches: Analysis and recommendations for future research. Applied Sciences (Switzerland), 11(12), 1–46. https://doi.org/10.3390/app11125713

Weber, M., Apel, S., & Siegmund, N. (2021). White-box performance-influence models: A profiling and learning approach. Proceedings - International Conference on Software Engineering, 1059–1071. https://doi.org/10.1109/ICSE43902.2021.00099

Wijaya, Y. D., & Astuti, M. W. (2021). Pengujian Blackbox Sistem Informasi Penilaian Kinerja Karyawan PT Inka (Persero) Berbasis Equivalence Partitions. Jurnal Digital Teknologi Informasi, 4(1), 22–26. https://doi.org/10.32502/digital.v4i1.3163

Wintana, D., Pribadi, D., & Nurhadi, M. Y. (2022). Analisis Perbandingan Efektifitas White-Box Testing dan Black-Box Testing. Jurnal Ladang Artikel Ilmu Komputer, 2(1), 8–16. https://doi.org/10.31294/larik.v2i1.1382

Downloads

Published

2024-09-30

How to Cite

Maspupah, A. (2024). LITERATURE REVIEW: ADVANTAGES AND DISADVANTAGES OF BLACK BOX AND WHITE BOX TESTING METHODS. Jurnal Techno Nusa Mandiri, 21(2), 151–162. https://doi.org/10.33480/techno.v21i2.5776

Issue

Vol. 21 No. 2 (2024): Techno Nusa Mandiri : Journal of Computing and Information Technology Period of September 2024

Section

Articles

License

The copyright of any article in the TECHNO Nusa Mandiri Journal is fully held by the author under the Creative Commons CC BY-NC license.

  1. The copyright in each article belongs to the author.
  2. Authors retain all their rights to published works, not limited to the rights set out on this page.
  3. The author acknowledges that Techno Nusa Mandiri: Journal of Computing and Information Technology (TECHNO Nusa Mandiri) is the first to publish with a Creative Commons Attribution 4.0 International license (CC BY-NC).
  4. Authors can enter articles separately, manage non-exclusive distribution, from manuscripts that have been published in this journal into another version (for example: sent to author affiliation respository, publication into books, etc.), by acknowledging that the manuscript was published for the first time in Techno Nusa Mandiri: Journal of Computing and Information Technology (TECHNO Nusa Mandiri);
  5. The author guarantees that the original article, written by the stated author, has never been published before, does not contain any statements that violate the law, does not violate the rights of others, is subject to the copyright which is exclusively held by the author.
  6. If an article was prepared jointly by more than one author, each author submitting the manuscript warrants that he has been authorized by all co-authors to agree to copyright and license notices (agreements) on their behalf, and agrees to notify the co-authors of the terms of this policy. Techno Nusa Mandiri: Journal of Computing and Information Technology (TECHNO Nusa Mandiri) will not be held responsible for anything that may have occurred due to the author's internal disputes.