MEASURING PERCEIVED USABILITY OF ARTIFICIAL INTELLIGENCE-BASED QUIZZES IN A VIRTUAL MUSEUM
DOI:
https://doi.org/10.33480/jitk.v10i4.5611Keywords:
artificial intelligent, SUS, UMUX, software usability scale, virtual museumAbstract
The transformation of modern museums through digital technology offers added value to visitors, especially in the context of education. Virtual museums, in particular, complement physical museums by providing accessibility and enhancing the learning experience. The SMBII virtual museum includes an AI-based quizzes feature designed to assess the knowledge level of visitors regarding the museum's history and collections as an educational feature. In addition to physical museums, virtual museums offer convenience and enrich the learning process for visitors. The quizzes adapts its questions based on the visitor's profile, leveraging AI to tailor content and maximize learning outcomes. This study aims to compare the effectiveness of two widely used usability metrics—System Usability Scale (SUS) and Usability Metric for User Experience (UMUX)—in evaluating the usability of the AI-driven quiz feature within the SMBII virtual museum. The study specifically seeks to determine whether there are significant differences between SUS and UMUX in measuring user perceptions of the quiz’s usability. The primary respondents of this study were students, who represent the museum's target audience for educational purposes. Hypothesis testing results show no significant difference between the SUS and UMUX scores (P > 0.05), indicating that both metrics offer similar evaluations of usability. Based on these findings, the study recommends the use of UMUX over SUS for future usability assessments in virtual museum systems, as UMUX is more time-efficient without compromising accuracy. This research contributes to advancing the understanding of usability testing methods for AI-based educational features in virtual museum environments
Downloads
References
S. Puspasari, E. Ermatita, and Z. Zulkardi, “Sensitivity Analysis of the New Model of Museum Education Performance Index with Machine Learning-Based Digital Technology Usage Parameters,” in 2023 International Conference on Informatics, Multimedia, Cyber and Informations System (ICIMCIS), 2023, pp. 561–565, doi: 10.1109/ICIMCIS60089.2023.10349041.
C. Silva, N. Zagalo, and Mário Vairinhos, “Towards participatory activities with augmented reality for cultural heritage: A literature review,” Comput. Educ. X Real., vol. 3, no. October, p. 100044, 2023, doi: 10.1016/j.cexr.2023.100044.
S. Puspasari, Ermatita, and Zulkardi, “Innovative Virtual Museum Conceptual Model for Learning Enhancement During The Pandemic,” in 2022 11th Electrical Power, Electronics, Communications, Controls and Informatics Seminar (EECCIS), 2022, pp. 339–344, doi: 10.1109/EECCIS54468.2022.9902937.
E. Ermatita, S. Puspasari, and Z. Zulkardi, “Improving Student ’ s Cognitive Performance during the Pandemic through a Machine Learning-Based Virtual Museum,” TEM Journal., vol. 12, no. 2, pp. 948–955, 2023, doi: 10.18421/TEM122.
S. Puspasari, N. Suhandi, and J. N. Iman, “Evaluation of Augmented Reality Application Development for Cultural Artefact Education,” Int. J. Comput., vol. 20, no. 2, pp. 237–245, 2021, doi: 10.47839/ijc.20.2.2171.
F. M. La Russa and C. Santagati, “An AI-based DSS for preventive conservation of museum collections in historic buildings,” J. Archaeol. Sci. Reports, vol. 35, no. November 2020, p. 102735, 2021, doi: 10.1016/j.jasrep.2020.102735.
F. Ponsignon and M. Derbaix, “The impact of interactive technologies on the social experience: An empirical study in a cultural tourism context,” Tour. Manag. Perspect., vol. 35, no. April, p. 100723, 2020, doi: 10.1016/j.tmp.2020.100723.
D. R. Sanchez, M. Langer, R. Kaur, and S. Francisco, “Gamification in the classroom : Examining the impact of gamified quizzes on student learning,” Comput. Educ., vol. 144, no. October 2018, p. 103666, 2020, doi: 10.1016/j.compedu.2019.103666.
S. Puspasari, E. Ermatita, and Z. Zulkardi, “Assessing an Innovative Virtual Museum Application using Technology Acceptance Model,” Int. J. Informatics Dev., vol. 11, no. 1, pp. 212–221, 2022, doi: 10.14421/ijid.2022.3758.
G. Ioannakis, L. Bampis, and A. Koutsoudis, “Exploiting artificial intelligence for digitally enriched museum visits,” J. Cult. Herit., vol. 42, pp. 171–180, 2020, doi: 10.1016/j.culher.2019.07.019.
M. Fiorucci, M. Khoroshiltseva, M. Pontil, A. Traviglia, A. Del Bue, and S. James, “Machine Learning for Cultural Heritage: A Survey,” Pattern Recognit. Lett., vol. 133, pp. 102–108, 2020, doi: 10.1016/j.patrec.2020.02.017.
P. Ambarwati and M. Mustikasari, “Usability Evaluation of the Restaurant Finder Application Using Inspection and Inquiry Methods,” J. Sist. Inf. (Journal Inf. Syst., vol. 17, no. 2, pp. 1–17, 2021.
Y. M. Kim and I. Rhiu, “Development of a virtual reality system usability questionnaire (VRSUQ),” Appl. Ergon., vol. 119, p. 104319, 2024, doi: https://doi.org/10.1016/j.apergo.2024.104319.
K. S. Al-Tahat, “An Arabic Adaptation of the Usability Metric for User Experience (UMUX),” Int. J. Hum. Comput. Interact., vol. 36, no. 11, pp. 1050–1055, 2020, doi: 10.1080/10447318.2019.1709332.
S. Puspasari, Ermatita, and Zulkardi, “Machine Learning for Exhibition Recommendation in a Museum’s Virtual Tour Application,” Int. J. Adv. Comput. Sci. Appl., vol. 13, no. 4, pp. 404–412, 2022, doi: https://doi.org/10.14569/IJACSA.2022.0130448.
A. Marto, M. Melo, A. Goncalves, and M. Bessa, “Development and Evaluation of an Outdoor Multisensory AR System for Cultural Heritage,” IEEE Access, vol. 9, pp. 16419–16434, 2021, doi: 10.1109/ACCESS.2021.3050974.
R. Suharsih, R. Febriani, and S. Triputra, “Usability of Jawara Sains Mobile Learning Application Using System Usability Scale (SUS),” J. Online Inform., vol. 6, no. 1, p. 41, 2021, doi: 10.15575/join.v6i1.700.
P. Buono, D. Caivano, M. F. Costabile, G. Desolda, and R. Lanzilotti, “Towards the detection of UX Smells: The support of visualizations,” IEEE Access, vol. 8, pp. 6901–6914, 2020, doi: 10.1109/ACCESS.2019.2961768.
USAID, “Digital Ecosystem Framework,” 2022.
S. Puspasari, I. A. Siradjuddin, Rachmansyah, M. A. F. Rahman, and D. Haversyalapa, “IoT and AI-Driven Conceptual Model of Museum Ecosystem,” in 2023 International Conference on Electrical Engineering and Informatics (ICEEI), 2023, pp. 1–6, doi: 10.1109/ICEEI59426.2023.10346949.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Shinta Puspasari, Rendra Gustriansyah, Dwi Asa Verano, Ahmad Sanmorino, Hartini Hartini, Ermatita Ermatita
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
-a.jpg)
-b.jpg)
