COMPARATIVE STUDY OF GENERATIVE AI TOOLS IN VISUAL COMMUNICATION DESIGN EDUCATION: CREATIVITY AND USABILITY

Authors

DOI:

https://doi.org/10.33480/jitk.v11i3.7087

Keywords:

CAT-SUS, Creativity Assessment, Education, Generative AI, Usability

Abstract

The integration of generative artificial intelligence (AI) into visual communication design education presents opportunities to enhance creativity and usability in learning. This study compares the effectiveness of three generative AI tools (MidJourney, DALL·E, and Adobe Firefly) in supporting students’ creative outcomes and perceived usability, while also examining their broader pedagogical role in design education. A quasi-experimental design was conducted with 30 undergraduate students who each produced two poster designs: one manually and one with AI assistance. Creativity was evaluated using the Consensual Assessment Technique (CAT) by expert judges, and usability was measured using the System Usability Scale (SUS). Results showed that AI-assisted designs achieved significantly higher creativity scores (M = 4.3 vs. 3.2, p < 0.05) and usability ratings (range M = 74–82) compared to manual designs, with MidJourney rated highest in creativity and Adobe Firefly in usability. These findings provide empirical evidence that generative AI can act as a catalyst for creativity and usability in design education, offering theoretical insights into human–AI co-creation and practical implications for curriculum integration. Limitations include the small sample size and the study’s focus on a single academic program, which may affect generalizability.

Downloads

Download data is not yet available.

References

[1] Y. Liang, “Balancing: The Effects of AI Tools in Educational Context,” Frontiers in Humanities and Social Sciences, vol. 3, no. 8, p. 7, 2023, doi: 10.54691/fhss.v3i8.5531.

[2] G. Franceschelli and M. Musolesi, “DeepCreativity: measuring creativity with deep learning techniques,” Intelligenza Artificiale: The international journal of the AIxIA, vol. 16, no. 2, pp. 151–163, Dec. 2022, doi: 10.3233/IA-220136.

[3] V. Kujore, A. Adebayo, O. Sambakiu, and B. S. Segbenu, “Transformative role of generative AI in marketing content creation and brand engagement strategies,” GSC Advanced Research and Reviews, vol. 23, no. 3, p. 1, 2025, doi: 10.30574/gscarr.2025.23.3.0145.

[4] Y. Li, “Advancing Design With Generative AI: A Case of Automotive Design Process Transformation,” in Proceedings of DRS, 2024. doi: 10.21606/drs.2024.1260.

[5] D. Hanna, “The Use of Artificial Intelligence Art Generator ‘Midjourney’ in Artistic and Advertising Creativity,” Journal of Design Sciences and Applied Arts, vol. 4, no. 2, p. 42, 2023, doi: 10.21608/jdsaa.2023.169144.1231.

[6] L. Tan and M. Luhrs, “Using Generative AI Midjourney to enhance divergent and convergent thinking in an architect’s creative design process,” The Design Journal, vol. 27, no. 4, p. 677, 2024, doi: 10.1080/14606925.2024.2353479.

[7] L. Tian, Q. Wang, B. Zhang, and L. Bo, “EMO: Emote Portrait Alive – Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions,” ArXiv, 2024, doi: https://doi.org/10.48550/arXiv.2402.17485.

[8] M. Chandra and Y. Erlyana, “Pilah sampah melalui media edukasi kreatif: pendekatan design thinking,” Jurnal Desain, vol. 12, no. 3, p. 811, Jul. 2025, doi: 10.30998/jd.v12i3.24282.

[9] Y.-M. Fang, “The role of generative AI in industrial design: enhancing the design process and education,” in IET Conference Proceedings, 2024, p. 135. doi: 10.1049/icp.2024.0303.

[10] M. L. Haryanti and R. Purbojo, “Peran Kepemimpinan Transformasional dan Literasi Digital terhadap Kompetensi Pedagogis Guru dalam Pengintegrasian Teknologi,” Edumatic: Jurnal Pendidikan Informatika, vol. 8, no. 1, pp. 103–112, Jun. 2024, doi: 10.29408/edumatic.v8i1.25444.

[11] P. Cotroneo and J. Hutson, “Generative AI tools in art education: Exploring prompt engineering and iterative processes for enhanced creativity,” Metaverse, vol. 4, no. 1, p. 14, 2023, doi: 10.54517/m.v4i1.2164.

[12] D. Satria, “Implementasi User Centered Requirements Engineering dalam Pencarian Kebutuhan Sistem eLearning,” Journal of Information System Research (JOSH), vol. 3, no. 4, pp. 437–445, Jul. 2022, doi: 10.47065/josh.v3i4.1618.

[13] K. A. Bartlett and J. D. Camba, “Generative Artificial Intelligence in Product Design Education: Navigating Concerns of Originality and Ethics,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 8, no. 5, p. 55, 2024, doi: 10.9781/ijimai.2024.02.006.

[14] J. Liang, “The application of artificial intelligence-assisted technology in cultural and creative product design,” Sci. Rep., vol. 14, no. 1, 2024, doi: 10.1038/s41598-024-82281-2.

[15] M. Abdaljaleel et al., “A multinational study on the factors influencing university students’ attitudes and usage of ChatGPT,” Sci. Rep., vol. 14, no. 1, 2024, doi: 10.1038/s41598-024-52549-8.

[16] Y. Choi, “Integrating ChatGPT into the Design of 5E-Based Earth Science Lessons,” Educ. Sci. (Basel)., vol. 15, no. 7, p. 815, 2025, doi: 10.3390/educsci15070815.

[17] M. G. Saputra and I. R. Andelina, “Analysis of Interface Design in the Game Honkai Star Rail Using the Usability Heuristics Principles of UI,” Gameology and Multimedia Expert, vol. 2, no. 1, pp. 7–16, Jan. 2025, doi: 10.29103/game.v2i1.19957.

[18] B. Jose, J. Cherian, A. M. Verghis, S. M. Varghise, S. Mumthas, and S. Joseph, “The cognitive paradox of AI in education: between enhancement and erosion,” Front. Psychol., vol. 16, 2025, doi: 10.3389/fpsyg.2025.1550621.

[19] M. I. Baig and E. Yadegaridehkordi, “Factors influencing academic staff satisfaction and continuous usage of generative artificial intelligence (GenAI) in higher education,” International Journal of Educational Technology in Higher Education, vol. 22, no. 1, 2025, doi: 10.1186/s41239-025-00506-4.

[20] S. Chardonnens, “Adapting educational practices for Generation Z: integrating metacognitive strategies and artificial intelligence,” Front. Educ. (Lausanne)., vol. 10, 2025, doi: 10.3389/feduc.2025.1504726.

[21] R. Chugh et al., “The Promise and Pitfalls: A Literature Review of Generative Artificial Intelligence as a Learning Assistant in ICT Education,” Computer Applications in Engineering Education, vol. 33, no. 2, 2025, doi: 10.1002/cae.70002.

[22] J. Kim and H. Kim, “Generative AI in creative workflows: A case study on Midjourney and insights for future image tools,” Edelweiss Applied Science and Technology, vol. 9, no. 4, p. 54, 2025, doi: 10.55214/25768484.v9i4.5936.

[23] R. Marrone, V. Taddeo, and G. Hill, “Creativity and Artificial Intelligence—A Student Perspective,” J. Intell., vol. 10, no. 3, p. 65, 2022, doi: 10.3390/jintelligence10030065.

[24] J. Fernandes Andry, M. Clara, W. Chandra, M. Antonio, and D. Yurisca Bernanda, “User Interface Analysis of PeduliLindungi Application to Improve User Experience with The Heuristic Evaluation Method,” Journal Research and Development (ITJRD), vol. 8, no. 2, 2024, doi: 10.25299/itjrd.2024.12295.

[25] J. Wu and J. Dong, “Impact of Augmented Reality Characteristics on Retail Brand Equity,” 2022. doi: 10.2991/assehr.k.220107.042.

[26] N. Hiu and Y. Erlyana, “Redesigning User Interface of Datascripmall Mobile Apps Using User Centered Design Method,” Teknika, vol. 13, no. 2, pp. 283–292, Jul. 2024, doi: 10.34148/teknika.v13i2.854.

[27] M. Gomez-Hernandez, X. Ferre, C. Moral, and E. Villalba-Mora, “Design Guidelines of Mobile Apps for Older Adults: Systematic Review and Thematic Analysis,” JMIR Mhealth Uhealth, vol. 11, p. e43186, Sep. 2023, doi: 10.2196/43186.

[28] M. Basalla, J. Schneider, and J. vom Brocke, “Creativity of Deep Learning: Conceptualization and Assessment,” in Proceedings of the 14th International Conference on Agents and Artificial Intelligence, 2022. doi: 10.5220/0010783500003116.

[29] J.-F. Chen, C.-C. Ni, P.-H. Lin, and R. Lin, “Designing the Future: A Case Study on Human-AI Co-Innovation,” Creat. Educ., vol. 15, no. 3, p. 474, 2024, doi: 10.4236/ce.2024.153028.

[30] Y. Meron, “Graphic design and artificial intelligence: Interdisciplinary challenges for designers in the search for research collaboration,” in Proceedings of DRS, 2022. doi: 10.21606/drs.2022.157.

[31] P. Barth and G. Stadtmann, “Creativity Assessment over Time: Examining the Reliability of CAT Ratings,” J. Creat. Behav., vol. 55, no. 2, pp. 396–409, Jun. 2021, doi: 10.1002/jocb.462.

[32] N. Pratama and R. Anrahvi, “Application of the System Usability Scale (SUS) Method in Measuring Student Satisfaction with the Academic Directory Website,” IJBEM: Indonesian Journal of Business Economics and Management, vol. 3, no. 2, pp. 74–80, Jun. 2024, doi: 10.57152/ijbem.v3i2.2024.

[33] S. B. Kim and D. Oh, “Evaluating Creativity: Can LLMs Be Good Evaluators in Creative Writing Tasks?,” Applied Sciences, vol. 15, no. 6, p. 2971, 2025, doi: 10.3390/app15062971.

[34] L. Hu, M. Boggess, and M. M. Shepley, “Comparing Expert, Quasi-Expert, and Novice Evaluations of Award-Winning Design Products Using the Consensual Assessment Technique,” Creat. Res. J., vol. 35, no. 4, pp. 730–748, Oct. 2023, doi: 10.1080/10400419.2022.2157591.

[35] B. Capili and J. K. Anastasi, “An Introduction to Types of Quasi-Experimental Designs,” American Journal of Nursing, vol. 124, no. 11, pp. 50–52, Nov. 2024, doi: 10.1097/01.NAJ.0001081740.74815.20.

[36] Y. Erlyana and Ressiani, Basic of Packaging: Belajar Kemas Kemasan, 1st ed. Yogyakarta: Graha Ilmu, 2020.

[37] L. J. Ball and F. Vallée-Tourangeau, The Routledge International Handbook of Creative Cognition. London: Routledge, 2023. doi: 10.4324/9781003009351.

[38] R. B. Ohnson and L. B. Christensen, Educational Research: Quantitative, Qualitative, and Mixed Approaches, 7th ed. California: SAGE Publications, Inc, 2020.

[39] A. Garg, K. Nisumba Soodhani, and R. Rajendran, “Enhancing data analysis and programming skills through structured prompt training: The impact of generative AI in engineering education,” Computers and Education: Artificial Intelligence, vol. 8, p. 100380, Jun. 2025, doi: 10.1016/j.caeai.2025.100380.

[40] A. Nanda, Dr. B. B. Mohapatra, A. P. K. Mahapatra, A. P. K. Mahapatra, and A. P. K. Mahapatra, “Multiple comparison test by Tukey’s honestly significant difference (HSD): Do the confident level control type I error,” International Journal of Statistics and Applied Mathematics, vol. 6, no. 1, pp. 59–65, Jan. 2021, doi: 10.22271/maths.2021.v6.i1a.636.

[41] P. Barth and G. Stadtmann, “Creativity Assessment over Time: Examining the Reliability of CAT Ratings,” Journal of Creative Behavior, vol. 55, no. 2, pp. 396–409, Jun. 2021, doi: 10.1002/jocb.462.

[42] S. Guo et al., “Vinci: An Intelligent Graphic Design System for Generating Advertising Posters,” Proceedings of CHI, vol. 1, 2021, doi: 10.1145/3411764.3445117.

[43] J. Hartmann, Y. Exner, and S. Domdey, “The power of generative marketing: Can generative AI create superhuman visual marketing content?,” International Journal of Research in Marketing, 2024, doi: 10.1016/j.ijresmar.2024.09.002.

[44] J. Lin et al., “AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generation,” in Proceedings of CHI, 2023, p. 1250. doi: 10.1145/3581783.3611930.

[45] S. Chompunuch and T. Lubart, “AI as a Helper: Leveraging Generative AI Tools Across Common Parts of the Creative Process,” J. Intell., vol. 13, no. 5, p. 57, 2025, doi: 10.3390/jintelligence13050057.

[46] A. Ansone, Z. Zālīte-Supe, and L. Daniela, “Generative Artificial Intelligence as a Catalyst for Change in Higher Education Art Study Programs,” Computers, vol. 14, no. 4, p. 154, 2025, doi: 10.3390/computers14040154.

[47] Q. Jiang, Y. Zhang, W. Wei, and C. Gu, “Evaluating Technological and Instructional Factors Influencing the Acceptance of AIGC-Assisted Design Courses,” Computers and Education Artificial Intelligence, vol. 7, p. 100287, 2024, doi: 10.1016/j.caeai.2024.100287.

[48] M. U. Kahraman, Y. Şekerci, M. Develier, and F. Koyuncu, “Integrating Artificial Intelligence in Interior Design Education: Concept Development,” Journal of Computational Design, vol. 5, no. 1, p. 31, 2024, doi: 10.53710/jcode.1418783.

[49] K. Seo, J. Tang, I. Roll, S. Fels, and D. Yoon, “The impact of artificial intelligence on learner–instructor interaction in online learning,” International Journal of Educational Technology in Higher Education, vol. 18, no. 1, 2021, doi: 10.1186/s41239-021-00292-9.

Downloads

Published

2026-02-10

Issue

Vol. 11 No. 3 (2026): JITK Issue February 2026

Section

Articles

License

Copyright (c) 2026 Yana Erlyana, M Garry Saputra

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

How to Cite

[1]
“COMPARATIVE STUDY OF GENERATIVE AI TOOLS IN VISUAL COMMUNICATION DESIGN EDUCATION: CREATIVITY AND USABILITY”, jitk, vol. 11, no. 3, pp. 733–742, Feb. 2026, doi: 10.33480/jitk.v11i3.7087.