Exploring User Experiences of Chat GPT and Google Gemini AI : A SUS and EUCS Approach
Keywords:
ChatGPT, EUCS, Google Gemini, SUS, Usability, User SatisfactionAbstract
This study evaluates user experience and satisfaction of two AI platforms, Chat GPT and Google Gemini, using the System Usability Scale (SUS) and End-User Computing Satisfaction (EUCS) approaches. The study involved 78 respondents from diverse backgrounds who provided evaluations based on five main dimensions of usability (Learnability, Efficiency, Memorability, Error, Pleasantness) and five dimensions of user satisfaction (Content, Accuracy, Format, Ease of Use, Timeliness). The results show that both platforms achieved a "Satisfied" category with an average usability and satisfaction score above 3.75. The lowest scores were recorded in Error and Timeliness variables, while Learnability and Format showed the highest scores. This study also revealed a significant positive correlation between usability and user satisfaction, providing recommendations for improvements in Error and Timeliness areas. These findings offer valuable insights for developing more user-friendly and responsive AI platforms in the future.
Downloads
References
Anggraini, F. D. P., Aprianti, A., Setyawati, V. A. V. & Hartanto, A. A., 2022. Pembelajaran Statistika Menggunakan Software SPSS untuk Uji Validitas dan Reliabilitas. JURNAL BASICEDU , 6(4), pp. 6491 - 6504.
Buana, P. A., Wicaksana, D. A. & Adinugroho, S., 2024. Pengukuran Kegunaan dan Kepuasan Pengguna pada Aplikasi Virtual Tour Reality dalam Meningkatkan Pengalaman Wisata. Jurnal Algoritma, 21(2), pp. 101-111.
Dewiyani, A. I. C. & Fadila, R., 2023. Uji Validitas dan Reliabilitas Kuesioner Pengetahuan Masyarakat Tentang Program JKN. Jurnal Kesehatan Qamarul Huda, 11(1), pp. 307-315.
Fahlefi, I., Amin, S. & Fitriaty, F., 2023. Model Kinerja Melalui Gaya Kepemimpinan Transformasional Dimediasi oleh Kepuasan Kerja dan Motivasi Pegawai pada Badan Keuangan Daerah Kabupaten Batang Hari. JIMT : Jurnal Ilmu Manajemen Terapan, 4(6), pp. 778-789.
Farwati, M., Salsabila, I. T., Navira, K. R. & Sutabri, T., 2023. ANALISA PENGARUH TEKNOLOGI ARTIFICIAL INTELLIGENCE (AI) DALAM KEHIDUPAN SEHARI-HARI. Jursima : Jurnal Sistem Informasi & Manajemen, 11(1), pp. 39-45.
Heryanto, Y., Fauziah, F., Farahdinna, F. & Wijanarko, S., 2024. Evaluasi Responsivitas dan Akurasi: Perbandingan Kinerja ChatGPT dan Google BARD dalam Menjawab Pertanyaan seputar Python. Jurnal Riset Sistem Informasi Dan Teknik Informatika (JURASIK) , 9(1), pp. 248-256.
Nasrul, I., Anggraini, A., Hamzah, M. L. & Saputra, E., 2024. Analysis Of User Experience Of ChatGPT And Gemini Users Using The User Experience Quistionnaire (UEQ) For Education. Jurnal SISFOKOM (Sistem Informasi dan Komputer), 13(3), pp. 352-359.
Rosidin, R. et al., 2024. PERAN KECERDASAN BUATAN DALAM PENGEMBANGAN SISTEM OTOMATISASI PROSES BISNIS. Jurnal Review Pendidikan dan Pengajaran , 7(3), pp. 9320-9329.
Tiara, T. & Pamuji, F. Y., 2024. KOMPARASI USABILITY CHATGPT VS GEMINI AI BERDASARKAN ISO/IEC 9126 DAN NIELSEN MODEL MENGGUNAKAN METODE USABILITY TESTING. Jusim : Jurnal Sistem Informasi Musi Rawas , 9(1), pp. 89-100.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Journal of Information Technology, Computer Engineering and Artificial Intelligence (ITCEA)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
