Evaluasi Usability Sistem Informasi Akademik Dosen Menggunakan User Experience Questionnaire dan Heuristic Walkthrough

Yuslena Sari; Maulidia  Arafah; Novitasari

doi:10.29207/resti.v5i2.3022

Yuslena Sari Universitas Lambung Mangkurat
Maulidia Arafah Universitas Lambung Mangkurat
Novitasari Universitas Lambung Mangkurat

DOI: https://doi.org/10.29207/resti.v5i2.3022

Keywords: usability evaluation, academic information system, user experience questionnaire, heuristic walkthrough

Abstract

University of Lambung Mangkurat (ULM) has an academic information system that can facilitate access to information and provide quality academic services. One of the ULM academic information system services is the Portal Akademik Dosen ULM. Since its release in 2016, there has been no research regarding the evaluation of the Portal Akademik Dosen ULM. Most of users feel that the interface of the Portal Akademik Dosen ULM needs to be improved to make it more attractive, and needs improvements in several features. In connection with the important function of the Portal Akademik Dosen ULM, an evaluation is needed to assess the success of implementing the information system. This study aims to evaluate the usability of the Portal Akademik Dosen ULM. The methods used are the User Experience Questionnaire (UEQ) and Heuristic Walkthrough. Based on the results of the UEQ questionnaire from 56 respondents, it was found that the aspects of attractiveness, perspicuity, efficiency, dependability, and stimulation got positive values, while the novelty aspect got a neutral value. For the evaluation results with Heuristic Walkthrough method which involved 4 evaluators, found 33 problems at the Cognitive Walkthrough stage, and as many as 21 problems at the Heuristic Evaluation stage with an average severity rating of 13.4. The overall results of the evaluation showed that the Portal Akademik Dosen ULM needs to be improved on novelty items and need to be improved to reduce the number of problems.

Downloads

Download data is not yet available.

References

Universitas Lambung Mangkurat, “Portal Dosen ULM,” 2016. https://simari.ulm.ac.id/ (accessed Feb. 27, 2020).

M. Maulida, H. Khatimi, S. A. Suriazdin, and E. S. Wijaya, “Penerapan Model People At the Center of Mobile Application Development ( PACMAD ) pada Evaluasi Usability Aplikasi Portal Mahasiswa ULM Berbasis Android,” vol. 6, no. 2, pp. 103–110, 2020.

R. M. Baecker, J. Grudin, W. A. S. Buxton, and S. Greenberg, Readings in human-computer interaction: Toward the year 2000 (2nd ed.). 1995.

J. Nielsen, “Usability 101: Introduction to Usability,” 2012. https://www.nngroup.com/articles/usability-101-introduction-to-usability (accessed Mar. 12, 2020).

P. Taylor, C. Stephanidis, D. Akoumianakis, and C. Stephanidls, “International Journal of Human- Preference-Based Human Factors Knowledge Repository for Designing User Interfaces Preference-Based Human Factors Knowledge Repository for Designing User Interfaces,” no. October 2014, pp. 37–41, 2009, doi: 10.1207/s15327590ijhc0903.

R. Pereira et al., “Usability Evaluation of Electronic Health Record,” 2012 IEEE-EMBS Conf. Biomed. Eng. Sci. IECBES 2012, no. December, pp. 359–364, 2012, doi: 10.1109/IECBES.2012.6498049.

M. Schrepp, A. Hinderks, and J. Thomaschewski, “Construction of a Benchmark for the User Experience Questionnaire (UEQ),” Int. J. Interact. Multimed. Artif. Intell., vol. 4, no. 4, p. 40, 2017, doi: 10.9781/ijimai.2017.445.

M. Rauschenberger, M. Schrepp, M. Perez-Cota, S. Olschner, and J. Thomaschewski, “Efficient Measurement of the User Experience of Interactive Products. How to use the User Experience Questionnaire (UEQ).Example: Spanish Language Version,” Int. J. Interact. Multimed. Artif. Intell., vol. 2, no. 1, p. 39, 2013, doi: 10.9781/ijimai.2013.215.

M. Schrepp, User Experience Questionnaire Handbook. 2019.

B. Laugwitz, T. Held, and M. Schrepp, “Construction and Evaluation of a User Experience Questionnaire,” pp. 63–76, 2008, doi: 10.1007/978-3-540-89350-9_6.

A. Woolrych, K. Hornbæk, E. Frøkjær, and G. Cockton, “Ingredients and Meals Rather Than Recipes: A Proposal for Research That Does Not Treat Usability Evaluation Methods as Indivisible Wholes,” Int. J. Hum. Comput. Interact., vol. 27, no. 10, pp. 940–970, 2011, doi: 10.1080/10447318.2011.555314.

J. Nielsen, Usability Engineering. London: Academic Press, 1994.

R. Khajouei, M. Z. Esfahani, and Y. Jahani, “Comparison of Heuristic and Cognitive Walkthrough Usability Evaluation Methods for Evaluating Health Information Systems,” vol. 24, no. August 2016, pp. 55–60, 2017, doi: 10.1093/jamia/ocw100.

C. Schaarup, S. Hangaard, and O. K. Hejlesen, “Cognitive Walkthrough : An Element in System Development and Evaluation – Experiences From The eWALL Telehealth System,” Procedia - Procedia Comput. Sci., vol. 100, pp. 539–546, 2016, doi: 10.1016/j.procs.2016.09.193.

A. Dix, J. Finlay, G. D. Abowd, and R. Beale, Human-Computer Interaction Ch. 9 Evaluation Techniques. 2004.

N. Borovina, D. Boškovis, J. Dizdarevis, K. Bulja, and A. Salihbegovis, “Heuristic Based Evaluation of Mobile Services Web Portal Usability,” pp. 1150–1153, 2014.

T. Hollingsed and D. G. Novick, “Usability Inspection Methods After 15 Years of Research and Practice,” SIGDOC’07 Proc. 25th ACM Int. Conf. Des. Commun., pp. 249–255, 2007, doi: 10.1145/1297144.1297200.

C. Wharton, J. Rieman, C. Lewis, and P. Polson, “The Cognitive Walkthrough Method: A Practitioner’s Guide,” Usability Insp., pp. 105–140, 1994, doi: 10.1108/09685220910944731.

A. Sivaji, A. Abdullah, and A. G. Downe, “Usability Testing Methodology: Effectiveness of Heuristic Evaluation in E-Government Website Development,” 2011, doi: 10.1109/AMS.2011.24.

C. Rusu, S. Roncagliolo, V. Rusu, and C. Collazos, “A methodology to establish usability heuristics,” ACHI 2011 - 4th Int. Conf. Adv. Comput. Interact., no. c, pp. 59–62, 2011.