Usability testing of intensive course mobile application using the usability scale system


Manda Rohandi(1*); Nurlaila Husain(2); Indri Wirahmi Bay(3);

(1) Universitas Negeri Gorontalo
(2) Universitas Negeri Gorontalo
(3) Universitas Negeri Gorontalo
(*) Corresponding Author

  

Abstract


The mobile intensive course (MIC) application version 2 is an application created to assist the learning process of the English intensive course. Measurement of the usability of the MIC version 2 application has never been done before, so the effectiveness, efficiency, and user satisfaction for this application have not been measured. In addition, usability measurement can be used as a reference for the level of user loyalty, whether including net promoters, passive users, or detractors. One of the usability measuring tools that are easy to use, the calculation is simple and can be used on a small sample, but still valid and reliable is the System Usability Scale (SUS). The purpose of this study was to test the usability of the MIC version 2 application to determine the quality of this application using the SUS questionnaire. This research was conducted in four steps, namely 1) piloting the MIC version 2 application to the respondents; 2) distributing SUS questionnaires to respondents to be filled out manually or online; 3) calculating the average SUS score; 4) analyzing the mean SUS score. This study involved 37 respondents consisting of students and lecturers of EIC. The results of this study indicate that the usability of the MIC version 2 application can be accepted by users with an average SUS score of 70.61 and get category C based on the CGS assessment. When viewed from the level of user loyalty, the average SUS score for this application only results in passive users. The average value of the contribution to learnability obtained is still low, which is 1.9 from the maximum value of 4. Improvements are needed in future applications in terms of application learnability, such as simplifying the appearance of features and functions in the application, thus allowing users to be more familiar with applications and potential as net promoters.

Keywords


Usability; System Usability Scale; MIC; EIC

  
  

Full Text:

PDF
  

Article Metrics

Abstract view: 846 times
PDF view: 295 times 		     

Digital Object Identifier

doi  https://doi.org/10.33096/ilkom.v13i3.821.252-258 		  

Cite

How to cite item

References


M. Rohandi, N. Husain and I. W. Bay, "Development of Web-Based Computer-Assisted Language Learning in English Intensive Course," in Annual Applied Science and Engineering Conference (AASEC), Bandung, 2017.

M. Rohandi, N. Husain and I. W. Bay, "Mobile-Assisted Language Learning Application for English Intensive Course," in International Conference on Technology and Vocational Teachers (ICTVT), Yogyakarta, 2017.

M. Rohandi, N. Husain and I. W. Bay, "Pengembangan Mobile-Assisted Language Learning Menggunakan User Centered Design," Jurnal Nasional Teknik Elektro dan Teknologi Informasi, vol. 7, no. 1, pp. 27-33, Februari 2018.

N. R. Usu, Z. Tanipu, R. Kadir, Y. Bantulu, F. Mohammad, M. S. Ibrahim, N. Husain, I. W. Bay, M. E. W. Kau, S. W. Ali, H. Badu, F. Malabar and J. Saud, Intensive Course of English: Students Book 1, 1 ed., Gorontalo: UNG Press, 2019.

N. R. Usu, Z. Tanipu, R. Kadir, Y. Bantulu, F. Mohammad, M. S. Ibrahim, N. Husain, I. W. Bay, M. E. W. Kau, S. W. Ali, H. Badu, F. Malabar and J. Saud, Intensive Course of English: Students Book 2, 2 ed., Gorontalo: UNG Press, 2019.

Y. Rogers, Sharp and J. Preece, Interaction Design: Beyond Human-Computer Interaction, 3 ed., New York: John Wiley and Son, Ltd, 2002.

9.-1. ISO, "Ergonomic Requirements for Office Work With Visual Display Terminals (VDTs), Part II Guidance of Usability," 1998.

A. Kaya, R. Azturk and C. A. Gummussoy, "Usability Measurement of Mobile Application with System Usability Scale (SUS)," in Industrial Engineering in The Big data Era, Cham, 2019.

I. Aprilia H. N., P. I. Santoso and R. Ferdiana, "Pengujian Usability Website Menggunakan System Usability Scale," Jurnal Ilmu Pengetahuan dan Teknologi Komunikasi (IPTEK-KOM), vol. 17, no. 1, pp. 31-38, Juni 2015.

H. Anam, M. Sadiq and H. Jamil, "Development of System Usability Scale for the Urdu Language," International Journal of Computer Science and Information Security (IJCSIS), vol. 18, no. 6, pp. 73-78, 2020.

Usability.gov, "Usability Evaluation Basics," 2020. [Online]. Available: http://usability.gov/what-and-why/usability-evaluation.html. [Accessed 20 Agustus 2020].

Z. Sharfina and H. B. Santoso, "An Indonesian Adaptation of the System Usability Scale (SUS)," in ICACSIS, 2016.

A. Garcia, "UX Research: Standardized Usability Questionnaire," 2013. [Online]. Available: http://chaione.com/ux-reseach-standardizing-usability-questionnaire/. [Accessed 15 6 2020].

Drew, R. Mandy, B. Falcone and W. L. Baccus, "What Does The System Usability Scale (SUS) Measure?," in International Conference in Learning of Design, User Experience, and Usability, Cham, 2018.

J. Xiong, "SUSapp: A Free Mobile Application That Makes the System Usability Scale (SUS) Easier to Administer," Journal of Usability Studies, vol. 15, no. 3, pp. 135-144, 2020.

J. Sauro, "Measuring Usability with The System Usability," 2011. [Online]. Available: https://measuringu.com/sus/. [Accessed 15 June 2020].

J. Brooke, "SUS: A Retrospective," Journal of Usability Stiudies, vol. 8, no. 2, pp. 29-40, 2013.

O. Konstantina, T. Nikolaos and K. Kristos, "Perceived Usability Evaluation of Learning Management Systems: Empirical Evaluation of The System Usability Scale," The International Review of Research in Open and Distributed Learning, vol. 16, no. 2, pp. 227-246, 2015.

P. Kortum and Sober, "Measuring the Usability of Mobile Application for Phones and Tablets," International Journal of Human-Computer Interaction, vol. 31, no. 8, pp. 518-529, 2015.

F. Nayebi, J. M. Desharnais and A. Abran, "The State of the Art of Mobile Application Usability Evaluation," in 25Th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), 2012.

Y. Wang, T. Lei and X. Liu, "Chinese System Usability Scale: Translation, Revision, Psychological Measurement ,," International Journal of Human-Computer Interaction, 2019.

S. McLellan, A. Muddimer and S. C. Peres, "The Effect Experience On System Usability Scale Ratings Vol. 7, No. 2, Februari 2012, Hal. 56-67," Journal of Usability Studies, vol. 7, no. 2, pp. 56-67, February 2012.

J. R. Lewis, "The System Usability Scale: Past, Present, and the Future," International Journal of Human-Computer Interaction, 2018.

J. Sauro and J. R. Lewis, Quantifying the User Experience: Practical Statistics for User Research, 1 ed., Cambridge: Morgan Kaufmann, 2012.

J. Sauro and J. R. Lewis, Quantifying the User Experience: Practical Statistics for User Research, 2 ed., Waltham: Morgan Kaufmann, 2016.

A. Bangor, P. Kortum and J. Miller, "Determining What Individual SUS Score Mean: Adding and Adjective Rating Scale," Journal of Usability Studies, vol. 4, no. 3, pp. 114-123, 2009.

J. Sauro, "Does Better Usability Increase Customer Loyalty?," 9 September 2010. [Online]. Available: https://measuringu.com/usability-loyalty/. [Accessed 2020].


Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Manda Rohandi, Nurlaila Husain, Indri Wirahmi Bay

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.