Construction of a virtual usability laboratory for conducting user tests during remote attendance
DOI:
https://doi.org/10.24054/rcta.v2i44.2713Keywords:
Usability laboratory, usability tests, user test, usabilityAbstract
One of the educational challenges arising from the COVID-19 pandemic was the adaptation of theoretical-practical or practical courses to virtual formats. In this context, the Human-Computer Interaction (HCI) course in the Systems Engineering Program at the University of Cartagena faced the challenge of developing user testing, involving conducting tests with end-users in a controlled environment or usability laboratory. This article contributes by presenting the design and implementation of a virtual academic usability laboratory for conducting user tests. The proposed laboratory was built and evaluated based on practices undertaken by students in the aforementioned HCI course. This laboratory aims to serve as a reference for conducting usability tests in both academic and business settings.
Downloads
References
S. D. Axinte and I. C. Bacivarov, “Improving the Quality of Web Applications Through Targeted Usability Enhancements,” Apr. 2019. doi: 10.1109/ECAI.2018.8679098. DOI: https://doi.org/10.1109/ECAI.2018.8679098
G. Li, Y. He, Y. Tang, X. Shen, and L. He, “Perceived Usability of Computer-Aided Engineering Software,” in 2023 IEEE 28th Pacific Rim International Symposium on Dependable Computing (PRDC), Oct. 2023, pp. 78–80. doi: 10.1109/PRDC59308.2023.00019. DOI: https://doi.org/10.1109/PRDC59308.2023.00019
M. U. Islam and B. M. Chaudhry, “A Framework to Enhance User Experience of Older Adults With Speech-Based Intelligent Personal Assistants,” IEEE Access, vol. 11, pp. 16683–16699, 2023, doi: 10.1109/ACCESS.2022.3230151. DOI: https://doi.org/10.1109/ACCESS.2022.3230151
Z. Jiao, “Research and Application of Human-Computer Interface Based on User Experience,” in 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), Apr. 2022, pp. 1417–1420. doi: 10.1109/ICSP54964.2022.9778329. DOI: https://doi.org/10.1109/ICSP54964.2022.9778329
G. E. Chanchí-Golondrino, M. C. Gómez-Álvarez, and W. Y. Campo-Muñoz, “Propuesta de una herramienta de inspección según los atributos de usabilidad de Nielsen,” Rev. Ibérica Sist. e Tecnol. Informação, no. E26, pp. 448–460, 2020.
J. Nielsen, “Usability 101: Introduction to Usability,” 2012. [Online]. Available: https://www.nngroup.com/articles/usability-101-introduction-to-usability/
K. Finstad, “The usability metric for user experience,” Interact. Comput., vol. 22, no. 5, pp. 323–327, Sep. 2010, doi: 10.1016/j.intcom.2010.04.004. DOI: https://doi.org/10.1016/j.intcom.2010.04.004
J.-L. González-Sánchez, F. Montero-Simarro, and F.-L. Gutiérrez-Vela, “Evolución del concepto de usabilidad como indicador de la calidad del software,” El Prof. la Inf., vol. 21, no. 5, pp. 529–536, 2012, doi: 10.3145/epi.2012.sep.13. DOI: https://doi.org/10.3145/epi.2012.sep.13
V. F. Martins, M. De Paiva Guimaraes, and A. G. Correa, “Usability test for Augmented Reality applications,” 2013. doi: 10.1109/CLEI.2013.6670668. DOI: https://doi.org/10.1109/CLEI.2013.6670668
S. Nizamani, S. Nizamani, S. Nizamani, N. Basir, K. Khoumbati, and S. Memon, “Usability Evaluation of University Websites in Pakistan through User Testing,” in ICETECC 2022 - International Conference on Emerging Technologies in Electronics, Computing and Communication, Dec. 2022, pp. 1–6. doi: 10.1109/ICETECC56662.2022.10069383. DOI: https://doi.org/10.1109/ICETECC56662.2022.10069383
G. E. Chanchí, M. Barragán Sánchez, and W. Campo Muñoz, “Sistema software para el análisis del estrés mental en test de usuarios,” Campus Virtuales, vol. 7, no. 2, pp. 105–114, 2018, [Online]. Available: https://dialnet.unirioja.es/servlet/articulo?codigo=6681863
F. Henrique Yoshiaki Nakagawa, A. Salvany Felinto, and M. Toshio Omori, “Inclusion of teaching slides in games: Analysis of the efficiency, effectiveness and satisfaction,” IEEE Lat. Am. Trans., vol. 11, no. 6, pp. 1372–1377, Dec. 2013, doi: 10.1109/TLA.2013.6710386. DOI: https://doi.org/10.1109/TLA.2013.6710386
N. Kerzazi and M. Lavallee, “Inquiry on usability of two software process modeling systems using ISO/IEC 9241,” Can. Conf. Electr. Comput. Eng., pp. 000773–000776, 2011, doi: 10.1109/CCECE.2011.6030560. DOI: https://doi.org/10.1109/CCECE.2011.6030560
L. Perurena Cancio and M. Moráguez Bergues, “Usabilidad de los sitios Web, los métodos y las técnicas para la evaluación,” Rev. Cuba. Inf. en Ciencias la Salud, vol. 24, no. 2, 2013, [Online]. Available: http://www.rcics.sld.cu/index.php/acimed/article/viewArticle/405/306
A. Calvo-Fernández, S. Ortega Santamaría, and A. Valls Saez, “Métodos de evaluación con usuarios,” 2011. [Online]. Available: http://openaccess.uoc.edu/webapps/o2/bitstream/10609/9861/4/PID_00176614.pdf
G. Sánchez Morales, C. Mezura-Godoy, and E. Benítez-Guerrero, “Proceso de Pruebas de Usabilidad de Software,” Tecnol. Educ., vol. 5, no. 1, pp. 27–32, 2018, [Online]. Available: https://conaic.net/revista/ingles/publicaciones/Vol_V_Num1_Ene_Abr_2018/Articulo4.pdf DOI: https://doi.org/10.32671/terc.v5i1.84
D. Fathiyyah, M. D. Sulthon Diani, Z. Ayuning Saputri, and Sunardi, “Usability Evaluation on Life Insurance Application Using System Usability Scale and ISO 9241-11,” in 2022 8th International HCI and UX Conference in Indonesia (CHIuXiD), Nov. 2022, pp. 94–99. doi: 10.1109/CHIuXiD57244.2022.10009774. DOI: https://doi.org/10.1109/CHIuXiD57244.2022.10009774
W. Ali, O. Riaz, S. Mumtaz, A. R. Khan, T. Saba, and S. A. Bahaj, “Mobile Application Usability Evaluation: A Study Based on Demography,” IEEE Access, vol. 10, pp. 41512–41524, 2022, doi: 10.1109/ACCESS.2022.3166893. DOI: https://doi.org/10.1109/ACCESS.2022.3166893
D. A. Albornoz, S. A. Moncayo, S. Ruano-Hoyos, G. E. Chanchí, and K. Márceles-Villalba, “Sistema software para la ejecución de pruebas de usabilidad bajo el enfoque de mouse tracking,” TecnoLógicas, vol. 22, pp. 19–31, 2019, doi: 10.22430/22565337.1511. DOI: https://doi.org/10.22430/22565337.1511
G. E. Chanchí and C. E. Hernández-Londoño, “Estrategia basada en TIC para la organización de ferias virtuales de divulgación académica durante la pandemia de COVID-19,” Rev. Espac., vol. 41, no. 42, pp. 66–80, Nov. 2020. DOI: https://doi.org/10.48082/espacios-a20v41n42p06
J. Hoofman and E. Secord, “The Effect of COVID-19 on Education,” Pediatr. Clin. North Am., vol. 68, no. 5, pp. 1071–1079, Oct. 2021, doi: 10.1016/J.PCL.2021.05.009. DOI: https://doi.org/10.1016/j.pcl.2021.05.009
C. H. Liu and H. You-Hsien Lin, “The impact of COVID-19 on medical education: Experiences from one medical university in Taiwan,” J. Formos. Med. Assoc., Mar. 2021, doi: 10.1016/j.jfma.2021.02.016. DOI: https://doi.org/10.1016/j.jfma.2021.02.016
V. S. Sierpina, “The impact of COVID-19 on medical education,” Explore, vol. 16, no. 5, p. 286, Sep. 2020, doi: 10.1016/j.explore.2020.06.009. DOI: https://doi.org/10.1016/j.explore.2020.06.009
M. Almetwazi, N. Alzoman, S. Al-Massarani, and A. Alshamsan, “COVID-19 impact on pharmacy education in Saudi Arabia: Challenges and opportunities,” Saudi Pharm. J., vol. 28, no. 11, pp. 1431–1434, Nov. 2020, doi: 10.1016/J.JSPS.2020.09.008. DOI: https://doi.org/10.1016/j.jsps.2020.09.008
T. Y. Chang et al., “Innovation of dental education during COVID-19 pandemic,” J. Dent. Sci., pp. 1–6, Aug. 2020, doi: 10.1016/j.jds.2020.07.011. DOI: https://doi.org/10.1016/j.jds.2020.07.011
A. Jabbar, C. G. Gauci, and C. A. Anstead, “Parasitology Education Before and After the COVID-19 Pandemic,” Trends in Parasitology, vol. 37, no. 1. Elsevier Ltd, pp. 3–6, Jan. 01, 2021. doi: 10.1016/j.pt.2020.10.009. DOI: https://doi.org/10.1016/j.pt.2020.10.009
A. S. Alves Gomes, J. F. Da Silva, and L. R. De Lima Teixeira, “Educational Robotics in Times of Pandemic: Challenges and Possibilities,” in 2020 Latin American Robotics Symposium, 2020 Brazilian Symposium on Robotics and 2020 Workshop on Robotics in Education, LARS-SBR-WRE 2020, Nov. 2020, pp. 1–5. doi: 10.1109/LARS/SBR/WRE51543.2020.9307145. DOI: https://doi.org/10.1109/LARS/SBR/WRE51543.2020.9307145
M. Y. I. Zia and M. Rashid, “A Novel Laboratory Experimental Platform Using LabVIEW and Multisim Environments,” in 2021 National Computing Colleges Conference (NCCC), May 2021, pp. 1–6. doi: 10.1109/nccc49330.2021.9428796. DOI: https://doi.org/10.1109/NCCC49330.2021.9428796
Z. Chinchilla-Rodríguez, Y. Bu, N. Robinson-García, R. Costas, and C. R. Sugimoto, “Revealing existing and potential partnerships: Affinities and asymmetries in international collaboration and mobility,” in ISSI 2017 - 16th International Conference on Scientometrics and Informetrics, Conference Proceedings, 2017, pp. 869–880. doi: 10.13039/100000001.
S. Kadavath et al., “How the COVID-19 Pandemic Has Affected Cardiology Fellow Training,” Am. J. Cardiol., Apr. 2021, doi: 10.1016/j.amjcard.2021.03.052. DOI: https://doi.org/10.1016/j.amjcard.2021.03.052
L. Bermello Crespo, “Los estudios de usabilidad en sitios web de bibliotecas virtuales,” Ciencias la Inf., vol. 36, no. 2, pp. 31–52, 2005, [Online]. Available: https://www.redalyc.org/pdf/1814/181417874002.pdf
Y. Hassan Montero and F. Martín Fernández, “Método de test con usuarios,” No Solo Usabilidad, no. 2, 2003, [Online]. Available: http://www.nosolousabilidad.com/articulos/test_usuarios.htm
D. M. Delgado, D. F. Girón Timaná, G. E. Chanchí, and K. Márceles Villalba, “Estimación del atributo satisfacción en test de usuarios a partir del análisis de la expresión facial,” Rev. Ing. Univ. Medellín, vol. 19, no. 36, pp. 13–28, Jun. 2019, doi: 10.22395/rium.v19n36a1. DOI: https://doi.org/10.22395/rium.v19n36a1
G. Enriquez and S. Casas, “Usabilidad en aplicaciones móviles,” Inf. Científico Técnico UNPA, vol. 5, no. 2, pp. 25–47, 2013, Accessed: Oct. 20, 2020. [Online]. Available: https://dialnet.unirioja.es/servlet/articulo?codigo=5123524&info=resumen&idioma=SPA DOI: https://doi.org/10.22305/ict-unpa.v5i2.71
E. de Lera and M. Garreta-Domingo, “10 heurísticos emocionales,” Rev. Faz, no. 2, pp. 68–81, 2008, [Online]. Available: http://www.revistafaz.org/articulos_2/06_diezheuristicos_delera_garreta.pdf
J. Nielsen, “Why You Only Need to Test with 5 Users,” 2000. [Online]. Available: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
G. Desolda, R. Lanzilotti, D. Caivano, M. F. Costabile, and P. Buono, “Asynchronous Remote Usability Tests Using Web-Based Tools Versus Laboratory Usability Tests: An Experimental Study,” IEEE Trans. Human-Machine Syst., vol. 53, no. 4, pp. 731–742, Aug. 2023, doi: 10.1109/THMS.2023.3282225. DOI: https://doi.org/10.1109/THMS.2023.3282225
G. E. Chanchí G, L. F. Muñoz S, and W. Y. Campo M, “Proposal of a tool for the stimation of satisfaction in usability test under the approach of thinking aloud,” in Communications in Computer and Information Science, 2018, vol. 944, pp. 211–222. doi: 10.1007/978-3-030-03763-5_18. DOI: https://doi.org/10.1007/978-3-030-03763-5_18
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 COLOMBIAN JOURNAL OF ADVANCED TECHNOLOGIES
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
