CHATBOT FOR EDUCATIONAL SERVICES:CONFIRMATION AND ASSESSMENT OF QUALITY DIMENSIONS
Keywords:
Chatbot, Quality Dimensions, User Experience, Educational ServicesAbstract
The increased use of digital devices and integration of information technology has resulted in a rise in the development and implementation of artificial intelligence-based bots. Education sector is no exception and is actively exploiting the capabilities of chatbots for teaching and learning. Delhi University too took a leap forward in this regard by enabling its admission chatbot in the current academic session. Since research in this domain is still in its infancy, the present study was undertaken to provide an understanding of the chatbot quality and effectiveness for academic institutions. Responses obtained from 226 students who had used the admission chatbot were analyzed using the technique of CFA and SEM. The results confirm 13 dimensions of chatbot quality for educational services. Further, the performance of the admission chatbot is found to be above average for all the dimensions, indicating the scope as well as need for improvement in its quality and effectiveness, especially with respect to the dimensions of Personalization, Security, and Information Quality which have been revealed to be exerting a significant impact on the overall experience of the users (i.e., students). The findings thus help in identifying important constituents of chatbot quality and may be used by higher education institutions and Universities to develop and integrate chatbots in teaching and learning activities to yield desired experience for students across different disciplines and courses.
References
Bitner, M., Faranda, W., Hubbert, A & Zeithaml, V. (1997). Customer contributions and roles in service delivery. International Journal of Service Industry Management. 8. 193-205. 10.1108/09564239710185398.
Curran, J. M., & Meuter, M. L. (2005). Self-service technology adoption: Comparing three technologies.
Journal of Services Marketing, 19(2), 103–113. https://doi.org/ 10.1108/08876040510591411
Djelassi, S., Diallo, M.F. & Zielke, S. (2018). How self-service technology experience evaluation affects waiting time and customer satisfaction? A moderated mediation model. Decision Support Systems, 111, 38-47. https://doi.org/10.1016/j.dss.2018.04.004.
Guesmia S.E., Tomiuk, D. & Marcotte, S. (2018). Developing a measure of quality for web-based Chatbots- Preliminary Results. Proceedings of the 2018 (8th) International Conference, Concordia University, Montreal, Canada. 34-51.
Iqbal, M.S., Hassan, M.U. & Habibah, U. (2018). Impact of self-service technology (SST) service quality on customer loyalty and behavioral intention: The mediating role of customer satisfaction. Congent Business & Management, 5, 1. https://doi.org/10.1080/23311975.2018.1423770 6. Li, L., Lee, K. Y., Emokpae, E., & Yang, S. B. (2020). What makes you continuously use chatbot services? Evidence from Chinese online travel agencies. Electronic Markets, 31(3), 575-599. https://doi. org/10.1007/s12525-020-00454-z
Meyer-Waarden, L. Pavone, G. Poocharoentou, T., Prayatsup, P., Ratinaud, M., Tison, A & Torne, S. (2020). How service quality influences customer acceptance and usage of Chatbots? Journal of Service Management Research, 4 (1), 35-51.
Nguyen, X.H., Tran, H.L., Phan, H.A., & Phan, T.D. (2019). Factors influencing customer satisfaction: The case of Facebook Chabot Vietnam. International Journal of Data and Network Science, 4, 167-178. 9. Noor, N., Rao Hill, S., & Troshani, I. (2021). Recasting service quality for AI-based service. Australasian Marketing Journal. doi: 10.1177/18393349211005056
Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1988). SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. Journal of Retailing, 64(1), 12. 11. Parasuraman, A., Zeithaml, V.A., & Malhotra, A. (2005). E-S-QUAL: A multiple-item scale for assessing electronic service quality. Journal of Service Research,7(3), 213-233. doi:10.1177/109467050427115 12. Radziwill, N.M., & Benton, M.C. (2017). Evaluating quality of Chatbots and intelligent conversational agents. ArXiv, abs/1704.04579.
Rust, R.T. and Oliver, R.L. (1994). Service quality: Insights and managerial implications from the frontier. In: Rust, R.T. and Oliver, R.L., Eds., Service Quality: New Directions in Theory and Practice, Sage Publications, Thousand Oaks, 1-19.http://dx.doi.org/10.4135/9781452229102.n1 14. The Economic Times, E-Paper, August 1, 2021. https://economictimes.indiatimes.com/industry/services/ education/delhi-university-to-start-registration-process-for-ug-courses-from monday/articleshow/84946729. cms?utm_source=contentofinterest&utm_medium=text&utm_campaign=cppst 15. Van de Sand, F., Frison, A. K., Zotz, P., Riener, A. & Holl, K. User Experience Is Brand Experience. Springer, 2020, https://EconPapers.repec.org/RePEc:spr:mgmtpr:978-3-030-29868-5. DOI: 10.1007/978- 3-030-29868-5
