Assessing 21st Century Skills: Development and Validation of a Multidimensional Tool for College Students
DOI:
https://doi.org/10.48165/IJEE.2026.622RT02Keywords:
Transversal skills, Factor analysis, Holistic development, Item analysis, Skill assessment.Abstract
This study endeavours to develop and validate a multidimensional tool for the assessment of 21st century skills among college-going students during 2024-25 at Banaras Hindu University (BHU), Varanasi. Initially, 120 items were identified through a comprehensive literature review. Experts from the teaching and research domains reviewed these items, and their feedback was incorporated to refine the tool, resulting in 56 items. The refined tool was administered to 350 respondents. The construct validity was established through exploratory factor analysis (EFA) and subsequently confirmed through confirmatory factor analysis (CFA) to ascertain the adequacy of the model fit. EFA revealed that the seven-factor structure accounted for a substantial proportion of the total variance. The CFA of the 54-item 21st-century skills assessment tool identified seven factors with good internal consistency. CFA indicated that items were loaded on the relevant factors and evidenced satisfactory model fit indices. The reliability of the tool was established by the Cronbach’s alpha coefficient, which yielded a value of 0.81. Thus, the tool was indicated to be relevant for college students and served as a valuable metric to assess college students’ 21st century skills.Downloads
References
Adeoye, M. A., Prastikawati, E. F., & Abimbowo, Y. O. (2024). Empowering learning: Pedagogical strategies for advancing quality education. Journal of Nonformal Education, 10(1), 10–21. https://doi.org/10.15294/jone.v10i1.1451
Cevik, M. (2019). Multidimensional scale: Validity and reliability study. Cypriot Journal of Educational Sciences, 14(1), 11–28. https://doi.org/10.18844/cjes.v14i1.3506
Chandra, S., Ghadei, K., Chennamadhava, M., & Ali, W. (2024). Development and validation of a farmer’s focused digital literacy scale. Indian Journal of Extension Education, 60(1), 111–115. https://doi.org/10.48165/IJEE.2024.601RT1
Chen, S., Salleh, S. M., & Salleh, M. A. M. (2025). Media and information literacy among pre-service teachers: A systematic review of key trends and gaps (2013–2024). International Journal of Information Management Data Insights, 5(2), 100348. https://doi.org/10.1016/j.jjimei.2025.100348
Durnali, M. (2022). “Destroying barriers to critical thinking” to surge the effect of self-leadership skills on electronic learning styles. Thinking Skills and Creativity, 46, 101130. https://doi.org/10.1016/j.tsc.2022.101130
Edwards, J. N. (1969). Familial behavior as social exchange. Journal of Marriage and the Family, 31, 518–526. https://doi.org/10.2307/349775
Erdogan, V. (2019). Integrating 4C skills of 21st century into four language skills in EFL classes. International Journal of Education and Research, 7(11), 113–124.
Falloon, G. (2020). From digital literacy to digital competence: The teacher digital competency (TDC) framework. Educational Technology Research and Development, 68(5), 2449–2472. https://doi.org/10.1007/s11423-020-09767-4
Goyal, K., & Kumar, S. (2021). Financial literacy: A systematic review and bibliometric analysis. International Journal of Consumer Studies, 45(1), 80–105. https://doi.org/10.1111/ijcs.70031
Gupta, R., & Vatta, L. (2025). Disruptions in lifestyle due to escalating screen time: A behavioural perspective. Indian Journal of Extension Education, 61(4), 14–18. https://doi.org/10.48165/IJEE.2025.61403
Gupta, S. K., Nain, M. S., Singh, R., & Mishra, J. R. (2022). Development of scale to measure agripreneurs’ attitude towards entrepreneurial climate. Indian Journal of Extension Education, 58(2), 153–157. https://doi.org/10.48165/IJEE.2022.58237
Holec, V., & Marynowski, R. (2020). Does it matter where you teach? Insights from a quasi-experimental study of student engagement in an active learning classroom. Teaching and Learning Inquiry, 8, 140–164. https://doi.org/10.20343/teachlearninqu.8.2.10
Howard, M. C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve? International Journal of Human–Computer Interaction, 32(1), 51–62. https://doi.org/10.1080/10447318.2015.1087664
Huang, P. H., O’Sullivan, A. J., & Shulruf, B. (2023). Development and validation of the student ratings in clinical teaching scale in Australia: A methodological study. Journal of Educational Evaluation for Health Professions, 20. https://doi.org/10.3352/jeehp.2023.20.26
Jones-Jang, S. M., Mortensen, T., & Liu, J. (2021). Does media literacy help identification of fake news? Information literacy helps, but other literacies don’t. American Behavioral Scientist, 65(2), 371–388. https://doi.org/10.1177/0002764219869406
Jünger, S., Payne, S. A., Brine, J., Radbruch, L., & Brearley, S. G. (2017). Guidance on conducting and reporting Delphi studies (CREDES) in palliative care: Recommendations based on a methodological systematic review. Palliative Medicine, 31(8), 684–706. https://doi.org/10.1177/0269216317690685
Kademani, S., Nain, M. S., Singh, R., Roy, S. K., Prabhakar, I., Ranjan, A., Karjigi, D. K., Patil, M., Das, D., & Wasaful, Q. S. K. (2025). Quantifying support for agripreneurs: A multidimensional scale development and analysis of institutional mechanisms. Journal of Global Entrepreneurship Research, 15, 12. https://doi.org/10.1007/s40497-025-00429-4
Karadas, A., Kaynak, S., Ergün, S., & Karaca, P. P. (2021). An examination of 21st century skills of nursing and midwifery students based on various variables. Ordu University Journal of Nursing Studies, 4(2), 232–239. https://doi.org/10.38108/ouhcd.906190
Kaya, E., Karatana, Ö., & Yıldırım, T. Ö. (2023). The relationship between the online learning process, 21st century skills and work readiness in senior nursing students. Nurse Education in Practice, 73, 103801. https://doi.org/10.1016/j.nepr.2023.103801
Kennedy, T. J., & Sundberg, C. W. (2020). 21st century skills. In B. Akpan & T. J. Kennedy (Eds.), Science education in theory and practice: An introductory guide to learning theory (pp. 479–496). Springer. https://doi.org/10.1007/978-3-030-43620-9_32
Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.
Koretz, D. (2017). The testing charade: Pretending to make schools better. University of Chicago Press. https://doi.org/10.2139/ssrn.3331704
Korkmaz, Ö., Cakir, R., & Özden, M. Y. (2017). A validity and reliability study of the computational thinking scales (CTS). Computers in Human Behavior, 72, 558–569. https://doi.org/10.1016/j.chb.2017.01.005
Kumar, R., Slathia, P. S., Peshin, R., & Nain, M. S. (2015). Development of scale to measure attitude of farmers towards rapeseed mustard crop. Journal of Community Mobilization and Sustainable Development, 10(2), 221–224.
Ledesma, R. D., Ferrando, P. J., Trógolo, M. A., Poó, F. M., Tosi, J. D., & Castro, C. (2021). Exploratory factor analysis in transportation research: Current practices and recommendations. Transportation Research Part F: Traffic Psychology and Behaviour, 78, 340–352. https://doi.org/10.1016/j.trf.2021.02.021
Likert, R. (1932). A technique for the measurement of attitude. Archives of Psychology, 22(140), 1–55.
Northouse, P. G. (2021). Leadership: Theory and practice (9th ed.). Sage Publications.
Pepe, R. J., Burns, W. A., Dutton, J. L., Nithikasem, S., Cai, J., & Patel, N. M. (2025). Utilizing the DiSC assessment in surgical residency leadership training to address communication skill acquisition: A Kern six-step approach to curriculum development. Journal of Surgical Education, 82(3), 103413. https://doi.org/10.1016/j.jsurg.2024.103413
Potter, W. J. (2022). Analysis of definitions of media literacy. Journal of Media Literacy Education, 14(2), 27–43. https://doi.org/10.23860/JMLE-2022-14-2-3
Revelle, W., & Condon, D. M. (2019). Reliability from α to ω: A tutorial. Psychological Assessment, 31(12), 1395–1411. https://doi.org/10.1037/pas0000754
Saleem, S., Dhuey, E., White, L., & Perlman, M. (2024). Understanding 21st century skills needed in response to industry 4.0: Exploring scholarly insights using bibliometric analysis. Telematics and Informatics Reports, 13, 100124. https://doi.org/10.1016/j.teler.2024.100124
Saxena, P., Gupta, S. K., Mehrotra, D., Kamthan, S., Sabir, H., Katiyar, P., & Prasad, S. S. (2018). Assessment of digital literacy and use of smartphones among Central Indian dental students. Journal of Oral Biology and Craniofacial Research, 8(1), 40–43. https://doi.org/10.1016/j.jobcr.2017.10.001
Shitu, G. A., Nain, M. S., & Kobba, F. (2018). Development of scale for assessing farmers’ attitude towards precision conservation agricultural practices. Indian Journal of Agricultural Sciences, 88(3), 499–504.
Smith, K. A., Morassaei, S., Ruco, A., Bola, R., Currie, K. L., Cooper, N., & Prospero, L. D. (2022). An evaluation of the impact for healthcare professionals after a leadership innovation fellowship program. Journal of Medical Imaging and Radiation Sciences, 53(4S), S137–S144. https://doi.org/10.1016/j.jmir.2022.09.004
Stewart, C. (2017). What we talk about when we talk about leadership: A review of research on library leadership in the 21st century. Library Leadership & Management, 32(1). https://doi.org/10.5860/llm.v32i1.7218
Tight, M. (2021). Globalization and internationalization as frameworks for higher education research. Research Papers in Education, 36(1), 52–74. https://doi.org/10.1080/02671522.2019.1633560
Tight, M. (2022). Internationalisation of higher education beyond the West: Challenges and opportunities—The research evidence. Educational Research and Evaluation, 27(3–4), 239–259. https://doi.org/10.1080/13803611.2022.2041853
Tuzlukova, V., Al Busaidi, S., Burns, S., & Bugon, G. (2018). Exploring teachers’ perceptions of 21st century skills in teaching and learning in English language classrooms in Oman’s higher education institutions. Journal of Teaching English for Specific and Academic Purposes, 6(1), 191–203. https://doi.org/10.22190/JTESAP1801191T
Van Laar, E., Van Deursen, A. J. A. M., Van Dijk, J. A. G. M., & De Haan, J. (2017). The relation between 21st century skills and digital skills: A systematic literature review. Computers in Human Behavior, 72, 577–588. https://doi.org/10.1016/j.chb.2017.03.010
Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807
Winters, C. A., Moore, C. F., Kuntz, S. W., Weinert, C., Hernandez, T., & Black, B. (2016). Principal components analysis to identify influences on research communication and engagement during an environmental disaster. BMJ Open, 6(8), e012106. https://doi.org/10.1136/bmjopen-2016-012106
Yagci, M. (2019). A valid and reliable tool for examining computational thinking skills. Education and Information Technologies, 24(1), 929–951. https://doi.org/10.1007/s10639-018-9801-8
Yamaguchi, S. N., Oishi, T., Ohnishi, Y., & Nishino, K. (2023). Designing an asynchronous information literacy lecture to change learning styles in ICT utilization. Procedia Computer Science, 225, 1282–1292. https://doi.org/10.1016/j.procs.2023.10.116
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
