Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT)
Abstract
:1. Introduction
2. Materials and Methods
2.1. Scale Development
Item Generation Process
2.2. Pilot Study
2.2.1. Evaluating the Content Validity
2.2.2. Construct Validity and Reliability
2.3. Sample
2.4. Ethical Considerations
2.5. Data Collection
2.6. Data Analysis
3. Results
4. Discussion
Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Brooks, C.D.; McCormack, M. Driving Digital Transformation in Higher Education; ECAR Research Report; ECAR: Louisville, CO, USA, 2020. [Google Scholar]
- Fernández, A.; Gómez, B.; Binjaku, K.; Meçe, E.K. Digital Transformation Initiatives in Higher Education Institutions: A Multivocal Literature Review. Educ. Inf. Technol. 2023, 28, 12351–12382. [Google Scholar] [CrossRef] [PubMed]
- Digital Education Action Plan (2021–2027). European Education Area. Available online: https://education.ec.europa.eu/node/1518 (accessed on 25 November 2022).
- Redecker, C.; Punie, Y. European Framework for the Digital Competence of Educators: DigCompEdu; Publications Office of the European Union: Luxembourg, 2017; ISBN 978-92-79-73494-6. [Google Scholar]
- Ličen, S.; Cassar, M.; Filomeno, L.; Yeratziotis, A.; Prosen, M. Development and Validation of an Evaluation Toolkit to Appraise eLearning Courses in Higher Education: A Pilot Study. Sustainability 2023, 15, 6361. [Google Scholar] [CrossRef]
- Nagy, J.T.; Dringó-Horváth, I. Factors Influencing University Teachers’ Technological Integration. Educ. Sci. 2024, 14, 55. [Google Scholar] [CrossRef]
- Røe, Y.; Wojniusz, S.; Bjerke, A.H. The Digital Transformation of Higher Education Teaching: Four Pedagogical Prescriptions to Move Active Learning Pedagogy Forward. Front. Educ. 2022, 6, 784701. [Google Scholar] [CrossRef]
- Vieira, R.M.; Tenreiro-Vieira, C.C.; Bem-Haja, P.; Lucas, M. STEM Teachers’ Digital Competence: Different Subjects, Different Proficiencies. Educ. Sci. 2023, 13, 1133. [Google Scholar] [CrossRef]
- Howard, S.K.; Tondeur, J. Higher Education Teachers’ Digital Competencies for a Blended Future. Educ. Technol. Res. Dev. 2023, 71, 1–6. [Google Scholar] [CrossRef]
- Moreira-Choez, J.S.; Gómez Barzola, K.E.; Lamus de Rodríguez, T.M.; Sabando-García, A.R.; Cruz Mendoza, J.C.; Cedeño Barcia, L.A. Assessment of Digital Competencies in Higher Education Faculty: A Multimodal Approach within the Framework of Artificial Intelligence. Front. Educ. 2024, 9, 1425487. [Google Scholar] [CrossRef]
- Cascarosa Salillas, E.; Sánchez-Azqueta, C.; Gimeno, C.; Aldea, C. A Teaching-Learning Sequence to Develop Epistemic Thinking in Engineering Students at Master’s Educational Level. J. Appl. Res. High. Educ. 2024; ahead-of-print. [Google Scholar] [CrossRef]
- Naya-Forcano, A.; Garcia-Bosque, M.; Cascarosa, E.; Aznar, F.; Sánchez-Azqueta, C.; Celma, S.; Aldea, C. ChatPLT: An Intelligent Tutoring System for Teaching Physics in Higher Education. In Proceedings of the 10th International Conference on Higher Education Advances (HEAd’24), Valencia, Spain, 18–21 June 2024. [Google Scholar]
- Koukourikos, K.; Tsaloglidou, A.; Kourkouta, L.; Papathanasiou, I.V.; Iliadis, C.; Fratzana, A.; Panagiotou, A. Simulation in Clinical Nursing Education. Acta Inform. Medica 2021, 29, 15–20. [Google Scholar] [CrossRef]
- Lucena-Anton, D.; Fernandez-Lopez, J.C.; Pacheco-Serrano, A.I.; Garcia-Munoz, C.; Moral-Munoz, J.A. Virtual and Augmented Reality versus Traditional Methods for Teaching Physiotherapy: A Systematic Review. Eur. J. Investig. Health Psychol. Educ. 2022, 12, 1780–1792. [Google Scholar] [CrossRef]
- Abdulrahaman, M.D.; Faruk, N.; Oloyede, A.A.; Surajudeen-Bakinde, N.T.; Olawoyin, L.A.; Mejabi, O.V.; Imam-Fulani, Y.O.; Fahm, A.O.; Azeez, A.L. Multimedia Tools in the Teaching and Learning Processes: A Systematic Review. Heliyon 2020, 6, e05312. [Google Scholar] [CrossRef] [PubMed]
- Okoye, K.; Hussein, H.; Arrona-Palacios, A.; Quintero, H.N.; Ortega, L.O.P.; Sanchez, A.L.; Ortiz, E.A.; Escamilla, J.; Hosseini, S. Impact of Digital Technologies upon Teaching and Learning in Higher Education in Latin America: An Outlook on the Reach, Barriers, and Bottlenecks. Educ. Inf. Technol. 2023, 28, 2291–2360. [Google Scholar] [CrossRef] [PubMed]
- Kioupi, V.; Voulvoulis, N. Education for Sustainable Development: A Systemic Framework for Connecting the SDGs to Educational Outcomes. Sustainability 2019, 11, 6104. [Google Scholar] [CrossRef]
- United Nations. THE 17 GOALS. Sustainable Development. Available online: https://sdgs.un.org/goals (accessed on 12 August 2024).
- Tondeur, J.; Howard, S.; Van Zanten, M.; Gorissen, P.; Van der Neut, I.; Uerz, D.; Kral, M. The HeDiCom Framework: Higher Education Teachers’ Digital Competencies for the Future. Educ. Technol. Res. Dev. 2023, 71, 33–53. [Google Scholar] [CrossRef]
- Basantes-Andrade, A.; Casillas-Martín, S.; Cabezas-González, M.; Naranjo-Toro, M.; Guerra-Reyes, F. Standards of Teacher Digital Competence in Higher Education: A Systematic Literature Review. Sustainability 2022, 14, 13983. [Google Scholar] [CrossRef]
- Saltos-Rivas, R.; Novoa-Hernández, P.; Rodríguez, R.S. Understanding University Teachers’ Digital Competencies: A Systematic Mapping Study. Educ. Inf. Technol. 2023, 28, 16771–16822. [Google Scholar] [CrossRef]
- Castaño Muñoz, J.; Vuorikari, R.; Costa, P.; Hippe, R.; Kampylis, P. Teacher Collaboration and Students’ Digital Competence—Evidence from the SELFIE Tool. Eur. J. Teach. Educ. 2023, 46, 476–497. [Google Scholar] [CrossRef]
- Mhlongo, S.; Mbatha, K.; Ramatsetse, B.; Dlamini, R. Challenges, Opportunities, and Prospects of Adopting and Using Smart Digital Technologies in Learning Environments: An Iterative Review. Heliyon 2023, 9, e16348. [Google Scholar] [CrossRef]
- Wei, Z. Navigating Digital Learning Landscapes: Unveiling the Interplay Between Learning Behaviors, Digital Literacy, and Educational Outcomes. J. Knowl. Econ. 2023. [Google Scholar] [CrossRef]
- Alenezi, M. Digital Learning and Digital Institution in Higher Education. Educ. Sci. 2023, 13, 88. [Google Scholar] [CrossRef]
- Zhao, Y.; Pinto Llorente, A.M.; Sánchez Gómez, M.C. Digital Competence in Higher Education Research: A Systematic Literature Review. Comput. Educ. 2021, 168, 104212. [Google Scholar] [CrossRef] [PubMed]
- Basilotta-Gómez-Pablos, V.; Matarranz, M.; Casado-Aranda, L.-A.; Otto, A. Teachers’ Digital Competencies in Higher Education: A Systematic Literature Review. Int. J. Educ. Technol. High. Educ. 2022, 19, 8. [Google Scholar] [CrossRef]
- Phillips, R.; McNaught, C.; Kennedy, G. Evaluating e-Learning: Guiding Research and Practice; Routledge: New York, NY, USA, 2011; ISBN 978-0-203-81336-2. [Google Scholar]
- McGuinness, C.; Fulton, C. Digital Literacy in Higher Education: A Case Study of Student Engagement with E-Tutorials Using Blended Learning. J. Inf. Technol. Educ. Innov. Pract. 2019, 18, 1–28. [Google Scholar] [CrossRef] [PubMed]
- Surry, D.W.; Gray, R.M., Jr.; Stefurak, J.R. Technology Integration in Higher Education: Social and Organizational Aspects; IGI Global: Hershey, PA USA, 2011; ISBN 978-1-60960-147-8. [Google Scholar]
- Polit, D.F.; Beck, C.T. The Content Validity Index: Are You Sure You Know What’s Being Reported? Critique and Recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef]
- Field, A.P. Discovering Statistics Using IBM SPSS Statistics; SAGE Publications: London, UK; Thousand Oaks, CA, USA, 2018; ISBN 978-1-5264-1951-4. [Google Scholar]
- Hussain, S.; Fangwei, Z.; Siddiqi, A.F.; Ali, Z.; Shabbir, M.S. Structural Equation Model for Evaluating Factors Affecting Quality of Social Infrastructure Projects. Sustainability 2018, 10, 1415. [Google Scholar] [CrossRef]
- Marín, V.I.; Castañeda, L. Developing Digital Literacy for Teaching and Learning. In Handbook of Open, Distance and Digital Education; Zawacki-Richter, O., Jung, I., Eds.; Springer Nature: Singapore, 2022; pp. 1–20. ISBN 978-981-19035-1-9. [Google Scholar]
- Gutiérrez-Ángel, N.; Sánchez-García, J.-N.; Mercader-Rubio, I.; García-Martín, J.; Brito-Costa, S. Digital Literacy in the University Setting: A Literature Review of Empirical Studies between 2010 and 2021. Front. Psychol. 2022, 13, 896800. [Google Scholar] [CrossRef]
- Audrin, C.; Audrin, B. Key Factors in Digital Literacy in Learning and Education: A Systematic Literature Review Using Text Mining. Educ. Inf. Technol. 2022, 27, 7395–7419. [Google Scholar] [CrossRef]
- Timotheou, S.; Miliou, O.; Dimitriadis, Y.; Sobrino, S.V.; Giannoutsou, N.; Cachia, R.; Monés, A.M.; Ioannou, A. Impacts of Digital Technologies on Education and Factors Influencing Schools’ Digital Capacity and Transformation: A Literature Review. Educ. Inf. Technol. 2023, 28, 6695–6726. [Google Scholar] [CrossRef]
- Yoon, S.H. Gender and Digital Competence: Analysis of Pre-Service Teachers’ Educational Needs and Its Implications. Int. J. Educ. Res. 2022, 114, 101989. [Google Scholar] [CrossRef]
Competence Area | Description |
---|---|
Technological knowledge | Items focused on educators’ skills in using a variety of digital tools and platforms. |
Pedagogical use of digital tools | These items assessed how teachers integrate technology into their teaching practise to improve learning outcomes. |
Interactivity and collaboration in online environments | This category assessed the use of digital platforms to promote student interaction and collaboration. |
Assessment and feedback via digital platforms | These items examined how teachers use digital tools to assess students and provide timely feedback. |
Continuous professional development in digital technologies | These items addressed the importance of ongoing professional development for teachers to stay current with new digital tools and approaches. |
Strategies to ensure digital accessibility and inclusion | These items assessed teachers’ awareness and use of digital tools to ensure that all students, regardless of ability, have access to learning. |
Frequent use of digital communication platforms | These items measured how teachers interact with students via digital communication platforms. |
Integration of digital tools | These items assessed how teachers integrate digital tools into lectures and seminars. |
Use of analytics tools | These items assessed how teachers use analytics tools to track student progress. |
Digital ethics, data protection, equality, and accessibility | These items ensured that teachers comply with ethical principles in digital education. |
Participation in professional development | These items related to ongoing training in new technologies and digital pedagogical approaches. |
Development of digital learning modules, e-books, and multimedia elements | These items were used to measure teachers’ ability to create digital content and promote independent learning. |
Characteristic | n | % |
---|---|---|
Gender: | ||
Male | 174 | 42.3 |
Female | 237 | 57.7 |
Academic ranks: | ||
Lecturer | 75 | 18.2 |
Senior Lecturer | 51 | 12.4 |
Assistant | 173 | 42.1 |
Associate Professor | 70 | 17.0 |
Full Professor | 42 | 10.2 |
Fields of teaching: | ||
Social sciences | 69 | 16.8 |
Humanities | 12 | 2.9 |
Natural sciences | 75 | 18.2 |
Technical and technological sciences | 27 | 6.6 |
Medical sciences | 49 | 11.9 |
Biotechnical sciences | 27 | 6.6 |
Arts | 15 | 3.6 |
Sports sciences | 48 | 11.7 |
Interdisciplinary subjects | 12 | 2.9 |
Health sciences | 77 | 18.7 |
Items | Factor Loadings | z-Value | p | I-CVI (R, C) | |
---|---|---|---|---|---|
Factor 1 | I know how to use analytics tools to monitor student progress. | 0.914 | 106.532 | <0.001 | 1.00 |
I use digital tools to better adapt the teaching process to the different learning styles and needs of students. | 0.897 | 100.727 | <0.001 | 0.94 | |
I can adapt my teaching to the students’ technological abilities. | 0.894 | 83.404 | <0.001 | 0.91 | |
I regularly use multimedia elements such as animations and simulations to better understand complex concepts. | 0.888 | 79.275 | <0.001 | 0.91 | |
I actively encourage students to use digital tools for independent learning and research. | 0.866 | 77.525 | <0.001 | 0.87 | |
I develop and use digital learning modules and e-books to supplement traditional teaching materials. | 0.863 | 105.357 | <0.001 | 1.00 | |
I encourage students to develop their digital skills. | 0.862 | 90.308 | <0.001 | 0.98 | |
I regularly act as a mentor or counsellor for colleagues who want to improve their digital skills. | 0.861 | 77.801 | <0.001 | 1.00 | |
I regularly participate in webinars and workshops to improve my digital skills. | 0.845 | 85.542 | <0.001 | 1.00 | |
I am aware of the importance of digital privacy and uphold it consistently for my students (protecting personal data and information shared or created in a digital environment). | 0.827 | 88.956 | <0.001 | 0.91 | |
I consistently adhere to the principles of digital ethics and ensure safety in e-teaching. | 0.820 | 64.649 | <0.001 | 1.00 | |
I participate in research to improve digital pedagogical practises. | 0.817 | 97.672 | <0.001 | 1.00 | |
I regularly educate myself about new digital technologies and approaches. | 0.816 | 91.989 | <0.001 | 1.00 | |
I incorporate digital simulations into lessons where appropriate. | 0.800 | 92.288 | <0.001 | 1.00 | |
I frequently use digital communication platforms to interact with students (e.g., Zoom, Microsoft Teams, Moodle, email, etc.). | 0.758 | 74.126 | <0.001 | 0.98 | |
Collaborative digital platforms such as Moodle are a key element of my teaching process. | 0.747 | 83.632 | <0.001 | 0.88 | |
I understand the importance of digital equality and accessibility in education (ensuring equal opportunities for access to digital tools and educational content). | 0.691 | 58.111 | <0.001 | 0.78 | |
Factor 2 | I use advanced digital platforms to monitor and support the progress of individual students. | 0.930 | 100.727 | <0.001 | 1.00 |
I regularly evaluate and adapt my methods to ensure digital accessibility and inclusion for all students. | 0.927 | 97.324 | <0.001 | 1.00 | |
I use virtual collaboration tools such as online whiteboards (e.g., Padlet) for group projects and assignments. | 0.886 | 84.357 | <0.001 | 1.00 | |
I use digital tools for student assessment and feedback. | 0.865 | 95.68 | <0.001 | 1.00 | |
I effectively integrate online and physical learning environments for hybrid teaching. | 0.816 | 77.069 | <0.001 | 0.98 | |
I regularly use online tools for surveys and feedback collection to evaluate the effectiveness of my lectures and continuously improve them. | 0.808 | 84.357 | <0.001 | 0.98 | |
Factor 3 | I use various digital media in the classroom, e.g., videos, infographics, and quizzes. | 0.820 | 95.68 | <0.001 | 1.00 |
I encourage students to participate in digital discussions and forums. | 0.810 | 97.221 | <0.001 | 1.00 | |
I use various digital tools in my lessons without any problems. | 0.808 | 83.632 | <0.001 | 1.00 | |
I integrate various digital tools into lectures or seminars to complement traditional teaching methods. | 0.796 | 65.726 | <0.001 | 1.00 | |
My e-lectures are interactive and encourage student participation. | 0.793 | 64.96 | <0.001 | 0.98 | |
I regularly incorporate digital tools into my lectures and seminars. | 0.745 | 83.404 | <0.001 | 0.98 | |
Factor 4 | I encourage and support the use of digital portfolios to document students’ academic work (including in Moodle). | 0.842 | 83.632 | <0.001 | 1.00 |
I encourage students to use online information critically. | 0.798 | 81.401 | <0.001 | 1.00 | |
I recognise the importance of continuous professional development in digital skills and careful preparation of e-learning content that enables me to effectively adapt and deliver pedagogical processes in a digital environment. | 0.752 | 83.632 | <0.001 | 0.88 | |
I promote the use of social media for educational purposes. | 0.686 | 77.069 | <0.001 | 0.88 | |
I support the use of open educational resources (e.g., open textbooks, open-source educational platforms, free educational videos, and open scientific articles). | 0.642 | 83.632 | <0.001 | 0.88 | |
I actively participate in online communities and forums related to my teaching field. | 0.595 | 26.503 | <0.001 | 0.78 |
Factors | Estimate | Std. Error | z-Value | p | 95% Confidence Interval | |
---|---|---|---|---|---|---|
Lower | Upper | |||||
Digital literacy ↔ Digital skills | 0.950 | 0.008 | 117.169 | <0.001 | 0.934 | 0.966 |
Digital literacy ↔ Digital interaction | 0.946 | 0.011 | 85.052 | <0.001 | 0.924 | 0.968 |
Digital literacy ↔ Technology integration | 0.620 | 0.018 | 34.699 | <0.001 | 0.585 | 0.655 |
Digital skills ↔ Digital interaction | 0.901 | 0.015 | 60.156 | <0.001 | 0.871 | 0.930 |
Digital skills ↔ Technology integration | 0.688 | 0.025 | 27.031 | <0.001 | 0.638 | 0.738 |
Digital interaction ↔ Technology integration | 0.714 | 0.027 | 26.898 | <0.001 | 0.662 | 0.766 |
Factors/Subscales | n | Mdn | SD | Cronbach α | 95% Confidence Interval | p | |
---|---|---|---|---|---|---|---|
Lower | Upper | ||||||
Digital literacy | 17 | 3.35 | 0.952 | 0.966 | 3.01 | 3.33 | <0.001 |
Digital skills | 6 | 2.58 | 1.057 | 0.929 | 2.46 | 2.81 | <0.001 |
Digital interaction | 6 | 3.42 | 0.765 | 0.879 | 3.33 | 3.59 | <0.001 |
Technology integration | 6 | 3.67 | 0.627 | 0.791 | 3.44 | 3.65 | <0.001 |
Digital Competence Scale for University Teachers (DCS-UT) | 35 | 3.27 | 0.801 | 0.974 | 3.06 | 3.33 | <0.001 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ličen, S.; Prosen, M. Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT). Sustainability 2024, 16, 9937. https://doi.org/10.3390/su16229937
Ličen S, Prosen M. Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT). Sustainability. 2024; 16(22):9937. https://doi.org/10.3390/su16229937
Chicago/Turabian StyleLičen, Sabina, and Mirko Prosen. 2024. "Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT)" Sustainability 16, no. 22: 9937. https://doi.org/10.3390/su16229937