Next Article in Journal
How Urban Street Spatial Composition Affects Land Surface Temperature in Areas with Different Population Densities: A Case Study of Zhengzhou, China
Previous Article in Journal
Sustainable Use of By-Products (Okara and Linseed Cake) in Tempeh Fermentation: Effects on Isoflavones and Lignans
Previous Article in Special Issue
ChatGPT-Supported Education in Primary Schools: The Potential of ChatGPT for Sustainable Practices
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT)

Department of Nursing, Faculty of Health Sciences, University of Primorska, Polje 42, 6310 Izola, Slovenia
*
Author to whom correspondence should be addressed.
Submission received: 12 August 2024 / Revised: 19 October 2024 / Accepted: 13 November 2024 / Published: 14 November 2024

Abstract

:
The integration of digital competences into higher education is essential for the promotion of effective and sustainable teaching and learning environments. The aim of this study was to develop and validate the Digital Competence Scale for University Teachers (DCS-UT), an instrument to assess key digital competences of teachers. The development of the scale involved the creation of items based on an extensive literature review, followed by rigorous testing for content and face validity. The psychometric properties of the scale were assessed using data from 411 university teachers, with confirmatory factor analysis (CFA) and structural equation modelling (SEM) to examine the underlying structure of the scale. Reliability was assessed using Cronbach’s alpha, which confirmed the internal consistency of the instrument (0.974). The analysis revealed a robust four-factor structure: digital literacy, digital skills, digital interaction, and technology integration, which together explained 70.284% of the variance. These findings underscore the value of the DCS-UT as a tool to promote sustainable teaching practises by assessing digital competences. By equipping teachers with essential digital competences, the scale supports the long-term adaptability and effectiveness of higher education institutions in an increasingly digital field.

1. Introduction

The integration of digital technologies into higher education has revolutionised pedagogical practises and prompted institutions to adapt their approaches. This shift is particularly significant given the global move towards online and blended learning models, which emphasise the urgent need to equip teachers with robust digital competences. The COVID-19 pandemic has accelerated this shift and emphasised the need for teachers to master information and communication technology (ICT) [1,2]. This shift has redefined educational provision and increased expectations on teachers to navigate a rapidly evolving digital landscape while maintaining high standards of teaching and promoting meaningful student engagement.
Digital competences, broadly defined as the ability to use ICT effectively and efficiently in a professional context, are fundamental to creating engaging, adaptable, and sustainable learning environments [3,4,5]. However, the adoption of digital technologies in higher education is influenced by various factors that affect teachers’ motivations and intentions. Educators who see digital tools as beneficial for improving their teaching are more likely to adopt these technologies because they are easy to use, promote student engagement, and provide opportunities for innovation. Institutional support, such as professional development and access to resources, further encourages the integration of digital technologies into teaching [6,7]. Although digital competences are often treated as a unified concept, their application varies considerably depending on the subject area. For example, teachers in technical and engineering disciplines may need advanced skills in programming, specialised software, and data analysis, while in the humanities and social sciences, they may focus on digital collaboration platforms, multimedia integration, and critical information literacy [8,9,10]. Research shows that subject-specific needs influence how teachers adopt and integrate digital technologies into their pedagogical practises. In subjects such as engineering and physics, educators often utilise advanced technologies such as AI-based systems and structured teaching–learning sequences to improve problem solving and adaptive learning [11,12]. In the medical and health sciences, digital tools such as simulated patient interactions and telemedicine platforms have become indispensable for teaching diagnostic skills and promoting telemedicine practises [13]. In biotechnology and sports science, digital tools such as virtual reality and augmented reality are used to improve the teaching of practical skills, e.g., in physiotherapy and rehabilitation. These immersive technologies provide realistic simulations and help students to improve their motor skills and learn interactively [14]. In the arts, for example, digital competences revolve around multimedia tools that promote creativity, collaboration, and digital expression. Multimedia platforms are often used in teaching to encourage student engagement with traditional and digital art forms [15].
However, there are several barriers that can make this transition more difficult. Teachers may resist digital technologies because they lack confidence in their abilities, because they fear an increased workload, or because they favour traditional methods. This resistance is often the result of comfort with established practises and the technostress associated with constantly adapting to new tools. The perceived irrelevance of digital tools for certain topics can make experimenting with these technologies even more difficult [7,16]. Understanding these motivators and barriers is crucial for higher education institutions seeking to support their staff in digital transformation. Addressing the specific needs and concerns of educators allows institutions to create an environment that not only facilitates the adoption of digital technologies, but also improves the quality of education overall. Customised professional development and fostering a culture that values innovation are important strategies to help teachers successfully navigate this transition [7].
Promoting the development of digital competences is critical not only for the professional development of teachers, but also for the overall resilience and adaptability of higher education institutions. These competences are crucial for promoting sustainable teaching practises that create adaptive, inclusive learning environments that meet the diverse needs of today’s students [17]. In addition, digital competences are increasingly recognised as key to achieving several United Nations Sustainable Development Goals (SDGs), in particular SDG 4 (Quality Education), SDG 5 (Gender Equality), SDG 9 (Industry, Innovation and Infrastructure), and SDG 10 (Reduced Inequalities) [18].
Several established frameworks offer structured approaches to improve teachers’ digital competences and promote pedagogical innovation. The DigCompEdu framework, for example, was developed specifically to support educators in digital transformation. It identifies six key competency areas, including professional engagement, digital resources, teaching and learning strategies, assessment, learner empowerment, and digital literacy promotion [9,19,20]. Similarly, the UNESCO ICT Competency Framework for Teachers (ICT-CFT) emphasises the role of technology in education, focusing on the intersection of ICT skills and pedagogy. It provides a global standard that aligns digital skills with pedagogical goals and enables educators to use technology to improve student learning outcomes [20].
Despite the increasing importance of digital transformation, many higher education institutions, especially in regions with deep-rooted traditional teaching models, face major challenges in adapting to these changes. In areas with limited access to digital resources and professional development, disparities in faculty digital competences are exacerbated, making the effective integration of digital technologies into teaching a formidable challenge [21]. The persistent gaps in the digital competence of higher education teachers, particularly in developing countries where the digital divide hinders the adoption of ICT, emphasise the urgent need for targeted efforts in this area [9].
For today’s generation of students, who are digital natives, the integration of digital competences into teaching practise significantly enhances the learning experience. Students increasingly expect and benefit from interactive, technology-enhanced learning environments that are more engaging and better suited to their learning styles [22]. Research shows that students in digitally enriched environments are more likely to develop critical thinking skills, engage in collaborative learning, and achieve better academic outcomes [23,24]. By promoting the digital competences of teaching staff, universities can ensure that they provide a sustainable, high-quality education that equips students for the challenges of the future [25].
The aim of this study is to develop and validate a tool to assess the digital competences of university teachers. This tool will offer higher education institutions a systematic way to assess and improve the digital competences of their teaching staff, thereby promoting more sustainable, innovative, and equitable educational practise.

2. Materials and Methods

2.1. Scale Development

The development of the Digital Competence Scale for University Teachers (DCS-UT) was conducted in December 2023 and January 2024 in a comprehensive and systematic process. This process included several important steps: (a) creating an initial pool of items and a response scale, (b) assessing content and face validity, and (c) testing the factor structure and reliability of the new scale.

Item Generation Process

In the first phase, an extensive literature review was conducted to identify the key dimensions of digital competence relevant to higher education [2,4,9,19,20,21,22,23,24,25,26,27,28,29,30]. The review focused on established frameworks and literature that outline the essential competences required by educators in the digital age. All of this formed the theoretical basis for the development of the questionnaire items, ensuring that each item corresponded to a specific dimension of digital competence.
Based on this review, 38 items were developed, reflecting key competences in areas such as technological knowledge, pedagogical use of digital tools, interactivity and collaboration, assessment, and continuous professional development. Each item has been carefully designed to capture specific aspects of these competency areas to ensure comprehensive coverage of the critical dimensions of digital competence required by higher education teachers.
To illustrate the link between the literature-based competency areas and the items created, Table 1 summarises how the key competency dimensions were incorporated into the item development process.

2.2. Pilot Study

A pilot study was conducted to assess the initial reliability and validity of the Digital Competence Scale for University Teachers (DCS-UT). This study included a purposive sample of university teachers to refine and validate the items of the scale. This pilot study is crucial to assess the performance of the scale before conducting wider data collection and analysis. A more detailed analysis of the sample and statistical validation procedures are presented in the following sections.

2.2.1. Evaluating the Content Validity

To ensure the validity of the DCS-UT, an assessment of its content validity was carried out. Four experts, two women and two men, from the fields of higher education and digital technologies took part in this process. Their task was to assess the relevance and clarity of each item on the scale. A 4-point Likert scale was used for relevance, and a 3-point Likert scale was used for clarity. The Content Validity Index (CVI) was then calculated for each item. According to Polit and Beck’s [31] guidelines, a CVI of 0.78 or higher is considered acceptable when four experts are involved.

2.2.2. Construct Validity and Reliability

In order to assess the construct validity and reliability of the DCS-UT, a confirmatory factor analysis (CFA) was conducted. Prior to conducting the CFA, the Kaiser–Meyer–Olkin (KMO) measure and Bartlett’s test of sphericity were applied to assess sample adequacy and the suitability of the data for factor analysis. A KMO value of more than 0.60 and a significant result of the Bartlett’s test (p < 0.05) indicate that the data are suitable for factor analysis. Reliability was assessed using Cronbach’s alpha, with a value of 0.70 or higher generally considered acceptable [32]. In addition, structural equation modelling (SEM) was conducted to validate the factor structure and the relationships between the constructs. Model fit was assessed using several fit indices, including the Comparative Fit Index (CFI) and the Root Mean Square Error of Approximation (RMSEA), with CFI values above 0.95 and RMSEA values below 0.08 indicating a good fit between the hypothesised model and the observed data [33].

2.3. Sample

This study used a purposive sample of 411 university teachers who had experience as lecturers in digital educational contexts (distance learning, blended learning, or via learning management systems) or who had integrated digital technologies into traditional lectures and seminars. The sample within the group of university teachers was stratified to include teachers with different academic ranks (lecturer, senior lecturer, assistant professor, associate professor, and full professor). Potential participants were sought in collaboration with public and private universities and independent higher education institutions in Slovenia, which were asked to participate in this study. According to the data for the academic year 2021/2022, 3282 university teachers were employed in Slovenia, of which, 1802 were men and 1480 women. Based on a total population of 3282 university teachers, and considering a hypothetical frequency of the outcome factor of 50% ± 5%, the required sample sizes were calculated for different confidence levels. A sample size of 344 was required for a 95% confidence level, while a sample size of 553 was required for a 99% confidence level. The detailed characteristics of the sample are shown in Table 2.

2.4. Ethical Considerations

Ethical approval for this study was obtained from the Commission of the University of Primorska for Ethics in Human Subjects Research (Approval No: 4264-16-3/2022). All data were treated confidentially. Informed consent was obtained from all participants who were willing to engage in this study.

2.5. Data Collection

The data for this study were collected via an online survey conducted on the open-source platform 1KA (https://www.1ka.si/d/en, accessed on 28 May 2024). Following ethical approval, potential participants were invited by email, which included a link to the questionnaire and detailed instructions on its purpose and completion. The period of data collection was from April to June 2024. To preserve the anonymity of the respondents, the database created from the survey responses did not contain any personal identifiers. Access to the data was restricted to the study leader to ensure confidentiality throughout the analysis process. Informed consent was obtained from all participants prior to participation in this study, confirming their voluntary participation and understanding of the research objectives.

2.6. Data Analysis

For data analysis, the data set was processed with IBM SPSS version 29.0 (SPSS Inc., Chicago, IL, USA) and JASP version 0.18.3 (Intel, Santa Clara, CA, USA), an open-source statistical software. Descriptive statistics were used to obtain an overview of the characteristics of the sample. Reliability was assessed using Cronbach’s alpha to ensure internal consistency. Confirmatory factor analysis (CFA) was conducted to validate the factor structure of the DCS-UT, while structural equation modelling (SEM) was used to examine the relationships between latent constructs. The model’s fit was assessed using indices such as the Comparative Fit Index (CFI) and the Root Mean Square Error of Approximation (RMSEA). The covariances between the latent factors were analysed within the SEM to understand the relationships between them, setting a statistical significance level of 0.05.

3. Results

The CVI results show that most items of the DCS-UT have high content validity, with CVI values between 0.78 and 1.00. This shows that the majority of items were rated as relevant and clear by the experts. However, three items were identified with lower CVI values, indicating possible problems with their relevance or clarity. Consequently, these items were excluded from the final scale in order to maintain the overall content validity of the DCS-UT. The excluded items were carefully reviewed, and it was determined that their removal would not affect the completeness of the scale.
In order to validate the structure of the measurement model, a CFA was conducted. A factor analysis was conducted using Promax rotation, an oblique rotation method chosen because it allows for correlation of the factors. This approach is in line with the theoretical expectation that the underlying dimensions of university teachers’ digital competence are interrelated. Only items with factor loadings above 0.4 were selected for further analysis in order to ensure the robustness and validity of the constructs. The CFA confirmed that all 35 items yielded a robust factor solution with eigenvalues above 1. The factor weight matrix showed that all items had factor loadings above 0.40, confirming their suitability. The KMO measure of sampling adequacy was 0.929 and Bartlett’s test of sphericity was significant (χ2 = 4482.833, p < 0.001), supporting the suitability of the data for CFA. In addition, the univariate normal distribution of the indicator variables was assessed by analysing the skewness and kurtosis. The values for the skewness of the variables ranged from −0.847 to 0.447, indicating that the distributions are relatively symmetrical. The kurtosis values ranged from −0.999 to 0.780, indicating that there are no extreme outliers in the data. Therefore, the variables have distribution characteristics that are suitable for CFA, with values for skewness and kurtosis within acceptable ranges. Consequently, the factor analysis resulted in a four-factor structure that describes the basic dimensions of the digital competence scale (Table 2).
Table 3 also shows the z-values and p-values for each item, which indicate the statistical significance of the factor loadings. The consistently high z-values and p-values below 0.001 confirm that all relationships between the items and their respective factors are statistically significant.
Table 3 also summarises the total variance explained by the four factors identified by using Promax rotation with Kaiser normalisation. Factor 1, Digital literacy, accounted for the majority of the variance at 55.415%, followed by Factor 2, Digital skills, which explained 8.040% of the variance. Factor 3, Digital interaction, contributed 3.827% of the variance, while Factor 4, Technology integration, accounted for 3.002% of the variance. Together, these four factors explained 70.284% of the total variance, indicating a robust factor structure. The scree plot in Figure 1 illustrates the distribution of eigenvalues and shows the point where the curve flattens out (the “elbow”), indicating that four factors should be retained. This decision was further supported by retaining factors with eigenvalues greater than 1, as is common in factor analysis.
Furthermore, the factor covariances in the structural equation model were analysed in order to understand the relationships between the latent factors. Table 4 shows the covariance values, standard errors, z-values, p-values, and 95% confidence intervals for the relationships between the four factors: digital literacy, digital skills, digital interaction, and technology integration.
The results in Table 3 shows significant correlations between all factors. The estimates range from 0.620 to 0.950, with all p-values less than 0.001, meaning that the relationships are statistically significant. The high z-values further confirm these results. For example, Factor 1 (Digital literacy) and Factor 2 (Digital skills) have a covariance estimate of 0.950, indicating a strong positive relationship. Similarly, Factor 1 and Factor 3 (Digital interaction) have a covariance estimate of 0.946. These high covariance values indicate that these factors are closely related and likely to influence each other.
The fit indices for the overall model indicate a very good fit. The Comparative Fit Index (CFI) is 0.973 and the Tucker–Lewis Index (TLI) is 0.972. Both values are above the recommended threshold value of 0.95 and indicate an excellent fit. The Root Mean Square Error of Approximation (RMSEA) is 0.079 with a 90% confidence interval of 0.072 to 0.087 and a p-value indicating a good fit of less than 0.001, which is within acceptable limits. The Standardised Root Mean Square Residual (SRMR) is 0.075, also within acceptable limits.
Table 5 shows the reliability and descriptive statistics of the Digital Competence Scale and its four factors.
The Cronbach’s alpha values for the factors are as follows: Digital literacy (α = 0.966), Digital skills (α = 0.929), Digital interaction (α = 0.879), and Technology integration (α = 0.791). The overall Digital Competence Scale for University Teachers (DCS-UT) has a high reliability with a Cronbach’s alpha of 0.974. These values indicate that the scale and its subscales have excellent internal consistency and are therefore reliable measures for the assessment of digital competence.

4. Discussion

The Digital Competence Scale for University Teachers (DCS-UT) was developed and validated to meet the growing need for the integration of digital competences into university teaching. The robust factor structure, validated through confirmatory factor analysis (CFA) and further investigated using structural equation modelling (SEM), highlights the scale’s effectiveness in measuring four key dimensions: Digital Literacy, Digital Skills, Digital Interaction, and Technology Integration. These analyses confirm the strong construct validity of the scale with Cronbach’s alpha values of over 0.70, which is in line with psychometric standards [32]. The nature of the DCS-UT, which covers a wide range of digital competences, from basic skills to advanced technology integration, makes it a valuable tool for both teachers and institutions seeking to improve their digital teaching practises.
Digital literacy is a critical and evolving competency in higher education that goes beyond the basic use of digital tools. It encompasses a range of skills, knowledge, and attitudes that are essential for teachers to effectively integrate digital technologies into their teaching methods. These include the competent use of digital tools, the integration of digital simulations, and the promotion of interaction between students via digital platforms, which are becoming increasingly important in the modern educational landscape [1,9]. The importance of digital literacy is further emphasised by the ongoing digital transformation in higher education, making it a fundamental element of effective teaching. Digital literacy is dynamic and must constantly evolve with the emergence of new technologies. This evolution is critical for promoting equity, inclusion, and lifelong learning, and is in line with global frameworks such as DigCompEdu [34,35]. Our findings confirm the importance of digital literacy as a multidimensional construct that is crucial for addressing the complexity of digital competences in education. Our findings emphasise the importance of digital literacy as a multidimensional construct necessary to address the complexity of digital competencies in education [16].
Digital skills, another essential dimension, focus on the technical skills educators need to use various digital tools and platforms effectively in teaching. These skills include the use of learning management systems, digital collaboration tools, and specialised software that supports online and blended learning environments. As higher education increasingly utilises digital methods, these skills will become indispensable. Teachers must not only be proficient with digital tools, but also integrate them seamlessly into teaching to improve student engagement and learning outcomes. This dimension is in line with the broader framework of digital competences, which emphasises the importance of specific digital skills for effective teaching [4]. The findings of this study emphasise the critical role that these skills play in the successful implementation of digital and blended learning strategies to ensure that teaching methods remain engaging and up to date [35,36].
Digital interaction focuses on the use of digital tools to promote interactive learning environments. This dimension is critical to creating meaningful connections between students, teachers, and content. The ability to use digital platforms for interaction and collaboration is increasingly recognised as fundamental to digital competence, particularly in higher education where student engagement is a key factor in academic success [2,26,37]. This factor aligns with the growing body of research that emphasises the role of digital tools in creating dynamic learning environments that promote active learning and collaboration, especially as higher education institutions increasingly adopt digital and blended learning models [1,21].
Technology integration is about incorporating digital tools and resources into teaching practise to improve learning outcomes. This process requires both technical and pedagogical expertise to ensure that digital tools are used strategically to support learning objectives. As higher education undergoes digital transformation, effective technology integration is becoming a key component of educators’ professional competence [2,9]. This dimension encompasses the interplay between technical and pedagogical skills required for effective teaching in the digital age, making it an important focus for educators worldwide [30,37].
The validated Digital Competence Scale for University Teachers (DCS-UT) can be applied across various educational settings to assess and enhance digital competencies. Most items of the DCS-UT scale use a perception-based format (self-assessments), but this approach is widely accepted in measuring digital competence. Previous studies, including those using the DigCompEdu framework and the European Digital Competence Framework (DigComp), have successfully utilised self-assessment instruments to measure teachers’ digital skills, competence, and technology integration practises [35,36]. Research shows that perception-based items provide valuable insight into teachers’ confidence and perceived abilities in using digital tools, which directly impacts their motivation to integrate technology into their teaching practises [37]. In addition, perception-based assessments allow institutions to identify areas where teachers feel less confident and target their professional development efforts accordingly. Further, gender differences have been identified as an important factor influencing digital competence, particularly in education. Research suggests that female teachers often have lower confidence in using digital technologies compared to their male counterparts, despite having similar technical skills [38]. This gender gap in digital self-efficacy may impact the willingness to integrate new digital tools into teaching practise, especially when institutional support is limited. In contrast, male educators may be more inclined to experiment with advanced technologies, particularly in STEM subjects where digital competence is increasingly important [9].
The DCS-UT can be effectively integrated into professional development programmes to identify areas where teachers need further training. Through workshops and customised resources based on the assessment results, institutions can help educators build important digital literacy and technical skills. In addition, the scale can be used to monitor and improve the use of digital tools in blended and online learning environments. This ensures that teachers not only master these technologies, but also utilise them to create interactive learning experiences.
Future research should explore how these competences can be developed and maintained to support the long-term sustainability of higher education and ensure that institutions remain at the forefront of educational innovation and sustainability [2,4].

Limitations

Although this study provides valuable insights into the digital competences of university teachers, it is not without limitations. Firstly, the sample was limited to university teachers from a specific geographical region, which may limit the generalisability of the findings to other contexts. While the purposive sampling method is effective in targeting experienced teachers, it may also lead to selection bias, as it does not fully represent the diversity of teaching experiences and digital competences in the academic community. Finally, the rapid development of digital technologies means that the competences required for effective digital teaching are constantly changing. As a result, the scale developed in this study may need to be regularly updated to remain relevant in an ever-evolving field of education. Future research should take these limitations and investigate the application of the Digital Competence Scale for University Teachers (DCS-UT) in different educational settings and its adaptability over time, or adapt the scale for use in different cultural contexts.

5. Conclusions

This study highlights the critical role of digital competences in promoting sustainable education practises aligned with the key Sustainable Development Goals (SDGs), including quality education (SDG 4), gender equality (SDG 5), industry, innovation, and infrastructure (SDG 9), and reducing inequalities (SDG 10). The validated Digital Competence Scale for University Teachers (DCS-UT) is a valuable tool for improving teachers’ skills and fostering resilient, equitable, and adaptable education systems. Integrating these competences allows higher education institutions to contribute to a more inclusive and sustainable future and ensure that both teachers and students are well prepared to succeed in an increasingly digital world.

Author Contributions

Conceptualisation and design, S.L. and M.P.; methodology, S.L. and M.P.; statistical analysis, S.L.; data management, S.L.; writing—original draft preparation, S.L. and M.P.; writing—review and editing, S.L. and M.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was co-funded by the ARIS–Slovenian Research and Innovation Agency under funding number J5-4572 within the project “Development of a digital education standard in higher education for ensuring equity and accessibility in digital education”.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Commission of the University of Primorska for Ethics in Human Subjects Research (Approval No: 4264-16-3/2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in this study. Participation was voluntary and anonymous.

Data Availability Statement

The data are available from the corresponding author upon reasonable request, as the participants were assured that they would remain confidential.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Brooks, C.D.; McCormack, M. Driving Digital Transformation in Higher Education; ECAR Research Report; ECAR: Louisville, CO, USA, 2020. [Google Scholar]
  2. Fernández, A.; Gómez, B.; Binjaku, K.; Meçe, E.K. Digital Transformation Initiatives in Higher Education Institutions: A Multivocal Literature Review. Educ. Inf. Technol. 2023, 28, 12351–12382. [Google Scholar] [CrossRef] [PubMed]
  3. Digital Education Action Plan (2021–2027). European Education Area. Available online: https://education.ec.europa.eu/node/1518 (accessed on 25 November 2022).
  4. Redecker, C.; Punie, Y. European Framework for the Digital Competence of Educators: DigCompEdu; Publications Office of the European Union: Luxembourg, 2017; ISBN 978-92-79-73494-6. [Google Scholar]
  5. Ličen, S.; Cassar, M.; Filomeno, L.; Yeratziotis, A.; Prosen, M. Development and Validation of an Evaluation Toolkit to Appraise eLearning Courses in Higher Education: A Pilot Study. Sustainability 2023, 15, 6361. [Google Scholar] [CrossRef]
  6. Nagy, J.T.; Dringó-Horváth, I. Factors Influencing University Teachers’ Technological Integration. Educ. Sci. 2024, 14, 55. [Google Scholar] [CrossRef]
  7. Røe, Y.; Wojniusz, S.; Bjerke, A.H. The Digital Transformation of Higher Education Teaching: Four Pedagogical Prescriptions to Move Active Learning Pedagogy Forward. Front. Educ. 2022, 6, 784701. [Google Scholar] [CrossRef]
  8. Vieira, R.M.; Tenreiro-Vieira, C.C.; Bem-Haja, P.; Lucas, M. STEM Teachers’ Digital Competence: Different Subjects, Different Proficiencies. Educ. Sci. 2023, 13, 1133. [Google Scholar] [CrossRef]
  9. Howard, S.K.; Tondeur, J. Higher Education Teachers’ Digital Competencies for a Blended Future. Educ. Technol. Res. Dev. 2023, 71, 1–6. [Google Scholar] [CrossRef]
  10. Moreira-Choez, J.S.; Gómez Barzola, K.E.; Lamus de Rodríguez, T.M.; Sabando-García, A.R.; Cruz Mendoza, J.C.; Cedeño Barcia, L.A. Assessment of Digital Competencies in Higher Education Faculty: A Multimodal Approach within the Framework of Artificial Intelligence. Front. Educ. 2024, 9, 1425487. [Google Scholar] [CrossRef]
  11. Cascarosa Salillas, E.; Sánchez-Azqueta, C.; Gimeno, C.; Aldea, C. A Teaching-Learning Sequence to Develop Epistemic Thinking in Engineering Students at Master’s Educational Level. J. Appl. Res. High. Educ. 2024; ahead-of-print. [Google Scholar] [CrossRef]
  12. Naya-Forcano, A.; Garcia-Bosque, M.; Cascarosa, E.; Aznar, F.; Sánchez-Azqueta, C.; Celma, S.; Aldea, C. ChatPLT: An Intelligent Tutoring System for Teaching Physics in Higher Education. In Proceedings of the 10th International Conference on Higher Education Advances (HEAd’24), Valencia, Spain, 18–21 June 2024. [Google Scholar]
  13. Koukourikos, K.; Tsaloglidou, A.; Kourkouta, L.; Papathanasiou, I.V.; Iliadis, C.; Fratzana, A.; Panagiotou, A. Simulation in Clinical Nursing Education. Acta Inform. Medica 2021, 29, 15–20. [Google Scholar] [CrossRef]
  14. Lucena-Anton, D.; Fernandez-Lopez, J.C.; Pacheco-Serrano, A.I.; Garcia-Munoz, C.; Moral-Munoz, J.A. Virtual and Augmented Reality versus Traditional Methods for Teaching Physiotherapy: A Systematic Review. Eur. J. Investig. Health Psychol. Educ. 2022, 12, 1780–1792. [Google Scholar] [CrossRef]
  15. Abdulrahaman, M.D.; Faruk, N.; Oloyede, A.A.; Surajudeen-Bakinde, N.T.; Olawoyin, L.A.; Mejabi, O.V.; Imam-Fulani, Y.O.; Fahm, A.O.; Azeez, A.L. Multimedia Tools in the Teaching and Learning Processes: A Systematic Review. Heliyon 2020, 6, e05312. [Google Scholar] [CrossRef] [PubMed]
  16. Okoye, K.; Hussein, H.; Arrona-Palacios, A.; Quintero, H.N.; Ortega, L.O.P.; Sanchez, A.L.; Ortiz, E.A.; Escamilla, J.; Hosseini, S. Impact of Digital Technologies upon Teaching and Learning in Higher Education in Latin America: An Outlook on the Reach, Barriers, and Bottlenecks. Educ. Inf. Technol. 2023, 28, 2291–2360. [Google Scholar] [CrossRef] [PubMed]
  17. Kioupi, V.; Voulvoulis, N. Education for Sustainable Development: A Systemic Framework for Connecting the SDGs to Educational Outcomes. Sustainability 2019, 11, 6104. [Google Scholar] [CrossRef]
  18. United Nations. THE 17 GOALS. Sustainable Development. Available online: https://sdgs.un.org/goals (accessed on 12 August 2024).
  19. Tondeur, J.; Howard, S.; Van Zanten, M.; Gorissen, P.; Van der Neut, I.; Uerz, D.; Kral, M. The HeDiCom Framework: Higher Education Teachers’ Digital Competencies for the Future. Educ. Technol. Res. Dev. 2023, 71, 33–53. [Google Scholar] [CrossRef]
  20. Basantes-Andrade, A.; Casillas-Martín, S.; Cabezas-González, M.; Naranjo-Toro, M.; Guerra-Reyes, F. Standards of Teacher Digital Competence in Higher Education: A Systematic Literature Review. Sustainability 2022, 14, 13983. [Google Scholar] [CrossRef]
  21. Saltos-Rivas, R.; Novoa-Hernández, P.; Rodríguez, R.S. Understanding University Teachers’ Digital Competencies: A Systematic Mapping Study. Educ. Inf. Technol. 2023, 28, 16771–16822. [Google Scholar] [CrossRef]
  22. Castaño Muñoz, J.; Vuorikari, R.; Costa, P.; Hippe, R.; Kampylis, P. Teacher Collaboration and Students’ Digital Competence—Evidence from the SELFIE Tool. Eur. J. Teach. Educ. 2023, 46, 476–497. [Google Scholar] [CrossRef]
  23. Mhlongo, S.; Mbatha, K.; Ramatsetse, B.; Dlamini, R. Challenges, Opportunities, and Prospects of Adopting and Using Smart Digital Technologies in Learning Environments: An Iterative Review. Heliyon 2023, 9, e16348. [Google Scholar] [CrossRef]
  24. Wei, Z. Navigating Digital Learning Landscapes: Unveiling the Interplay Between Learning Behaviors, Digital Literacy, and Educational Outcomes. J. Knowl. Econ. 2023. [Google Scholar] [CrossRef]
  25. Alenezi, M. Digital Learning and Digital Institution in Higher Education. Educ. Sci. 2023, 13, 88. [Google Scholar] [CrossRef]
  26. Zhao, Y.; Pinto Llorente, A.M.; Sánchez Gómez, M.C. Digital Competence in Higher Education Research: A Systematic Literature Review. Comput. Educ. 2021, 168, 104212. [Google Scholar] [CrossRef] [PubMed]
  27. Basilotta-Gómez-Pablos, V.; Matarranz, M.; Casado-Aranda, L.-A.; Otto, A. Teachers’ Digital Competencies in Higher Education: A Systematic Literature Review. Int. J. Educ. Technol. High. Educ. 2022, 19, 8. [Google Scholar] [CrossRef]
  28. Phillips, R.; McNaught, C.; Kennedy, G. Evaluating e-Learning: Guiding Research and Practice; Routledge: New York, NY, USA, 2011; ISBN 978-0-203-81336-2. [Google Scholar]
  29. McGuinness, C.; Fulton, C. Digital Literacy in Higher Education: A Case Study of Student Engagement with E-Tutorials Using Blended Learning. J. Inf. Technol. Educ. Innov. Pract. 2019, 18, 1–28. [Google Scholar] [CrossRef] [PubMed]
  30. Surry, D.W.; Gray, R.M., Jr.; Stefurak, J.R. Technology Integration in Higher Education: Social and Organizational Aspects; IGI Global: Hershey, PA USA, 2011; ISBN 978-1-60960-147-8. [Google Scholar]
  31. Polit, D.F.; Beck, C.T. The Content Validity Index: Are You Sure You Know What’s Being Reported? Critique and Recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef]
  32. Field, A.P. Discovering Statistics Using IBM SPSS Statistics; SAGE Publications: London, UK; Thousand Oaks, CA, USA, 2018; ISBN 978-1-5264-1951-4. [Google Scholar]
  33. Hussain, S.; Fangwei, Z.; Siddiqi, A.F.; Ali, Z.; Shabbir, M.S. Structural Equation Model for Evaluating Factors Affecting Quality of Social Infrastructure Projects. Sustainability 2018, 10, 1415. [Google Scholar] [CrossRef]
  34. Marín, V.I.; Castañeda, L. Developing Digital Literacy for Teaching and Learning. In Handbook of Open, Distance and Digital Education; Zawacki-Richter, O., Jung, I., Eds.; Springer Nature: Singapore, 2022; pp. 1–20. ISBN 978-981-19035-1-9. [Google Scholar]
  35. Gutiérrez-Ángel, N.; Sánchez-García, J.-N.; Mercader-Rubio, I.; García-Martín, J.; Brito-Costa, S. Digital Literacy in the University Setting: A Literature Review of Empirical Studies between 2010 and 2021. Front. Psychol. 2022, 13, 896800. [Google Scholar] [CrossRef]
  36. Audrin, C.; Audrin, B. Key Factors in Digital Literacy in Learning and Education: A Systematic Literature Review Using Text Mining. Educ. Inf. Technol. 2022, 27, 7395–7419. [Google Scholar] [CrossRef]
  37. Timotheou, S.; Miliou, O.; Dimitriadis, Y.; Sobrino, S.V.; Giannoutsou, N.; Cachia, R.; Monés, A.M.; Ioannou, A. Impacts of Digital Technologies on Education and Factors Influencing Schools’ Digital Capacity and Transformation: A Literature Review. Educ. Inf. Technol. 2023, 28, 6695–6726. [Google Scholar] [CrossRef]
  38. Yoon, S.H. Gender and Digital Competence: Analysis of Pre-Service Teachers’ Educational Needs and Its Implications. Int. J. Educ. Res. 2022, 114, 101989. [Google Scholar] [CrossRef]
Figure 1. Scree plot of the Digital Competence Scale for University Teachers (DCS-UT).
Figure 1. Scree plot of the Digital Competence Scale for University Teachers (DCS-UT).
Sustainability 16 09937 g001
Table 1. Assignment of digital competence areas to task descriptions.
Table 1. Assignment of digital competence areas to task descriptions.
Competence AreaDescription
Technological knowledgeItems focused on educators’ skills in using a variety of digital tools and platforms.
Pedagogical use of digital toolsThese items assessed how teachers integrate technology into their teaching practise to improve learning outcomes.
Interactivity and collaboration in online environmentsThis category assessed the use of digital platforms to promote student interaction and collaboration.
Assessment and feedback via digital platformsThese items examined how teachers use digital tools to assess students and provide timely feedback.
Continuous professional development in digital technologiesThese items addressed the importance of ongoing professional development for teachers to stay current with new digital tools and approaches.
Strategies to ensure digital accessibility and inclusionThese items assessed teachers’ awareness and use of digital tools to ensure that all students, regardless of ability, have access to learning.
Frequent use of digital communication platforms These items measured how teachers interact with students via digital communication platforms.
Integration of digital tools These items assessed how teachers integrate digital tools into lectures and seminars.
Use of analytics tools These items assessed how teachers use analytics tools to track student progress.
Digital ethics, data protection, equality, and accessibilityThese items ensured that teachers comply with ethical principles in digital education.
Participation in professional developmentThese items related to ongoing training in new technologies and digital pedagogical approaches.
Development of digital learning modules, e-books, and multimedia elementsThese items were used to measure teachers’ ability to create digital content and promote independent learning.
Table 2. Characteristics of the participants (n = 411).
Table 2. Characteristics of the participants (n = 411).
Characteristicn%
Gender:
Male17442.3
Female23757.7
Academic ranks:
Lecturer7518.2
Senior Lecturer5112.4
Assistant17342.1
Associate Professor7017.0
Full Professor4210.2
Fields of teaching:
Social sciences6916.8
Humanities122.9
Natural sciences7518.2
Technical and technological sciences276.6
Medical sciences4911.9
Biotechnical sciences276.6
Arts153.6
Sports sciences4811.7
Interdisciplinary subjects122.9
Health sciences7718.7
Table 3. Digital Competence Scale for University Teachers (DCS-UT)—confirmatory factor analysis yields a four-factor solution with factor loadings (N = 411).
Table 3. Digital Competence Scale for University Teachers (DCS-UT)—confirmatory factor analysis yields a four-factor solution with factor loadings (N = 411).
ItemsFactor Loadingsz-ValuepI-CVI (R, C)
Factor 1I know how to use analytics tools to monitor student progress.0.914106.532<0.0011.00
I use digital tools to better adapt the teaching process to the different learning styles and needs of students.0.897100.727<0.0010.94
I can adapt my teaching to the students’ technological abilities.0.89483.404<0.0010.91
I regularly use multimedia elements such as animations and simulations to better understand complex concepts.0.88879.275<0.0010.91
I actively encourage students to use digital tools for independent learning and research.0.86677.525<0.0010.87
I develop and use digital learning modules and e-books to supplement traditional teaching materials.0.863105.357<0.0011.00
I encourage students to develop their digital skills.0.86290.308<0.0010.98
I regularly act as a mentor or counsellor for colleagues who want to improve their digital skills.0.86177.801<0.0011.00
I regularly participate in webinars and workshops to improve my digital skills.0.84585.542<0.0011.00
I am aware of the importance of digital privacy and uphold it consistently for my students (protecting personal data and information shared or created in a digital environment).0.82788.956<0.0010.91
I consistently adhere to the principles of digital ethics and ensure safety in e-teaching.0.82064.649<0.0011.00
I participate in research to improve digital pedagogical practises.0.81797.672<0.0011.00
I regularly educate myself about new digital technologies and approaches.0.81691.989<0.0011.00
I incorporate digital simulations into lessons where appropriate.0.80092.288<0.0011.00
I frequently use digital communication platforms to interact with students (e.g., Zoom, Microsoft Teams, Moodle, email, etc.).0.75874.126<0.0010.98
Collaborative digital platforms such as Moodle are a key element of my teaching process.0.74783.632<0.0010.88
I understand the importance of digital equality and accessibility in education (ensuring equal opportunities for access to digital tools and educational content).0.69158.111<0.0010.78
Factor 2I use advanced digital platforms to monitor and support the progress of individual students.0.930100.727<0.0011.00
I regularly evaluate and adapt my methods to ensure digital accessibility and inclusion for all students.0.92797.324<0.0011.00
I use virtual collaboration tools such as online whiteboards (e.g., Padlet) for group projects and assignments.0.88684.357<0.0011.00
I use digital tools for student assessment and feedback.0.86595.68<0.0011.00
I effectively integrate online and physical learning environments for hybrid teaching.0.81677.069<0.0010.98
I regularly use online tools for surveys and feedback collection to evaluate the effectiveness of my lectures and continuously improve them.0.80884.357<0.0010.98
Factor 3I use various digital media in the classroom, e.g., videos, infographics, and quizzes.0.82095.68<0.0011.00
I encourage students to participate in digital discussions and forums.0.81097.221<0.0011.00
I use various digital tools in my lessons without any problems.0.80883.632<0.0011.00
I integrate various digital tools into lectures or seminars to complement traditional teaching methods.0.79665.726<0.0011.00
My e-lectures are interactive and encourage student participation.0.79364.96<0.0010.98
I regularly incorporate digital tools into my lectures and seminars.0.74583.404<0.0010.98
Factor 4I encourage and support the use of digital portfolios to document students’ academic work (including in Moodle).0.84283.632<0.0011.00
I encourage students to use online information critically.0.79881.401<0.0011.00
I recognise the importance of continuous professional development in digital skills and careful preparation of e-learning content that enables me to effectively adapt and deliver pedagogical processes in a digital environment.0.75283.632<0.0010.88
I promote the use of social media for educational purposes.0.68677.069<0.0010.88
I support the use of open educational resources (e.g., open textbooks, open-source educational platforms, free educational videos, and open scientific articles).0.64283.632<0.0010.88
I actively participate in online communities and forums related to my teaching field.0.59526.503<0.0010.78
Note. Accumulated total explained variance = 70%. Bartlett’s Test of Sphericity: χ2 = 4482.833, p < 0.0001; Kaiser–Meyer–Olkin value = 0.929; SD—Standard Deviation; Factor 1—Digital literacy; Factor 2—Digital skills; Factor 3—Digital interaction; Factor 4—Technology integration; Factor Rotation: Promax with Kaiser normalisation; Rating is based on five response categories, ranging from 1—strongly disagree to 5—strongly agree; I-CVI (R, C)—Items Content Validity Index (Relevancy, Clarity); Rejected items based on CVI: I use various digital devices in my teaching without any problems; technical difficulties rarely hinder my online teaching; I regularly test and implement new digital technologies to improve the interactivity of my lectures (e.g., Kahoot, Mentimeter, Padlet, …).
Table 4. Factorial covariances in the structural equation model.
Table 4. Factorial covariances in the structural equation model.
FactorsEstimateStd. Errorz-Valuep95% Confidence Interval
LowerUpper
Digital literacy ↔ Digital skills0.9500.008117.169<0.0010.9340.966
Digital literacy ↔ Digital interaction0.9460.01185.052<0.0010.9240.968
Digital literacy ↔ Technology integration0.6200.01834.699<0.0010.5850.655
Digital skills ↔ Digital interaction0.9010.01560.156<0.0010.8710.930
Digital skills ↔ Technology integration0.6880.02527.031<0.0010.6380.738
Digital interaction ↔ Technology integration0.7140.02726.898<0.0010.6620.766
Table 5. Reliability and descriptive statistics of the Digital Competence Scale for University Teachers (DCS-UT) and its four factors.
Table 5. Reliability and descriptive statistics of the Digital Competence Scale for University Teachers (DCS-UT) and its four factors.
Factors/SubscalesnMdnSDCronbach α 95% Confidence Intervalp
LowerUpper
Digital literacy173.350.9520.9663.013.33<0.001
Digital skills62.581.0570.9292.462.81<0.001
Digital interaction63.420.7650.8793.333.59<0.001
Technology integration63.670.6270.7913.443.65<0.001
Digital Competence Scale for University Teachers (DCS-UT)353.270.8010.9743.063.33<0.001
Note. Mdn—Median; SD—Standard Deviation.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ličen, S.; Prosen, M. Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT). Sustainability 2024, 16, 9937. https://doi.org/10.3390/su16229937

AMA Style

Ličen S, Prosen M. Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT). Sustainability. 2024; 16(22):9937. https://doi.org/10.3390/su16229937

Chicago/Turabian Style

Ličen, Sabina, and Mirko Prosen. 2024. "Strengthening Sustainable Higher Education with Digital Technologies: Development and Validation of a Digital Competence Scale for University Teachers (DCS-UT)" Sustainability 16, no. 22: 9937. https://doi.org/10.3390/su16229937

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop