TEMJournalFebruary2022 463 471
TEMJournalFebruary2022 463 471
1
Nizhny Novgorod Dobrolyubov State Linguistic University, Nizhny Novgorod, Russian Federation
2
Moscow Technical University of Communications and Informatics, Moscow, Russian Federation
3
National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”, Kyiv, Ukraine
4
Federal State Budgetary Educational Institution of Higher Education “Kuban State Agrarian University
named after I.T. Trubilin”, Krasnodar, Russian Federation
Online platforms offer a number of advantages, for individual student, the researchers cannot conclude
example, learning at a convenient time and from any that there was genuine collective intelligence.
location, reducing the cost of transport and living in According to them, ICT-based teaching
another city, reducing teaching load, etc. methodologies offer new methods of knowledge
Today, online learning is being widely transfer and management in higher education. The
implemented and the quality of the systems required fact that students collaborate in evaluating each
is an urgent problem. The quality of an online other's work contributes to their motivation and
system, which refers to the availability and quality of promotes an active learning process [5].
content, is the most significant external factor that
affects perceived ease of use and perceived 1.2. Virtual Laboratories
usefulness. Technical students also believe that e-
learning platforms help them learn as they can revisit Virtual laboratory is a source of information that
what they have already learned (tapes and videos) in provides students with the opportunity to master
an online course [4]. practical skills and allows them to simulate
The use of online platforms is gaining momentum environmental phenomena and processes. The
today, so it is important to carefully consider the advantages of a virtual laboratory involve reducing
quality of their content and the opportunities the amount of equipment for experiments, improving
provided to students. This study aims to assess the the visibility of experiments in the absence of
capabilities and test the quality of online courses in appropriate equipment at the university, developing
the context of teaching engineering students. students' thinking skills using new Internet
technologies, improving the quality of information
1.1. Literature Review support for the learning process, automating the
verification of student experiment results, reducing
Engineering and science education is generally the risk of injury (for example, burns). The
based on skill development and content learning. disadvantage of a virtual laboratory is the lack of
However, in order to qualitatively prepare students tactile sensations during experiments. In general,
for modern life, it is also necessary to develop critical virtual laboratories were created not to replace real
thinking and stimulate thoughts on how to improve experiments but to supplement them [8].
current practices with the help of new technologies Available online laboratories have different
and tools [5]. interfaces and technical settings ranging from a
In the online learning environment, it is necessary simple experimental room based on a webcam to
to take into account different approaches to teaching complex direct control and feedback systems. Some
engineering disciplines. Content-based learning of them have been integrated into the learning
consists of sequential teaching of basic concepts and environment while others have a separate application
regular lab classes. Problem-based learning refers to programming interface. Today the most popular
technical skills (such as system design and problem online labs are RoboticHomeLabkit test bench,
statement) and soft skills (such as teamwork, Mobile robotlab, Manipulatorlab, 3D printerLab [9].
communication skills, lifelong learning, and
professional (or ethical) responsibility) [6]. Active 1.3. Forums
learning is a broad concept that refers to educational
approaches aimed at student participation rather than Internet forums are a good platform for students to
passive listening. There are many approaches to communicate and learn, but the problems related to
active learning, including problem-based learning, finding and tracking a large amount of data that are
project-based learning, challenge-based learning, generated on them often has the opposite effect.
service learning, flipped teaching, gamification, and Scientists suggest computer processing of
game-based learning [7]. information that can be used in online learning. Thus,
The collaboration model described by the Spanish information is processed using human language
researchers is based on the peer review methodology, processing techniques and the main topics of
which is implemented on an online learning platform. discussion are identified. According to the
The students were asked to review the work of their researchers: (1) Forums are the most important factor
fellow students, namely, to suggest ways to improve, in the success of Open and Distance Learning
comment on, and evaluate the tasks completed. The (ODL); (2) Forums can improve transfer of
process was supervised by the teachers. The knowledge, which will help increase participation,
experiment was attended by the Faculty of Computer teach and retain learners; (3) Methods of automatic
Science students. According to the results, content analysis of information can help process large
mastery and several skills improved. Although the volumes of messages [10].
team performance was greater than that of an
Today Massive Open Online Courses (MOOCs) CooL: SLiCE Cyberlearning Platform. American
are a tool that provides free quality education scientists have created an interactive web-based
opportunities for everyone. Learners can also study cyber learning environment. Constructionism in
engineering and programming on these platforms. Learning: Sustainable Life Cycle Engineering
However, programming cannot be mastered only (CooL: SLiCE). It was designed to facilitate the
with the help of common MOOC components such consideration of different human-initiated or
as content reading, video lectures, and quizzes. This controlled impacts on the natural environment
requires hands-on programming exercises and timely through team and individual project activities. Thus,
feedback. German researchers offer automatic CooL: SLiCE enables physical/hands-on engineering
evaluation of programming problems. Similar education based on a virtual platform that allows
systems that automatically assess students' students to analyze and visualize changes in product
programming assignments have been in use for over design, manufacturing processes, and supply chain
fifty years. Educational web-based tools such as configurations in terms of sustainability indicators.
Codewars and CodingBat can help educators as they CooL: SLiCE Cyberlearning Platform contains the
already contain a collection of hands-on modules of Product Design and Visualization;
programming exercises that can be used in a web Manufacturing Process and System Analysis;
browser [11]. Sustainable Product Architecture and Supplier
Lack of self-discipline to complete MOOCs and Selection (S-PASS) [15].
lack of interaction with others are the major hurdles CARDS. Online Card Sorting Platform (CARDS).
compared to compulsory lecture attendance. CARDS enables researchers to develop card sorting
Nevertheless, MOOCs offer a flexible schedule and tasks and send them to participants in order to
an opportunity to study regardless of location, which remotely collect data and analyze them. A card
makes it easier to access such education, in particular sorting session involves participants sorting a set of
for those who want to study entrepreneurship. There cards (such as engineering scenarios) while relying
are 4 main characteristics of MOOCs: (1) They are on any chart that they think is appropriate. Thus,
open to everyone, no entry requirements; (2) There is cards with car images can be sorted by color, number
no limit to the number of participants; (3) They are of doors or size, and there is no correct sorting
free; (4) Courses are fully online [12]. method. This approach is often used in user interface
Online courses should be evaluated according to (UX) design when users are asked to sort cards by
the following criteria: instructor design; category to get usability feedback, such as how to
communication, interaction and collaboration; organize context menus [16].
student assessment; student support and resources; Today, online education is still not very popular
web design and course evaluation [13]. among students. The main factors affecting student
acceptance of online learning are the learning
1.5. Big Data environment, instructor availability, clear and timely
feedback. Those students who prefer an online course
The advantages of big data technology in usually focus on reducing the cost of travel to the
education include improved learning experience, university. Some learners believe that there are
higher-quality learning, improved market analysis, certain disciplines that they would not like to study
effective decision making, predictable learning and online. Those who prefer traditional learning talk
assessment strategy. Big data technology is used in about the importance of interaction with teachers and
education for several purposes, such as identifying fellow students. Some students believe that they
students at the risk of dropping out; predicting should be taught social skills in college (university).
academic performance; studying student behavior; Low motivation and technical problems were cited as
tracking absenteeism; making course other online learning problems [17].
recommendations; providing instant help and To date, the above technologies have been poorly
assessment; ensuring visual analytics of student introduced into the educational process, but they are
interaction on forums; improving accessibility; commonly used.
promoting research and development; identifying the
risk of non-assimilation of the course by students
[14].
Today, there is an acute problem with the quality 1. In what way would you like to become rich?
and efficiency of online education, including Invest in my business, take risks
engineering education. This study is conducted in Build a career in a company
order to obtain data on the quality of engineering Win the lottery
education and the results of such training. 2. What would you do with money if you made a
The purpose of the study is to determine students' million?
learning outcomes in the context of online education, Put money in the bank and receive%
describe its advantages and disadvantages, as well as Invest in my business
develop recommendations for improvement. Distribute the money between the first and
The objectives of the study include determining the second options
quality of the online platform/course, assessing the 3. If you became rich, would you like to appear in
relevance of the course and students' interest in it, as the papers?
well as determining the effectiveness of the online My name often appears in the media
platform in teaching engineering students. Yes
No
2. Methods and Materials Examples of interview questions:
2.1. Research Design and Sample 1. Are you interested in the topic of this course?
2. What do you think about the quality of this
The research was based on testing and interviews. course?
A similar method was used by Chiu and Chai [18]. 3. Was the information easy to perceive?
4. How did you benefit from the course?
2.2. Survey 5. Would you recommend it to your friends or
family?
The study was attended by 295 engineering
students (19-22 years old) from Kuban State 2.3. Data Analysis and Statistical Processing
Agrarian University named after I.T. Trubilin (the
Russian Federation) and Igor Sikorsky Kyiv The test results were entered into Excel and
Polytechnic Institute (Ukraine) (Table 1). They were analyzed. The interview results were recorded on a
handed out invitations in university campus facilities. SONY voice recorder, transcribed into Word, and
The students were offered to take the online course further analyzed as well. All the results obtained
"Systems Thinking" on the Open Learning platform. were relevant.
The course consists of three modules. The course
topics are (1) What types of situations are we dealing 2.4. Ethical Issues
with? (2) What does “complex system” mean? (3)
Strengthening our systems thinking; (4) Worldview Participation in the study was voluntary. When
and paradigms; (5) Applying systems thinking in life. students were invited to participate, they were
The course tasks can be completed at any time. The handed out printed information about the objectives,
course lasted 3 weeks (from July 26 to August 16, rules and conditions of the study. Students' responses
2021). After that, the participants took a written test were not transferred to third parties and the results
to check the level of knowledge on the topic (August were not disclosed.
17, 2021) and were interviewed about their opinion
on the course (August 19, 2021). The test and 2.5. Research Limitations
interviews were conducted in the classrooms of the
above universities. The results of the study can be considered reliable
as the testing procedure was supervised and the
Table 1. Demographic information
students were not allowed to use any aids but it
Male 160 should be noted that the participants were from only
Gender
Female 135 two universities in Ukraine and the Russian
19-20 185 Federation and their number was limited.
Age
21-22 110
The Russian Federation (Kuban
State Agrarian University named 152
Country after I.T. Trubilin)
Ukraine (Igor Sikorsky Kyiv
143
Polytechnic Institute)
immediately explain any scientific terms or At this stage of the development of technologies in
provide an explanation in the form of text on the education, it is recommended to give preference to
screen. It should be remembered that learners options No. 2 and No. 3 and not to completely
have different levels of knowledge and they abandon traditional education.
could have previously studied other disciplines. It will take universities 4.5 - 8 years to completely
For example, a philologist can take a course on switch from face-to-face classes to the use of
the basics of programming or vice versa. Also, MOOCs. A model of the transition of universities to
older people may not remember the definitions of the massive use of online courses is described below
some terms they studied in college or university. (Table 3).
Pay more attention to the purpose of the course
(audience, age, level of knowledge, etc.). A Table 3. Model for the implementation of MOOC courses
mixed form of courses (for example, lectures + in university programs
practical classes + discussion on the forum) is MOOC implementation stages Duration
suitable for engineering students. They also need The beginning of the use of MOOCs by
a control system (attendance, individual work, students as additional general education
6 months
tests) as young people may not have enough 1 courses. For engineering students, these
- 1 year
motivation to complete the course thoroughly can be cultural studies, business ethics,
and qualitatively. Working people should select management
courses dominated by lectures as while working, The introduction of MOOCs as a source
they can immediately apply theory in practice. of additional advanced information on 1-2
2
university courses (e.g. additional years
For those who are simply interested in the topic
programming languages)
of the course and take it on their own initiative,
Providing an opportunity to take
courses focused on the analysis of real-life MOOCs instead of some face-to-face
examples are good option. courses. The use of MOOCs as a source
Today, MOOCs can be used as an additional 3 of duplicate information to consolidate 2-3 years
resource to educate engineering students. Their use and repeat the material. In the beginning,
these may be history and philosophy
has a number of advantages, such as reducing the
courses.
workload of teachers, ensuring a free schedule, Complete replacement of some
providing an opportunity to study regardless of university courses with MOOCs. It is
location, reducing costs, etc. 1-2
4 necessary to start with non-major
In engineering education, MOOCs can be used in years
disciplines (for example, economics, a
several formats (Table 2). foreign language)
Table 2. MOOCs in engineering education This model can be used by all universities in the
context of all disciplines, including engineering
Students may be offered to take
additional courses, which are not education. However, in the course of its
Completing implementation, it is necessary to constantly monitor
found in the university curriculum,
1 additional the effectiveness of MOOCs by testing the level of
on the MOOC platform in order to
courses students' knowledge (tests, exams).
improve knowledge and broaden
their horizons.
More Students can listen to online 4. Discussion
information courses in order to obtain broader
2
on university information on any disciplines or As mentioned above, in a constantly changing
courses topics that are studied at university environment, young people need to acquire
Students can listen to online knowledge not only in their area of expertise. Each
Repetition of
courses in order to repeat or student should receive basic knowledge of
information
consolidate the information they economics, psychology, management, and other
3 from
learned during the lecture. It can
university subjects in order to be a highly qualified and
also be useful for those who
courses competitive specialist in the labor market. According
missed face-to-face classes.
When circumstances require (for to Spanish scientists, in the modern world, it is not
Replacing enough to have technical competencies and the
example, distance learning, a crisis
face-to-face technical education of the future should be more
4 situation (the Covid-19 pandemic),
university
etc.), students can complete the integrative. Moreover, in the rapidly growing
courses
course online economy, engineers should understand the basic
principles of project management [19]. MOOCs and
other online learning platforms can greatly help with
this.
Today, MOOCs are becoming increasingly auditory, reading / writing, kinesthetic, and
popular among different categories of learners. multimodal (more than two learning styles) [21].
Massive open online courses (MOOCs) have been There is an opinion that it is difficult to become an
considered an alternative to part of traditional classes engineer by studying only remotely. Today many
in higher educational institutions while making the universities are introducing MOOCs into their
learning process more personalized, reducing teacher curricula, but there are still many areas to be
workload and the cost of implementing courses [8]. improved. Recommendations for the improvement of
With the outbreak of the COVID-19 pandemic in online engineering education: increase the quality of
2020, online learning has become the major way to learning and teaching, reduce costs, increase student
keep learning. The first online course was launched satisfaction, increase teacher satisfaction, provide
in Canada in 2008. Today in the Russian Federation, design and maths opportunities, create better labs for
there are three models for the introduction of online online engineering education, allow students to study
courses in higher education: (1) Introduction of from anywhere, establish partnerships, use online
MOOCs in blended learning; (2) Partial replacement learning technologies [22]. However, interactive
of regular courses with online courses; (3) learning technologies are widely used at all stages of
Development of an online master's degree program learning. The role of news resources and websites is
that is based on MOOCs [8]. Since 2020, MOOCs particularly noteworthy [23].
have gained the greatest popularity as the COVID-19
pandemic has created the need for distance learning. 5. Conclusions
In addition, due to the large amount of time spent at
home, many people decided to increase their level of The test results showed that 61% of participants
education, which can be easily done with the help of experienced some difficulties while taking the test.
MOOCs. Thus, the performance of 19% of students was
In the context of MOOCs in engineering
"excellent" (81-100 points); 26% demonstrated
education, scientists from the United States
recommend the use of competency-based learning "good" results (61-80 points); the performance of
(CBL), which implies a pedagogical approach that 42% and 16% of respondents was rated as
focuses on measurable student outcomes [20]. The "satisfactory" (36-60 points) and unsatisfactory (0-35
assessment of student progress is based mainly on points), respectively. The main difficulties in passing
whether he / she has acquired certain skills the test were the application of theoretical knowledge
(competencies). Possession of such competencies in practice and the insufficient number of examples
implies the ability to apply the acquired knowledge in the lectures. The interviews with students showed
in real life situations. To achieve great professional that most of them positively assess the quality of this
outcomes, an engineering student has to possess (1) course. Many participants believe that the course is
leadership abilities; (2) teamwork skills; (3) interesting and relevant today. Some of them are
communication skills; (4) self-reflection; (5) ready to recommend this course to their friends and
interdisciplinary skills; (6) recognition of a acquaintances. However, 69% reported that it was
disciplinary perspective; (7) context awareness; (8)
difficult for them to understand how to apply the
design skills [20]. This approach can help students
learn to apply theoretical knowledge in practice – the information in practice.
skill that young people with no work experience When developing courses, it is recommended to
often lack. As many participants in this study noted, simplify the presentation of the material, to use
putting knowledge into practice is one of the most graphs, schemes, and tables; at the end/beginning of
challenging aspects of online learning. the lecture, to provide its brief summary in the form
In the course of the development of online of a table or theses; to introduce more examples so
courses, it should be borne in mind that despite the that students understand how the information can be
fact that they are designed for a wide audience, each applied in practice; to provide feedback through
student has his/her own learning style. In this regard, forums, chats, email correspondence, etc.; to use
courses should present information so that it can be simple language and explain all the terms found in
comprehended by people with various cognitive the course materials taking into account the fact that
abilities. Researchers from Lithuania concluded that learners can be of different ages, from different
(1) changes in pedagogy are needed to improve
countries, and also with different levels of
student performance; (2) the main success factors in
implementing mobile learning scenarios were the knowledge; to take into account the specifics of the
determination of student learning styles; audience the course is designed for (age, education,
identification and application of suitable learning goals, etc.). At the same time, it is necessary to
activities, methods, goals, tools and mobile constantly monitor the effectiveness of courses by
applications in accordance with the student learning testing the knowledge of students. In the case of
styles; the use of correct sequences and sets of students, it is necessary to use control methods such
teaching methods when implementing mobile as attendance records, independent work, testing as
learning. Learning styles are categorized into visual, one of the reasons why young people do not
complete online courses is the lack of motivation and [7]. Chan, K., Cheung, G., Brown, I., & Luk, G. (2015,
control on the part of teachers and parents. June). Synthesizing technology adoption and learners'
MOOCs can be used in engineering education in approaches towards active learning in higher
several ways: taking additional courses, providing education. In international conference on e-
learning (p. 66). Academic Conferences International
additional information on university courses,
Limited.
repetition of information from university courses, [8]. Radhamani, R., Divakar, A., Nair, A. A., Sivadas, A.,
replacing face-to-face university courses. In addition Mohan, G., Nizar, N., ... & Diwakar, S. (2018,
to MOOCs, it is recommended to use virtual labs and September). Virtual laboratories in biotechnology are
forums, where students are given more opportunities significant educational informatics tools. In 2018
to practice their skills and communicate with peers International Conference on Advances in Computing,
and teachers. Today, it is not recommended to Communications and Informatics (ICACCI) (pp.
abruptly switch to online courses in major university 1547-1551). IEEE.
disciplines. First, they should be used as an auxiliary [9]. Sell, R., Rüütmann, T., & Seiler, S. (2014). Inductive
learning tool and then they can replace part of face- teaching and learning in engineering pedagogy on the
example of remote labs. International Journal of
to-face courses. As for the full transition to online
Engineering Pedagogy (iJEP), 4(4), 12-15.
courses in the future, it is necessary to take into [10]. Mora, H., Ferrández, A., Gil, D., & Peral, J. (2017).
account their effectiveness in mastering a particular A computational method for enabling teaching-
specialty, as well as constantly test the knowledge of learning process in huge online courses and
students during such training. On average, it will take communities. International Review of Research in
universities 4.5 - 8 years to completely switch from Open and Distributed Learning, 18(1), 225-246.
face-to-face classes to the use of MOOCs. [11]. Staubitz, T., Klement, H., Renz, J., Teusner, R., &
The research is a contribution to the study of the Meinel, C. (2015, December). Towards practical
capabilities and quality of online platforms in programming exercises and automated assessment in
engineering education and may be of interest to Massive Open Online Courses. In 2015 IEEE
International Conference on Teaching, Assessment,
students, teachers, university administration, parents
and Learning for Engineering (TALE) (pp. 23-30).
and all those who are interested in modern trends in IEEE.
education. Further research could focus on specific [12]. Montes-Rodríguez, R., Martínez-Rodríguez, J. B., &
aspects of the operation of online learning platforms Ocaña-Fernández, A. (2019). Case Study as a
(for example, ways of providing feedback, and Research Method for Analyzing MOOCs: Presence
analyzing student data). and Characteristics of Those Case Studies in the Main
Scientific Databases. International Review of
References Research in Open and Distributed Learning, 20(3),
59-79.
[1]. Costa, C., Hammond, M., & Younie, S. (2019). [13]. Wilbur, K. (2016). Evaluating the online platform of
Theorising technology in education: An a blended-learning pharmacist continuing education
introduction. Technology, Pedagogy and degree program. Medical education online, 21(1),
Education, 28(4), 395-399. 31832.
[2]. Oakley, B. A., & Sejnowski, T. J. (2019). What we [14]. Bamiah, S. N., Brohi, S. N., & Rad, B. B. (2018).
learned from creating one of the world’s most popular Big data technology in education: Advantages,
MOOCs. NPJ science of learning, 4(1), 1-7. implementations, and challenges. Journal of
[3]. Alqahtani, M. S. M., Bhaskar, C. V., Elumalai, K. V., Engineering Science and Technology, 13, 229-241.
& Abumelha, M. (2018). WhatsApp: An Online [15]. Raoufi, K., Park, K., Khan, M. T. H., Haapala, K. R.,
Platform for University-Level English Language Psenka, C. E., Jackson, K. L., ... & Kim, K. Y. (2019).
Education. Arab World English Journal (AWEJ), 9(4), A cyberlearning platform for enhancing
108-121. undergraduate engineering education in sustainable
[4]. Ang, W., Jedi, A., & Lohgheswary, N. (2021). Factors product design. Journal of Cleaner Production, 211,
affecting the acceptance of open learning as e-learning 730-741.
platform by technical course students. Journal of [16]. Wilson, C. (2013). User interface inspection
Engineering Science and Technology methods: a user-centered design method. Waltham,
(JESTEC), 16(2), 903-918. MA:Morgan Kaufmann Publishers.
[5]. Mora, H., Signes-Pont, M. T., Fuster-Guilló, A., & [17]. Scherrer, C. R., Butler, R. J., & Burns, S. (2010).
Pertegal-Felices, M. L. (2020). A collaborative Student Perceptions of On-Line Education. Advances
working model for enhancing the learning process of in Engineering Education, 2(2), n2.
science & engineering students. Computers in Human [18]. Chiu, T. K., & Chai, C. S. (2020). Sustainable
Behavior, 103, 140-150. curriculum planning for artificial intelligence
[6]. Tadjer, H., Lafifi, Y., Seridi-Bouchelaghem, H., & education: A self-determination theory
Gülseçen, S. (2020). Improving soft skills based on perspective. Sustainability, 12(14), 5568.
students’ traces in problem-based learning [19]. Oberlender, G. D., & Oberlender, G. D.
environments. Interactive Learning Environments, 1- (1993). Project management for engineering and
18. construction (Vol. 2). New York: McGraw-Hill.
[20]. Cajander, Å., Daniels, M., McDermott, R., & von [22]. Bourne, J., Harris, D., & Mayadas, F. (2005). Online
Konsky, B. (2011). Assessing professional skills in engineering education: Learning anywhere,
engineering education. Australian Computer Science anytime. Journal of Engineering Education, 94(1),
Communications, 33(2), 145-154. 131-146.
[21]. Ahmed, J., Shah, K., & Shenoy, N. (2013). How [23]. Lee, S. H., Magjuka, R., Liu, X., & Bonk, C. J.
different are students and their learning (2006). Interactive technologies for effective
styles. International Journal of Research in Medical collaborative learning. International Journal of
Sciences, 1(3), 212-215. Instructional Technology and Distance
Learning, 3(6), 17-32.