Evaluatingvideoconferencingsystemsforthequalityoftheeducationalexperience
Evaluatingvideoconferencingsystemsforthequalityoftheeducationalexperience
Evaluatingvideoconferencingsystemsforthequalityoftheeducationalexperience
net/publication/344405066
CITATIONS READS
123 4,600
3 authors:
Fan Xu
The Ohio State University
5 PUBLICATIONS 126 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Redesigning Basic Statistics course for improving student performance and retention. View project
All content following this page was uploaded by Fan Xu on 28 September 2020.
To cite this article: Ana-Paula Correia , Chenxi Liu & Fan Xu (2020): Evaluating
videoconferencing systems for the quality of the educational experience, Distance Education, DOI:
10.1080/01587919.2020.1821607
ARTICLE
Background
In the context of the COVID-19 pandemic, the impetus for a shift to emergency online distance
teaching has required many educators, teachers, students, parents, and administrators to rely
on videoconferencing systems for synchronous communication. This emergency response to
physical distancing proves to be challenging because it is unprecedent and unplanned.
Schools, colleges, and universities that used to provide online instructional support to small
groups of instructors were not able to respond to all the instructors in a 1- to 2-week period.
This caused an exorbitant amount of stress and anxiety among instructors who were not
familiar with online distance teaching before the pandemic to cope well with the unpredict
able change on their teaching (Hodges et al., 2020). Although well-designed online learning
can carry the same quality as face-to-face learning (Hodges et al., 2020; Milman, 2020), the
necessary time to design, develop, and implement high-quality online teaching and learning
experiences was nonexistent; therefore, emergency distance teaching was the response. The
shift to emergency distance teaching has exacerbated the digital divide and made it difficult to
provide students equal online learning opportunities as well as raising concerns regarding the
accessibility of digital resources, and student data and privacy (Trust, 2020).
Without much instructional guidance, educators turned to what they felt was natural, real-
time communication and tried to replicate the classroom in videoconferencing virtual meet
ings. To make the situation more complex, there is a lack of systematic analysis of
D. A. Kolb (1984) claimed experience is the primary source of learning and development
and introduced experiential education as a contemporary application of experiential
learning theory. He argued that in particular adult learners demand that their life and
professional experiences (e.g., work-related activities, family responsibilities, and previous
education) be incorporated into their learning. More than communication skills and
content knowledge, education systems should contribute to more advanced forms of
intellectual development and permeate the multiple dimensions of human development
demanded by today’s globalization and digital revolution (Correia, 2014).
Experiential learning theory defines learning as “the process whereby knowledge is created
through the transformation of experience” (D. A. Kolb, 1984, p. 38). The focus is on the process
of adaptation and learning as opposed to content or outcomes. Knowledge is continuously
created and recreated, “not an independent identity to be acquired or transmitted” (p. 39).
A. Kolb and Kolb (2005, p. 194) described experiential learning as “a process of constructing
knowledge that involves a creative tension among the four learning modes.” The four learning
modes—concrete experience, reflective observation, abstract conceptualization, and active
experimentation—are organized into a cyclical pattern known as experiential learning
(Figure 1).
Through concrete experience, one observes and feels the world around them, while
reflective observation helps to make sense of that experience on a personal level. Abstract
conceptualization enables one to think and generate new concepts, understandings, and
strategies for action. Active experimentation gives opportunities to practice these concepts,
understandings, and strategies in novel situations, which lead to the next concrete experience.
D. A. Kolb (1984) argued that learners need to be fully immersed in new learning experi
ences and embrace these experiences fully and openly by leaving behind their biases. Learners
should expose themselves to different perspectives and reflect on their learning and growth as
they go through these experiences. They must be able to relate to the new concepts and
integrate their observations in theories and models that support them. Instructional decisions
are then made, and educational problems are solved based on these theories (D. A. Kolb, 1984).
Concrete
experience
Active Reflective
experimentation observation
Abstract
conceptualization
the design and establishment of public and private spaces conducive to the creation of
communities of practice in higher education to facilitate innovation and change
management.
From a social constructivism and sociocultural theory perspective, videoconferencing
systems have the potential to positively impact the online learning and teaching experi
ence. Social constructivism suggests that learning derives from learners’ interaction and
experiences with others (Hagstrom & Wertsch, 2004; Piaget, 1952). Learning happens in
a wide-ranging social system, and people’s learning and development are based on their
involvement in cultural activities. Wiesemes and Wang (2010) argued that the use of
videoconferencing broadens the boundaries of classrooms, mixes the existence of virtual
and real classrooms, and breaks the physical limitations of traditional classrooms. This
increases students’ interaction with their environment, peers, and instructor and expands
their learning experience.
Although videoconferencing can benefit distance education, learners’ perceptions of it
can impact their success (Candarli & Yuksel, 2012). A study conducted by Dogget (2008)
revealed that despite over 80% of students having a positive response to videoconferen
cing, 80% of them claimed that they would feel more comfortable in a traditional class
room. The quality of the videoconferencing system itself was one of the reasons behind
that observation. In 2011, Karal et al. (2011) reported a similar result: students identified
technical problems, such as frequent disconnections, low quality of sound and image, and
time lag between sound and image, as hindering their learning. It is undeniable that the
quality of the videoconferencing system in itself will influence the quality of interactions
and the overall learning experience (M. Martin, 2005). However, it is important to note that
in the last decade videoconferencing systems, in particular web-based systems similar to
Zoom, Skype, Teams, and WhatsApp, have evolved significantly. The current technology
offers higher quality image, sound, and connection, and the time lag between sound and
image has been reduced to 300 ms. (Smith, 2020). Currently, teachers and students have
more experience in using these systems for learning and teaching as well as in their
personal lives.
Using experiential e-learning as the framework for analysis, this study compared four
widely used videoconferencing systems in terms of general and learning-related features
and usability. The results of the analytic evaluation provide guidance when selecting an
effective videoconferencing system for educational purposes. We discuss new teaching
approaches and pedagogies as well as human agency made possible via videoconferen
cing. We also offer a set of recommendations and suggestions for system improvements
to support learning.
Methodology
According to Scriven (1966), evaluation methods generally fall into two categories:
analytic and empirical. Empirical methods involve actual participants and assess how
well a system performs. Analytic methods analyze a system’s features and interpret what
characteristics affect its performance. Table 1 presents examples of analytic and empirical
evaluation methods (Rosson & Carroll, 2002). Although these examples are primarily used
for systems usability evaluation, they also can be applied to a system’s overall evaluation.
6 A. CORREIA ET AL.
Table 1. Examples of analytic and empirical evaluation methods (Rosson & Carroll, 2002, p. 230).
Type of method Example methods
Analytic evaluation: Investigations that involve modeling Claims analysis: system features are analyzed with respect
and analysis of a system’s features and their to positive and negative impacts.
implications for use. Usability inspection: a set of guidelines or an expert’s
general knowledge is used as a basis for identifying or
predicting usability problems.
User models: a representation of the mental structures and
activities assumed during use is developed and
analyzed for complexity, consistency, and so on.
Empirical evaluation: Investigations that involve Controlled experiment: one or more system features are
observation or other data collection from system users. manipulated to see effects on use.
Think-aloud experiment: users think out loud about their
goals, plans, and recreations as they work with
a system.
Field study: surveys or other types of user feedback are
collected from real-world usage settings.
The selection process consisted of three steps to ensure comprehensiveness and reliability.
Firstly, through a comprehensive online search, each of us independently identified at least
three videoconferencing systems that best meet the selection criteria. Removing duplications,
seven videoconferencing systems were collected during this step. Secondly, we reviewed the
initially selected videoconferencing systems together and removed the systems that were
proposed only by only one of us. Two videoconferencing systems were excluded at this point.
Finally, we fully explored the functions of the remaining videoconferencing systems and
identified the final four videoconferencing systems to be evaluated. One videoconferencing
system was excluded because its audience is mainly limited to the People’s Republic of China
and the functions of its web and desktop versions are significantly reduced compared to its
mobile application version. As a result, we selected four prevalent and widely used
DISTANCE EDUCATION 7
Figure 2. Summary of the process used to select the videoconferencing systems to be evaluated.
videoconferencing systems, in the context of online education, for this study: Zoom, Skype,
Teams, and WhatsApp. Between February and April 2020, and in terms of number of users,
Zoom had 300 million daily meeting participants (Warren, 2020); Skype was used by
100 million people on a monthly basis and by 40 million people on a daily basis (Lardinois,
2020); Teams reported 75 million daily active users (Zaveri, 2020); and WhatsApp had 2 billion
users around the globe (WhatsApp, n.d). Figure 2 summarizes the process used to select the
videoconferencing systems evaluated in this study.
tools, breakout rooms, polling and question and answers capabilities, virtual hand-raising,
instant reaction and caption. The learning-related features were then cross-referenced
with the four experiential learning modes: concrete experience, reflective observation,
abstract conceptualization, and active experimentation. The plus sign indicates the pre
sence of the learning-related feature in the videoconferencing system and if this feature
supports each of the experiential learning modes (Table 2). We undertook this determina
tion as a collaborative activity. The degree of agreement among us was high.
● Efficiency as the ability of the system to allow users to use appropriate resources to
perform a specific task with the least amount of waste;
● Effectiveness as the capability of the system to allow users to complete specified
tasks with accuracy and completeness;
● Satisfaction refers to the users’ response in relation to their feelings while using the
system (e.g., happiness, frustration, and anger);
● Learnability relates to how easy it is to learn a system feature in order to achieve
a particular goal;
● Safety is concerned with whether a system limits the risk of harm to users or
damaging other resources, such as hardware or stored information;
● Trustfulness is the confidence a system offers to its users;
● Accessibility is the capability of a system to be used by users with some type of
disability (e.g., visual, hearing and psychomotor);
● Universality concerns on whether a system accommodates a diversity of users with
different cultural backgrounds (e.g., nationality and ethnicity);
DISTANCE EDUCATION 9
● Usefulness relates to the system’s ability to allow users to solve real problems in an
acceptable way.
In regard to the usability criteria, based on the needs of the current study, a few criteria were
excluded (e.g., resource utilization, fault tolerance, load time) and others were combined
(e.g., privacy & security, and flexibility & controllability) from the original QUIM model (Seffah
et al., 2006). Customer service support was added as a new criterion. The usability criteria
used in this study were privacy and security, flexibility and controllability, simplicity, read
ability, self-descriptiveness, user guidance, consistency, familiarity, minimal action, navig
ability, and customer service support (Table 3).
Table 3. Usability criteria adapted from the QUIM model (Seffah et al., 2006, p. 171).
Criteria Description Sub-criteria
Privacy & security Whether users’ personal information is protected & End-to-end code
capability of the system to protect information and data Meeting entry protection
from unauthorized persons or systems. Preview
Background blur
Private conversation
Lock meeting
Waiting room
Enable/disable participants to
record a meeting
Allow participants to be
anonymous
Recording notification
Flexibility & Whether the system can be tailored to match users’ Virtual background
controllability personal preferences & whether users feel that they are System preference setting
in control of the system. Host controllability
Invitation methods
Apps integration
View options
Compatibility
Simplicity Whether irrelevant elements are removed from the user No extraneous elements on
interface without significant loss of information. videoconferencing interface
No significant information loss
Readability Ease with which visual content (e.g., text dialogues) can be Clear visual content
comprehended. Simple and understandable text
Dialogues
Self-descriptiveness Capability of the system to deliver its purpose and offer Visual support
clear user assistance on how it works. Textual assistance
User guidance Whether the user interface provides context-sensitive Error reminder
assistance to the user and meaningful feedback when
errors occur.
Consistency Degree of uniformity among user interface elements and Same-device consistency
whether they offer easy to understand metaphors to Cross-device consistency
users.
Familiarity Whether the user interface offers recognizable elements Follow user design convention
and interactions that the user can easily comprehend.
Minimal action Capability of the system to assist users in completing their Start a meeting
tasks in the least number of steps possible. Join a meeting
In-meeting invitation
Sharing
Instant interaction
Schedule a meeting
Collaboration
Leave a meeting
Navigability Whether users can move around in the system in a well- Clarity of navigation menu
organized way. Efficiency
Customer service Whether the system offers different ways to get help, if the Contact channels
support service is timely and the interaction is pleasant. Service time
10 A. CORREIA ET AL.
Table 4. Associations between usability factors and criteria in the QUIM model (adapted from Seffah
et al., 2006).
Factors
Criteria Efficiency Effectiveness Satisfaction Learnability Safety Trustfulness Accessibility Universality Usefulness
Privacy & security + + + +
Flexibility & + + + + + +
controllability
Simplicity + + +
Readability + +
Self-descriptiveness + + + +
User guidance + + + +
Consistency + + + + +
Familiarity + +
Minimal action + + + +
Navigability + + + + +
Customer service +
support
Reliability process
We used a qualitative approach to establish consistency among our ratings through
extensive and frequent virtual discussions. Combined, we have extensive experience in
teaching, learning technologies, learning design, and human-computer interaction. To
reach agreement, we followed the following process.
First, we reviewed Wild and Wiggins’ (2006) and Seffah et al.’s (2006) instruments
individually for relevancy, clarity, and comprehensiveness in terms of what they were
intended to measure and the purpose of our study. After that, we met via Zoom and
thoroughly discussed both instruments and analyzed each item. The purpose of this
meeting was to identify the level of agreement or disagreement among us in relation
to the operational definitions of the dimensions included in each instrument. The output
from this stage was the final list of the criteria to be used for the analytical evaluation of
the four popular videoconferencing systems. We carried out this task by analyzing each
criterion or item and reaching consensus on to include it in the analytical evaluation or
not. This meant that the three of us had to be in agreement on which criterion to keep and
on which criterion to leave out and provide a rationale for our decision. We used the same
process to select the sub-criteria for the analysis.
Consensus-reaching was preferred over voting because we were committed to make
decisions that everyone actively supported, or at least could live with. We used the same
approach to decision-making throughout the rest of the analytical evaluation.
Results
In the following section, we present the results of the analytical evaluation. The analysis
compared the general features, learning-related features, and usability of each videocon
ferencing systems selected for this study.
DISTANCE EDUCATION 11
Supported Mac OS X with mac OS 10.7 or later Mac OS X 10.10+ (Mac OS X 10.9 does not Mac OS X 10.11 El Capitan+ Mac OS X 10.10+,
desktop Windows 10 (S Mode is not supported)/ support Skype version 8.49.0.49+) Windows Server 2012 R2+, Windows 10, or Windows Windows 8+
operating Windows 8 or 8.1/Windows 7/Windows Vista Windows Desktop 8.1 (64-bit, 32-bit) (64-bit, 32-bit)
systems with SP1+/Windows XP with SP3+ Windows 10 (version 1809) + Linux distribution capable of installing DEB or RPM
Ubuntu 12.04+ 64-bit Ubuntu 14.04+ (Ubuntu 16.04 LTS, 18.04 LTS, Fedora 30
Mint 17.1+ 64-bit Debian 8.0+ Workstation, RHEL 8 Workstation, CentOS 8)
Red Hat Enterprise Linux 6.4+ 64-bit OpenSUSE 13.3+
Oracle Linux 6.4+ 64-bit Fedora Linux 24+
CentOS 6.4+
Fedora 21+
OpenSUSE 13.2+
ArchLinux (64-bit only)
Supported mobile iOS 8.0+ iOS 10.0+ iOS 10.0+ iOS 9.0+
operating Android 5.0+ Android 4.0.4+ Android 8.0+ Android 2.3.7+
systems Blackberry 10 OS 2.1+
Supported IE 11+ Microsoft Edge Internet Explorer 11 Google Chrome
browsers Microsoft Edge 12+ Google Chrome (latest versions) Microsoft Edge Safari
Safari 7+ Not supported on mobile phones or tablets RS2+ Firefox
Firefox 27+ Google Chrome Opera
Google Chrome 30+ Firefox Microsoft Edge
Safari 11.1+
Cost Basic: Free Skype is free, but Skype for Business has Free download Free
Pro: $14.99 per host per month a cost Needs a Microsoft 365 account with the appropriate
Business: $19.99 per host per month Microsoft 365 license plan (with free trial)
Enterprise: $19.99 per host per month
Live meeting One-to-one meetings: unlimited Group video calls: 100 hr per month with no Meetings: The maximum length depends the type of Unlimited
duration Group meetings: 40 min more than 10 hr per day and a limit of 4 hr authentication
per individual video call Live events: 16 hr
Participants per Up to 100 Up to 50 Meetings: up to 250 Up to 4
meeting Live events: up to 20,000
Video or audio call from chat: up to 20
DISTANCE EDUCATION 13
As can be seen, Zoom has the highest number of learning-related features, and WhatsApp
has the lowest.
According to the established protocol for learning-related features analysis, we scored
how the videoconferencing systems supported (or not) the four experiential learning
modes. We followed this protocol because the videoconferencing systems were analyzed
from an online learning and teaching perspective and not merely from an application
design perspective. Consequently, the scores of the learning features related to each
experiential learning mode presented in Table 2 were added up and converted into
a percentage for each videoconferencing systems (Table 7). For example, 100% means
that the system has all the learning features associated with one of the experiential
learning modes. On the other hand, 25% means that the system exhibits only one fourth
of the learning features associated with a particular experiential learning mode.
It is clear from Table 7 that Zoom is the most supportive system for each experiential
learning mode, while WhatsApp is the least supportive. Skype and Teams offer exactly the
same support in relation to each learning mode. The interpretation is offered in the next
paragraphs.
In regard to supporting concrete experience, the screen and application sharing and
in-meeting file transfer features of Zoom, Skype, and Teams assist educators to use
accompanying materials during their lessons. On the other hand, WhatsApp supports
only file transfer during the meeting. Both Zoom and Teams offer annotation tools like
whiteboards, which make it easier for educators to explain content in order to facilitate
learners’ understanding. The instant reaction function of Zoom and Skype, and polling
and question and answer functions of Zoom, Skype, and Teams promote interactive
learning and engagement during the online learning experiences. In addition, educators
14 A. CORREIA ET AL.
can create up to 50 breakout rooms in Zoom and assign learners into groups for discus
sion and activities. Learners can also use the virtual hand-raising function to call their
teacher for help or to request to talk during the lesson. Lastly, Zoom, Skype, and Teams
can add captioning for talks in different languages, which can effectively solve accessi
bility issues and language barriers.
To support reflective observation, educators are able to use the recording and playback
features in Zoom, Skype, and Teams. The recordings of the online learning experiences are
made available to learners, who can playback the teachers’ lecture, peers’ presentations,
or any guest speaker talks. Similarly, the captioning function can support learners’ under
standing of the content taught. Learners may also need to ask questions to the instructor
and/or share comments with the learning community as a result of their own reflections.
Along the same lines, the chat feature, which is supported by all four systems and virtual
hand-raising, which is only supported by Zoom, may be useful as well. Additionally, the
annotation tools offered by Zoom and Teams are useful to capture reflections and keep
comments.
Regarding support of abstract conceptualization, conversations among peers are of
critical importance because they permit knowledge construction through interactions
with each other and the content. Among the selected videoconferencing systems, Zoom
is the one that offers relatively more support to peer discussions with breakout rooms
combined with remote control. Synchronous discussions can take place, and students can
request remote control from the teacher and share their screens with their peers to
facilitate discussion, explain a particular point of view, or offer a demonstration.
Finally, when learners engage in active experimentation, they may need to work as
part of a team or in an individual project that requires multiple conversations with
different stakeholders. For example, a design team that works in an educational pro
blem will use a videoconferencing system to present their solutions. Features like audio
(mute), video (turn off camera), screen and application sharing, remote control, file
transfer, annotation tools, and instant reaction including virtual hand-raising and inter
active functions are indispensable to support effective live presentations. In particular,
the remote control function in Zoom and Teams is an essential feature to support
demonstrations, collaboration, and knowledge construction. This function enables lear
ners to access the system remotely and make selections, edits, and other modifications
to a shared screen.
Usability
When analyzing usability, using the sub-criteria presented in Table 3, we independently
scored each criterion from 1 (not at all satisfied) to 5 (completely satisfied). After that, we
aggregated the scores and averaged them to obtain the final scores of each criterion for
each videoconferencing system (Table 8).
Then, we added up the scores of the criteria associated with each factor and converted
them into a percentage for each videoconferencing system (Table 9). As a result, we were
able to conduct a cross-system comparison between usability criteria and factors. For
example, 90% on efficiency means that the system scored 9 out of the 10 for this factor,
and 35% on usefulness means that the system scored 3.5 out of 10. A system would have
100% on each factor if it reached the full marks on each of them, for example, efficiency =
DISTANCE EDUCATION 15
Table 8. Total usability criteria scores for the four videoconferencing systems.
Criteria Zoom Skype Teams WhatsApp
Privacy & security 4.5 2.5 4 1.5
Flexibility & controllability 4 3 3.5 2
Simplicity 4 4.5 4.5 3.5
Readability 4.5 4.5 4.5 5
Self-descriptiveness 4.5 5 4 5
User guidance 3 5 4.5 4.5
Consistency 4 5 4 2.5
Familiarity 5 5 5 5
Minimal action 5 5 5 4.5
Navigability 4 4.5 2.5 4
Customer service support 5 4 2.5 2.5
Total (out of 55) 47.5 48.0 44.0 40.0
Note. Original scores of each feature are given: 1 (not at all satisfied) to 5 (completely satisfied).
10, effectiveness = 15, satisfaction = 20, learnability = 30, safety = 10, trustfulness = 25,
accessibility = 40, universality = 40, usefulness = 10, for a total of 200.
The final analysis shows that the usability of Skype is the best among the four systems,
followed by Zoom, Teams, and WhatsApp. The biggest differences seem to relate to the
efficiency, effectiveness, safety, satisfaction, and usefulness usability factors.
For the efficiency factor, because the operation procedures among the systems are
similar (e.g., most actions can be completed within 3 steps), navigability becomes the
crucial element in determining the efficiency of a system. Among the four selected
systems, Skype’s navigability is the best due to the simplicity and the fluency of switching
among videoconferencing, chat, and sharing features. All the three features are presented
in the same operation window, and by clicking the associated icons, users do not get lost
easily. In contrast, the navigability of Teams could be improved the most. Although the
setup of its operation window is similar to Skype, the function of each navigation icon on
the left of its operation window is not clearly defined.
In terms of effectiveness, Skype performance is the highest ranked. Besides the efficient
navigability mentioned above, the design of the user interface and the locations of the
different icons are the most consistent and similar across different devices. Although
Skype flexibility and controllability are reduced due to its limited app integration, host
control, and view changing, users still can personalize their user experience by changing
virtual backgrounds, adjusting system preference, and sending different forms of
16 A. CORREIA ET AL.
Discussion
The intent of this study was to explain how four widely used videoconferencing systems
support online education. Since many educators may not be very experienced with
videoconferencing, this analytical evaluation is able to provide recommendations for
each of the systems evaluated regarding its efficacy to support learning. This way,
educators will have an in-depth knowledge of each system and be able to choose the
one that better supports their online teaching needs. Moreover, since the study used
experiential e-learning as a framework, online instructors could also explore this proven
online pedagogy when teaching and supporting their students’ learning. Yet, as some
authors (e.g., T. Anderson, 2008; Lai, 2017) have pointed out, the use of videoconferencing
systems should not be a panacea for addressing online education connectedness and
interaction issues. It is recommended to use a multitude of communication channels
(synchronously and asynchronously) to increase access and opportunities for commu
nication. T. Anderson (2008, p. 121) concluded that when videoconferencing systems are
used exclusively to teach, they offer:
DISTANCE EDUCATION 17
With the global outbreak of COVID-19, colleges and universities have had to employ
videoconferencing systems to contain the spread of the virus. As a result, classes have
moved to virtual and online formats, including lab-based courses and clinical subjects.
According to Moszkowicz et al. (2020), anatomical and medical education can benefit
from the use of these systems since they add pedagogical value. One of the reasons for for
using videoconferencing systems in these classes is the high absenteeism among medical
students for in-person classes that may be overcome with alternatives to deliver instruc
tion. Moreover, videoconferencing systems build the capacity of colleges and universities
to offer academic support that does not require a physical presence on-campus. For
example, Rennar-Potacco and Orellana (2018) described the use of videoconferencing to
support an online program in science, technology, engineering, and mathematics with
respect to its technical, pedagogical, staffing, training, and marketing needs.
The results of this analysis suggest a link between the learning experience and the
chosen system. For example, Zoom, Skype, and Teams support screen sharing, application
sharing, and in-meeting file transfer, which provides educators with a plethora of ways to
exchange and share educational materials. Zoom breakout rooms combined with remote
control support small-group live discussions and group activities. Another example is the
Skype chat feature. Contrary to Zoom, Skype chat supports image files in both animated
and static formats as well as short videos. This functionality makes communication
between teacher and students and among students richer and more expressive.
Conversely, Zoom chat permits only a limited number of emojis and file sharing.
Lawson et al. (2010, p. 302) claimed that “other uses of videoconferencing equipment
in higher education have sought to move beyond traditional styles of teaching and
learning and develop new pedagogies appropriate for the more innovative potential of
the technology.” For example, videoconferencing systems support learner-centered vir
tual classrooms and learning activities such as role-plays, simulations, and group work.
They create interactions that make students forget the physical distance (R. Anderson
et al., 2003; Smyth, 2005).
As distance education as a field responds to the disruption caused by the COVID-19
pandemic and videoconferencing systems improve their functionality, it is important not
to forget human agency in this transformation. Humans act and make decisions based on
their experiences, reflections, self-determination, and motivation. The design and optimi
zation of web-based videoconferencing systems should advance toward a more human-
centered approach. For example, the new generation of web-based videoconferencing
systems should give learners and educators alike opportunities to make choices and take
advantage of the system to improve the virtual learning experience, instead of limiting it
because of restricted system functionality.
Another related issue is how to mitigate the distance that may hinder interactions
between teachers and students, students and students, and students and content is one
of the important challenges for the future of videoconferencing systems (R. Anderson et al.,
18 A. CORREIA ET AL.
2003). We therefore present a set of recommendations and suggestions for designers and
developers of videoconferencing systems to be used in learning, teaching, and training.
Zoom
As a cloud-based videoconferencing system that has developed rapidly over the past
couple of years, Zoom stands out among the selected systems due to its relativity higher
cost and performance ratio. Compared with the other systems, Zoom free version best
supports learners to incorporate their experiences into online learning by offering the
most learning-related features that correlate to the four experiential learning modes (see
Tables 6 and 7). Although in terms of the maximum number of participants for each
meeting, Teams performs better than Zoom, due to its free trial time limit, users cannot
utilize this advantage for a long time without cost. Therefore, under the premise of long-
term use and low cost, Zoom is suitable for small and middle-sized organizations and
cheaper if users need to meet only for less than or equal to 40 min. Although Zoom’s
overall usability is not the highest ranked in this analysis, if users require the highest levels
of safety, trustfulness, and usefulness, they should definitely choose Zoom.
Under the premise of good overall performance, Zoom’s usability is relatively weaker
when compared to the other systems. Therefore, usability should be the primary focus of
its improvement, in particular regarding user guidance. When operational errors occur,
clear and sufficient user guidance, such as text reminders, should be provided so that
users can correct their incorrect operations in time without confusion. This can improve
the user’s satisfaction with the system and improve the overall online learning experience.
Skype
If users value a system’s overall usability, Skype stands out from the selected systems. For
the nine factors contributing to a system’s usability, Skype scores highest (85% or higher –
see Tables 8 and 9) on five of them, which are efficiency, satisfaction, learnability,
accessibility, and universality. This means that Skype can enable users to achieve their
desired results accurately and completely by spending fewer resources. Additionally,
Skype can hold up to 50 participants per meeting and scores second in each experiential
learning mode (see Table 7). Therefore, Skype is an option for small organizations seeking
a videoconferencing system with good usability to support online learning. However, the
primary drawbacks of Skype are its usefulness and safety. If these are two critical factors
for users, then they should consider Skype carefully.
Even though Skype has the highest usability scores (see Tables 8 and 9), it could
increase its performance by improving privacy and security and flexibility and controll
ability. Unlike flexibility and controllability that cater to a learner’s need for autonomy,
privacy and security protect learners’ personal information and safeguard the learning
experience. Therefore, such an improvement would provide a safer and more trustworthy
distance education environment. Besides, improving the system’s flexibility and controll
ability has the potential to increase learners’ autonomy and motivation.
DISTANCE EDUCATION 19
Teams
Teams is a solid cross-platform tool. A total of 250 participants can join in one regular meeting,
but the meeting length depends on the type of authentication. Teams’ system provides many
functions for learners, such as a well-developed chat function, captioning, and remote control
(see Table 6). While Teams does not support breakout rooms during a meeting and virtual
hand-raising, it may not be suitable for times where students need to be divided into small
groups for discussion or teamwork. As for usability, the system ranks high on learnability (85%
or higher—see Table 9), but its effectiveness and usefulness are unsatisfactory mainly because
its navigation bars are sometimes complicated and confusing.
With regard to customer service support and navigability, Teams ranked low (see Table 8).
The current customer support from Teams has difficulty in helping to solve their specific issues
with the system in a timely fashion. Therefore, a pressing improvement is to optimize
customer service and provide better user support so that users can use its features with
a lower level of difficulty. Along the same lines, navigability is an issue with Teams.
Improvements in the clarity of the navigation menu and system organization are necessary.
WhatsApp
WhatsApp is an efficient system with high navigability and minimal actions to set up
a videoconference. The system user interface is simple and consistent, visually self-
descriptive, and offers textual assistants, as well as user guidance when errors occur.
Even beginners of this system will learn it quickly. Consequently, efficiency and learn
ability are the two highest scored usability factors of WhatsApp (see Table 9). When
compared to the other systems, the biggest advantage of WhatsApp is cost (see Table 5).
The system allows up to four people to communicate for unlimited time across the globe
at no cost. However, compared to Zoom, Skype, and Teams, WhatsApp is inferior in
creating and supporting online teaching and learning (see Table 6). Because WhatsApp
offers only audio, video, chat, and file transfer functions, it may be suitable only for small
group discussions and mini-scale conferences. In addition, the poor scores for privacy and
security (see Table 8) puts WhatsApp at a disadvantage when supporting online learning
and protecting learners.
WhatsApp has the lowest usability scores (see Tables 8 and 9), in particular regarding
privacy and security, flexibility and controllability, consistency, and customer service
support. These are the necessary areas for improvement. Additionally, the current version
of WhatsApp does not support desktops or desktop devices, which makes communication
between teachers and students and among peers more cumbersome. For WhatsApp to
be used more broadly for educational purposes, it needs to include additional function
ality such as screen and application sharing, remote control, file transfer, and annotation
tools. Besides, increasing the system’s privacy and security should be the top priority for
system optimization.
Conclusion
As Calvert (2005) explained, correspondence education was the first and widely used
model of distance education, which then evolved to using audio and videoconferencing
20 A. CORREIA ET AL.
to teach students in remote areas who could not come physically to schools and
campuses. The COVID-19 pandemic is pressing educators around the work to rethink
distance education and bring back some of these early models as well as expanding them
to kindergarten to 12th grade school settings. But such resurgence is also pushing
distance education as a field to reimagine these models. New teaching approaches and
pedagogies, such as experiential e-learning, are positioning videoconferencing systems at
the center of this advancement. This study offers current insights into a larger body of
literature on videoconferencing systems and the quality of the online learning and
teaching experience, in particular about web-based systems like Zoom, Skype, Teams,
and WhatsApp.
With the growing need for innovation in distance education, especially under the
current pandemic situation, web-based videoconferencing systems will mature into
more comprehensive systems with the human experience at the core of their function
ality. Schools and universities will undertake intense organizational renewal and put in
place bottom-up processes (e.g., informed by student voices). Informal and experiential
learning will be essential to the reimagining of distance education. “We learn this
together” will join the “We are in this together” mantra with educators and learners
around the world informing the creation of the new generation of web-based videocon
ferencing systems. Potential features of these systems are, as follows, just to mention
a few:
In their extensive review of distance education, Zawacki-Richter and Naidu (2016, p. 245)
found three “waves” of research perspective in this field: “(1) consolidation of distance
education institutions and instructional design; (2) quality assurance and student support,
and (3) the virtual university, and online interaction and learning.” They went on predict
ing that “the future for distance education looks bright and promising. In fact, there has
never been a better time to be in the field of open, flexible, distance and online education
than now!” (p. 264). The disruption that educators and learners are experiencing in 2020
due to a global health crisis and social distancing creates a drive to push the boundaries of
distance education models and calls for the thoughtful optimization of videoconferencing
systems to support learning.
Disclosure statement
No potential conflict of interest was declared by the authors.
DISTANCE EDUCATION 21
Notes on contributors
Ana-Paula Correia is an associate professor of learning technologies and the director of the Center
on Education and Training for Employment at The Ohio State University. Correia’s research is
focused on learning technologies, learning design, and curriculum development. Her work has
been published in 55 peer-reviewed journals and books.
Chenxi Liu is a doctoral student of learning technologies at The Ohio State University and a graduate
research assistant at the Center on Education and Learning for Employment. Liu worked as
a language teacher and TV director. Her research interests include mobile learning, educational
technology design, and learning experience design.
Fan Xu is a doctoral student of learning technologies at The Ohio State University and a graduate
research assistant at the Center on Education and Learning for Employment. Xu has worked as an
instructional designer for online courses and training. Her research interests include instructional
design, computational thinking, and learning analytics.
ORCID
Ana-Paula Correia http://orcid.org/0000-0003-0806-7835
References
Al-Samarraie, H. (2019). A Scoping review of videoconferencing systems in higher education:
Learning paradigms, opportunities, and challenges. International Review of Research in Open
and Distributed Learning, 20(3). https://doi.org/10.19173/irrodl.v20i4.4037
Anderson, R., Beavers, J., VanDeGrift, T., & Videon, F. (2003). Videoconferencing and presentation
support for synchronous distance learning. In EP Innovations (Ed.), 33rd Annual Frontiers in
Education Conference (pp. F3F–13). IEEE. https://doi.org/10.1109/FIE.2003.1264746
Anderson, T. (2008). Is videoconferencing the killer app for K12 distance education? Journal of
Distance Education, 22(2), 109–124. http://www.ijede.ca/index.php/jde/article/view/18
Andrews, T., & Klease, G. (1998). Challenges of multisite video conferencing: The development of an
alternative teaching/learning model. Australasian Journal of Educational Technology, 14(2), 88–97.
https://doi.org/10.14742/ajet.1902
Bias, R. G., & Mayhew, D. J. (Eds.). (1994). Cost-justifying usability. Academic Press. https://dl.acm.org/
doi/book/10.5555/186524
Calvert, J. (2005). Distance education at the crossroads. Distance Education, 26(2), 227–238. https://
doi.org/10.1080/01587910500168876
Candarli, D., & Yuksel, H. G. (2012). Students’ perceptions of video-conferencing in the classrooms in
higher education. Procedia-Social and Behavioral Sciences, 47, 357–361. https://doi.org/10.1016/j.
sbspro.2012.06.663
Carver, R., King, R., Hannum, W., & Fowler, B. (2007). Toward a model of experiential elearning.
MERLOT Journal of Online Learning and Teaching, 3(3), 247–256. https://jolt.merlot.org/vol3no3/
hannum.pdf
Correia, A.-P. (2008). Moving from theory to real-world experiences in an e-learning community.
Innovate: Journal of Online Education, 4 (4).Article 2. https://nsuworks.nova.edu/innovate/vol4/
iss4/2/
Correia, A.-P. (2014). Creating scurriculum within the context of an enterprise. In M. Gosper &
D. Ifenthaler (Eds.), Curriculum Models for the 21st Century: Using Learning Technologies in Higher
Education (pp. 113–134). Springer. https://link.springer.com/chapter/10.1007/978-1-4614-7366-4_7
Doering, A. (2007). Adventure learning: Situation learning in an authentic context. Innovate: Journal
of Online Education, 3 (6).Article 4. https://nsuworks.nova.edu/innovate/vol3/iss6/4
22 A. CORREIA ET AL.
Lawson, T., Comber, C., Gage, J., & Cullum-Hanshaw, A. (2010). Images of the future for education
videoconferencing: A literature review. Technology, Pedagogy and Education, 19(3), 295–314.
https://doi.org/10.1080/1475939X.2010.513761
Martin, F., Parker, M. A., & Deale, D. F. (2012). Examining interactivity in synchronous virtual
classrooms. International Review of Research in Open and Distributed Learning, 13(3), 227–261.
https://doi.org/10.19173/irrodl.v13i3.1174
Martin, M. (2005). Seeing is believing: The role of videoconferencing in distance learning. British Journal
of Educational Technology, 36(3), 397–405. https://doi.org/10.1111/j.1467-8535.2005.00471.x
McLoughlin, C., & Luca, J. (2002). A learner-centered approach to developing team skills through
web-based learning and assessment. British Journal of Educational Technology, 33(5),571–582.
https://doi.org/10.1111/1467-8535.00292
Milman, N. B. (2020, March 30). This is emergency remote teaching, not just online teaching.
Education Week. https://www.edweek.org/ew/articles/2020/03/30/this-is-emergency-remote-
teaching-not-just.html
Moszkowicz, D., Duboc, H., Dubertret, C., Roux, D., & Bretagnol, F. (2020). Daily medical education for
confined students during coronavirus disease 2019 pandemic: A simple videoconference
solution. Clinical Anatomy, 33(6), 927–928. https://doi.org/10.1002/ca.23601
Nielsen, J. (1993). Usability engineering. Morgan Kaufmann. https://doi.org/10.1016/C2009-0-21512-1
Nielsen, J., & Mack, R. L. (Eds.). (1994). Usability inspection methods. John Wiley & Sons.
Piaget, J. (1952). The origins of intelligence in children (M. Cook, Trans.). W. W. Norton & Co. https://
doi.org/10.1037/11494-000
Reaburn, P., & McDonald, J. (2017). Creating and facilitating communities of practice in higher
education: Theory to practice in a regional Australian university. In J. McDonald & A. Cater-Steel
(Eds.), Communities of practice (pp. 121–150). Springer.
Rehn, N., Maor, D., & McConney, A. (2016). Investigating teacher presence in courses using synchro
nous videoconferencing. Distance Education, 37(3), 302–316. https://doi.org/10.1080/01587919.
2016.1232157
Rennar-Potacco, D., & Orellana, A. (2018). Academically supporting STEM students from a distance
through videoconferencing: Lessons learned. American Journal of Distance Education, 32(2),
131–149. https://doi.org/10.1080/08923647.2018.1446121
Rosson, M. B., & Carroll, J. M. (2002). Usability engineering: Scenario–based development of human–
computer interaction. Academic Press.
Scriven, M. (1966). The methodology of evaluation (ED4014001). Purdue University. ERIC. https://files.
eric.ed.gov/fulltext/ED014001.pdf
Seffah, A., Donyaee, M., Kline, R. B., & Padda, H. K. (2006). Usability measurement and metrics:
A consolidated model. Software Quality Journal, 14(2), 159–178. https://doi.org/10.1007/s11219-
006-7600-8
Smith. E. (2020, March 11). Why conference call technology never works. Motherboard Tech by Vice.
https://www.vice.com/en_us/article/y3mxyw/why-conference-call-technology-never-works
Smyth, R. (2005). Broadband videoconferencing as a tool for learner-centred distance learning in
higher education. British Journal of Educational Technology, 36(5), 805–820. https://doi.org/10.
1111/j.1467-8535.2005.00499.x
Sondak, N. E., & Sondak, E. M. (1995). Video conferencing: The next wave for international business
communication. In Proceedings of the Annual Conference on Languages and Communication for
World Business and the Professions (pp. 1–10). https://www.learntechlib.org/p/80886/
Trust, T. (2020, April 2). The 3 biggest remote teaching concerns we need to solve now. EdSurge.
https://www.edsurge.com/news/2020-04-02-the-3-biggest-remote-teaching-concerns-we-need-
to-solve-now
Warren, T. (2020, April 23). Zoom grows to 300 million meeting participants despite security
backlash. The Verge. https://www.theverge.com/2020/4/23/21232401/zoom-300-million-users-
growth-coronavirus-pandemic-security-privacy-concerns-response
WhatsApp. (n.d.). About WhatsApp. https://www.whatsapp.com/about/
Wiesemes, R., & Wang, R. (2010). Video conferencing for opening classroom doors in initial teacher
education: Sociocultural processes of mimicking and improvisation. International Journal of
24 A. CORREIA ET AL.