Best Example by Henk - Research Proposal 1
Best Example by Henk - Research Proposal 1
Best Example by Henk - Research Proposal 1
Instructional videos are increasingly used in education but the learning effectiveness of those videos is
not yet optimal. To achieve optimal learning effectiveness, it is important that the learner engages in
adequate information processing in order to recall the content. Next to the cognitive processes,
motivation of the learner has an effect on the retrieval of memory. A review (summary) could be a
possible solution to make sure that the learner engages in the right information processing. In
addition, it is expected that the review enhances self-efficacy and compensates for little self-regulated
learning skills. This research aims to investigate the effects of reviews in an instructional conceptual
video on primary school (i.e. grade 8-9) children’s retention and motivation.
The expected cognitive and motivational effects of reviews will be investigated using an
experimental design and by means of interviews. Within the timeframe, knowledge tests, self-efficacy
tests and self-regulated learning tests are administered. The control group will receive an instructional
video without the presence of a review, whereas the experimental group will receive an instructional
video with reviews included. After the experiment, interviews are held. Subsequently, ANOVAs will
be used to analyse the effect of the different conditions on video engagement, motivation and
retention. The interviews will be analysed using a hybrid coding scheme. In order to provide in depth
recommendations for design based principles, cognitive and motivational effects are taken into
account. Furthermore, this research will shed light on the previous proven effectiveness of summaries
in text, with regard to videos.
‘What is the effect of reviews in instructional conceptual video on primary school children’s (i.e.
grade 8-9) learning outcomes and motivation? ‘
1)To what extent does a review influence children’s immediate and delayed post-retention of
an instructional video?
2)To what extent does a review influence children’s video interaction, self-efficacy and self-
regulation?
3) How do children experience reviews regarding learning and motivation?
2.2. RESPONDENTS
Approximately 50 children in grade 8-9 of primary school will participate in this study. Based
on convenience sampling two classes of grade 8-9 of different schools are selected. To assure that
differences in children outcomes cannot be ascribed by factors of the school, children are randomly
assigned to condition, after stratification for classroom. When examining group differences, a
prerequisite for a relative high power is that there are approximately 20 children per condition
(Wilson Van Hoorhis & Morgan, 2007).
2.3 INSTRUMENTATION
A variety of instruments is used to collect relevant data in the different phases of this research.
In order to investigate the effect of reviews, four reviews will be developed and incorporated into an
existing instructional video. When the children are watching the videos, user logs will be used in
order to examine the children’s engagement with the video.
In addition, a couple of tests are used. First, knowledge tests are used in order to asses factual
knowledge. A pre-test, immediate domain knowledge test and delayed domain knowledge test are
administered. The assessed content will be aligned with the theory discussed in the instructional video
and the tests are developed on the basis of Bloom’s Taxonomy (Jones, Harland, Reid & Barlett, 2009).
Second, self-efficacy will be measured with the Initial Self-Efficacy Questionnaire (ISEQ) and the
Final Self-Efficacy Questionnaire (FSEQ) (Rheinberg, Vollmeyer & Burns, 2001). This test is
previously used in empirical studies who examined the effect of reviews in procedural knowledge
videos on self-efficacy (e.g. van der Meij et al. 2018; van der Meij, 2017). The survey is based on a 7-
point Likert scale and four questions are asked per timepoint. An example question from the ISEQ is:
‘How much do you know about this topic?’ Third, a self-regulation test (MSLQ) is administered in
order to determine the level of self-regulation (Duncan & McKeachie, 2005; Pintrich & Smith, 1993).
The learning-strategies scale (cognitive) will be used for this research because this examines the
concept of self-regulation targeted with this research. Ledoux, Meijer, Van der Veen and Breetvelt
(2013) examined the psychometric quality of the instrument and report that the MSLQ is a reliable
and valid instrument to use. The scale will be translated in Dutch and quality will be assessed prior to
using it. Also, all instruments will be pilot-tested to ensure that the instruments are appropriate to use.
For the qualitative part, an interview guide is developed to investigate children’s view
regarding the review. A grounded theory lens is used because sensitizing concepts from the theoretical
framework are used to develop the interview guide. While administering the interviews, story-
eliciting techniques will be used which is recommended in research with children (Flick, 2018).
2.4 PROCEDURE
Before data will be gathered, the ethics commission of the University of Twente will be asked
for permission. The participating children and their parents will be asked for consent, after they are
informed about the purpose of this study. The measurements and interviews will be conducted during
school hours at the primary school of the children. In the first meeting, three pre-tests are
administered, namely a prior knowledge test, a self-efficacy test and a self-regulation test. What
follows is the instructional video (with or without reviews present). While watching the instructional
video, user logs are administered. When children have watched the video, they fill in a domain
knowledge test, a self-efficacy test and a self-regulation test.
After 2 weeks, a second meeting will be planned. During this meeting, a delayed retention test
will be administered followed by focus groups. A focus group is chosen because more information can
be gathered in a short amount of time in comparison with one-to-one interviews (Flick, 2018). By
means of stratified random sampling, only children from the experimental group will be selected for
the interview because the aim of this research is to get insight in the experiences of children with
reviews. The interviews will be recorded and transcribed, so that the researcher can focus on the
interview itself. As discussed with the teacher, the children will be thanked for their participation in
this study through doing the ‘Freek Vonk Game’. When the teacher would like to know the outcomes
of the study, he/she could indicate to receive an infographic with important findings.
3. PLANNING
3.1 TIMELINE
3.2 OUTPUT
Table 1 provides a planning of this research project. The table shows when which activities
take place. The darkest colours indicate different parts of the project and the aimed week for delivery
or finishing and the lightest colours indicate sub activities of those parts. As indicated in the table, the
project starts in July and intends to be finished at the end of January 2020.
First, an analysis of the target group and theories regarding the to be developed product
(review) is made. Second, instruments are created and data can be collected. Third, the data is
analysed and will inform the answering of the research questions. Finally, everything can be brought
together in the product of the thesis.
REFERENCES
Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NJ: Freeman. Retrieved from:
https://www.worldcat.org/title/self-efficacy-the-exercise-of-control/oclc/36074515
Bembenutty, H., & Karabenick, S. A. (2004). Inherent association between academic delay of
gratification, future time perspective, and self-regulated learning. Educational Psychology
Review, 16(1), 35-57. doi: 10.1023/B:EDPR.0000012344.34008.5c
Brar, J., & van der Meij, H. (2017). Complex software training: Harnessing and optimizing
video instruction. Computers in Human Behavior, 70, 475-485.
doi:10.1016/j.chb.2017.01.014
Cabi, E. (2018). The Impact of the Flipped Classroom Model on Students' Academic
Achievement. International Review of Research in Open and Distributed Learning, 19(3).
doi: 10.19173/irrodl.v19i3.3482
Colton, D., & Covert, R. W. (2007). Designing and constructing instruments for social research and
evaluation: John Wiley & Sons.
Davis, F. (1989). Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information
Technology. MIS Quarterly,13(3), 319-340. doi:10.2307/249008
De Boer, H., Donker-Bergstra, A. S., Kostons, D. D. N. M., Korpershoek, H., & van der Werf, M. P.
(2013). Effective strategies for self-regulated learning: A meta-analysis. Groningen, NL:
GION/RUG. Retrieved from:
https://www.nro.nl/wp-content/uploads/2014/05/PROO_Effective+strategies+for+self-
regulated+learning.pdf
De Koning, B. B., Hoogerheide, V. V., & Boucheix, J. M. J. M. (2018). Developments and Trends in
Learning with Instructional Video. Computers in Human Behavior, 89, 395-398.
doi:.10.1016/j.chb.2018.08.055
Duncan, T. G., & McKeachie, W. J. (2005). The Making of the Motivated Strategies for Learning
Questionnaire. Educational Psychologist, 40(2), 117-128. doi: 10.1207/s15326985ep4002_6
Field, A.P. (2005). Discovering statistics using SPSS (2nd edition). London: Sage.
Gabriel, R. F., & Mayzner, M. S. (1963). Information ‘‘chunking’’ and short-term retention. Journal
of Psychology: Interdisciplinary and Applied, 56, 161-164. doi:10.1037/h0043158
Hartley, J., Goldie, M., & Steen, L. (1979). The role and position of summaries: some issues and data.
Educational Review, 31(1), 59–65. doi:10.1080/0013191790310107
Jones, K. O., Harland, J., Reid, J. M., & Bartlett, R. (2009, October). Relationship between
examination questions and Bloom's taxonomy. In 2009 39th IEEE Frontiers in Education
Conference (pp. 1-6). IEEE.
Juvina, I., Larue, O., & Hough, A. (2018). Modeling valuation and core affect in a cognitive
architecture: The impact of valence and arousal on memory and decision-making. Cognitive
Systems Research, 48, 4–24. doi: 10.1016/j.cogsys.2017.06.002
De Koning, B. B., Hoogerheide, V. V., & Boucheix, J. M. J. M. (2018). Developments and Trends in
Learning with Instructional Video. Computers in Human Behavior, 89, 395-398.
doi:.10.1016/j.chb.2018.08.055
Kostons, D., Donker, A., & Opdenakker, M. (2014). Zelfgestuurd leren in de onderwijspraktijk. Een
kennisbasis voor effectieve strategie-instructie. Groningen: GION onderzoek/onderwijs.
Retrieved from: https://www.nro.nl/wp-content/uploads/2015/02/Opdenakker_Zelfgestuurd-
leren-in-de-onderwijspraktijk.pdf
Hartley, J. & Trueman, M. (1982). The effects of summaries on the recall of information from prose:
five experimental studies. Human Learning, 1, 63-82. doi: 10.1007/BF02684519
Lam, S., Wong, B. P. H., Yang, H. & Lui Y. (2012). Understanding student engagement with a
contextual model, in Handbook of Research on Student Engagement, S. L. Christenson, A.
L. Reschly, C. Wylie, Eds., New York: Springer, pp. 403-419.
Ledoux, G., Meijer, J., Veen, I. van der, & Breetvelt, I. (2013). Meetinstrumenten voor sociale
competenties, metacognitie en advanced skills. Een inventarisatie. Amsterdam: Kohnstamm
Instituut. (Rapport 900).
Leman, P., Bremner, A., Gauvain. M., & Parke, R. (2012). Developmental Psychology. Mcgraw-Hill
Education: New York.
Lorch, R. F. (1989). Text-signaling devices and their effects on reading and memory
processes. Educational Psychology Review, 1(3), 209-234. doi: 10.1007/BF01320135
Mayer, R., & Mayer, R. E. (Eds.). (2015). The Cambridge handbook of multimedia learning. New
York, NY, US: Cambridge university press
McLaughlin Cook, N. (1981) Summaries: further issues and data, Educational Review, 33:3, 215-
222. doi: 10.1080/0013191810330305
Van der Meij, H., & van der Meij, J. (2016a). The effects of reviews in video tutorials. Journal of
Computer Assisted Learning, 32(4), 332-344. doi: 10.1111/jcal.12136
Van der Meij, H., & van der Meij, J. (2016b). Demonstration-based training (DBT) in the design of a
video tutorial for software training. Instructional Science, 44(6), 527-542. doi:
10.1007/s11251-016-9394-9
Van der Meij, H. (2017). Reviews in instructional video. Computers & Education, 114, 164-174. doi:
10.1016/j.compedu.2017.07.002
Van der Meij, H., Van der Meij, J., Voerman, T., & Duipmans, E. (2018). Supporting motivation, task
performance and retention in video tutorials for software training. Educational Technology
Research and Development, 66(3), 597-614. doi: 10.1007/s11423-017-9560-z
Van der Meij, M. & Dunkel, P. (2019). Effects of a review and practice in video-based statistics.
Article in preparation.
Pan, C.C. (Sam), Sivo, S., Gunter, G., & Cornell, R. (2005). Students’ Perceived Ease of Use of an
eLearning Management System: An Exogenous or Endogenous Variable? Journal of
Educational Computing Research, 33(3), 285–307. Retrieved from
http://search.ebscohost.com.ezproxy2.utwente.nl/login.aspx?
direct=true&db=eric&AN=EJ739141&site=ehost-live
Pintrich, P. R., & Smith, D. A. F. (1993). Reliability and predictive validity of the motivated strategies
for learning questionnaire (MSLQ). Educational and psychological measurement : a
quarterly journal devoted to the development and application of measures of individual
differences, 53(3), 801-813. doi: 10.1177/0013164493053003024
Rheinberg, F., Vollmeyer, R., & Burns, B. D. (2001). QCM: A questionnaire to assess current
motivation in learning situations. Diagnostica, 47(2), 57-66. doi:10.1026//0012-1924.47.2.57
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic
motivation, social development, and well-being. American Psychologist, 55(1), 68-87. doi:
10.1037/0003-066X.55.1.68
Smallhorn, M. (2017). The flipped classroom: A learning model to increase student engagement not
academic achievement. Student Success, 8(2), 43-53. doi: 10.5204/ssj.v8i2.381
Sun, J. C. Y., Wu, Y. T., & Lee, W. I. (2017). The effect of the flipped classroom approach to
OpenCourseWare instruction on students’ self‐regulation. British Journal of Educational
Technology, 48(3), 713-729. doi: 10.1111/bjet.12444
Wilson Van Voorhis, C. R., & Morgan, B. L. (2007). Understanding power and rules of thumb for
determining sample sizes. Tutorials in Quantitative Methods for Psychology, 3(2), 43-50. doi:
10.20982/tqmp.03.2.p043
Woolfolk, A., Perry, N. E., & Winne, P. H. (2004). Educational psychology. Toronto: Allyn and
Bacon.
Wulf, G., & Lewthwaite, R. (2016). Optimizing performance through intrinsic motivation and
attention for learning: The OPTIMAL theory of motor learning. Psychonomic Bulletin &
Review, 23(5), 1382-1414. doi:10.3758/s13423-015-0999-9