Paper Rubric
Paper Rubric
Paper Rubric
Abstract: Student’s satisfaction is the core of teaching and it is [4] Addie has been used as a base model to ideate precision in
continuous learning process. In order to achieve this author have medicine domain. In [5-7] various approaches for the usage of
experimented with rubrics, ADDIE and Gagne model to deliver Addie have been explained, it is used in the domain of moral
the topic thread in java subject. Detail rubrics with four criteria education, early childhood education as well as open online
and four levels have been designed and performance has been
course to develop the professionalism in a teacher profession.
evaluated after delivery of specific topic by using one of the
educational models. Paired student’s t-test has been used to In short Impact of Addie model has already been proven in
evaluate the before the after impact and statistical significance. versatile domain. In this study author has experimented the
Results have been retrieved at 99%, 95% and 90% confidence delivery steps of Addie model for the performance
interval. Criteria 1 and Criteria 2 has not retrieved significant enhancement of programming subject along with the
results at alpha=0.01 and hence failed to reject the null hypothesis coordination of well design rubrics.in[8-10] usage of gagne
in Gagne and Rubrics model respectively. The entire set model in the various domain has been explained. In [11-15]
hypothesis has rejected the null hypothesis at alpha=0.05 and importance of rubrics in the assessment and its designed
alpha=0.10.The survey has been conducted for ADDIE and
parameters are explained. Rubrics have played a very
Gagne group at the end of this experimentation. This study has
proven that to deliver programming subject steps of ADDIE model important role in the area of design thinking and working
is more appropriate. practices. Rest of the paper is divided into sections
Keywords: Addie, Gagne, Rubrics, Statistical test methodology, result, discussion and results.Methodolgy
section gives the insight of identification of students in the
I. INTRODUCTION study and application of steps of rubrics, Addie and gagne. In
result section hypothesis statistical test and individual subject
In education delivery of contents is an art.In this work we level performance analysis result has been retrieved. And the
have experimented with popular 3 educational models and results are discussed in detail in discussion section. Study has
importance of known rubrics in advance. To check the impact been concluded in conclusion section.
of educational model on programming subject java, on
specific topic thread as it assumes to be difficult to understand II. METHODOlOGY
and implement for the students as per verbal enquire about the
subject. Addie model has been used in the literature in various In this section approach used in this study has been discussed along
domains. Proposed elements in this study have been used in with the criteria for inclusion and exclusion of subject in study.
versatile domain in literature. This model has designed in A. ADDIE Model
such a way that in every academic as well as related field steps This educational model involves five major steps analysis,
of this model can be introduced to check the performance design, development, implementation and evaluation. First
impact, comparison impact and so on. In [1] Addie model has phase mainly focus on the appropriate sample inclusion to
been used for the feature driven development agile method deliver the expected product. In order to deliver the topic by
and has given the new dimension to though process of usage adopting the steps of ADDIE model author have moulded
of model. Language learning assumed to be very difficult after entire instruction sets of topics in the skeleton of Addie
the person cross the certain age or one can say learning model. Analysis phase has been fulfilled by identifying the
process slower down as the age progresses but in [2] author appropriate sets of students, outcome of the course has been
has clearly made use of Addie model for the development of decided by setting the hypothesis to gain the enhancement in
educational model. This model has versatile application and the criteria level, as input criteria level to this study is the
many found them useful as the performance enhancer, in [3] output generated by case 1 study, author has set the hypothesis
this model has been used to sensitize the postgraduate to increase the performance of the students on the scale of
students about the competency based medical education level. Various assignments have been produced and
programm. The steps enlisted in this model gives a very clear videos/tutorial and practical’s have been designed and
understanding for the demonstration of complicated subject provided to students. Evaluation has been done on the basis of
as well, Thus model has gain a wide range of publicity in short detailed designed rubrics and statistical test has been executed
span if time. Ideate precision medicine design is the important to check the acceptance and rejection of stated null
area and this model has also proven useful for this criteria, in hypothesis.
Revised Manuscript Received on October 05, 2019
* Correspondence Author
Nilima S. Department of Virtualiaztion,School of Computer
Science,University of Petroleum and Energy studies,Dehradun,India Email:
[email protected]
Published By:
Retrieval Number: A9973109119/2019©BEIESP Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119
7140 & Sciences Publication
Impact of Rubrics, Addie and Gagne Model on the Performance of Students in Programming Subject
Published By:
Retrieval Number: A9973109119/2019©BEIESP
Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119 7141 & Sciences Publication
International Journal of Engineering and Advanced Technology (IJEAT)
ISSN: 2249 – 8958, Volume-9 Issue-1, October 2019
Remark: No assessment guidelines, rubrics were provided to Ex: Traceability matrix. SRS User
students. Guide etc.
Purpose of conduct of case 1: Identify an appropriate
population for further study. F. Statistical Significance test:
Students have been assessed by following the designed Paired student t-test has been used to compute the statistical
rubrics as in table 2.After assessment student population has significance of before and after effect of all proposed
clearly divided into two groups proficient and deficient group approach. Test has been computed at confidence interval of
as in table 3. Proficient group has been identified by who has 90%, 95% and 99% in order to check the correctness of
scored level 3 and level 4 in any of the 2 criteria’s and
method.
Deficient group has been identified as who has scored only
level 1 and level 2 in all the criteria’s. Same case has been Paired student’s t-test found to be appropriate to use in this
repeated in the followed week with same number of students study as major concern of this study is to check if there any
in the same batch size but during this time rubrics were significant impact of the experimented approach on the
already made available to all the students and purpose to academic performance of the student or not.
conduct this study is to reduce the deficient percentage level
and increase the proficient percentage level. Table 2: Restricted rubrics designed for the study
Execution of case 2:
For execution of case 2 inclusion of subjects in the study has Criteria Level 1(0-3) Level 2(4-6) Level Level
been identified from the result analysis of case 1. Deficient 3(7-8) 4(9-10)
Process Tried to Create a Create a Made use
group even after introduced the rubrics in advance still need followed and create a complete complete of all
more attention to improve the overall performance in their Project program program with program appropriat
academics, thus deficient group with only who has scored Features with basic middle level with e methods
level 1 satisfaction only in 3 criteria’s has been included. knowledge of proficiency to create a
only. Easily understandin level but simulation
Addie model has been used to deliver the topic thread to the
breakdown g g, not robust for
group of students. somewhere it and banking
Execution of case 3: breaks down somewhere operations
For execution of case 3 inclusion of subjects in the study has breakdown withdraw
been identified from the result analysis of case 1. Deficient and
deposit.
group even after introduced the rubrics in advance still need Robust
more attention to improve the overall performance in their program.
academic thus deficient group with only who has scored level Efficient.
2 satisfaction only in 3 criteria’s has been included. The No
breakdown
Gagne model has been followed to deliver the topic thread to in any
the set of students. situation.
Table 1: Generalized Rubrics designed for the study Usability Not aware Able to Able to Excellently
about flow explain few explain explain the
No. Criteria Details in program things more than flow
1 Process followed Project Plan – Milestone Timelines - half part of
Requirement Analysis – Technical program
Design – Internal Reviews (Within Quality Not Test cases are Few test Created
team , With Mentor) – Product Assurance prepared at not cases has sufficient
Packaging – Presentation – Hand-outs Testing all supporting to been test cases
including Future Roadmap robustness designed to prove
2 Project Features Simple, Medium and Complex the
Scenarios which are covered. Watch robustness
for unwanted scenarios as well which of the
lead to slippage and increased not system
required complexity in project. Code No Some Part Most Part Highly
Advance features which are Optimizatio optimizatio optimized
implemented which actually adds n n
value to project use /efficiency
3 Usability Minimum number of clicks
Tool Tips
Field arrangements. (Ex: First Name, III. RESULT
Last Name, TAB Press / focus
handling) Results retrieved in this section are categorized into three
Readily available analytics within parts. Part 1 results are the execution of Case 1 which is
project
4 Code Optimization Design Flexibility
associated with impact of rubrics. Part 2 results are associated
Best Practices Followed. (ex: Code with impact of Addie model on the performance of the
Comments) students. Part 3 results are associated with the execution of
Coding Standard and Optimization / case 3 which deals in to identify the impact of gagne model on
Performance Followed in
implementation
the academic performance of the students in programming
5 Quality Testing Matrix (Unit , End to End), subject.
Assurance(Testing) Test Data
6 Delivery Timeline Duration within which it is completed
and team spirit and strength
7 Documentation Artifacts Created for future reference.
Published By:
Retrieval Number: A9973109119/2019©BEIESP Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119
7142 & Sciences Publication
Impact of Rubrics, Addie and Gagne Model on the Performance of Students in Programming Subject
Table 3: Proficient and Deficient group identification Table 5: Statistical performance of the rubrics
before and after rubrics. Rubrics
Before After Criteria t p p=0.05 p=0.01 p=0.10
Deficient Proficient Deficient Proficient 1 8.285994 0.00001 Sig Sig Sig
Male Female Male Female Male Female Male Female 2 2.076517 0.03977 Sig No-Sig Sig
52 24 24 31 30 20 49 35 3 9.102436 0.00001 Sig Sig Sig
4 7.19909 0.00001 Sig Sig Sig
Published By:
Retrieval Number: A9973109119/2019©BEIESP
Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119 7143 & Sciences Publication
International Journal of Engineering and Advanced Technology (IJEAT)
ISSN: 2249 – 8958, Volume-9 Issue-1, October 2019
ADDIE
Criteria t p p=0.05 p=0.01 p=0.10
1 7.468092 0.00001 Sig Sig Sig
2 6.585718 0.00001 Sig Sig Sig
3 6.76432 0.00001 Sig Sig Sig
4 9.788554 0.00001 Sig Sig Sig
Published By:
Retrieval Number: A9973109119/2019©BEIESP Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119
7144 & Sciences Publication
Impact of Rubrics, Addie and Gagne Model on the Performance of Students in Programming Subject
Gagne
Criteria t p p=0.05 p=0.01 p=0.10
1 2.376654 0.02429 Sig No-Sig Sig
2 7.946215 0.00001 Sig Sig Sig
3 9.641712 0.00001 Sig Sig Sig
4 7.303142 0.00001 Sig Sig Sig
Published By:
Retrieval Number: A9973109119/2019©BEIESP
Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119 7145 & Sciences Publication
International Journal of Engineering and Advanced Technology (IJEAT)
ISSN: 2249 – 8958, Volume-9 Issue-1, October 2019
criteria level has significant for all the level. Individual at subjects can lead to better academic performance of the
subject level analysis has been performed as shown in figure 3 students.
to 6 .It’s clear evidence that there is a raise in the level after
intervention of rubrics in the study. Case 2 has explicitly REFERENCES:
designed to check the impact of Addie model on the academic 1. Budoya, C., Kissaka, M., & Mtebe, J. (2019). Instructional design
performance of the students. Rubrics with 4 criteria and 4 enabled Agile method using ADDIE model and Feature Driven
satisfaction level has been designed for the assessment Development method. International Journal of Education and
.Deficient output group of case 1 as shown in table 3 and Development using ICT, 15(1).
2. Ghani, M. T. A., Malim, T., & Daud, W. A. A. W. (2018).
figure 1, who has only scored level 1 performance in 3 ADAPTATION OF ADDIE INSTRUCTIONAL MODEL IN
criteria’s has been included in this case study. Student has DEVELOPING EDUCATIONAL WEBSITE FOR LANGUAGE
been delivered a topic by following the steps of Addie as LEARNING. GLOBAL JOURNAL AL-THAQAFAH, 8(2), 7-16.
explained in the introduction section of this study. As all the 3. Shrivastava, S., Shrivastava, P., & Ramasamy, J. (2019). Employing
analyze, design, develop, implement, and evaluate (ADDIE) model to
students were at level 1, target to conduct this study is to
sensitize postgraduate students about competency-based medical
improve the level of performance at all the criteria level. education program. International Journal of Academic
Statistical paired student t-test has computed at criteria level Medicine, 5(1), 82-82.
with confidence interval of 90,95 and 99 and computed 4. 4.Woo, W. H. (2018). Applying ADDIE model to ideate precision
medicine in a polytechnic biomedical science programme. Journal of
results are statistically significant for all confidence interval
Biomedical Education, 2018.
for the target population as shown in table 6. Individual at 5. Zulkifli, H., Razak, K. A., & Mahmood, M. R. (2018). The Usage of
subject level analysis has been performed as shown in figure 7 ADDIE Model in the Development of a Philosophical Inquiry
to 11 .It’s clear evidence that there is a raise in the level after Approach in Moral Education Module for Secondary School
intervention of Addie step in the delivery of target topic. Students. Creative Education, 9(14), 2111.
6. Mariam, N., & Nam, C. W. (2019). The Development of an ADDIE
Criteria 4 have shown the exceptional growth. But Based Instructional Model for ELT in Early Childhood
performance of the students at criteria 1 and criteria 3 is less Education. Educational Technology International, 20(1), 25-55.
as compare to criteria 4 and 1.But as the overall significant 7. rust, T., & Pektas, E. (2018). Using the ADDIE Model and Universal
impact is strong at all the confidence interval. Case 3 as Design for Learning Principles to Develop an Open Online Course for
Teacher Professional Development. Journal of Digital Learning in
explicitly designed to check the impact of Gagne model on the Teacher Education, 34(4), 219-233.
academic performance of the students. Rubrics with 4 criteria 8. de Leeuw, R., Scheele, F., Walsh, K., & Westerman, M. (2019). A
and 4 satisfaction level has been designed for the assessment 9-Step Theory-and Evidence-Based Postgraduate Medical Digital
.Deficient output group of case 1 who has only scored level 2 Education Development Model: Empirical Development and
Validation. JMIR medical education, 5(2), e13004.
performance in 3 criteria’s has been included in this case 9. Lund, J. L., Kuo, T. M., Brookhart, M. A., Meyer, A. M., Dalton, A. F.,
study. Student has been delivered a topic by following the Kistler, C. E., ... & Lewis, C. L. (2019). Development and validation of
steps of gagne. As all the students were at level 2, target to a 5‐year mortality prediction model using regularized regression and
conduct this study is to improve the level of performance at all Medicare data. Pharmacoepidemiology and drug safety, 28(5),
584-592.
the criteria level. Statistical paired student t-test has computed 10. Subramanian, A. C., Gagne, D. J., Christensen, H. M., & Monahan, A.
at criteria level with confidence interval of 90,95 and 99 and H. (2018, December). Evaluating Generative Adversarial Network
computed results are statistically significant for all confidence Stochastic Parameterizations of the Lorenz'96 Model at Climate and
interval for the target population except criteria 1 at 0.01 as Weather Scales. In AGU Fall Meeting Abstracts.
11. Giralt, E. G., & Varela, J. L. M. (2018). Performance assessment and
shown in table 7. Individual at subject level analysis has been rubrics in art education: A study of student perceptions. Observar.
performed as shown in figure 12 to 16 .It’s clear evidence that Revista electrónica de didáctica de las artes, (12), 39-52.
there is a raise in the level after intervention of gagne step in 12. Ackermans, K., Rusman, E., Nadolski, R., Specht, M., &
the delivery of target topic. Criteria 2 and criteria 3 have Brand-Gruwel, S. (2019). Video-or text-based rubrics: What is most
effective for mental model growth of complex skills within formative
shown the exceptional growth. But performance of the
assessment in secondary schools?. Computers in Human
students at criteria 1 and criteria 4 is less as compare to Behavior, 101, 248-258.
criteria 2 and 3.Copartive statement of conducted study is as 13. Snyder, R. (2018). R Rubrics 4 U?.
shown in table 8.Criteria 1 has been designed to test the 14. Taylor, J., Charters, A., & Bates, E. (2019). Introducing marked rubrics
proficiency of students in formulating the problem statement to enhance the student experience: one programme’s journey to
improve consistency.
and thus the steps include I Gagne model delivery has not 15. Munden, R. A., Rodriguex, M. A., Belfadel, D., & Zabinski, M.
cater the need of formulation of problem statement. Rubrics (2018). Critical Thinking, Design Practices, and Assessment in a
designed has not satisfied at 0.01 level for criteria 2 ,Criteria 2 Fundamentals of Engineering Course.
has been set to understand the usefulness of the problem
statement and understanding the usability criteria has not AUTHORS PROFILE
made clear to students by mere designing the rubrics and let
the students know that rubrics in advance. Nilima S. has done her BE.Mtech and PhD in
Computer Science and Engineering. Her
research interest area is human computer
V. CONCLUSION
Interaction, cognitive science; Signal
In these study Rubrics, ADDIE and Gagne Model has been processing, Machine Intelligence and
Academic Research.
experimented for concept thread in subject java and statistical
results have been retrieved at the confidence interval of 90%,
95% and 99%.Addie model stands statistically significant to
improve the performance of students from level 1 to level 4 at
all the confidence level. Thus to deliver the programming
subjects inclusion of ADDIE model steps for the delivery of
Published By:
Retrieval Number: A9973109119/2019©BEIESP Blue Eyes Intelligence Engineering
DOI: 10.35940/ijeat.A9973.109119
7146 & Sciences Publication