Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm
Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm
net/publication/308929960
Test Bank Management System Applying Rasch Model and Data Encryption
Standard (DES) Algorithm
CITATIONS READS
4 2,025
3 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Bartolome T. Tanguilig Iii on 03 February 2017.
Abstract—Online examinations are of great importance and finally, (d) printing out the exam papers [2]. So in
to education. It has become a powerful tool for evaluating order to precisely and reliably measure the proficiency of
students’ knowledge and learning. Adopting modern students and discern examinees with different levels of
technology that saves time and ensures security. The ability, items should be subjected to thorough
researcher developed a Test Bank Management System investigation using some psychometric methods. That is,
that can store test items in any subjects. The system is to item analyze. The basic idea of item analysis is that the
capable of conducting item analysis using the Rasch statistical behavior of “bad items” is fundamentally
model scale. Items that undergo analysis based on Rasch different from that of “good items” [3].
scale helped faculty by quantifying each item as “good”, However, conducting item analysis manually can cause
“rejected”, or “revised”. For securing items in the test a lot of time and effort, which may have inaccurate data,
bank, Data Encryption Standard (DES) algorithm was unreliable, and inefficient results. This procedure is an
successfully applied thus ensuring the safety and important technique for teachers to identify the
reliability of the questions in the test bank. Only items effectiveness of the examination they have created.
that are ready for deployment to the student’s computer Item analysis is a type of statistical technique that helps
during the examinations will be decrypted. In conclusion, instructors determines the effectiveness of their test items
the system passed the evaluation process and eliminates [5]. A basic assumption made by ScorePak® [4] is that
redundancy of manual work. the test under analysis is composed of items measuring a
single subject area or underlying ability. The quality of
Index Terms—Test Bank Management System, Rasch the test as a whole is assessed by estimating its "internal
Model, Data Encryption Standard, Test Items, Item consistency”. With item analysis, sorting questions could
Analysis. be easily quantified as “good”, “rejected”, or “revised”.
There would be no need for the instructors/faculty to do it
manually.
I. INTRODUCTION There are several tools that can be utilized in analyzing
data. One of these tools is the Rasch Model Analysis.
One of the bases for evaluating or giving grades to the
Rasch model is the only item response theory (IRT)
students is the examination or test. Examination or test model in which the total score across items characterizes
serves as an assessment intended to measure the a person’s totality. It is also the simplest of such models
examinees’ knowledge in a particular subject or topic.
having the minimum of parameters for the person
Examinations are a crucial part of both the academic
corresponding to each category of an item. This item
teaching and learning process and of the parameter is generically referred to as a threshold. It
school/university’s administration procedures [1].It is one provides teachers with two types of information:
aim of an institution to gauge their students’ ability and
Difficulty Index and Discrimination Index.
competitiveness. To the student, examination gives them
Due to the different issues involved in the examination
goals toward which they are directed, pushing them to management, the author proposed to develop a web –
attain that goal within a specified period. For teachers, based Test Bank Management System applying Rasch
the result of examination also gives them drive and work
Model and Data Encryption Standard (DES) algorithm.
direction, towards the better learning.
The proposed system is capable of storing test questions
The preparation of the exam is a repetitive task and a that would be readily available for students and can be
very tedious process. It includes: (a) developing the exam, taken online. For the analysis of the test results from the
(b) digitizing it with text editor such as Microsoft Word,
students’ answer sheet, the Rasch model would be used.
(c) piloting and reviewing the quality of each question,
Rasch analysis is employed to evaluate this assessment as
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
2 Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm
a measurement tool. This produces measures for ability Zughoul et.al. [24] proposed a new method for key
and item difficulty that are independent of both the generation based on Data Encryption Standard Algorithm
specific items on the assessment and the sample of test- for online examination to make it more secure. They
takers [6] while DES (Data Encryption Standard) reiterated the encryption of the Online Examination
algorithm will be used for securing the test questions in System particularly the privacy of the users’ credentials.
the test bank by encrypting each item. This algorithm Furthermore, they proposed that users should have a
uses a symmetric key (secret key) for the security of the personal space such that there is user control on what and
test questions. how much personal information could be shared with
The rest of this paper is organized as follows: Section others. They proposed an improvised algorithm of DES.
II is dedicated to related studies relevant to the present
studies. Section III, is the operational framework. Section
IV presents the design architecture of the TBMS. Then in III. OPERATIONAL FRAMEWORK
Section V, is dedicated to conclusion and future works.
Figure 1 shows the framework of the proposed system.
The faculty would prepare all the test questions in the
subjects they handle based on the covered topics in the
II. RELATED STUDIES
syllabus. The Chairperson, would review, check and
This section presents the studies reviewed which are approve all the items. The remaining questions would
relevant to the present study. then be encoded in the system subject for DES encryption
Chieh-Ju and Wang [19] provided a baseline results of to ensure the security and confidentiality of the test
the item analysis for the English Proficiency Test where it questions before saving it in the Test Bank. A maximum
offered guidelines to know which items need to be of one hundred (100) test items per subject would be
discarded or could be maintained. It contributed to the stored in the test bank. The system would randomly select
assessments of English major students’ language items in the Test Bank. Randomly selected questions
proficiency. would then be decrypted using DES algorithm again
On the same manner, Bermundo and Bermundo [20] in before it could be deployed in the students’ computer and
their study developed software that checks and analyzes could be taken by the students online. After the
the test items. This is in response to the needs of examination, the system would automatically check the
developing a system that lessens, if not eliminate the said answer sheets. Results of the exam would be displayed by
difficulty and complexity of the process to item analyze the system and Rasch model tool would be utilized for
the exam. They reiterated the difference of having such item analysis. The answer sheets would serve as the point
system helped in the analysis as compared to the reference for the process of weighing if the test questions
traditional method. It also showed how the teachers are “good”; “rejected”, or “revised”.
perceived the level of usability and acceptability of the
design of the TCIAS regarding feasibility, functionality, Faculty
accuracy and efficiency.
Likewise, in the study of Dio [21], he developed a Dean
Mathematics Proficiency Test that determined the
proficiency level including the competencies that are Filter
needed to be enhanced in general education mathematics
of the pre-service elementary teachers. He also proposed DES
Encryption
an enhancement in the syllabus based on the identified
needs of the students. The MPT developed a used test
method and tested internal consistency to determine the
reliability level of the MPT. He used Cronbach’s alpha Randomly
selected
DES
Decrypt
for testing the validity of the test items. TBMS items
ion
Chang [22] investigated the differences in the partial
scoring performance of examinees in elimination testing
and conventional dichotomous scoring of multiple-choice Filter
tests implemented on a computer-based system. They
used multiple-choice items to eliminate examinees with
partial knowledge over those who are simply guessing. Fig.1. Conceptual Framework of Test Bank Management System
Applying Rasch Model and Data Encryption Standard Algorithm.
While, Muddu [23] mentioned in his study, that online
test, exam, and contest are part of online education but
not widely implemented due to lack of resources and
security related issues. He proposed a solution to the
IV. DESIGN ARCHITECTURE OF THE TBMS
security issues and cheating, in an online exam. Two
cryptographic algorithms namely RSA and Data This part of the documentation presented the design
Encryption Standard are used. The RSA algorithm was architecture of the system. It includes application of
used for securing the users credentials, and the DES are Rasch model as analysis tools for the analysis of each
used for securing online test environment. item and for the security of the test items in the test bank
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm 3
Item Index of
Item # Interpretation Interpretation Remarks
Difficulty Discrimination
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
4 Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm
1 9c58b2a3cda7 9 e80d33d75314
2 da91ddd7b748 10 e5aa2dd123ec
3 1dc24bf89768 11 83b69cf0ba8d
4 2359ae58fe2e 12 7c1ef27236bf
5 b829c57c7cb8 13 f6f0483f39ab
6 116e39a9787b 14 0ac756267973
7 c535b4a7fa32 15 6c591f67a976
8 d68ec5b50f76 16 4f57a0c6c35b
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm 5
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
6 Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm
64-bit output
test the performance of the system in view of its users.
The criteria used are composed of six (6) main quality
characteristics that are defined in the ISO9126 [28]
standards as follows:
32-bit Ln 32-bit Rn
Functionality – the ability of the software product
to provide functions which meet stated or implied
Mangler
Function
needs of the users.
Kn Reliability – the ability of the system to functions
as specified, and the capability of the system to
maintain its service provisions under defined
conditions for defined period of time.
Efficiency – the ability of the software to provide
32-bit Ln +
appropriate performance in relation to the amount
32-bit Rn + of resources used. This is used to measure how
1
1
well the system works.
Usability –the ability of the software to be easily
64-bit input operated by a given user in a given environment
and the ease of which the system functions could
Fig.5. Ciphertext Decryption Process be understood by the intended users.
Portability – characterizes the ability of the
software/system to change to new specifications or
Table 9. Decryption Result of the 1st block of Ciphertext
operating environments or the measure of the
Step Process Result effort that is needed to move software to another
Get the value of L1 L1 = d040c800 computing platform.
1
and R1 R1=86ed743c Maintainability – it is the ability to identify the
2 XOR R1 to L1 dc1f1cf4 root cause of a failure within the software, the
Get the value of R1, amount of effort to change a system and the effort
performed
3 86ed743c needed to verify (test) a system change.
expansion
permutation
An evaluation sheet was distributed to different
Apply S-Boxes
4 ae1ba189 respondents. The questionnaire uses the scale of 1 to 5,
Substitution
XOR the result to with 1 as the lowest and 5 as the highest. The evaluation
5 9c58b2a3cda7 sheet enumerates six (6) indicators: functionality,
the key in round 1
6 New Value for R1 R1 = 07b5cf4c reliability, efficiency, usability, maintainability, and
7 R1 II L1 4713b8f45cd9b326 portability. Table 11 is the over-all tabulated results based
Plaintext value of on the respondents evaluation.
8 the 1st cipher after 776869636820636f
16 Rounds. Table 10. Tabulated Rating of the Respondents – Overall
Ql
C. Evaluation of the developed system/software using the Criteria Mean Qn
ISO 9126 standard.
1. Functionality 4.6 5 E
In any project development, a certain design
methodology is employed in order to come up with an 2. Efficiency 4.6 5 E
effective and desirable result. However, in order to 3. Usability 4.8 5 E
achieve the goal of having an affective and desirable
result, the system has to undergo the evaluation using the 4. Reliability 4.15 4 VG
ISO 9126 Standard. Below are the activities performed in 5. Portability 4.85 5 E
the evaluation of the developed system.
The system was presented to the evaluators- 6. Security 4.8 5 E
respondents consisting of thirty (30) students and three (3)
Overall Mean 4.63 5 E
Faculty members of the Engineering Department. The
functions and processes of the software were discussed
Legend:
during the presentation to ensure that the developed Mean Range Quantitative Value (Qn) Qualitative Value(Ql)
system is evaluated properly. During the final evaluation, 4.51 – 5.00 5 (E) Excellent
survey questionnaires were distributed. 3.51 – 4.50 4 (VG) Very Good
The evaluation survey for this system is based from the 2.51 – 3.50 3 (G) Good
1.51 – 2.50 2 (F) Fair
external and internal quality model adopted from the ISO 1.00 – 1.50 1 (P) Poor
/ IEC 9126 standard. The primary goal of the survey is to
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm 7
Table 10 shows the overall mean of the criteria used in the making of this study. Without their inputs, the
the evaluation of the system quality. The overall mean is validation of survey could not have been successfully
4.63, which has an equivalent qualitative result of conducted.
“Excellent”. The result simply implied that respondents I would also like to acknowledge the former President
found the system useful and was able to attain the goals of the Sorsogon State College Dr. Antonio Fuentes and
and objectives of the study. the present president Dr. Modesto D. Detera for their
invaluable support in the conduct of this study. I am
gratefully indebted.
V. CONCLUSION AND FUTURE WORKS Appreciation is extended to the Commission on Higher
Education (CHED), for the scholarship granted to the
The developed system is capable of storing test items proponent.
in the test bank per subject. Random selection of the test
I must also express my profound gratitude to my
items ready for deployment to the student’s computer is
parents, brothers and sister for their unfailing support and
one of the functions of the system. It automatically continuous encouragement throughout the years of my
checked the answer sheet of each student. The Rasch study.
model was successfully applied by conducting an analysis
To my children Erika, Oli and Julia for their
of each item based on the result of the exams of the
understanding during the time when I cannot give my
students, as it was part of the function of the system, thus 100% attention during the course work and for
eliminating redundancy of manual work. After analysis continuously providing me an inspiration to keep me
faculty members could now easily quantify all the items
going and work on this project.
in the exams as good, rejected or revised items.
Finally to my husband Rico, for the love and for
The integrity and confidentiality of the test items providing me with unfailing support, continuous
stored in the test bank was successfully secured using encouragement and understanding throughout the years
DES algorithm by automatically encrypting all the test
of study and through the process of researching and
items in the test bank. Only items ready for deployment
writing. This accomplishment would have not been
after randomly selected by the system will be decrypted. possible without them. Thank you so much.
Functions like editing/saving items are embedded in Above all, to the ALMIGHTY GOD for His blessings.
the system.
With the developed system, manual work of the faculty
REFERENCES:
when it comes to preparation of the exams is reduced if
not eliminated. [1] Bauer, Dr. Yvonne,Degenhardt, Dr. Lars, Kleimann, Dr.
The system passed the evaluation process based on the Bernd, and Wannemacher, Dr. Klaus,“Online Exams as
ISO 9126 standard as perceived by the respondents. Part of the IT – supported Examination Process
Full implementation of the developed system is Chain”,Higher Education Information System.
[2] YewTzeHui, Cheong Soon Nyean, Yap Wen Jiun,
recommended. NordinAbdRazak 2 and Ahmad ZamriKhairani,
As for future works The TBMS may be further secured “Development of Mathematics Question Banking System
by using other security algorithm aside from DES. The for Secondary School in Malaysia, 2012 International
developed TBMS can still be improved by adding other Conference on Management and Education Innovation,
features/functions that will help ease-up the usage of the IPEDR Vo, 37, pp. 12-16.
system, like: to restore the discarded questions [3] Kehoe and Jerard, Basic Item Analysis for Multiple-
automatically if needed; choices for multiple choice Choice Tests, Practical Assessment, Research &
format can be re-arranged together with the correct Evaluation, 4(10), 1995.
answers; graphic choices can be considered; and the [4] Scorepak, “Score Pak: Item Analysis”,Office of the
Educational University of Washington. August 2005.
system can provided audit trail or report of faculty who [5] “Scatron Guide”, Educational Management Center.
contributed the questions or faculty who modified the [6] Ahmad Zamri Khairani, “Development of Mathematics
question. Question Banking System for Secondary School in
Malaysia,2012 International Conference on Management
ACKNOWLEDGEMENT and Education Innovation IPEDR vol.37 (2012)© .
[7] Camero, Joseph T., “The Role of Online Grading
I would like to express my sincerest gratitude to my Programs in School/Community Relations”;New Southern
thesis adviser, Dr. Ariel M. Sison, for his guidance and International School, Bangkok Thailand, July 2011, Vo. 1,
his valuable suggestions for the improvement of the study. pp.91-105.
He consistently allowed this paper to be my own work, [8] Elaine Barker, William Barker, William Burr, Wiliam
but steered me in the right direction whenever he thought Pork, Mike Smid; “Computer Security”, National Institute
I needed it. Thank you, Sir Ariel. of Standard and Technology, July, 2012.
Also to all the Panel of Examiners, for their comments [9] MwaiNyaga, Hassan Bundu; “The Impact of Examination
Analysis for Improving the Management of public
and suggestion for the improvement of the research paper.
Examination or Otherwise”; 27th Annual Conference of
I would also like to thank the experts who were the Association for Educational Assessment in Africa;
involved in the validation survey of this research project: August 2009, pp. 1-20.
particularly the Statistician, Computer Analysts, and the [10] Dr.Roberta N. Chinn, Dr. Norman R. Hertz and Dr.
SSC Research Director who participated/contributed in Barbara A. Showers; “Building and Managing Small
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8
8 Test Bank Management System Applying Rasch Model and Data Encryption Standard (DES) Algorithm
Copyright © 2016 MECS I.J. Modern Education and Computer Science, 2016, 10, 1-8