Salvato in:
Dettagli Bibliografici
Autore:MAQSOOD, RABIA
Titolo:ANALYZING AND MODELING STUDENTS¿ BEHAVIORAL DYNAMICS IN CONFIDENCE-BASED ASSESSMENT
Pubblicazione:: Università degli Studi di Milano, 2020-01-31
Abstract: Confidence-based assessment is a two-dimensional assessment paradigm which considers the confidence or expectancy level a student has about the answer, to ascertain his/her actual knowledge. Several researchers have discussed the usefulness of this m...r expectancy level a student has about the answer, to ascertain his/her actual knowledge. Several researchers have discussed the usefulness of this model over the traditional one-dimensional assessment approach, which takes the number of correctly answered questions as a sole parameter to calculate the test scores of a student. Additionally, some educational psychologists and theorists have found that confidence-based assessment has a positive impact on students’ academic performance, knowledge retention, and metacognitive abilities of self-regulation and engagement depicted during a learning process. However, to the best of our knowledge, these findings are not exploited by the educational data mining community, aiming to exploit students (logged) data to investigate their performance and behavioral characteristics in order to enhance their performance outcomes and/or learning experiences. Engagement reflects a student’s active participation in an ongoing task or process, that becomes even more important when students are interacting with a computer-based learning or assessment system. There is some evidence that students’ online engagement (which is estimated through their behaviors while interacting with a learning/assessment environment) is also positively correlated with good performance scores. However, no data mining method to date has measured students engagement behaviors during confidence-based assessment. This Ph.D. research work aimed to identify, analyze, model and predict students’ dynamic behaviors triggered by their progression in a computer-based assessment system, offering confidence-driven questions. The data was collected from two experimental studies conducted with undergraduate students who solved a number of problems during confidence-based assessment. In this thesis, we first addressed the challenge of identifying different parameters representing students’ problem-solving behaviors that are positively correlated with confidence-based assessment. Next, we developed a novel scheme to classify students’ problem-solving activities into engaged or disengaged behaviors using the three previously identified parameters namely: students’ response correctness, confidence level, feedback seeking/no-seeking behavior. Our next challenge was to exploit the students’ interactions recorded at the micro-level, i.e. event by event, by the computer-based assessment tools, to estimate their intended engagement behaviors during the assessment. We also observed that traditional non-mixture, first-order Markov chain is inadequate to capture students’ evolving behaviors revealed from their interactions with a computer-based learning/assessment system. We, therefore, investigated mixture Markov models to map students trails of performed activities. However, the quality of the resultant Markov chains is critically dependent on the initialization of the algorithm, which is usually performed randomly. We proposed a new approach for initializing the Expectation-Maximization algorithm for multivariate categorical data we called K-EM. Our method achieved better prediction accuracy and convergence rate in contrast to two pre-existing algorithms when applied on two real datasets. This doctoral research work contributes to elevate the existing states of the educational research (i.e. theoretical aspect) and the educational data mining area (i.e. empirical aspect). The outcomes of this work pave the way to a framework for an adaptive confidence-based assessment system, contributing to one of the central components of Adaptive Learning, that is, personalized student models. The adaptive system can exploit data generated in a confidence-based assessment system, to model students’ behavioral profiles and provide personalized feedback to improve students’ confidence accuracy and knowledge by considering their behavioral dynamics.
Read more
Note:diritti: info:eu-repo/semantics/openAccess
In relazione con info:eu-repo/semantics/altIdentifier/hdl/2434/699383
Autori secondari:CERAVOLO, PAOLO
supervisor: P. Ceravolo ; director of the phd school: P. Boldi
BOLDI, PAOLO
CERAVOLO, PAOLO
Classe MIUR:Settore INF/01 - - Informatica
Risorsa digitale:Copia depositata in BNCF Repository di Ateneo
Copia depositata in BNCF Repository di Ateneo
LEADER 05291nam a2200313 n 4500
001 TD20012395
005 20200205140345.0
049 |a TDMAGDIG 
100 |a 20190501d2020 --k--ita-50----ba  
101 1 |a eng 
200 1 |a ANALYZING AND MODELING STUDENTS¿ BEHAVIORAL DYNAMICS IN CONFIDENCE-BASED ASSESSMENT  |b Tesi di dottorato 
210 1 |c Università degli Studi di Milano  |d 2020-01-31 
300 |a diritti: info:eu-repo/semantics/openAccess 
300 |a In relazione con info:eu-repo/semantics/altIdentifier/hdl/2434/699383 
328 0 |b tesi di dottorato  |c Settore INF/01 - Informatica  |e Università degli Studi di Milano 
330 |a Confidence-based assessment is a two-dimensional assessment paradigm which considers the confidence or expectancy level a student has about the answer, to ascertain his/her actual knowledge. Several researchers have discussed the usefulness of this model over the traditional one-dimensional assessment approach, which takes the number of correctly answered questions as a sole parameter to calculate the test scores of a student. Additionally, some educational psychologists and theorists have found that confidence-based assessment has a positive impact on students’ academic performance, knowledge retention, and metacognitive abilities of self-regulation and engagement depicted during a learning process. However, to the best of our knowledge, these findings are not exploited by the educational data mining community, aiming to exploit students (logged) data to investigate their performance and behavioral characteristics in order to enhance their performance outcomes and/or learning experiences. Engagement reflects a student’s active participation in an ongoing task or process, that becomes even more important when students are interacting with a computer-based learning or assessment system. There is some evidence that students’ online engagement (which is estimated through their behaviors while interacting with a learning/assessment environment) is also positively correlated with good performance scores. However, no data mining method to date has measured students engagement behaviors during confidence-based assessment. This Ph.D. research work aimed to identify, analyze, model and predict students’ dynamic behaviors triggered by their progression in a computer-based assessment system, offering confidence-driven questions. The data was collected from two experimental studies conducted with undergraduate students who solved a number of problems during confidence-based assessment. In this thesis, we first addressed the challenge of identifying different parameters representing students’ problem-solving behaviors that are positively correlated with confidence-based assessment. Next, we developed a novel scheme to classify students’ problem-solving activities into engaged or disengaged behaviors using the three previously identified parameters namely: students’ response correctness, confidence level, feedback seeking/no-seeking behavior. Our next challenge was to exploit the students’ interactions recorded at the micro-level, i.e. event by event, by the computer-based assessment tools, to estimate their intended engagement behaviors during the assessment. We also observed that traditional non-mixture, first-order Markov chain is inadequate to capture students’ evolving behaviors revealed from their interactions with a computer-based learning/assessment system. We, therefore, investigated mixture Markov models to map students trails of performed activities. However, the quality of the resultant Markov chains is critically dependent on the initialization of the algorithm, which is usually performed randomly. We proposed a new approach for initializing the Expectation-Maximization algorithm for multivariate categorical data we called K-EM. Our method achieved better prediction accuracy and convergence rate in contrast to two pre-existing algorithms when applied on two real datasets. This doctoral research work contributes to elevate the existing states of the educational research (i.e. theoretical aspect) and the educational data mining area (i.e. empirical aspect). The outcomes of this work pave the way to a framework for an adaptive confidence-based assessment system, contributing to one of the central components of Adaptive Learning, that is, personalized student models. The adaptive system can exploit data generated in a confidence-based assessment system, to model students’ behavioral profiles and provide personalized feedback to improve students’ confidence accuracy and knowledge by considering their behavioral dynamics. 
689 0 |a Settore INF/01  |b - Informatica  |c TDR 
700 0 |a MAQSOOD, RABIA 
702 0 |a CERAVOLO, PAOLO 
702 0 |a supervisor: P. Ceravolo ; director of the phd school: P. Boldi 
702 0 |a BOLDI, PAOLO 
702 0 |a CERAVOLO, PAOLO 
801 3 |a IT  |b IT-FI0098 
856 4 |u http://memoria.depositolegale.it/*/http://hdl.handle.net/2434/699383  |2 http://hdl.handle.net/2434/699383 
856 4 |u http://memoria.depositolegale.it/*/http://air.unimi.it/bitstream/2434/699383/2/phd_unimi_R11621.pdf  |2 http://air.unimi.it/bitstream/2434/699383/2/phd_unimi_R11621.pdf 
977 |a  CR 
997 |a CF 
FMT |a TD 
FOR |a TD 
Tesi di dottorato | Lingua: Inglese | Paese: | BID: TD20012395
Visualizza in formato Unimarc
Biblioteca Inventario Volume Collocazione Fruizione status