Reliability Investigation of Automatic Assessment of Learner-Build Concept Map with Kit-Build Method by Comparing with Manual Methods
Use this link to cite this item : https://ir.lib.hiroshima-u.ac.jp/00046326
ID | 46326 |
file | |
creator |
Wunnasri, Warunya
Pailai, Jaruwat
|
subject | Concept map assessment method
Kit-Build concept map
Reliability
|
NDC |
Education
|
abstract | This paper describes an investigation into the reliability of an automatic assessment method of the learner-build concept map by comparing it with two well-known manual methods. We have previously proposed the Kit-Build (KB) concept map framework where a learner builds a concept map by using only a provided set of components, known as the set "kit". In this framework, instant and automatic assessment of a learner-build concept map has been realized. We call this assessment method the "Kit-Build method" (KB method). The framework and assessment method have already been practically used in classrooms in various schools. As an investigation of the reliability of this method, we have conducted an experiment to compare the assessment results of the method with the assessment results of two other manual assessment methods. In this experiment, 22 university students attended as subjects and four as raters. It was found that the scores of the KB method had a very strong correlation with the scores of the other manual methods. The results suggest that automatic assessment of the Kit-Build concept map can attain almost the same level of reliability as well-known manual assessment methods.
|
description | 'Artificial Intelligence in Education' 18th International Conference, AIED 2017, Wuhan, China, June 28 – July 1, 2017, Proceedings
|
journal title |
Lecture Notes in Computer Science
|
volume | Volume 10331
|
start page | 418
|
end page | 429
|
date of issued | 2017
|
publisher | Springer, Cham
|
issn | 0302-9743
1611-3349
|
isbn | 978-3-319-61424-3
978-3-319-61425-0
|
publisher doi | |
language |
eng
|
nii type |
Conference Paper
|
HU type |
Conference Papers
|
DCMI type | text
|
format | application/pdf
|
text version | author
|
rights | The final authenticated version is available online at https://doi.org/10.1007/978-3-319-61425-0_35.
This is not the published version. Please cite only the published version. この論文は出版社版でありません。引用の際には出版社版をご確認ご利用ください。
|
department |
Graduate School of Engineering
|