文献管理

Title: Group Optimization to Maximize Peer Assessment Accuracy Using Item Response Theory
Source: DOI: 10.1007/978-3-319-61425-0_33
Author(s): Masaki Uto, Nguyen Duc Thien, and Maomi Ueno
Online Reference:
Abstract:

As an assessment method based on a social constructivist approach, peer assessment has become popular in recent years. When the number of learners increases as in MOOCs, peer assessment is often con- ducted by dividing learners into multiple groups to reduce the learner’s assessment workload. However, in this case, a difficulty remains that the assessment accuracies of learners in each group depends on the assigned rater. To solve that problem, this study proposes a group opti- mization method to maximize peer assessment accuracy based on item response theory using integer programming. Experimental results, how- ever, showed that the proposed method does not necessarily present higher accuracy than a random group formation. Therefore, we further propose an external rater selection method that assigns a few outside- group raters to each learner. Simulation and actual data experiments demonstrate that introduction of external raters using the proposed method improves the peer assessment accuracy considerably.


File:
Relevant Principles (APA): 原理19 要实现对学生的技能、知识和能力的良好评价,就 应遵循特定的对评价过程的要求,该过程应根植于 心理科学、在质量和公平方面具有明确定义的标准
原理20 对评价数据的理解是建立在清晰、适当和公正的解 释基础之上的
Notes (Theories):
Notes (Technologies):
Notes (Applications):
Notes (Impacts):
Tags: