Peer evaluation in online anchored discussion for an increased local relevance of replies

This study investigates the use of an evaluation function to increase the local relevance of replies in online anchored discussion. Being implemented in a university course on French linguistics, a regular system for anchored discussion is compared with two versions that are enhanced with an integrated evaluation function. The function asks students to evaluate the relevance of each others’ replies. To compare between experimental and control conditions, the collaboration protocols are analysed with a newly developed coding scheme for the local relevance of replies. Statistical processing of the data is done with a multilevel approach and results indicate that an evaluation function can effectively increase the local relevance of students’ replies, but only if it is actually used to a certain extent. Using the evaluation function is hypothesized to increase students’ awareness of the importance of writing relevant replies.