Archive for the ‘Research and Evaluation’ Category

Student Consensus on

December 1, 2011 Comments off

Student Consensus on (PDF)
Source: Practical Assessment, Research and Evaluation

At the same time as some faculty committees and corporations are appealing to the use of online ratings from to inform promotion decisions and nationwide university rankings, others are derogating the site as an unreliable source of idiosyncratic student ratings and commentary. In this paper we describe a study designed to test the assumption that students’ ratings are unreliable. The sample included 366 instructors with 10 or more student ratings. Contrary to the assumption that students’ ratings are unreliable, variance in students’ ratings about a given instructor was similar across number of raters, with 10 raters showing the same degree of consensus as 50 or more raters. Students showed the most consensus about instructors who were among the top third of the distribution in quality, and this effect occurred even among instructors rated as the most difficult. Taken alongside other investigations of and the broad literature on student evaluations of teaching, our findings suggest that students who use are likely providing each other with useful information about quality of instruction.


Get every new post delivered to your Inbox.

Join 361 other followers