The Effect of Multiple-Choice Test Items’ Order on ‎the Accuracy of Estimating of Items’ Parameters and ‎Persons’ Ability

Abstract

This study aimed to detect the effect of multiple-choice test items’ order according to statistical indices on the accuracy of estimating of items’ parameters and persons’ ability. For each one of the seven models of the multiple-choice test, responses for 1000 simulees were simulated such that the responses for each simulee were generated 100 times. Generated data were analyzed; to estimate items’ parameters and persons’ ability, in addition to find the values of the root mean squared error, and bias for these estimates. Findings of the study revealed that there was statistical significant effect of ordering items on items’ parameters and persons’ ability, where the mean of the root mean squared error values of items’ parameters and persons’ abilities was the least for both the randomly ordered items (fourth model), and the descending ordered items according to item validity index (fifth model). Moreover, the results showed that the mean values of bias index were close to zero for these two models