Assessing Measurement Accuracy of ‎Multistage Adaptive Testing under Different ‎Testing Modes

Abstract

This study aims at comparing the measurement accuracy of multistage adaptive testing under different conditions: test length (12, 24 and 36 items), panel design (1-3-3 and 1-2-2 panel designs), routing module length (long and short) and routing strategy (AMI and DPI). To achieve the aims of this study, (5000) true abilities were generated with a normal distribution of a mean of (1) and a standard deviation of (0). Measurement accuracy was assessed using mean of bias and mean squared error (MSE). The results show that the measurement accuracy increases as the test length increases, despite of panel design (1-3-3 and 1-2-2 panel designs), routing module length (long and short) or routing strategy. Moreover, the results show that panel design, routing strategy and routing module length marginally affect the measurement accuracy of multistage adaptive testing