The most effective indicator of quality of implementation and indeed of quality of reading comprehension is Average Percent Correct (APC) – the extent to which pupils score highly on book quizzes. Renaissance recommends that pupils score at 85% or higher if they are to really benefit from the programme.
Star Reading generates outcome scores for individuals: The Scaled Score (from 1 to 1400) and the Percentile Rank (the percentage of scores that fall at or below a certain observation). Table 3 on the web gives the average of these measures for all students who had both a Star Reading score and AR data.
The number of students with a Star test score declined from 1,097,410 to 965,332 (see Table 3), although previously somewhat unreliable results were available for Years 11 – 13, which accounts for some of the deficit. Years 1-10 do, however, show a very clear pattern on all measures, and all but one show Star scores above average, i.e., above the 50th percentile. The Average Unified Scaled Score was 977.9 (as compared to 465 last year when scaled scores were calculated differently). The Average Percentile Rank was 55 (as compared to 50 last year).
For the remainder of this section of the analysis, students’ Star reading scores are divided into quartiles: Percentile 1-24, Percentile 25-49, Percentile 50-74, and Percentile 75 to 100 (percentiles are a score at or below which a given percentage of the distribution falls). The four groups are used to give an indication of the relationship of other factors to the reading performance of the students. Figure 1 shows the relationship for each year between the quartiles of students in relation to their Star reading scores and their APC on quizzes (Table 4 gives more detail).
In all years, there is a consistent pattern whereby the lowest APC scores are associated with the lowest reading scores, the highest with the highest reading scores, and the middle APC scores are associated with the middle reading scores. Obviously, implementation quality makes a big difference!

