The 2021 mini-pilot

Literacy and Numeracy | Te Reo Matatini me te Pāngarau

In 2021, we piloted draft literacy and numeracy, te reo matatini and pāngarau standards with a diverse range of learners in 13 secondary schools, six kura and two tertiary providers across Aotearoa New Zealand.

The aims of the mini-pilot were to:

  • refine and improve the standards so they are clear and at the right level

  • refine the assessments so they are equitable, valid, and robust

  • understand how we can support the teaching and learning of literacy and numeracy, te reo matatini and pāngarau

The mini-pilot allowed us to understand the quality of the new standards and assessments, as well as the impact the changes will have on kaiako and ākonga.

The 2021 mini-pilot evaluation

Standards and assessments

As part of the mini-pilot evaluation, we looked at whether the standards were fit for purpose and if the assessments tested against the standards well. Our evaluation found that both the standards and assessments performed well. Generally, feedback told us that the standards were at the right level. Technical analysis of the assessments told us that they broadly tested well against the outcomes of the standards.

We gained valuable feedback on some components of the assessments and we are using the feedback to improve their design (there is more information on this in next steps below).

Results

We received 2,313 total submissions of evidence or assessments from learners. COVID-19 impacted Auckland participants of the mini-pilot, and only one Auckland school was able to participate.

The small pilot cohort meant the results were not representative. They should also not be regarded as likely NCEA attainment levels for future learners as most participants in the mini-pilot were Year 9 or 10 ākonga who will have further opportunities to sit the assessments again.

A summary of the results from the mini-pilot:

Standard Provider Type Participating Students Achieved Students Achievement Rate
Reading Secondary School 590 395 66.9%
Writing 554 191 34.5%
Numeracy 1,055 689 65.3%
Pāngarau 29 8 27.6%
Te Reo Matatini 30 25 83.3%
Reading Tertiary 19 14 73.7%
Writing 21 14 66.7%
Numeracy 15 11 73.3%

In 2021, we piloted draft literacy and numeracy, te reo matatini and pāngarau standards with a diverse range of learners in 13 secondary schools, six kura and two tertiary providers across Aotearoa New Zealand.

The aims of the mini-pilot were to:

  • refine and improve the standards so they are clear and at the right level

  • refine the assessments so they are equitable, valid, and robust

  • understand how we can support the teaching and learning of literacy and numeracy, te reo matatini and pāngarau

The mini-pilot allowed us to understand the quality of the new standards and assessments, as well as the impact the changes will have on kaiako and ākonga.

The 2021 mini-pilot evaluation

Standards and assessments

As part of the mini-pilot evaluation, we looked at whether the standards were fit for purpose and if the assessments tested against the standards well. Our evaluation found that both the standards and assessments performed well. Generally, feedback told us that the standards were at the right level. Technical analysis of the assessments told us that they broadly tested well against the outcomes of the standards.

We gained valuable feedback on some components of the assessments and we are using the feedback to improve their design (there is more information on this in next steps below).

Results

We received 2,313 total submissions of evidence or assessments from learners. COVID-19 impacted Auckland participants of the mini-pilot, and only one Auckland school was able to participate.

The small pilot cohort meant the results were not representative. They should also not be regarded as likely NCEA attainment levels for future learners as most participants in the mini-pilot were Year 9 or 10 ākonga who will have further opportunities to sit the assessments again.

A summary of the results from the mini-pilot:

Standard Provider Type Participating Students Achieved Students Achievement Rate
Reading Secondary School 590 395 66.9%
Writing 554 191 34.5%
Numeracy 1,055 689 65.3%
Pāngarau 29 8 27.6%
Te Reo Matatini 30 25 83.3%
Reading Tertiary 19 14 73.7%
Writing 21 14 66.7%
Numeracy 15 11 73.3%