Independent evaluation of 2022 pilots

[ Heading ]

Why was the evaluation done?

A core part of NCEA Change is developing new standards, assessments and associated teaching and learning materials to replace all existing achievement standards, beginning with Level 1.

Independent evaluation is part of ensuring that changes to NCEA are supporting all ākonga in their NCEA journey.

Evaluation reports are used by the Ministry and NZQA to understand how the new NCEA materials and changes for assessment are working in practice.

An independent view of how pilot schools and kura are building capability and managing the change helps both schools and kura as well as the Ministry and NZQA to look at the changes objectively. Robust, evidence-based information within the evaluation is used to progress the NCEA Changes.

The reports outline both issues and opportunities faced by kaiako and ākonga in NCEA pilots. The experience of pilot schools and kura, alongside evaluation data, is used to develop resources and support to make changes to NCEA practical and accessible for all schools and kura nationally.

Timing

Release of the evaluation reports in July 2023 follows the in-depth evaluation of both The New Zealand Curriculum subjects and Te Marautanga o Aotearoa wahanga ako in 2022. Some reports were completed earlier in 2023 but were not published separately.

Publishing reports for both curricula at the same time was desired to provide a full picture across all NCEA subjects and wahanga ako.

Who was involved

Evaluation of Te Marautanga o Aotearoa and Kaupapa Ako Māori is based on experiences of 20 schools and kura using Te Marautanga o Aotearoa and Kaupapa Ako Māori NCEA Level 1, as well as New Zealand curriculum subjects – Te Reo Māori and Te Ao Haka. Evaluation was conducted by The Education Review Office | Te Tari Arotake Mātauranga (ERO)

Three reports developed by Evaluation Associates | Te Huinga Kākākura Mātauranga are based on experiences of 92 pilot schools and kura using the New Zealand curriculum – including two kura and four schools in Realm countries - Cook Islands, Niue, Tokelau.

A core part of NCEA Change is developing new standards, assessments and associated teaching and learning materials to replace all existing achievement standards, beginning with Level 1.

Independent evaluation is part of ensuring that changes to NCEA are supporting all ākonga in their NCEA journey.

Evaluation reports are used by the Ministry and NZQA to understand how the new NCEA materials and changes for assessment are working in practice.

An independent view of how pilot schools and kura are building capability and managing the change helps both schools and kura as well as the Ministry and NZQA to look at the changes objectively. Robust, evidence-based information within the evaluation is used to progress the NCEA Changes.

The reports outline both issues and opportunities faced by kaiako and ākonga in NCEA pilots. The experience of pilot schools and kura, alongside evaluation data, is used to develop resources and support to make changes to NCEA practical and accessible for all schools and kura nationally.

Timing

Release of the evaluation reports in July 2023 follows the in-depth evaluation of both The New Zealand Curriculum subjects and Te Marautanga o Aotearoa wahanga ako in 2022. Some reports were completed earlier in 2023 but were not published separately.

Publishing reports for both curricula at the same time was desired to provide a full picture across all NCEA subjects and wahanga ako.

Who was involved

Evaluation of Te Marautanga o Aotearoa and Kaupapa Ako Māori is based on experiences of 20 schools and kura using Te Marautanga o Aotearoa and Kaupapa Ako Māori NCEA Level 1, as well as New Zealand curriculum subjects – Te Reo Māori and Te Ao Haka. Evaluation was conducted by The Education Review Office | Te Tari Arotake Mātauranga (ERO)

Three reports developed by Evaluation Associates | Te Huinga Kākākura Mātauranga are based on experiences of 92 pilot schools and kura using the New Zealand curriculum – including two kura and four schools in Realm countries - Cook Islands, Niue, Tokelau.

[ Heading ]

NCEA Evaluation Te Marautanga o Aotearoa and Kaupapa ako Māori

He kupu whakarāpopoto me te whakarāpopototanga o ngā tūtohungae

Executive summary and summary of recommendations

This report forms part of an evaluation of the quality of the new assessment materials, effectiveness of the pilot systems and processes supporting the implementation of the new achievement standards derived from The New Zealand Curriculum and Te Marautanga o Aotearoa.

The evaluation provides a synthesis view from an independent perspective on the execution and outcomes of the 2022 pilot and mini pilots. The evaluation tests the robustness of the piloting support and process mechanisms with a view to strengthen piloting for future rollouts and for providing ongoing support for senior secondary schools and kura.

He kupu whakarāpopoto me te whakarāpopototanga o ngā tūtohungae

Executive summary and summary of recommendations

This report forms part of an evaluation of the quality of the new assessment materials, effectiveness of the pilot systems and processes supporting the implementation of the new achievement standards derived from The New Zealand Curriculum and Te Marautanga o Aotearoa.

The evaluation provides a synthesis view from an independent perspective on the execution and outcomes of the 2022 pilot and mini pilots. The evaluation tests the robustness of the piloting support and process mechanisms with a view to strengthen piloting for future rollouts and for providing ongoing support for senior secondary schools and kura.

[ File Resource ]

  • Title: Evaluation 2022 Te Marautanga o Aotearoa & Kaupapa Ako Māori
  • Description: ERO evaluation of 2022 pilots, support to kaiako and learners, and summary of achievement standards and assessments
  • File URL: https://ncea-live-3-storagestack-53q-assetstorages3bucket-2o21xte0r81u.s3.amazonaws.com/s3fs-public/2023-07/ERO_NCEA%20Evaluation%202022-Te%20Marautanga%20o%20Aotearoa%20and%20Kaupapa%20Ako%20M%C4%81ori.pdf?VersionId=sOYjQ.LN2TML3YH5f5ZFcnCKw9VYFVwh
  • File Extension: pdf
  • File Size: 857KB

Download
Download

Evaluation 2022 Te Marautanga o Aotearoa & Kaupapa Ako Māori

ERO evaluation of 2022 pilots, support to kaiako and learners, and summary of achievement standards and assessments
ERO evaluation of 2022 pilots, support to kaiako and learners, and summary of achievement standards and assessments
[ Heading ]

Evaluation of the 2022 NZC NCEA Level 1 Mini-Pilot Case Study

This report focuses on the experiences of ten lead teachers in the 2022 pilot. It is intended to present the system shifts across key aspects of NCEA Change objectives – what has changed, and the real-world impacts of new NCEA materials in use in schools and kura.

Each case study reflects the reality of pilot teachers and their ākonga across a range of schools and kura. The report uses direct voices of kaiako to reflect how NCEA changes impact teaching and learning and assessment practices, including how kaiako experienced the inclusion of mātauranga Māori. The case studies include the challenges and highlights of each kaiako and their school.

Each case study focuses on a different NCEA subject, across:

  1. Commerce

  2. Digital Technologies

  3. Drama

  4. English

  5. History

  6. Mathematics and Statistics

  7. Physical Education

  8. Agricultural and Horticultural Science

  9. Te Reo Māori Kūki ‘Āirani

  10. Visual Arts

This report focuses on the experiences of ten lead teachers in the 2022 pilot. It is intended to present the system shifts across key aspects of NCEA Change objectives – what has changed, and the real-world impacts of new NCEA materials in use in schools and kura.

Each case study reflects the reality of pilot teachers and their ākonga across a range of schools and kura. The report uses direct voices of kaiako to reflect how NCEA changes impact teaching and learning and assessment practices, including how kaiako experienced the inclusion of mātauranga Māori. The case studies include the challenges and highlights of each kaiako and their school.

Each case study focuses on a different NCEA subject, across:

  1. Commerce

  2. Digital Technologies

  3. Drama

  4. English

  5. History

  6. Mathematics and Statistics

  7. Physical Education

  8. Agricultural and Horticultural Science

  9. Te Reo Māori Kūki ‘Āirani

  10. Visual Arts

[ File Resource ]

  • Title: NZC Evaluation Case Study Report – January 2023
  • Description: Experiences of ten lead teachers in the 2022 pilot. Presents the system shifts across key aspects of NCEA Change objectives
  • File URL: https://ncea-live-3-storagestack-53q-assetstorages3bucket-2o21xte0r81u.s3.amazonaws.com/s3fs-public/2023-07/NCEA%20L1%20Pilot%20Evaluation_Case%20Studies%20Report_compressed.pdf?VersionId=GjBFuTRYfyOVGEHnjRyL830VhjaOM2oD
  • File Extension: pdf
  • File Size: 15MB

Download
Download

NZC Evaluation Case Study Report – January 2023

Experiences of ten lead teachers in the 2022 pilot. Presents the system shifts across key aspects of NCEA Change objectives
Experiences of ten lead teachers in the 2022 pilot. Presents the system shifts across key aspects of NCEA Change objectives
[ Heading ]

Evaluation of the 2022 NZC NCEA Level 1 Mini-Pilot Report 1

The first of two evaluation reports for the 2022 mini-pilot, focuses on the first half of the 2022 year. The report provided early identification of issues and problems used to refine processes for 2023 pilots as well as implementation ideas and support, and refinements to policy and Level 1 materials.

The report describes:

  • views on the new achievement standards and associated materials

  • the reported impact on teaching and learning

  • the effectiveness of the mini-pilot systems and processes.

The first of two evaluation reports for the 2022 mini-pilot, focuses on the first half of the 2022 year. The report provided early identification of issues and problems used to refine processes for 2023 pilots as well as implementation ideas and support, and refinements to policy and Level 1 materials.

The report describes:

  • views on the new achievement standards and associated materials

  • the reported impact on teaching and learning

  • the effectiveness of the mini-pilot systems and processes.

[ File Resource ]

  • Title: NZC Evaluation Report 1 - NCEA Level 1 2022 mini-pilot
  • Description: First of two evaluation reports, focus on first half of 2022. Views on new achievement standards and associated materials
  • File URL: https://ncea-live-3-storagestack-53q-assetstorages3bucket-2o21xte0r81u.s3.amazonaws.com/s3fs-public/2023-07/NZC%20Evaluation%20Report%201%20NCEA%20Level%20one%20RAS.pdf?VersionId=FvFvZ57CO4P8ESlMe.q8HSpmAs4UvESo
  • File Extension: pdf
  • File Size: 1MB

Download
Download

NZC Evaluation Report 1 - NCEA Level 1 2022 mini-pilot

First of two evaluation reports, focus on first half of 2022. Views on new achievement standards and associated materials
First of two evaluation reports, focus on first half of 2022. Views on new achievement standards and associated materials
[ Heading ]

Evaluation of the 2022 NZC NCEA Level 1 Mini-Pilot Report 2

The full-year evaluation report presents the views and experiences of teachers, students, the Ministry’s Lead Secondary Advisors, and NZQA programme leads. This second evaluation report focuses on how the standards and the supporting materials performed and captures the views and experiences of pilot participants across the full year of piloting. Findings were used to inform further improvements to NCEA materials and expansion of implementation support.

The full-year evaluation report presents the views and experiences of teachers, students, the Ministry’s Lead Secondary Advisors, and NZQA programme leads. This second evaluation report focuses on how the standards and the supporting materials performed and captures the views and experiences of pilot participants across the full year of piloting. Findings were used to inform further improvements to NCEA materials and expansion of implementation support.

[ File Resource ]

  • Title: NZC Evaluation Report 2 - NCEA Level 1 2022 mini-pilot
  • Description: Full-year report. How standards and supporting materials performed, views and experiences of pilot participants across 2022
  • File URL: https://ncea-live-3-storagestack-53q-assetstorages3bucket-2o21xte0r81u.s3.amazonaws.com/s3fs-public/2023-07/NZC%20Evaluation%20Report%202%20NCEA%20Level%20one%20RAS%20May%202023.pdf?VersionId=Cn.sYmXmUQKCGzj682VK2EUmlA5jafBZ
  • File Extension: pdf
  • File Size: 1MB

Download
Download

NZC Evaluation Report 2 - NCEA Level 1 2022 mini-pilot

Full-year report. How standards and supporting materials performed, views and experiences of pilot participants across 2022
Full-year report. How standards and supporting materials performed, views and experiences of pilot participants across 2022