About us

2016 Digital Trials and Pilots evaluation

NZQA’s findings from the 2016 NCEA Digital Trials and Pilots evaluation are being used to inform the 2017 project, as we work towards having NCEA examinations online, where appropriate, by 2020.

As part of the 2016 Digital Trials and Pilots project, feedback was sought from the students, teachers, markers and examination centre managers who participated in the Trials and Pilots. This feedback has been valuable in providing insight into their experience, which is already informing the next steps NZQA takes with digital assessment in collaboration with schools and the wider education sector.

100 schools and 4386 students took part in at least one of the 2016 NCEA Level 1 Digital Trials and Pilots. 263 schools have been involved in NZQA’s Digital Trial and Pilot work in 2015 and 2016.

Feedback from students to the surveys shows we are on the right track. Psychometric and statistical analysis of results, which was conducted for the Level 1 English Pilot examination, showed no evidence of disadvantage for those students sitting a digital examination, compared to the paper equivalent. These are good indicative findings on which to build our future work.

The opt-in Trials and Pilots model is working well, with schools able to participate at a pace they are comfortable with and assess their capacity for digital assessment and its relevance, subject by subject, to the way they are delivering their teaching and learning.

NZQA will continue with a co-creation model for digital assessment wherever practicable.

User Experience Evaluation Report (PDF, 566KB)

Appendices

Appendix A: Psychometric and statistical analysis, English Level 1 externally-assessed achievement standards using digital medium (PDF, 327KB)

Appendix B: Student survey – English Level 1 Digital Pilot 2016 (PDF, 128KB)

Appendix C: Student survey – Media Studies and Classical Studies Level 1 Digital Pilots 2016 (PDF, 124KB)

Appendix D: Student survey – Level 1 Digital Trials 2016 (PDF, 127KB)

Appendix E: Teacher survey – Digital Trials 2016 (PDF, 166KB)

Appendix F: Marker survey – Digital Pilots 2016 (PDF, 147KB)

Appendix G: Examination Centre Manager/Supervisor survey 2016 (PDF, 189KB)