2018 Trials & Pilots evaluation reports

2018 Key points – Student Experience:

  • Nine Digital Pilot examinations were offered in 2018 – Levels 1, 2, and 3 for the subjects English, Media Studies, and Classical Studies.
  • 10 Digital Trial examinations were offered in 2018 – the digital only Level 1 Science Trial and Levels 1, 2, and 3 for the subjects English, Media Studies, and Classical Studies.
  • 13,190 unique students participated in NCEA Online Trials and Pilots in 2018.
  • Overall, students continue to be very positive about completing exams online, with 95% of Digital Pilot student survey respondents (21% response rate) preferring a digital exam over paper and 97% reporting that they found their Digital Pilot exam experience a positive one.

Our focus for 2019 is on improving the digital exam experience through continued co-design with students.

2018 Key points – School Participation:

  • 136 schools participated in NCEA Online Trials and Pilots in 2018, including 55 schools new to digital assessment.
  • Since 2016, 203 schools have participated in at least one Digital Trial or Pilot.

The information above and the Evaluation Reports (below) is summarised in a single A3 page (PDF, 767KB).

Reports

There are six evaluation reports:

  1. Student Experience Pilots
  2. Marker Experience Pilots
  3. ECM Supervisor Experience Pilots
  4. Student Experience Science Trial
  5. Student Experience Trials
  6. Teacher PN Experience Trials

Psychometric Analysis Report
Psychometric and statistical analysis of results, which was conducted for the Level 1 and 2 English Pilot examinations, showed no conclusive evidence of a difference in achievement between students completing assessments online or on paper. The analyses were restricted to Level 1 and 2 English, as these two examinations had a large enough number of participants to provide reliable comparisons of the digital and paper formats. Read the full report here (PDF, 674KB).

 
Skip to main page content Accessibility page with list of access keys Home Page Site Map Contact Us newzealand.govt.nz