National external moderation manual for Tertiary Education Organisations

Section Four: Moderation Report

The moderation report describes the outcomes of the moderation. The moderator completes the moderation report and sends a copy to the TEO’s moderation liaison and NZQA. The expected turnaround time is three weeks from the moderation submission date, except for November submissions when the turnaround time may be longer. If you have not received a moderation report within six weeks of your submission date, please contact Tertiary Assessment and Moderation

Moderation results for most field Māori standards are often confirmed at kāhui. The turnaround time for materials moderated at kāhui may be eight to ten weeks, depending on the submission date.

Following is a description of each part of a moderation report and how to interpret it.

The front cover

The front cover of the moderation report provides an overall summary of findings. It contains the following sections:

  1. Overview: This gives a summary of moderation findings in relation to the standard, including where there are any areas of concern.  It will refer to the assessment materials and assessor judgements.
  2. Commentary (optional): This section is completed when the moderator can give some specific feedback to assist the assessor that is not directly related to the moderation result.
  3. Next Steps: This section is included in all reports for schools and TEOs. There is a different statement for schools and TEOs.

Moderation Results: explaining the results

The Moderation Results section of the moderation report focuses on the overall moderation results.

Overall decision about assessor judgements

The number in the first box is how many assessor judgements about learner samples the moderator has agreed with (i.e. verified).

The number in the second box is how many learner samples the organisation submitted for national external moderation.

Fig1 - Moderation results section

Figure 1: Moderation results section (view larger version (GIF, 9.9KB))

In the moderation report for Literacy or Numeracy unit standards, there will be no reference to or moderation result for assessment materials. This is because these standards are assessed on the basis of naturally occurring evidence, and setting assessment activities for the purposes of assessing these standards is inappropriate. The overall moderation decision will only refer to the number of assessor judgements about learner samples the moderator has verified.

Figure 2: moderation results in  literacy and numeracy moderation report

Figure 2: Moderation results in Literacy and Numeracy moderation report (view larger version (GIF, 6.8KB))

A 0/0 moderation result for assessor judgements may be given when:

  • no learner work was submitted
  • no assessor judgements/results are shown on the moderation coversheet, and your TEO has been unable to provide further clarification to TAM
  • the assessor decisions could not be verified (for example because the learner evidence is illegible or un-viewable, or because there isn’t enough submitted evidence of learner performance for the moderator to see how the assessor made their judgement).

Overall decisions about assessment materials

Moderators reflect on the assessment materials overall when making their decision. Specifically, whether the outcome in the title and purpose of the standard has been met. Moderators use the following bulleted indicators to determine whether the assessment materials meet the national standard, if they require modification or they do not meet the national standard.

Moderator decision: The assessment materials meet the national standard

Any issues identified in the moderation report are very minor, or phrased as recommendations.

Likely indicators for this decision:

  • Special/explanatory notes and all of the outcomes/elements have been covered.
  • Range statement requirements and evidence requirements/performance criteria have been appropriately covered.
  • The only “No” decisions in the moderation report are for minor issues in sections 1 and 3 (i.e. decisions in sections 2, 4 and 5 must all be “Yes”).
Moderator decision: The assessment materials require modification

The assessment materials require revision or some redevelopment, but issues identified can easily be addressed (i.e. the moderator is satisfied that, if the modifications specified in the moderation report are made, materials will meet the national standard).

Likely indicators for this decision:

  • Special/explanatory notes and all outcomes/elements have been covered.
  • There are only minor omissions in the assessment materials and/or schedule, for example either the evidence or judgement statements in the schedule are missing or unclear, or model answers have been referred to but not included for moderation.
  • Most of the range statement requirements and most of the evidence requirements/performance criteria have been appropriately covered.
  • There are a sufficient number of “Yes” responses in the assessment materials and schedule sections of the moderation report to validate the assessment materials.
Moderator decision: The assessment materials do not meet the national standard

The assessment materials require significant redevelopment. The issues are widespread within the materials (note: some examples of the issues will be given in the moderation report rather than an exhaustive list). A complete review of the materials is needed.

Likely indicators for this decision:

  • A significant number of special/explanatory notes and/or outcomes/elements have not been covered.
  • There are serious omissions in the assessment materials and/or schedule. A significant number of range statements and/or evidence requirements/performance criteria have not been covered.
  • There are insufficient “Yes’s” in the assessment materials and schedule sections of the moderation report to validate the assessment materials.

TEO follow-up on results

If the moderator has ticked “The assessment materials meet the national standard”:

  • address any issues or consider areas for improvement that the moderator may have commented on.

If the moderator has ticked “The assessment materials require modification”:

  • The assessment materials must be modified before they are used again.
  • The moderation report will detail what changes are required for the assessment materials to meet the national standard, or specify where the materials do not meet the standard.
  • The standard may be chosen again for moderation as a resubmission in the same year, or in the following year.
  • Please do not resubmit the materials once you have modified them unless TAM has asked you to (in the letter accompanying your National External Moderation Results report will contain this information – refer to National External Moderation Report).

If the moderator has ticked “The assessment materials do not meet the national standard”:

  • The assessment materials must be significantly altered before they can be used again.
  • The moderation report will detail what changes are required for the assessment material to meet the national standard.
  • NZQA will notify your TEO of what further action will be required for this assessment in a letter sent with the National External Moderation Results report.

Assessment Materials

This section of the moderation report, comments on the outcomes of the moderation of assessment activities, conditions and the assessment schedule.

Figure 3: Assessment materials section

Figure 3: Assessment materials section (view larger version (GIF, 31KB))

Assessed Work

This section of the moderation report, comments on the outcomes of the moderation of assessor decisions about learner evidence.

Both the assessor judgements of the learner evidence (as noted on the Tertiary moderation cover sheet) and the moderator decisions about the assessor judgements are recorded in this section.

In the example below, the moderator agreed with the assessor decisions for one out of three samples (learner 2) and disagreed with the decision for learner 1 and learner 3. This information is transferred to the Moderation Results section of the moderation report.

Figure 4: Assessed work section of the moderation report

Figure 4: Assessed work section of the moderation report (view larger version (GIF, 16KB))

What to do when you receive the moderation report

The moderation liaison should ensure all relevant people in your TEO get a copy of the moderation report. If the moderation report states that the assessment materials require modification or do not meet the national standard, modify the assessment material as indicated in the moderation report. This needs to be done before the assessment materials are used again.

We also recommend that the feedback in all NZQA moderation reports is used to inform assessment practice within your TEO as well as your organisation’s assessment design and internal pre- and post-assessment moderation processes.

The National External Moderation Results report and accompanying letter from TAM will detail anything else the TEO has to do (for example resubmit material and/or an action plan).

If your organisation has questions or concerns about the results or comments contained in a moderation report, please have your TEO’s moderation liaison contact Tertiary Assessment and Moderation. Do not contact the moderator directly.

Refer also to Moderation clarifications and appeals.

Assessment Materials Not Received (AMNR) report

As mentioned in Submitting assessment materials for moderation, if your organisation receives an AMNR report, do not then send assessment materials to the moderator.

However, if your TEO did send the assessment materials to the moderator and still received an AMNR report, please contact Tertiary Assessment and Moderation.

 
 
Skip to main page content Accessibility page with list of access keys Home Page Site Map Contact Us newzealand.govt.nz