Conducting external evaluation and review

This section sets out the NZQA policies and guidelines for the external evaluation and review of private training establishments (PTEs), wānanga and institutes of technology and polytechnics. A step by step approach to the conduct of external evaluation and review is described.

The approach to external evaluation and review is generic and applies across all non-university tertiary education organisations (TEOs), yet it is flexible in that it recognises the distinctive contributions of the institutes of technology and polytechnics, wānanga and other TEOs. In particular, the unique values and philosophy of wānanga in the new Zealand tertiary education system will be recognised.

At times, these pages reflect specific details of NZQA's internal processes and roles which may vary from those developed for the external evaluation and reviews undertaken by the Institutes of Technology and Polytechnics Quality (ITPQuality) under delegated authority from NZQA.

The legislative and policy environment

Self-assessment and external evaluation and review are requirements of course approval and accreditation (under sections 258 & 259 of the education Act 1989) for all tertiary education organisations (TEOs) that are entitled to apply. The requirements are set through the course approval and accreditation criteria and policies established by NZQA under section 253(1)(d) & (e) of the Act.

The criteria and policies for private training establishment registration require self-assessment and external evaluation and review at an organisational level, in addition to the individual courses they own or provide. these criteria and policies are set by NZQA under section 253(1)(ca) of the Act.

NZQA is responsible for ensuring TEOs continue to comply with the policies and criteria after initial approval and accreditation of courses and/or registration is granted. However, the New Zealand Vice-Chancellors' Committee (NZVCC) has statutory responsibility for university compliance, and the Institutes of Technology and Polytechnics Quality (ITPQuality) is responsible, under delegated authority from NZQA, for the polytechnic sector compliance.

The Quality Assurance Framework

These policies and criteria are gazetted under the Education Act 1989. they provide for a quality assurance framework established by NZQA, comprising four components:

• initial entry processes of course approval, accreditation to deliver a course, registration of private training establishments and accreditation to assess standards on the national Qualifications Framework
• self-assessment
• external evaluation and review
• managing the consequences of poor performance.

The quality assurance framework uses the theory and practice of evaluation in order to focus on the quality of educational outcomes. evaluation as a discipline provides a systematic basis for answering questions about quality and value. Its use in tertiary education provides a practical approach to focusing on outcomes and key contributing processes, using both qualitative and quantitative information.

Evaluative quality assurance draws on a wide range of international theory and practice, in particular mixed method and participatory approaches, to arrive at a robust process for reaching consistent and comparable judgements.

The following four principles underpin the quality assurance framework.

'High trust and high accountability'

Evaluative quality assurance operates in an environment of 'high trust and high accountability' throughout the tertiary sector. the relationship between government agencies and TEOs is based on good communication and collaboration.

A high trust environment recognises a TEO has autonomy over its own processes, with minimal crown intervention, except in relation to undertaking its regulatory roles.

The government recognises that quality is the direct responsibility of each individual TEO and that the TEO is accountable for the educational outcomes it achieves and the ongoing improvement of educational performance.

In return for greater autonomy, the crown needs to have a high level of confidence in each TEO. external evaluation and review is the mechanism that will determine those levels of confidence. However, if the performance of a TEO falls below an acceptable level, that organisation will be monitored more closely by central agencies.

Quality as a dynamic concept

Quality is dynamic and will look different in different contexts. In tertiary education, what matters is the value that learners gain from their learning experience, the utility of their qualifications and the extent to which positive, longer-term outcomes occur.

this dynamic concept of quality is consistent with international trends where there is a shift from quality control (meeting input standards) to quality enhancement and striving for excellence. this approach emphasises the aspects of an education experience that generate better outcomes.

Every TEO will have an understanding of quality which varies according to the purpose and goals of the organisation. In the TEO context, quality relates to how well learners actually achieve and the extent to which that achievement meets both their needs and those of the wide range of groups and individuals that have a direct, formal and often economic interest in the work of TEOs.

A Focus on outcomes

Traditional quality assurance has focused mainly on inputs, systems and activities. this assumes that doing these well provides an assurance of quality.

evaluative quality assurance is focused on the outcomes of tertiary education and the key processes that contribute to these outcomes. A key difference from traditional approaches is that while evaluative quality assurance also looks at processes, it does so from the perspective of the utility or impact of these processes on what is done and achieved - the 'valued outcomes' of tertiary education.

Outcomes are affected by contextual inputs such as student characteristics, staff and resources. An important indicator of quality in practice is a TEO taking all reasonable steps to maximise learner achievement.

Flexibility

Evaluative quality assurance is flexible and designed to constructively respond to the distinctive contributions and character of the wide range of tertiary education organisations in New Zealand.

Like the concept of quality, it recognises that evaluation will look different in different contexts, while still retaining the required consistency of approach to evaluate performance credibly.

In particular, the approach to evaluation taken by the distinctively Māori organisations, notably wānanga and Māori private training establishments, will directly reflect their values, beliefs and aspirations.

Page updated: 31 August 2009