Quality Assurance Framework - cll.mcmaster.ca

1 1 Quality Assurance in Higher Education: A Review of the Literature Karen Nicholson Teaching and Learning Development Officer Council of Ontario Universities Degree Level Expectations Project McMaster University January 3, 2011 Introduction Over the past two decades, Quality Assurance processes in higher education have become increasingly common in Europe, the United Kingdom and Australia, and are steadily gaining in importance in Canada and the United States. A number of factors have contributed to this development: government and industry have advocated that a well-educated workforce is essential to increased productivity and to maintaining a competitive edge in the global knowledge economy, resulting in an increase in public funding for higher education and a drive to make postsecondary education more accessible, particularly for under-represented populations.

2 This, in turn, has brought about calls for greater accountability on the part of educational providers and the measuring of outputs through Quality Assurance processes (Australian Universities Quality Agency, 2009; Harvey, 1998 Harvey & Knight, 1996; Koslowski, 2006; Quality Assurance Task Force, 2010; Woodhouse, 1999). In Ontario, external audit and appraisal of graduate programs has been in place since 1968; for undergraduate programs, it has existed since 1996. 2010 marked the establishment of the Ontario Universities Council on Quality Assurance (the Quality Council) and a new Quality Assurance protocol, the Quality Assurance Framework . The Quality Council is responsible for assuring (a) the Quality of all programs leading to degrees and graduate diplomas granted by Ontario s publicly assisted universities, and (b) the integrity of university Quality Assurance processes.

3 Through these practices, the Quality Council seeks to assist with the improvement and enhancement of university programs. The Quality Council has the following mandate: to guide Ontario s publicly assisted universities in the ongoing Quality Assurance of their academic programs; to review and approve proposals for new graduate and undergraduate programs; to ensure through regular audits that Ontario s publicly assisted universities comply with Quality Assurance guidelines, policies and regulations for graduate and undergraduate programs; to communicate final decisions to the Ministry of Training, Colleges and Universities; 2 to review and revise, from time to time for future application, the Council of Ontario University s Quality Assurance protocols in light of its own experiences and developments in the field of Quality Assurance ; to liaise with other Quality Assurance agencies, both provincially and elsewhere; and to undergo regular independent review and audit at intervals of no longer than eight years.

4 ( Quality Assurance Task Force, 2010, p. 35) With the implementation of the Quality Assurance Framework , publicly assisted universities in Ontario have placed themselves in the mainstream of Quality Assurance . The following literature review provides an overview of some of the main themes related to Quality Assurance in higher education in order to provide background information and context for the Framework . First, we will examine the debate surrounding the meaning and measures of Quality in higher education. Next, we will discuss the dual purpose of Quality Assurance to ensure accountability and promote enhancement and the processes of accreditation, assessment and audit of Quality Assurance by which it is achieved.

5 Finally, we will review common approaches to Quality Assurance in higher education and examine the main features of outcome-based education. Defining Quality One of the overarching themes in the higher education literature on Quality Assurance is how to define and measure Quality . Harvey and Knight (1996) identify the following meanings attributed to Quality : Quality as exceptional, , exceptionally high standards of academic achievement; Quality as perfection (or consistency), which focuses on processes and their specifications and is related to zero defects and Quality culture; Quality as fitness for purpose, which judges the Quality of a product or service in terms of the extent to which its stated purpose defined either as meeting customer specifications or conformity with the institutional mission is met.

6 Quality as value for money, which assesses Quality in terms of return on investment or expenditure and is related to accountability; and Quality as transformation, which defines Quality as a process of qualitative change with emphasis on adding value to students and empowering them. Quality as transformation is further described as critical transformation and as a meta- Quality concept : The transformative notion of Quality presupposes a fundamental purpose of higher education. It assumes that higher education must concern itself with transforming the life experiences of students, by enhancing or empowering them. The transformative conception is, in effect, a meta- Quality concept.

7 Other concepts, such as perfection, high standards, fitness for purpose and value for 3 money, are possible operationalizations of the transformative process rather than ends in themselves. (Harvey & Knight, 1996, pp. 15-16) Bogue (1998) highlights the following three perspectives on Quality common to institutions of higher education: limited supply, often used in institutional rankings such as Macleans; Quality within mission, defined as fitness for purpose ; and value-added, or Quality in results, defined by Astin (1985, cited in Bogue, 1998, p. 9) as the impact on the student s knowledge and personal development and on the faculty member s scholarly and pedagogical ability and productivity.

8 The definitions put forth by Harvey and Knight (1996) and Bogue (1998) can be aligned as presented in Table 1. Definitions of Quality Compared. Table 1. Definitions of Quality Compared Harvey and Knight (1996) Bogue (1998) Quality as exceptional Quality as limited supply Quality as perfection or consistency Quality as fitness for purpose (mission) Quality within mission Quality as value for money Quality as transformation Quality as value-added According to Koslowski (2006), in the 1980 s and 1990 s, Quality was defined as excellence or limited supply and assessed according to the internal resources of an institution, such as the number of faculty with terminal degrees, the number of volumes in the library, reputation, endowment, etc.

9 Emphasis was placed on high Quality inputs and producing excellent outcomes. Total Quality Management and Continuous Quality Improvement, approaches borrowed from corporate management paradigms, followed in the late 1990 s. These were replaced in turn by performance-oriented, outcomes-based approaches to Quality that stress identifying and measuring competencies students should gain through a university education. Since then, the most widely accepted definition of Quality is fitness for purpose (Harvey, 1998; 4 Woodhouse, 1999). One can surmise that its appeal stems from its inherent flexibility, which allows institutions to measure Quality in terms of their ability to meet their respective missions and objectives.

10 For many scholars, the lack of agreement surrounding the meaning of Quality in higher education suggests that the concept borrowed from business and industry is ill suited to the educational context. While customer-based definitions of Quality have gained pre-eminence in business, in higher education, they are viewed as problematic for a number of reasons. First, a singular view of Quality is not representative of the varied and sometimes conflicting views of stakeholder groups: The key issue is the ability of the Quality concept to facilitate the perspective of a range of stakeholders who have different conceptions of higher education (Cullen, Joyce, Hassall & Broadbent, 2003, p.)