Quality Assurance of Quality Assurance Agencies

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 12

Asia Pacific Educ. Rev.

DOI 10.1007/s12564-015-9358-9

Quality assurance of quality assurance agencies from an Asian


perspective: regulation, autonomy and accountability
Angela Yung-Chi Hou • Martin Ince •

Sandy Tsai • Chung Lin Chiang

Received: 4 August 2014 / Revised: 27 January 2015 / Accepted: 30 January 2015


 Education Research Institute, Seoul National University, Seoul, Korea 2015

Abstract As quality guardians of higher education, are facing and dealing with are presented as a conclusion at
quality assurance agencies are required to guarantee the the end of the paper.
credibility of the review process and to ensure the objec-
tivity and transparency of their decisions and recommen- Keywords Internal quality assurance  External quality
dations. These agencies are therefore expected to use a assurance  Quality assurance agency  Higher education
range of internal and external approaches to prove the
quality of their review activities. Quality assurance agen-
cies in Asia are attempting to enhance their quality ca- Introduction
pacity through several internal and external approaches.
The purpose of this study is to explore internal and external More than 100 countries across the globe have established
quality assurance mechanisms used by quality assurance higher education quality assurance (QA) mechanisms of
agencies in Asian nations, through an international survey varied types, based on a range of purposes and processes,
of 17 APQN full members and their use of the International including auditing, accreditation, evaluation, ranking and
Network of Quality assurance Agencies in Higher Educa- benchmarking (APQN 2012a). As quality guardians of
tion and the Asia–Pacific Quality Network guidelines. The higher education, quality assurance agencies are required to
balance between external review and autonomy is dis- guarantee ‘‘the credibility of the review process and to
cussed at the national and international levels. The chal- ensure the objectivities and transparency of their decisions
lenges and strategies that Asian quality assurance agencies or recommendation’’ (Martin and Stella 2007, p. 91).
As public concern over the accountability of quality
assurance agencies escalates, they are expected to
demonstrate to stakeholders that they are serious about
A. Y.-C. Hou (&) accreditation activities and have a positive impact on
Graduate School of Educational Leadership and Development, higher education. ‘‘Quality assurance agencies are desig-
Fu Jen Catholic University, 510, Jhongjheng Rd., nated to be self-critical, objective and open-minded’’
Sinjhuang City, Taipei County 24205, Taiwan, ROC
(Costes et al. 2012, p. 28) in checking the quality of higher
e-mail: 035440@mail.fju.edu.tw
education institutions. This expectation has led to the
A. Y.-C. Hou recognition by quality assurance agencies of external re-
Office of International Education, Fu Jen Catholic University, view as a legitimate exercise at the national and interna-
510, Jhongjheng Rd., Sinjhuang City, Taipei County 24205,
tional levels. This is referred to as ‘‘accountability of
Taiwan, ROC
accreditation.’’ Eaton (2011) states that the accountability
M. Ince of quality assurance agencies refers to how, and how much,
Martin Ince Communications Limited, London, UK quality assurance agencies accept responsibility for the
quality and results of their work and are openly responsive
S. Tsai  C. L. Chiang
Fu Jen Catholic University, Sinjhuang City, Taipei County, to constituents and the public. Quality assurance agencies
Taiwan, ROC are therefore expected to undertake varying internal and

123
A. Y.-C. Hou et al.

external approaches to prove the quality of their review International Network of Quality assurance Agencies in
activities (Woodhouse 2004). Higher Education (INQAAHE), and the Asia–Pacific
The USA was the first nation to develop a recognition Quality Network (APQN), have published guidelines or
system for the quality of quality assurance agencies at the principles of best practice for the self-review of quality
national level. In 1998, the Council for Higher Education assurance agencies. The ASEAN University Network
(CHEA), the American recognition organization, an- (AUN) has also published guidelines for quality assurance
nounced its standards for recognition of American ac- to assist quality agencies ‘‘inside and outside ASEAN in
creditors (CHEA 2006). Germany also developed a relation to harmonization of quality assurance frameworks
recognition scheme at an early stage, essentially because of and development of professionals in quality assurance’’
its decentralized accreditation system. German quality as- (AUN 2014a). The ASEAN University Network Quality
surance agencies are supposed to be accredited by the Ac- Assurance Guidelines was intended ‘‘as a manual and
creditation Council of the Foundation for the Accreditation reference for the distinct and unique quality assurance
of Study Programmes, which acts ‘‘as the central decision- movement in the ASEAN region’’ (AUN 2014b, p. 2).
making body of the foundation to define the basic require- The main purpose of this study is to explore the internal
ments of the process and takes care that any accreditation is and external quality assurance mechanisms of quality as-
carried out on the basis of reliable, transparent and inter- surance agencies in Asian nations through an international
nationally recognized criteria.’’ (GAC 2010, p. 1). survey of 17 APQN full members using INQAAHE and
The international recognition system for quality assur- APQN guidelines and semi-structured interviews with 11
ance agencies was initiated in Europe for the purpose of top administrators of quality assurance agencies. The
regional integration in higher education. In 2005, the challenges and strategies that Asian quality assurance
European Association for Quality Assurance in Higher agencies are facing and dealing with are presented as a
Education (ENQA) stated that its full membership criteria conclusion at the end of the paper. Based on these research
would involve achieving part III of Standards and Guide- aims, five research questions are addressed, as follows:
lines for Quality assurance in the European Higher
1. How was the recognition system for quality assurance
Education Area (ESG) (ENQA 2005; ENQA 2010).
agencies developed?
Similarly, the European Quality Assurance Register for
2. What is the current development of quality assurance
Higher Education (EQAR), a register of quality assurance
in Asian higher education?
agencies established in 2008, requested applicant agencies
3. How did Asian quality assurance agencies enhance
to demonstrate their substantial compliance with ESG
their quality through the internal quality assurance and
through an external review by independent experts (EQAR
external review?
2013).
4. How can Asian quality assurance agencies strike a
Over the past decade, Asian nations have developed
balance between external review and autonomy?
their own quality assurance system, by setting up a national
5. What is the role of the governments and international
accreditor whose principal role is to accredit local tertiary
quality assurance networks in quality improvement of
education institutions and academic programs. Even before
Asian quality assurance agencies?
the establishment of their current national accreditor, local
accreditors, including professional accreditors, had
emerged in Asian countries. In order to ensure the quality
of these quality assurance agencies, some nations have Literature review
developed a recognition system for them. Take the
Philippines for example. It has two recognition bodies Development of recognition scheme of quality
certified by the Commission on Higher Education of the assurance agencies
Philippines (CHED). All accrediting agencies operate un-
der the umbrella of the National Network of Quality As- Quality assurance is ‘‘a process of establishing stakeholder
surance Agencies (NNQAA) and of the Federation of confidence that provision (input, process and outcomes)
Accrediting Agencies of the Philippines. However, there fulfills expectations or measures up to threshold minimum
are no specific standards for recognition. requirements’’ (INQAAHE 2013a). Since quality assurance
Driven by global forces in higher education, Asian na- became recognized as a profession in recent years, quality
tional quality assurance agencies are now being challenged assurance agencies are supposed to be ‘‘under review and
to demonstrate that the quality of their own operations development to ensure that they remain current and rele-
meets externally determined as well as international stan- vant’’ on the basis of a systematic scheme for quality
dards. In recent years, other international networks of (Woodhouse 2010, p. 79). Governments, driven by pres-
quality assurance in higher education, such as the sure for accountability, also impose external review on

123
Quality assurance of quality assurance agencies

quality assurance agencies, and in the 1990s, several in- such as meta-evaluation. The registration mode is charac-
ternational networks stated that they considered peer re- terized by stipulating that quality assurance agencies
view ‘‘an important tool available to the quality assurance should comply substantially with a specific standard in
agencies to strengthen their credibility and accountability’’ order be admitted to an international register, such as the
(APQN 2012c, p. 2). European Quality assurance Register for Higher Education
Szanto (2010) proposed four tiers of a quality assurance (EQAR). In the last mode, ‘‘following the principles or
pyramid intended to ensure the overall quality of a higher practices of the international networks,’’ quality assurance
education system. At the first level, higher education in- agencies conduct a regular external review on the basis of
stitutions need to develop an internal quality assurance the criteria and guidelines of international networks to
mechanism for self-assessment. Quality assurance agencies maintain their membership. This applies to the members of
conduct an external review at the institutional and program the International Network of Quality Assurance Agencies
levels, and this is the second level. The third involves in Higher Education (INQAAHE), the European Asso-
recognition bodies aiming to recognize quality assurance ciation for Quality Assurance in Higher Education (ENQA)
agencies in terms of professionalism, resources, indepen- and the Asia–Pacific Quality Network (APQN) (Table 1).
dence, self-enhancement mechanisms, etc. In most coun- Generally speaking, European and US agencies tend to
tries, a Department of Education plays the role of belong to ‘‘Umbrella’’ and ‘‘Registering’’ models, due to
recognition body. Few countries set up an independent the existence of a well-developed higher education quality
recognition organization to review quality assurance assurance system. Most public agencies involved in na-
agencies externally. International quality assurance net- tional audits fall into the mode of ‘‘Built-in checks.’’ At
works are considered the final quality guardians to ‘‘review present, more and more quality assurance agencies are in
the reviewers,’’ that is, they scrutinize agency reviewers to pursuit of autonomy and internationalization, and are
see whether reviews are conducted in an appropriate moving to the modes of ‘‘Periodic assessment’’ and ‘‘Ad-
manner and in adherence to international standards (see herence to international principles.’’ These include the
Fig. 1). Tertiary Education Quality and Standards Agency
Martin and Stella (2007) categorized the current (TEQSA) and the Higher Education Evaluation & Ac-
recognition modes of quality assurance agencies into five creditation Council in Taiwan (HEEACT).
types, including Built-in checks, Umbrella organization
mechanism, Periodic assessment of agencies, Registration Internal and external quality assurance approaches
of agencies and Following the principles or practices of the by quality assurance agencies
international networks. In Built-in checks mode, quality
assurance agencies are required to submit their plans and As the public becomes more concerned with the effec-
annual reports to the governing bodies, particularly gov- tiveness of quality assurance activities, demonstrating the
ernment, which will make them public to ensure trans- ‘‘quality of quality assurance’’ is an area of growing in-
parency and strengthen accountability. Most public terest for all quality assurance agencies (APQN 2010).
agencies follow this model. In umbrella mode, quality as- Quality assurance of quality assurance agencies consists of
surance agencies need to obtain regular national recogni- internal and external quality assurance (IQA and EQA),
tion from an independent umbrella body, such as the which indeed are so much ‘‘two sides of the same coin that
Council for Higher Education (CHEA) or the Accreditation the activities are inextricable interrelated’’ (Vroeijenstijn
Council of Germany (GAC), as an accountability measure. 2008, 1). Both internal and external quality assurance will
This applies especially to a diversified quality assurance help in decision-making processes by the agencies.
system. Periodic assessment of agencies emphasizes that According to the International Network of Quality as-
the external assessment is launched by some internal need, surance Agencies in Higher Education (INQAAHE)
(2013a), internal review means ‘‘a process of quality re-
view undertaken within an institution for its own ends.’’
Level one
Here, internal quality assurance is considered as the part of
Higher Education institutions (self assessment) the external process that an institution undertakes in
Level two preparation for an external quality assurance. Several in-
Quality Assurance Agencies (external review)
ternational networks have engaged in developing guideli-
Level three nes for the self-improvement of quality assurance agencies.
Recognition Agencies (national review of reviewers)
In order to underpin European quality assurance agencies’
Level four
International Networks of Quality assurance (international and regional review of reviewers) own development and self-improvement, Standard 3.8
(entitled ‘‘Accountability procedures’’) in the European
Fig. 1 Four tiers of quality assurance pyramid standards for external quality assurance agencies (ESG)

123
A. Y.-C. Hou et al.

Table 1 Comparisons of the Models of quality assurance of quality assurance agencies


Items Types
Built-in checks Umbrella model Periodic assessment Registering Adherence to international
principles

Recognition/ Government Recognition body Quality assurance agencies International International networks
supervising network
body
Level/nature National Independent Institutional Regional International
Procedure submit their plans and Review externally Meta-evaluation Review Self-enhancement
annual reports externally
Approach External Internal and external Internal Internal & Internal
external
Feature Accountability Quality assurance Quality enhancement Quality Quality enhancement
assurance
Examples Malaysia qualification CHEA (US), GAC TEQSA (Australia) EQAR INQAAHE, ENQA, and
Agency (MQA) (Germany) HEEACT (Taiwan) members APQN members
Source: Martin and Stella (2007). External quality assurance in higher education: making choices. Paris: UNESCO

states that European ‘‘agencies should have in place in- and more efficient way to gather opinions. However, their
ternal assurance procedures for their own accountability’’ limited number of participants makes it difficult to tell
(ENQA 2005, p. 26). Founded in 1999, the International whether all the information they produce is accurate and
Network of Quality assurance Agencies in Higher Educa- unbiased (Marcos 2012). In response, quality assurance
tion (INQAAHE) aims to be a platform for information agencies have started to adopt multiple methods to gather
sharing on good practices for quality improvement in feedback from macro- and micro-perspectives.
higher education between quality assurance agencies Internal quality assurance is a major element of the
(Woodhouse 2004). To assist in the self-review of quality quality assurance of quality assurance agencies (ENQA
assurance agencies, it has developed good principles and 2012). However, a study by the European Association for
practices, entitled the Guidelines of Good Practice in Quality assurance in Higher Education (ENQA) reviewing
Quality Assurance (GGP). In the first section, the guideli- 34 European quality assurance agencies’ self-review re-
nes state that external quality assurance should have ‘‘a ports found that only 65 percent of the agencies comply
system of continuous quality assurance of its own activities with accountability standards. It concludes that the imple-
that emphasizes flexibility in response to the changing mentation of internal quality assurance mechanism is still
nature of higher education, the effectiveness of its op- developing (ENQA 2010). But its arrival has already
erations and its contribution toward the achievement of its brought with it several impacts on quality assurance
objectives’’ (INQAAHE 2009, p. 7). These indicators will agencies, such as internal knowledge of the organization
be of practical assistance for quality assurance agencies in itself, the creation of a methodology for internal checks and
reviewing their level of quality assurance operations awareness of the weaknesses and strengths of an organi-
(ENQA 2005; INQAAHE 2009; Blackmur, 2008a). zation (Llavori, 2010).
Several internal quality assurance approaches are gen- External reviews mean ‘‘a process that uses people ex-
erally undertaken by quality assurance agencies them- ternal to the program or institution to evaluate quality or
selves, such as collecting feedback from reviewed standards’’ (INQAAHE 2013a). In other words, an external
institutions through satisfaction surveys and having formal quality review undertaken by a third party, which might be
or informal meetings, seminars and congresses with a government, a recognition body or an international net-
stakeholders (Marcos 2012). Recently, some agencies have work, is intended to recognize the quality of the agency’s
organized focus groups and conducted meta-evaluation to activities. Nowadays, ‘‘the shift from internal improvement
gather information. These different tools for internal toward external accountability seems to prevail’’ (Szanto
quality assurance might each have their advantages and 2010, p. 12) among quality assurance agencies.
disadvantages. Take satisfaction surveys, for example. In fact, several quality assurance agencies began early in
Anonymous surveys tend to be positive and do not permit the 1990s to review themselves through an external review
more interaction with respondents. In addition, any new mechanism, such as the Middle States Association of
ideas to emerge will probably not come from the institution Schools and Colleges (USA), the Higher Education Quality
being assessed. In contrast, focus groups seem to be a faster Council (UK), the University Grants Committee (Hong

123
Quality assurance of quality assurance agencies

Kong), the German Accreditation Council (Akkreditier- Hong Kong in 2003 ‘‘to enhance the quality of higher
ungsrat) (Germany) and the North-Central Association of education in Asia and the Pacific region through strength-
Schools and Colleges (USA). The major reasons for ex- ening the work of quality assurance agencies and extending
ternal review include the need to renew recognition status, the cooperation between them’’ (APQN 2012b). It has
assisting in the development of the future plans and ac- criteria for membership review in place, including the na-
tivities of the agency and demonstrating that it meets the ture of the operations, mission statement and objectives,
stakeholder’s expectations (Szanto 2010). staff, profile of reviewers, independence, resources, review
Quality assurance networks have started to review criteria and processes, and quality assurance. Like the In-
quality assurance agencies externally by a set of criteria in ternational Network of Quality Assurance Agencies in
order to grant or maintain membership. The European Higher Education (INQAAHE) and the European Asso-
Association for Quality Assurance in Higher Education ciation for Quality assurance in Higher Education (ENQA),
(ENQA) is the first organization to review all its members’ it has proposed some specific principles, called the ‘‘Chiba
status externally, including their quality assurance proce- Principles,’’ for quality assurance agencies and institutions
dures for higher education, official status, activities, re- (in 2008) (APQN, 2010). In 2012, supported by the Global
sources, mission statement, independence, criteria and Initiative for Quality assurance Capacity (GIQAC), it
process, and accountability. It emphasizes that this external conducted a pilot study on assisting its member agencies to
review should be objective and provide ample evidence for undergo peer reviews. The Quality and Accreditation
the given agency meeting (or not) the European standards Council established under the University Grants Commis-
for external quality assurance agencies (ESG) and thereby sion (UGC) in Sri Lanka was the first member to take part
the ENQA membership criteria (ENQA 2005). in the initiative against the criteria drawn from APQN’s
In 2009, the International Network of Quality Assurance membership criteria, the Chiba principles and the
Agencies in Higher Education (INQAAHE) undertook an INQAAHE Guidelines of Good Practice (APQN 2012c). In
‘‘adherence review’’ of its members to the INQAAHE 2014, the APQN decided to launch the Asia Pacific Quality
Guidelines of Good Practice. Unlike the European Asso- Register (APQR) to serve a quality hallmark ‘‘for global
ciation for Quality assurance in Higher Education (ENQA), stakeholders on trustworthy quality assurance agencies in
the external review is applied voluntarily by its members. Asia Pacific’’ (APQN 2014, p. 2).
Up to the present, ten members have been recognized in
accordance with the INQAAHE Guidelines of Good Anatomy of Asian quality assurance agencies and their
Practice (INQAAHE, 2013b). The review standards in- assessment tools in era of mass higher education
clude the agency’s governance, resources, quality assur-
ance, reporting of public information, relationship with In recent decades, higher education in Asia has been in the
institutions, standards and internal reviews for institutions, massification phase. Enrollments have increased by over
evaluation, decision, and appeals systems, collaboration 50 %, and in East Asia and Pacific, the gross enrollment
with other quality assurance agencies and policy on cross- rate has reached the world average level (Calderon 2012,
border higher education. For the review, it uses a panel of Marginson et al. 2011). Due to the variations in demo-
international experts to undertake an on-site visit. A final graphic and economic development, national higher
report indicating specific areas in which shortcomings are education systems are vastly different in size and growth.
observed is presented to the reviewed agencies for follow- For example, China with its 1.3 billion population has more
up actions. Take the Sistema Nacional de Accreditacion de than 2,300 higher education institutions, compared to 1.2
la Education Superior (SINAES) review for example: the million Timor-Leste with one university.
final review report states, Massification generates access to higher education, but
it also increases public concern over the quality of insti-
SINAES met fully ten of the INQAAHE Guidelines
tutions and students. As a result, it poses several challenges
and it provided several commendations for how
to quality assurance and management in higher education.
carefully SINAES had structured the agency and its
To respond to this trend, Asian governments determined to
accreditation programs to meet and, in some cases,
develop national quality assurance systems in higher
exceed the international good practices… by meeting
education, including national or professional accreditors.
fully or substantially all of the INQAAHE’s Guide-
Quality assurance systems in Asian nations are diverse
lines, SINAES is well positioned to maintain its ex-
in terms of size, maturity, budget, nature, subjects and re-
cellence and credibility in the future. (INQAAHE
view approach (Stella 2010). In most Asian nations, the
2010, p. 3).
principal role of a national accreditor is to accredit local
With the support of the World Bank and UNESCO, the tertiary education institutions and academic programs.
Asia–Pacific Quality Network (APQN) was established in Even before the establishment of a national accreditor,

123
A. Y.-C. Hou et al.

numerous local accreditors emerged in Asian countries, assurance agencies. The Council for Higher Education
such as the Shanghai Education Evaluation Institute in Accreditation (CHEA) defined ‘‘accreditation’’ as ‘‘a pro-
1996 and the Institute of Engineering Education Taiwan in cess of external quality review created and used by higher
2003. To date, half of the Asian nations have more than education to examine colleges, universities and programs
two accrediting bodies, including Japan, Hong Kong, for the purposes of quality assurance and quality im-
China, Philippines and Taiwan (APQN 2012a). These local provement’’ (CHEA 2008, p. 12). In other words, ac-
accreditors are self-funded agencies, ‘‘without any inter- creditation ‘‘is a voluntary process of approval of an
vention of central governmental in its establishment or institution or program by an accrediting agency or body’’
functioning’’ (Martin and Stella 2007, p. 82). They review according to its own mission and goal (WASC 2008). The
certain groups of universities or types of program via a Hong Kong Council for Accreditation of Academic and
voluntary approach. Vocational Qualifications (HKCAAVQ) and Higher
Several quality assurance agencies have been set up for a Education Evaluation and Accreditation Council of Taiwan
long time and are trying to make further improvements, such (HEEACT) adopted the ‘‘Accreditation’’ concept to assess
as the Japan University Accreditation Association (JUAA) programs and institutions.
founded in 1947 (Hou 2014). Some have well-established ‘‘Evaluation’’ involves decisions by peers and/or stake-
policies and procedures that can be learned by other agen- holders concerning an individual institution’s achievement,
cies, like the Hong Kong Council for Accreditation of Aca- excellence and/or potential. It ‘‘focuses more on how
demic and Vocational Qualifications (HKCAAVQ). Some successfully the institution is achieving its goals and ob-
new agencies have recently established their policies and jectives’’ (NIAD-UE 2007, p. 4). It often involves a culture
procedures, for example, the National Center of Public Ac- of self-reflection and self-improvement. National Institu-
creditation (NCPA) established in Russia in 2009. tion for Academic Degrees and University Evaluation
Most Agencies are pubic organizations funded by gov- (NIAD-UE) is among one of the agencies in this sphere.
ernment. A few are self-funded by charging applicant in- As with the previous terms, ‘‘audit’’ focuses more on
stitutions fees, such as the Accrediting Agency of ‘‘evaluating processes rather than evaluating quality’’
Chartered Colleges and Universities in the Philippines (INQAAHE 2013b). Instead of assessing the institution, the
(AACCUP). Yet, even these still receive partial support aim of ‘‘audits’’ is to ensure that the institution has clearly
from government. Asian agencies vary in size and budget, defined internal quality monitoring procedures linked to ef-
too. The biggest is the Malaysia Qualification Agency fective action and implementation (INQAAHE 2013b). The
(MQA) with 320 staff, while the smallest, the New Zealand New Zealand Universities Academic Audit Unit (NZAAU)
Universities Academic Audit Unit (NZAAU), employs one has adopted ‘‘audit’’ in its institutional assessment.
staff member only. Annual budgets of the agencies ranged To sum up, Asian nations have developed their own
from 0.03 million USD to 33.3 million USD. systems to ensure the quality of their higher education in-
In terms of review subjects, more than two-thirds of stitutions, with either a single national agency or a diver-
agencies undertake reviews both at the program and at the sified framework. For example, in Indonesia, the National
institutional levels, such as the Accreditation Committee of Accreditation Agency for Higher Education (BANPT)
Cambodia, the Higher Education Evaluation and Ac- (Indonesia), as a public organization, has conducted ac-
creditation Council of Taiwan, and Yunnan Higher creditation of programs and universities via a mandatory
Education Evaluation Center. A few have implemented approach. The accreditation fees were borne by the gov-
institutional evaluations in response to the growing number ernment. In Japan, NIAD-UE has conducted university
of higher education institutions. These include the National evaluation of public universities using a mandatory ap-
Institution for Academic Degrees and University Evalua- proach, and again, the cost was covered by the government.
tion (NIAD-UE, Japan), the Office for National Education In contrast, the other private agency, the Japan University
Standards and Quality Assessment (ONESQA, Thailand) Accreditation association (JUAA), has engaged in volun-
and the National Assessment and Accreditation Council tary evaluation of private universities which pay fees for
(NAAC, India). In addition to higher education institutions, this service.
some agencies, as the one nationally recognized quality In response to the growing global reach of higher
assurance agency, have to accredit vocational educational education, some Asian nations started to welcome inter-
schools. These include the Malaysia Qualification Agency national accreditors, particularly US accreditors, wishing to
(MQA), the General Department of Education Testing and provide cross-border quality assurance services for local
Accreditation (GDETA) and the Office for National institutions (Ewell, 2008). This development led to de-
Education Standards and Quality Assessment (ONESQA). mands by governments and institutions for international
‘‘Accreditation,’’ ‘‘Evaluation’’ and ‘‘Audit’’ are the accreditation to be integrated into the national quality as-
three major assessment tools adopted by Asian quality surance framework (Hou et al. 2015). Accreditors emerged

123
Quality assurance of quality assurance agencies

at local, national and global levels in East Asian countries, (Cohen et al. 2007). In addition, triangulation involving
including China, Hong Kong, Japan and Taiwan. using multiple data sources in an investigation to produce
understanding was adopted as a method for verification of
major findings (Patton 2001). There are two major limita-
Research method and subjects tions of online surveys and email contacts. One is the low
rate of full response. Some target groups are not patient and
The research adopted a qualitative approach to collect the motivated enough to answer all questions. Complexity is
relevant data, including an online survey and quality as- the other problem. Online questionnaires cannot be too
surance experts’ interviews. First, an online survey tar- complex and complicated, or the respondents may not
geting twenty-six the Asia–Pacific Quality Network understand them properly (Dillman 2000).
(APQN) full members was conducted in 2011 to discover
their current situation in the development of internal and
external quality assurance mechanisms. Three international Major findings
quality assurance experts from APQN and INQAAHE were
invited to review whether the questionnaires were appro- Quality assurance agencies’ responses and their attitude
priate. The on-line survey was mailed to 26 contact persons toward internal and external quality assurance
on the Asia–Pacific Quality Network (APQN) official Web mechanisms
sites, mainly those in charge of international affairs. Based
on the INQAAHE and APQN principles, the questionnaires 1. Over 80 percent of the responding agencies indicate
were developed into six sections, including basic infor- that they have a self-evaluation or internal quality as-
mation, current situation of external review, internal re- surance mechanism in place on a regular basis.
view, review procedures and items, and challenges and
According to the survey, 14 out of 17 have a self-evalua-
strategies to enhance quality in quality assurance agencies.
tion or internal quality assurance mechanism in place.
Replies were received from 17 of 26 nations, seven from
Cyclical review mainly ranges from a one-year to a four-
East Asia, seven from Southeast/South Asia and three from
year timetable. Two agencies adopted APQN’s principles
the Pacific. Table 2 shows the distribution of the APQN
for internal review, and six applied both the INQAAHE
full members and the respondents by country and region.
and APQN guidelines as one of the references for self-
To facilitate data analysis, all respondents were given a
assessment. When it comes to the approaches to internal
shortened code for their agency from A1 to A17.
review, the most popular methods are ‘‘using internal re-
In addition, the opinions of 11 heads of Asian quality
flection mechanism to take actions or react to internal and
assurance agencies, including Hong Kong, Japan, New
external recommendations for improvement,’’ ‘‘collecting
Zealand, Philippines, Thailand, and Vietnam, Malaysia,
external feedback via interview or survey from the expert,
India and Indonesia, were collected through semi-struc-
reviewers or evaluated institutions for future development’’
tured interview or e-mail from February to May, 2012. The
and ‘‘collecting the feedback and opinions from the
interviews focus on the top administrators’ attitudes to the
staff/council/board.’’ Four agencies have developed ‘‘Key
quality assurance of quality assurance agencies, their per-
Performance Indicators’’ for internal evaluation (see
ceptions of the characteristics of internal and external re-
Table 3). The survey also showed that some agencies have
views, the approaches their agencies use for self-
adopted multiple methods to gather feedback. For example,
improvement, the challenges they faced in the procedures
the Hong Kong Council for Accreditation of Academic and
of external and internal reviews, and their preferred ex-
Vocational Qualifications (HKCAAVQ) set up ‘‘Focus
ternal review mode. All interviewees were given the other
group meetings with program operators’’ to collect insti-
shortened code from B1 to B11.
tutional feedbacks. National Accreditation Agency for
While distributing online questionnaires through e-mail,
Higher Education/(BANPT) (Indonesia) conducted a cus-
the respondents were informed that the interview results
tomer satisfaction survey to visualize the impact of its
would be used for academic purposes only. They gave their
quality assurance procedures on higher education from a
permission with their informed consent. Data from the
wider perspective. The Japan University Accreditation
interviews were analyzed using the Miles and Huberman
Association (JUAA) has just started to launch an internal
(1994) method for generating meaning from transcribed
system by setting up a Self-Evaluation Committee.
and interview data. Their methods of noting patterns and
themes; clustering items into categories; building logical 2. More than half of these agencies have been reviewed
chains of evidence through noting causality and making externally, either by government or by a recognition
inferences; and making conceptual coherence allow authority, particularly in terms of the indicators of
typically large amounts of qualitative data to be reduced ‘‘effectiveness and efficiency’’ and ‘‘review procedures.’’

123
A. Y.-C. Hou et al.

Table 2 Distribution of the respondents by country and region Table 4 Number of review items selected by agencies
Area Country Receiving Respondent Review items No. of agencies
institutions institutions
Effectiveness and efficiency 10
East Asia Russia 3 2 Quality assurance criteria and processes 10
Japan 2 2 Resources 9
China 2 2 Mission 8
Taiwan 2 2 Quality of reviewers 8
Hong Kong 2 1 Internal quality assurance improvement 7
South Korea 1 0 Independence 6
Mongolia 1 0 Internationalization 6
Subtotal 15 9
Southeast/South Asia Cambodia 1 1
Malaysia 1 1 criteria and processes including review standards, on-site
Vietnam 1 1 visit, makeup of the panel, publication of a report, follow-
Philippines 2 1 up procedure.’’ The item on ‘‘having adequate and pro-
Indonesia 1 1 portional resources’’ is chosen by nine, making it the third
Thailand 1 1 most popular standard. Eight agencies chose ‘‘the mission
India 1 1 and goals of quality assurance reflect in the agency’s pro-
Subtotal 8 7 cesses and results’’ and ‘‘quality of reviewers, including
Pacific New Zealand 2 1 their characteristics, selection and training of reviewers, no
Australia 2 0 conflicts of interest.’’ ‘‘Having in place internal quality
Samoa 1 0 assurance procedures to inform and underpin its own de-
Subtotal 3 1 velopment and improvement’’ is ranked in sixth place.
Total 26 17 Respondent agencies indicated that ‘‘independence’’ and
Response rate 65.4 (%) ‘‘internationalization’’ are regarded as the least important
items. Government regulation is more important to them
than these factors appear to be. Most of them are reviewed
Table 3 Number of agencies adopting internal quality assurance by national government, which would lead to a lack of
mechanism autonomy and less attention to internationalization
Internal quality assurance mechanism No. of
(Table 4).
agencies

Internal reflection (to collect feedback and opinions 11 A growing awareness of internal quality assurance
from the staff/council/board) mechanism among quality assurance agencies
Internal feedback (to take actions or react to internal 9
and external recommendations for improvement) The survey shows that awareness of the importance of
External feedback (to collect feedback via interview or 9 developing internal quality assurance mechanisms is
survey from the experts, reviewers or evaluated
growing among quality assurance agencies. Several re-
institutions for future development)
spondents agreed that quality enhancement was a ‘‘must’’
Key performance indicators (to use KPI to ensure 4
accountability) for a quality assurance agency’s quality.
Others (focus group meetings with evaluated program; 2 Enhancing quality of quality assurance agency is a
customer satisfaction survey)
must, as a means of collaborative quality improve-
ment, especially because we are using government
budget that are supposed to be accountably utilized,
Compared to the large number of the agencies developing
maintain agency’s integrity and sustain the organi-
internal review mechanisms, only ten agencies have an ex-
zational growth in response to ever increasing and
ternal review in place, and seven of them are compulsory. Six
changing stakeholder’s needs and demands. (A15).
are reviewed by government authorities, and two are re-
viewed by national recognition agencies. The review cycle is According to quality assurance agency’s administrators,
usually 5–6 years. When it comes to external review items, the internal quality assurance mechanism has been inte-
ten agencies responded that they have been reviewed for grated into strategic plans and embedded into organiza-
‘‘effectiveness and efficiency’’ and ‘‘quality assurance tional structures.

123
Quality assurance of quality assurance agencies

The department of training collected the feedbacks and building mutual recognition agreement with
from the surveys over institutions, panels and board some other countries for collaborative quality im-
members, in which are integrated into three year provement purposes, such as staff exchange, sharing
strategic plan (Interviewee B1). the good practices with external quality assurance
regional and international network. (Interviewee B4).
We have a research Department to enhance our
quality internally. The department publishes the in-
Challenges for implementation internal quality
formation collected through the network and the re-
assurance and external quality assurance
sults of researches on quality assurance. It forms the
network of quality assurance researches and Higher
According to the survey, most respondents indicated that
Education institutions, as well as quality assurance
the transparency of internal quality assurance still needs to
agencies (domestic as well as international). Each
strengthen. One-third of the agencies have not published
research plan is embedded in the Plan-Do-Check-
their annual reports, self-review report or other relevant
Action (PDCA) cycle to develop and verify the
quality report to the public yet. They are still learning to
quality assurance criteria and processes. (Interviewee
communicate with other stakeholders on their internal re-
B3).
view outcomes, such as by having formal meetings to get
feedback from staff, experts and board members, and
Most agencies expected to be reviewed externally holding informal talks to collect opinions from institutions,
by international networks instead of government reviewers and employers (A3, A5, A6, A8, A12, A17). On
the other hand, they also complained about the lack of time
The survey shows that more than a half of responding and resources for internal quality assurance implementa-
agencies have been under governmental control through tion, including ‘‘hardly making time for internal quality
external review, particularly Southeast Asian agencies. assurance of our own,’’ ‘‘difficulties in setting criteria and
Two Southeast agency heads stated: benchmarks for internal quality assurance’’ and ‘‘budget
constraints’’ (A2, A3).
The review reports belong to Ministry of Education and However, several quality assurance heads stated that
its annual report must be sent to the Ministry of successful internal quality assurance implementation
Education for accountability purposes. (Interviewee should heavily rely on the quality of staff and would like to
B9). invest in staff training.
Our agency would submit the final report to the Prime
Minister directly. (Interviewee B7). ‘‘If staff of quality assurance agencies can share re-
sponsibilities with each other, it will definitely
In order to gain more autonomy, the survey and the strengthen the commitment of the whole organization
interviews both showed that most agencies expected to be to internal quality assurance mechanism’’ (Intervie-
reviewed externally by ‘‘the board members from interna- wee B2)..
tional quality assurance network’’ or ‘‘experts or scholars Our agency developed a good reward system for staff
from other quality assurance agencies invited by the and sent them to take part in international seminars
agency itself’’ instead of by governments. At the same and workshops. In addition, the agency initiated an
time, they expected to build international capacity and to internship program for the staff to learn from outside
strengthen global recognition by either being audited by (Interviewee B6).
international networks or taking part in international ac-
tivities. For example, the New Zealand Universities Aca- In addition, it was found that the private quality assur-
demic Audit Unit (NZUAAU) has been comprehensively ance agencies perceive the costs of external quality assur-
adhering to the INQAAHE Guidelines of Good Practice ance as being more prohibitive than the public agencies do.
(Interviewee B5). Higher Education Evaluation & Ac- Some private quality assurance agencies could not undergo
creditation Council Taiwan (HEEACT) is planning to ap- external review at an earlier stage because both the agency
ply for the INQAAHE external review. One agency said and staff would have lacked maturity, and the national
that it has tried its best to improve its accountability legal framework would have been incomplete (Interviewee
through various international activities, B10 & Interviewee B11). One quality assurance agency’s
President stated that,
As a quality assurance agency, we always does col-
laborative quality improvement through various It is easier to conduct an internal quality assurance.
means, including customer satisfaction survey, However, an external quality assurance is more dif-
inviting international reviewers for various purposes, ficult as it involves much cost (Interviewee B2).

123
A. Y.-C. Hou et al.

Discussion recognition agencies would ‘‘exhibit substantial variations


in subjectivity and rigor’’ (p. 445). The accrediting body
A balance between autonomy and accountability may feel obliged to carry out the government’s wishes
rather than those suggested by its own agenda and mission
As discussed above, Asian quality assurance agencies are (Hawkins et al. 2006; Ewell 2008). This suggests that the
aware of the importance of accountability and agreed that autonomy and independence of the agency will be threat-
internal and external review could contribute to their ened when the government maintains bureaucratic control
creditability and accountability nationally and worldwide. of its internal governance and external review. In order to
However, external reviews address critical issues at the manage this dilemma, quality assurance agencies have to
national levels regarding autonomy and independence be more accountable for quality of their work and are
(Dill, 2011). obliged to demonstrate that their professionalism in quality
The study found that most Asian quality assurance assurance will not be affected by this external control.
agencies reviewed or regulated directly by governments
tended to lose their autonomy over quality assurance op- Is international network review an appropriate
eration. Southeast Asian national quality assurance agen- approach?
cies established as governmental agencies are under direct
government control. Likewise, East Asian agencies tend to Based on the analyses above, external review is indeed
be a buffer body where the government still plays a major seen to be more challenging to implement independently
role in the agency. They are both usually considered as than internal quality assurance. The study shows that Asian
extended arms of government, because they are primarily quality assurance agencies preferred the review service of
funded by the state. For example, ONESQA (Thailand), international networks to governmental audit for two major
established as a public organization in 2000, is the only reasons. First, they wish to gain more autonomy. Second,
Thailand quality assurance agency responsible for ‘‘de- compliance with international network guidelines would
velopment of external quality assurance criteria and build their international capacities. It was also believed that
methods’’ and for ‘‘conducting evaluation of educational an international external review of quality assurance op-
achievements to assess quality of institution’’ according to erations would promote the national and global reputation
National Education Act of 1999. In contrast, HEEACT of a quality assurance agency (Hou 2014). According to the
(Taiwan) falls into the category of a buffer body. It was survey and interviews, INQAAHE and APQN are both
established as a non-governmental agency jointly endowed international organizations of quality assurance, and Asian
by the Ministry of Education and 153 colleges and uni- quality assurance agencies expected to be reviewed by
versities based on the 2005 Revised University Law. them. Up to the present, two Asian quality assurance
However, it remained financially dependent on govern- agencies have been recognized in accordance with the
mental funding. In fact, both types of agency are expected INQAAHE Guidelines of Good Practice, the Tertiary
to serve government functions, particularly use of ac- Education Quality and Standards Agency (TEQSA) and the
creditation outcomes in educational policy making and New Zealand Universities Academic Audit Unit (NZAAU)
funding allocation. Although most agencies claimed that (INQAAHE, 2013b). In response to its members’ needs,
they have autonomy over review procedures and decisions, the Asia–Pacific Quality Network (APQN) is now planning
they admitted that it was not easy to enhance their level of to launch Asia Pacific Quality Register in 2015 with a
‘‘autonomy’’ because of their close affiliation with the combination of Chiba principles and APQN membership
government. In comparison, self-funded and private agen- review criteria as review standards.
cies are more autonomous than public and quasi-govern- Quality assurance agencies’ attitude toward self-
mental ones, due to their independent funding and regulation through adhering to international network stan-
resources. dards demonstrates that they would like to undertake their
Several scholars have expressed their concerns over this operations autonomously and independently. Yet, Black-
issue. Brown (2013) has stated that when the government mur (2008b) doubted whether international reviews are
develops quality assurance initiatives as a part of higher truly independent or sufficiently robust. Dill (2011) was
education reform strategies, its intervention in quality as- also worried about the effectiveness of external review by
surance design becomes inevitable. Martin & Stella (2007) international networks. Take the European Association for
also pointed out that ‘‘Getting the government to support Quality assurance in Higher Education (ENQA), for ex-
the quality assurance process without losing any of the ample, only 17 out of 44 national European quality as-
agency’s autonomy or affecting its functioning is certainly surance agencies approved by the European Association for
an option to be considered’’ (p. 80). Dill (2011) indicated Quality assurance in Higher Education (ENQA) success-
that even truly independent government audit or fully were registered in the European Quality assurance

123
Quality assurance of quality assurance agencies

Register for Higher Education (EQAR) (Westerheijden networks rather than governments will be able to play a
et al. 2010). In addition, King (2009) pointed out directly major and neutral role in the quality recognition of Asian
that ‘‘rules, protocols and procedures become the means to quality assurance agencies. It can also be foreseen that
demonstrate regulatory good practices as part of corporate demands for cyclical internal and external review to ensure
self-defense rather than actual desire for improvement’’ (p. the accountability of the quality assurance agencies will get
90). Nonetheless, these worries about whether international stronger. As David Woodhouse, former president of
audit can actually improve Asian quality assurance agen- INQAAHE, has said,
cies will remain in respect of both INQAAHE and APQN.
Quality assurance agencies need to work at their own
quality assurance, just as they expect their institutions
to do. As educational institutions are constantly being
Conclusion
exhorted to exhibit continuous quality improvement,
and we quality agencies must do the same. (Wood-
The results of the study indicated that Asian quality as-
house 2007, p. 7–8).
surance agencies intended to develop internal quality as-
surance mechanisms, particularly by reacting to internal
and external recommendations for improvement, having
interviews or surveys from expert reviewers or evaluated References
institutions and collecting feedback from the staff and
ASEAN University Network (AUN). (2014a). Official website
council, or board members. Generally speaking, govern- Retrieved December 18, 2014, from http://www.aunsec.org/
ments are mainly responsible for the external quality as- qualityassurance_details.php?id=3.
surance of Asian quality assurance agencies. However, ASEAN University Network (AUN). (2014b). ASEAN University
most Asian quality assurance agencies expressed their network-quality assurance guidelines. Retrieved December 18,
2014, from http://www.aunsec.org/pdf/aunwebsite/01_AUNQA
interest in using the principles and guidelines of interna- GuidelineManual.pdf.
tional networks to prove their accountability, although the Asia–Pacific Quality Network (APQN). (2010). Chiba principles.
effectiveness and objectivity of these international Retrieved October 1, 2010, from http://www.apqn.org/.
evaluations remain a major concern. Indeed, there is an Asia–Pacific Quality Network (APQN). (2012a). Assessing quality in
higher education: Electronic package for reviewers’ training.
urgent need to establish common guidelines and basic Shanghai: APQN.
principles for all quality assurance agencies, especially for Asia–Pacific Quality Network (APQN). (2012b). Official website.
some developing and centrally controlled countries in Retrieved October 1, 2012, from http://www.apqn.org/.
Southeast Asia. Compared to governmental audit, inter- Asia–Pacific Quality Network (APQN). (2012c). Peer review of
quality assurance Agencies. Unpublished.
national evaluation in Asia is more acceptable and reliable Asia–Pacific Quality Network (APQN). (2014). Discussion paper on
at present. APQN is working aggressively with Asian Asia Pacific quality register (APQR). Unpublished.
quality assurance agencies to implement a quality label Blackmur, D. (2008a). A critical analysis of the INQAAHE guide-
initiative. lines of good practice for higher education quality assurance
agencies. Higher Education, 56(6), 723–734.
The massification of higher education has sped up the Blackmur, D. (2008b). Quis custodiet ipsos custodes?: The review of
development of quality assurance in Asia and made it serve the Australian universities quality agency. Quality in Higher
specific functions for governments and higher education Education, 14(3), 249–264.
institutions. Asian quality assurance agencies have adopted Brown, R. (2013). Mutuality meets the market: analyzing changes in
the control of quality assurance in United Kingdom higher
several positive strategies to enhance the quality of quality education 1992–2012. Higher Education Quarterly, 67(4),
assurance operations, such as appointing excellent evalua- 420–437.
tors, developing more effective programs on evaluator Calderon, A. (2012). Massification continues to transform higher
training, deepening collaboration with other quality assur- education. University World News, 2(237). Retrieved June 7,
2014 from http://www.universityworldnews.com/article.
ance agencies, engaging more in research activities on php?story=20120831155341147.
higher education and related issues, and even attempting to Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in
stabilize their financial bases. In addition to the good education. New York: Routledge.
practices already in place, they aggressively develop their Costes, N. et. al. (2012). First external evaluations of quality
assurance agencies—lessons learned. Retrieved December 15,
international capacity through taking part in regional and 2010, from http://www.enqualityassurance.eu/files/ENQA%
global quality assurance networks to build trust among in- 20workshop%20report%2010.pdf.
stitutions, governments and the public. Council for Higher Education Accreditation (CHEA). (2006).
Inevitably, these agencies’ autonomy will continue to be Recognition of accrediting organizations policy and procedures.
Washington, DC: CHEA.
challenged if they are affiliated closely with public au- Dill, D. D. (2011). Governing quality. In R. King, S. Marginson, & R.
thorities and reviewed externally by them. But it will be Naidoo (Eds.), Handbook on globalization and higher education.
worth observing and investigating whether international Cheltenham, UK: Edward Elgar.

123
A. Y.-C. Hou et al.

Dillman, D. A. (2000). Mail and internet surveys: The tailored design King, R. (2009). Governing universities globally. Cheltenham, UK:
method. New York: Wiley. Edward Elgar.
Eaton, J. (2011). US accreditation: Meeting the challenges of Llavori, R. (2010). Self-assessment of agencies and self-assessment
accountability and student achievement. Evaluation in Higher report: an agency perspective—the case of the National Agency
Education, 5(1), 1–20. for Quality Assessment and Accreditation of Spain (ANECA).
European Association for Quality assurance in Higher Education European Association for Quality assurance in Higher Education
(ENQA). (2005). Standards and guidelines for quality assurance (ENQA), 14–16. First external evaluations of quality assurance
in the European higher education area. Helsinki: ENQA. agencies-lessons learned. Helsinki: ENQA.
European Association for Quality assurance in Higher Education Marcos, S. (2012). Learning from each other-using benchmarking to
(ENQA). (2010). First external evaluations of quality assurance develop Internal quality assurance, European Association for
agencies—lessons learned. Helsinki: ENQA. Quality assurance in Higher Education (ENQA), (Internal
European Association for Quality assurance in Higher Education quality assurance benchmarking) (pp. 13–16). Helsinki: ENQA.
(ENQA). (2012). Internal quality assurance benchmark. Hel- Marginson, S., Kaur, S., & Sawir, E. (2011). Global, local, national in
sinki: ENQA. the Asia–Pacific. In Marginson S. Kaur & E. Sawir (Eds.), Higher
European Quality assurance Register for Higher Education (EQAR). Education in the Asia–Pacific (pp. 3–34). Dordrecht: Springer.
(2013). EQAR at a glance. Retrieved March 16, 2014, from Martin, M., & Stella, A. (2007). External quality assurance in higher
https://www.equalityassurancer.eu/about/introduction.html. education: making choices. Paris: UNESCO.
Ewell, P. (2008). US accreditation and the future of quality Miles, M., & Huberman, M. (1994). Qualitative data analysis (2nd
assurance. Washington, DC: CHEA. ed.). Beverly Hills, CA: Sage.
Germany Accreditation Council (GAC) (2010). Criteria for the National Institution for Academic Degrees and University Evaluation
accreditation of accreditation agencies. Retrieved November 11, (NIAD-UE). (2007). Glossary of quality assurance in Japanese
2010, from http://www.akkreditierungsrat.de/index.php?id= higher education. Tokyo: NIAD-UE.
44&L=1. Patton, M. Q. (2001). Qualitative evaluation and research methods.
Hawkins, D., et al. (2006). Delegation and agency in international Thousand oaks, CA: Sage Publications.
organization. Cambridge, UK: Cambridge University Press. Stella, A. (2010). The Chiba principles: A survey analysis on the
Hou, A. Y. C. (2014). Quality in cross-border higher education and developments in the APQN membership. Shanghai: Asia–Pacific
challenges for the internationalization of national quality assur- Quality Network.
ance agencies in the Asia–Pacific region–Taiwan experience. Szanto, T. (2010). Background and purposes of external reviews of
Studies in Higher Education, 39(6), 152–163. quality assurance agencies: ENQA membership, national pur-
Hou, A. Y. C., Morse, R., Ince, M., Chen, H. J., Chiang, C. L., & poses. European Association for Quality assurance in Higher
Chan, Y. (2015). Is the Asian quality assurance system for higher Education (ENQA). First external evaluations of quality assur-
education going glonacal?: Assessing the impact of three types ance agencies-lessons learned. Helsinki: ENQA.
of program accreditation on Taiwanese universities. Studies in Vroeijenstijn, T. (2008). Internal and external quality assurance—
Higher Education, 40(1), 83–105. Why are they two sides of the same coin? Retrieved March 31,
International Network for Quality assurance Agencies in Higher 2012, from http://www.eahep.org/web/images/Bangkok/28_
Education (INQAAHE). (2009). Guidelines of good practice in panel_ton.pdf.
quality assurance. Retrieved December 1, 2009, from http:// WASC. (2008). Handbook of accreditation 2008. Alameda: WASC.
www.inqualityassuranceahe.org/main/capacity-building-39/ Westerheijden, D. F. et al. (2010). The Bologna process independent
guidelines-of-good-practice-51. assessment: The first decade of working on the European higher
International Network for Quality assurance Agencies in Higher education area. Retrieved July 16, 2014, http://www.doc/
Education (INQAAHE). (2010). INQAAHE review report: bologna_process/independent/_assessment_l_detailed_rept.pdf.
Sistema nacional de acreditacion de la educacion superior Woodhouse, D. (2004). The quality of quality assurance agencies.
(SINAES). Retrieved November 10, 2011, from http://www. Quality in Higher Education, 10(2), 77–87.
inqualityassuranceahe.org/main/capacity-building-39/review/ Woodhouse, D. (2007). Quality of quality assurance agencies, 1–7.
inqualityassuranceahe-review-reports. Retrieved December 10, 2011, from http://www.inqualityassur
International Network for Quality assurance Agencies in Higher anceahe.org/Upload/Presentations/AsiaPacificQualityNetwor
Education (INQAAHE). (2013a). Quality glossary. Retrieved kAnnualConferenceFebruary2007.doc.
January 26, 2013, from http://www.apqn.org/. Woodhouse, D. (2010). Internationalization of quality assurance: The
International Network for Quality assurance Agencies in Higher role played by the networks. Retrieved February 15, 2011 from
Education (INQAAHE). (2013b). GGP aligned agencies. http://www.auqualityassurance.edu.au/files/presentations/interna
Retrieved January 26, 2013, from http://www.apqn.org/. tionalisatioofqualityassurancetheroleplayedbythenetworks.pdf.

123

You might also like