The Role of Accreditation in Promoting Quality Assurance of Technical Education

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 12

Int. J. Engng Ed. Vol. 16, No. 2, pp. 85±96, 2000 0949-149X/91 $3.00+0.

00
Printed in Great Britain. # 2000 TEMPUS Publications.

The Role of Accreditation in Promoting


Quality Assurance of Technical Education*
R. NATARAJAN
Director, Indian Institute of Technology, Madras 600-036, India. E-mail: nataraj@shiva.iitm.ernet.in
This paper first examines the nature and scope of quality, and the different perceptions about
quality, particularly as it applies to engineering education. The factors promoting quality in
technical institutions are briefly reviewed, and the requirements of and expectations from engineers
and engineering administrators in order to face the challenges of the next millennium are
enumerated. Beginning with the pioneering efforts of ABET, USA, accreditation has established
itself worldwide as the principal mechanism for quality assurance in technical education, and more
and more countries are coming under the umbrella of the Washington Accord. The major
differences between accreditation and recognition, in the Indian context, are brought out.
Accreditation involves a two-stage process, self-assessment and peer evaluation; the essential
characteristics of each are highlighted. Some recent ABET initiatives and Indian experiences are
discussed.

INTRODUCTION focuses on the needs of both external and inter-


nal customers.
WHILE QUALITY assurance has always been a
matter of concern and significance in education, in Perceptions of quality in higher education
general, and in professional education such as Quality perceptions depend to a large extent on
technical education in particular, the recent quant- the particular sector or group that is considered.
itative expansion of an unprecedented nature, in Three such perceptions are indicated below:
India, has caused educators to devote careful . National Funding Agencies: education for largest
attention to the quality aspect. There already
number at minimum cost
exist several regulatory mechanisms for ensuring . Educational Administrators: image and reputa-
minimum standards before an institution is
tion of their institutions
started. However quality assurance entails an . Faculty: student learning and satisfaction
assessment of the performance of the institution
in delivering Education of the prescribed quality.
Barnett's classification
Barnett has classified quality perceptions into
three groups:
THE NATURE AND SCOPE OF QUALITY
. Objectivist perception: identification and quanti-
The corporate sector has universally recognized fication of inputs and outputs. Inputs: faculty,
the importance of quality in their products and physical resources, students, funds; outputs: stu-
services for achieving and sustaining competitive- dent learning, failure rates, results, employment
ness. The engineering education sector has been patterns, PG education, R&D.
slow to act. We must recognize the role of quality . Relativist perception: examination of `fitness for
in achieving our identified mission and vision. purpose'. Different stakeholders have different
foci: studentsÐeducational process; employersÐ
What quality is and what it is not work output of graduates; professorsÐresearch.
. Development perception: exists within the insti-
. Quality is very specific; it involves continuous
tution, not imposed from outside. TQM culture
improvement; it can be achieved by prevention;
promotes achievement of quality through this
it implies zero defects or errors; it includes
approach
correction of errors.
. Quality is not something vague; not something
Characteristics of quality applicable to services
achieved by inspection, testing and checking;
The major developments in quality control and
nor acceptable quality levels.
. The scope of quality includes manufacturing assurance have taken place in the context of the
manufacturing sector. Recently, these concepts
activities, business processes, and services, and
have also been made applicable to the service
sector, which includes the education sub-sector.
Some of the characteristics of quality applicable
* Accepted 30 October 1999. to the service sector are:

85
86 R. Natarajan

. responsiveness to customer; Some indicators of academic quality


. cost-sensitivity; Table I summarizes some salient indicators of
. volume-sensitivity; student, faculty and institutional quality.
. ethical considerations;
. energetic and enthusiastic approach; Is academic quality quantifiable?
. openness to experiment; There have been several discussions on this
. goal/results focus; fundamental question. It is widely believed that
. errors can not be hidden; academic quality, like beauty, for example, is an
. skill- not capital-intensive nature; elusive characteristic. Robert Pirsig [1] has resorted
. heavy investment in training. to much verbal gymnastics in coming to terms with
quality:
Implications of TQM for engineering education of
the future `Quality, you know what it is, yet you don't know
The US National Science Foundation (NSF) what it is. But that is self-contradictory. But some
task force on TQM has come up with the following things are better than others; that is, they have
definition of Quality Engineering Education: more quality. But when you try to say what the
quality is, apart from the things that have it, it all
. `Quality Engineering Education is the develop- goes poof.'
ment of intellectual skills and knowledge that
will equip graduates to contribute to society A Mafatlal ad proclaimed: `Quality needs no
through productive and satisfying engineering definition, you recognize it when you see IT'.
careers as innovators, decision-makers and lea- Quality is a complex, multidimensional entity, no
ders in the global economy of the twenty-first doubt; but so are many other things of signifi-
century.' cance, and we have to deal with them; such as,
. `Quality Engineering Education demands a pro- for example, development, growth, excellence,
cess of continuous improvement of and dramatic democracy, religion.
innovation in student, employer and societal Two quotations are given below to bring out the
satisfaction by systematically and collectively need for quantification, and simultaneously the
evaluating and refining the system, practices and limitations of this approach:
culture of engineering education institutions.' . Lord Kelvin: `When you can measure what you
The task force points out that TQM is not a are speaking about, and express it in numbers,
destination, but rather a journey to improvement. you know something about it; and when you
The task force has also examined the nature of cannot measure it in numbers, your knowledge
the customer of engineering education. it preferred is of a meager and unsatisfactory kind.'
to deal with the concept of `stakeholders', which . G. N. Lewis: `I have no patience with attempts
could vary widely depending on an institution's to identify Science with measurements, which is
mission, goals, strategies and tactics. The stake- but one of its tools, or with any definition
holders include suppliers, such as high schools, and which would exclude a Darwin, a Pasteur or
receivers, such as employers and students. a Kekule.'

Table 1. Indicators of student, faculty and institutional quality

Indicators of student quality Indicators of faculty quality Indicators of institutional quality

Number of applications per seat Number of applications for faculty The utilization of strategic planning
position, at different levels processes
Diverse preparation and background Academic quality, in terms of Interaction with the environmentÐ
of entering students publications, honors, awards, patents, industry, profession, community.
sponsored projects and consultancy.
Number completing degree Retention success; turn-over Mobilization of resources for institutional
development
Time to complete degree Teaching quality, innovative initiatives Diversity of external financial support
Proportion undertaking practical Publication records Demand from outside agencies for R & D
training and continuing education
Proportion participating in research Sponsored research, consultancy and Adjunct appointments with Industry
and development continuing education activities
Employment profiles and salaries on Professional society and public service Inter-disciplinary activities
graduation involvement
Number taking up post-graduate studies Ability to mobilize resources for Self-assessment and accreditation
department and institution processes
Satisfaction levels of students and Internal and external (national and Alumni involvement
employees international) honors and awards
Perceived reputation of graduates and Quantum of practical experience Perceived reputation, nationally and
alumni, nationally and internationally internationally
Proportion of foreign students Effectiveness of student counseling Use by national agencies as think tanks
and for technology development
Number becoming entrepreneurs Faculty career satisfaction levels. Leadership in education and research
The Role of Accreditation in Promoting Quality Assurance of Technical Education 87

The subjective considerations in assessment of much students learn; the value addition
quality achieved.
There are several human activities where quality
assessment is necessary and inevitable, but the In a very recent ranking of universities and tech-
techniques employed are quite subjective, and nical institutions in the Asia-Pacific region
depend to a large extent on the human sensory published by Asiaweek, the following criteria
perceptions: were employed:

. sightÐbeauty contests academic reputation


. soundÐmusic student selectivity
. tasteÐtea, wine faculty resources
. touchÐcomfort levels in air conditioning; research output
. smellÐperfumes. financial resources.

It is also as well to recognize that we do not have No system of quality assessment is perfect; the
unequivocal measures for many things in life: following are some of the criticisms of commonly
employed criteria:
. feelingsÐlove, compassion
. intellectÐIQ is an attempt . Number of Ph.D. holders on faculty: not every
. emotionÐEQ is an attempt. Ph.D. holder is a good teacher; senior professors
may not teach UG classes at all.
. Number of enrolled students who graduate:
college may screen out low-performers.
SOME CRITERIA ADOPTED FOR RANKING . Number of research papers: assumes all papers
ACADEMIC QUALITY are of equal importance; focus should be on
quality, not quantity.
There are several agencies and magazines that . ProductivityÐin terms of research, consultancy,
undertake the task of ranking academic institu- sponsored research.
tionsÐcountry-wise, region-wise and globally. . How to quantify student counseling, good
Most of these published rankings indicate the teaching, etc.
criteria employed; they assign weighting factors . Reputation rankings: perceptions of quality are
to the different criteria and come up with a single highly subjective.
composite numerical score. Some of these criteria
are:
. depth and nature of coursework THE NATURE AND SCOPE OF
. student/faculty ratio ACCREDITATION
. selectivity or acceptance rate: number of
applications per seat The dictionary meanings of accreditation are:
. number of enrolled students who graduate
(`retention') official recognition
. students' later achievements guarantee of quality
. library facilities general acceptance.
. laboratory facilities The primary purpose of accreditation is to
. computing facilities ensure quality control and quality assurance,
. reputation/prestige commonly with reference to a certification system
. quality of faculty members in the areas of education, training, testing, etc.
. performance in competitive exams (GATE, In some countries, this function is performed by
CAT, GRE, GMAT, etc.) an agency of the Ministry of Education, while in
. accomplishments of alumni several industrialized countries it is undertaken by
. endowments a confederation of voluntary agencies or profes-
. institutional resources sional societies. In our country, we do not yet have
. perception of employers an umbrella organization confederating a majority
. productivityÐresearch, consultancy. of professional societies. There are several quality
Webster makes the following recommendations control mechanisms (inspection), however, in
in order to ensure that the rankings reflect a valid place; such as, for example, university affiliation,
indication of relative academic quality: recognition by professional societies, such as the
Institution of Engineers, AICTE approval for
. The assessment must be multidimensional; starting and continuing programs. However,
based on many measurable aspects. there are several differences between the functions
. Measures should be based on achievements of of inspection and accreditation; these are brought
majority of faculty and students. out in Table 2.
. Must be based on per capita figures; not The basic process inherent in accreditation is
aggregate numbers. evaluation or assessment of the different sub-
. A technique must be devised to measure how systems and component processes. There are two
88 R. Natarajan

Table 2. Some differences between recognition and . `What are our goals, aims and objectives? Are
accreditation processes they clearly stated? Are they useful? Why do we
Recognition Accreditation
do what we are doing? Does consensus exist on
the interpretation of goals, aims and objectives?
Performed before an Performed after two batches . Is the program designed in the context of the
institution is to be started have graduated realization of the goals?
Fulfillment of initial Fulfillment of minimum norms . Is the program functioning properly? Are we
conditions of achievements and results
Assessment of promise Assessment of performance monitoring and controlling the input, the
Largely based on physical, Includes availability and process and the output?
financial, and infrastructure quality of human resources, in . Do we have the right performance indicators?
resources addition . The outcome of the self-assessment must lead
Based on Project Report Based on information in self-
assessment questionnaires
to improvements, and, if necessary, to
which demand a clear reformulation of the goals.
articulation of mission and
goals, and a SWOT analysis
Essentially a `quantity' Essentially a `quality'
assessment assessment
THE PIONEERING WORK OF ABET
Reasonably straightforward Much more complex
Decision: yes or no Decision: grading into three The Accreditation Board for Engineering and
classes Technology, ABET, has been the pioneer in
Not a new concept A new concept in the Indian designing and implementing the accreditation of
higher and professional
education scene. engineering and engineering technology programs
in the US. Several countries world-wide have
followed closely the ABET processes. The Indian
initiative, through the establishment of the National
parts to it: critical self-assessment and external Board of Accreditation in 1994, has derived inspira-
peer review, The former is performed by the tion from the rich experience of ABET, but has
faculty as a part of the support materials, and, if introduced several modifications appropriately to
carefully and effectively done, can be a valuable take local conditions into account.
strategic tool. Apart from collection and analysis A companion paper in this IJEE Special Issue
of the data, the following questions should be traces the history and evolution of ABET, and its
posed and answered [2]: recent articulation of Engineering Criteria 2000

Fig. 1. The IIT system.


The Role of Accreditation in Promoting Quality Assurance of Technical Education 89

Fig. 2. Strategy for planning an engineering education system.

(EC 2000), which represent the result of a compre- 7. Benchmarking.


hensive study of the existing system and introspec- 8. External Environment
tion, through the Accreditation Process Review
In the modern corporate scenario, `customer is
Committee set up in 1992 to help outline `a qual-
king', and one of the principal measures of success
ity-oriented, flexible accreditation system that
and performance is customer satisfaction or
encourages diversity and does not inhibit innova-
customer delight. Many management experts and
tions in an engineering system'. ABET has also
consultants prefer to employ the notion of
mounted a massive national effort, along with
stakeholders. Figure 3 shows the stakeholder
NSF and industry leaders, in order to develop
relationships in the engineering education system.
knowledgeable program evaluators.

THE ANATOMY OF A TYPICAL SELF-ASSESSMENT


TECHNICAL INSTITUTION
Self-assessment is often performed through a
It is instructive to adopt the systems approach to SWOT analysis. SWOT is an acronym for
describe the anatomy of a typical technical institu- Strengths, Weaknesses, Opportunities and Threats;
tion (The IIT system, for example). Figure 1 shows it refers to the internal strengths and weaknesses of
the processes that constitute the core activities of an organization or institution, and the environ-
such a system, the three major classes of inputs, mental opportunities and threats facing the organ-
and the two major classes of outcomes. ization. SWOT analysis involves a systematic
Figure 2 shows a block diagram expressing the identification of these factors and the strategy
strategic intent of an engineering education system, that reflects the best match between them. It is
and the interconnections between the different based on the premise that an effective strategy
elements: maximizes an institution's strengths and opportu-
nities, but at the same time minimizes its weak-
1. Overall mission and direction. nesses and threats. Strengths and weaknesses are
2. Organization and management. internal to the institution and are within its
3. Effective deployment of resources. control; they may be manipulated to suit a parti-
4. Activities based on core competencies: educa- cular situation. Ideally, an institution should build
tion, research, consultancy (technical and on its strengths, dilute its weaknesses, exploit the
educational), continuing education, training. opportunities, and avoid the threats.
5. Measurement of outcomes: identification of A strength is a resource, skill or other advantage
measures, and methods to measure them. relative to competitors; it is a distinctive compe-
6. Feedback: comparison with overall mission. tence that gives the institution a comparative
90 R. Natarajan

Fig. 3. Stakeholder relationships in the engineering education system.

advantage, such as image, financial/physical/ as `turnaround±centered strategy', that between


human resources, etc. A weakness is a limitation weaknesses and threats as `defensive strategy',
or deficiency in resources, skills, and capabilities and that between threats and strengths as `diver-
that seriously impedes effective performance. sification strategy'.
An opportunity is a major favorable situation
in the Institution's environment. A threat is a A major challenge in using SWOT analysis is in
major unfavorable situation in the institution's identifying the position the Institution actually is
environment. in. The value of the analysis does not rest solely on
SWOT analysis may be used in different ways in careful placement of an Institution in one particu-
strategic choice decisions: lar cell. The SWOT analysis helps resolve one
fundamental concern in selecting a strategy:
. Systematic SWOT analysis spans all aspects of What will be the principal purpose of the grand
an Institution's status, and provides a dynamic strategy? Is it to take advantage of a strong
and useful framework for choosing a strategy. position or to overcome a weak one?
. Key external opportunities and threats are sys- Pearce and Robinson [3] also provide an
tematically compared to internal strengths and extended SWOT analysis, termed the `strategic
weaknesses in a structured approach, with the wedge analysis'. It reveals sources of risk and
objective of identifying one of four distinct opportunity for the organization or institution.
patterns in the match between the Institution's The quality of the strategy and the realism of the
internal and external situations. Pearce and implementation plan will be directly related to the
Robinson [3] label the quadrant between quality of the `wedge' analysis: `quality' in terms
strengths and opportunities as `aggressive strat- of clarity of focus, concentration on the sig-
egy', that between opportunities and weaknesses nificant, the depth of insight, vision and lateral
The Role of Accreditation in Promoting Quality Assurance of Technical Education 91

Table 3. SWOT analysis of a traditional engineer

Strengths Weaknesses

Analytical capabilities Ability to work in a team


Design capabilities: ability to handle open-ended problems; Inter-disciplinary knowledge
ability to handle poorly-defined problems; creativity and Practical orientation (academics)
innovation Commercial orientation
Decision-making, including problem-solving Introspective nature, modesty
Graphical communication skills Oral and written communication skills
Discipline, work ethic. Integrative skills
Ability to employ IT
Obsolescence (remedy: continuing education)
Inter-personal skills
Public perception and recognition
Opportunities Threats
Most real-life problems require contributions from Engineers Competition from scientists, economists, financial experts,
National policies recognize role of S & T administrators in high-level decision-making bodies.
Business recognizes role of technology Quantitative expansion in technical education without
Ambition of bright youth to become Engineers simultaneous quality assurance
Globalization offers opportunities for acquisition of Industrial development entails depletion of natural resources and
state-of-the art technologies environment degradationÐengineers held responsible for these.

thinking, multi-disciplined perspective and objec- who are at the heart of the engineering education
tive challenge. system as far as the teaching-learning processes are
concerned, engineering educators and admini-
strators have the responsibility for the planning,
THE GENERIC ATTRIBUTES OF AN design, implementation and monitoring of the
ENGINEERING GRADUATE system. Table 5 lists the traditional as well as
strategic functions and areas of concern of
The main purpose of accreditation is to certify engineering educators.
the quality of engineering education provided by In a recent report, the Institution of Engineers,
technical institutions, which is reflected in the Australia, has outlined the generic attributes of an
knowledge, skills and attitudes acquired by the engineering graduate. Graduates from an accre-
engineering graduates which enable them to prac- dited course should have the following attributes:
tice their profession with competence and confi- . ability to apply knowledge of basic sciences and
dence. This has been the subject of studies and
engineering fundamentals;
reports in several countries; for example, the . ability to communicate effectively, not only with
Grinter ASEE Goals Report (USA), and the
engineers but also with the community at large;
Finniston Report (UK).
Table 3 provides a SWOT analysis of a tradi-
tional engineer. Table 4 includes the desirable
attributes of an engineerÐboth the traditional Table 5. Educational planning and administration
traits and those required for facing the challenges
Traditional concerns Future concerns
of the twenty-first century. Apart from the faculty,
Conformity Resource mobilization
Table 4. The desirable characteristics of twenty-first century Curricular contents Market Forces
engineers Faculty development User-oriented research
Uniformity/standardization IPR
Traditional attributes 21st century attributes Extrapolation of past Quality, excellence,
Procedure-driven relevance
Problem-solving abilities Learnability: learning to Quantitative expansion Internationalization
Analytical skills learn, on one's own Command and control Education delivery systems
Communication skills: Yen for life-long learning Resource crunch Distance education
oral, written, graphic Ðcontinuous education Examinations Virtual university
Ability to relate to practical Ability to muster knowledge Digital libraries
aspects of engineering. from neighboring disciplines Continuing education
Inter-personal skills Ability to work in a team Innovation
Management skills Exposure to commercial Employment potential
Decision-making skills disciplines Autonomy
Creativity and innovation Flexibility
Integrative skills Strategic planning and
International outlook management
Ability to employ IT Articulation of mission,
Ability to work at interfaces vision, objectives
between traditional Continuous improvement
disciplines Performance evaluation
Commitment to sustainable Educational technology
development Internet connectivity
92 R. Natarajan

. in depth technical competence in at least one imparting technical education, and the profile of a
engineering discipline; good institution. For instance, since the criteria
. ability to undertake problem identification, demand that every institution have a mission and
formulation and solution; goals, industry/institute interaction, and research
. ability to utilize a systems approach to design and development, we have seen institutions strive
and operational performance; to satisfy these requirements. Accreditation also
. ability to function effectively as an individual promotes awareness and replication of good
and in multidisciplinary and multicultural teams practices (as in the case of energy conservation
with the capacity to be a leader or manager as and environmental protection).
well as an effective team member;
. understanding of the social, cultural, global,
environmental and business responsibilities THE MALCOLM BALDRIGE NATIONAL
(including an understanding of entrepreneurship (US) QUALITY AWARD
and the process of innovation) of the profes-
sional engineer, and the need for and principles The Malcolm Baldrige Award is a very presti-
of sustainable development; gious national quality award in the US, which was
. understanding of and a commitment to profes- instituted in order to promote quality in the
sional and ethical responsibilities; corporate sector. It is an annual award to recog-
. in-depth technical competence in at least one nize US companies that excel in quality achieve-
engineering discipline; ment and management. The initiative for
. ability to undertake problem identification, instituting this award seems to have come from
formulation and solution; ability to utilize a the then President, George Bush: `The improve-
systems approach to design and operational ment of quality in products and the improvement
performance; of quality in serviceÐthese are national priorities
. and a capacity to undertake lifelong learning. as never before'.
The Foundation for the MBNQA was created to
foster active partnership between the private sector
SOME FUTURE DIRECTIONS FOR and government. The management of the award
ENGINEERING EDUCATION IMPACTING program has been entrusted to the National
ON ACCREDITATION Institute of Standards and Technology (NIST).
The award promotes:
Engineering practice today has changed
dramatically and irreversibly, due to: . awareness of quality as an increasingly impor-
tant element in competitiveness;
growing global competition, and the sub- . understanding of the requirements for quality
sequent restructuring of industry; excellence;
shift from defense work to private enterprise as . sharing of information on successful quality
the major source of engineering employment; strategies and on the benefits derived from
explosion of information; implementation of these strategies.
developments in IT.
There are three eligible categories of the award:
Engineering success today requires more than
manufacturing companies, service companies and
up-to-the-minute technical capability: small businesses.
ability to communicate; The key concepts in the award examination
ability to work in teams; criteria are:
ability to think creatively;
. Quality is defined by the customer.
ability to learn quickly;
. Senior leadership should create clear quality
ability to value diversity.
values and build the values into the way the
We need a new instructional paradigm with new company operates.
standards, and new ways of assessing those stan- . Quality excellence derives from well-designed
dards. Internal or institutional assessment by itself and well-executed systems and processes.
does little to convince the public of an institution's . Continuous improvement must be part of
ability to provide quality education. External management of all systems and processes.
accountability or accreditation can inform the . Companies need to develop goals, and strategic
general public and peers. and operational plans to achieve quality
leadership.
Some positive consequences of accreditation . Shortening of response time of all operations
There are several positive consequences of and processes of companies to be part of the
accreditationÐfor the institution, for the faculty, quality improvement effort.
students and staff, for the parents of students, for . Operations and decisions of companies need to
the university administrators and for the general be based upon facts and data.
public. The accreditation criteria define the . All employees must be suitably trained and
nature and scope of pre-requisites for institutions developed and involved in quality activities.
The Role of Accreditation in Promoting Quality Assurance of Technical Education 93

Table 6. MBNQAÐexamination categories Table 7. NBA accreditation criteria

Leadership 100 Criterion Weightings


Information and analysis 70 U. G. P. G.
Strategic quality planning 60
Human resource utilization 150 I. Mission, goals and organization 100 70
Quality assurance of products and services 140 II. Financial and physical resources 100 80
Quality results 180 and their utilization
Customer satisfaction 300 III. Human resources 200 200
Total points 1000 IV. Students 100 100
V. TeachingÐlearning 350 250
VI. Supplementary processes 50 50
VII. IndustryÐinstitution interaction 70 100
. Design quality, and defect and error prevention VIII. Research & development 30 150
should be major elements of the quality system. Total 1000 1000
. Companies need to communicate quality
requirements to suppliers and work to elevate
supplier quality performance. 3 Student and Stakeholder Focus: 80
3.1 Knowledge of Student Needs and Expecta-
Table 6 shows the seven examination categories tions: 40
and the points for each, amounting to a total of 3.2 Student and Stakeholder Satisfaction and
1000 points. Table 7 shows the Indian National Relationship Enhancement: 40
Board of Accreditation (NBA) accreditation 4 Information and Analysis 80:
criteria, under eight categories, amounting also to 4.1 Selection and Use of Information and
a total of 1000 points. While each scheme is Data: 25
designed keeping in mind the specific objectives 4.2 Selection and Use of Comparative Infor-
of the two systems, human resources and their mation and Data: 15
utilization is common to both; the focus of 4.3 Analysis and Review of School Perfor-
MBNQA is on quality and customer satisfaction, mance: 40
while that of NBA accreditation is on teaching/ 5 Faculty and Staff Focus: 100
learning processes. 5.1 Work Systems: 40
5.2 Faculty and Staff Education, Training, and
Development: 30
THE MBNQA EDUCATION CRITERIA FOR 5.3 Faculty and Staff Well-Being and Satisfac-
PERFORMANCE EXCELLENCE tion: 30
6 Educational and Support Process Management:
President Clinton signed legislation into law on 100
October 30, 1998, enabling education institutions 6.1 Education Design and Delivery: 60
and health care organizations to take full advan- 6.2 Education Support Processes: 40
tage of the Malcolm Baldrige National Quality 7 School Performance Results: 450
Award in 1999. The award application process, 7.1 Student Performance Results: 150
as well as self-assessment against the criteria for 7.2 Student and Stakeholder Satisfaction
performance excellence, provides a steady and Results: 100
proven course for education institutions to 7.3 Faculty and Staff Results: 100
pursue performance excellence and maintain a 7.4 School-Specific Results: 100
leadership position in their communities. The TOTAL POINTS: 1000
criteria provide a valuable framework for perfor-
mance excellence, and assist in assessing and Explanation of concepts
measuring performance in a wide range of
key institutional performance indicators: student/ . Measures and indicators. Measures and indica-
stakeholder, educational service and outcomes, tors refer to numerical information that quanti-
operational and financial. Self-assessment permits fies input, output, and performance dimensions
the identification of strengths and targeting of of processes, products, services, and the overall
opportunities for improvement on processes and outcomes; they can be simple (derived from one
results affecting all key stakeholdersÐincluding measurement) or composite. While the Criteria
students, faculty, staff and community. do not make a distinction between measures and
A listing of the education criteria for perfor- indicators, some users of these terms prefer the
mance excellence is given below (1999 categories/ term indicator: (i) when the measurement relates
items point values): to performance, but is not a direct or exclusive
measure of such performance (e.g., the number
1 Leadership: 110 of complaints is an indicator of dissatisfaction,
1.1 Leadership System: 80 but not a direct measure of it); and (ii) when the
1.2 Public Responsibility and Citizenship: 30 measurement is a predictor (or leading indica-
2 Strategic Planning: 80 tor) of some significant performance.
2.1 Strategy Development Process: 40 . Performance. Performance refers to information
2.2 School Strategy: 40 on output results obtained from processes and
94 R. Natarajan

services that permits evaluation and comparison the well-being, satisfaction, and motivation of
relative to goals, standards, past results, and faculty and staff.
other organizations. Performance might be . Education design and delivery. Describe how
expressed in financial or non-financial terms. educational programs and offerings are
Two types of performance are addressed in the designed, implemented, and improved; also,
criteria: (i) operational, referring to performance how delivery processes are designed, implemen-
relative to effectiveness and efficiency measures ted, managed and improved.
and indicators; examples being productivity, and
regulatory compliance. (ii) student and stake- Core values, concepts and framework
holder-related, referring to performance relative The education criteria are built upon a set of
to measures and indicators of student and stake- core values and concepts, which are the foundation
holder perceptions, reactions and behaviors. for developing and integrating all requirements
. Process. Process refers to linked activities with within a results-oriented framework.
the object of producing a product or service These core values include learning-centered
for a customer within or outside an organ- education which places the focus of education on
ization. In knowledge work, such as teaching, learning and the real needs of students. Such needs
strategic planning, R & D, and analysis, process derive from the requirements of the marketplace
does not necessarily imply formal sequences of and the responsibility of citizenship. Rapid
steps; rather it implies general understanding changes in technology and in the national and
regarding competent performance, such as global economies are creating increasing demands
timing, options to be included, evaluation, and on employees to become knowledge workers and
reporting. problem-solvers, keeping pace with the rapid
. Productivity. Productivity refers to measures of changes in the marketplace. A learning-centered
efficiency of the utilization of resources. Institution needs to fully understand and translate
marketplace and citizenship requirements into
Explanation of criteria appropriate curricula. Education offerings need
to be built around learning effectiveness. Teaching
. Leadership system. How senior leaders guide the effectiveness needs to stress the promotion of
institution in setting directions, and in develop- learning and achievement.
ing and sustaining effective leadership through-
out the organization.
. Public responsibility and citizenship. How the MBNQA AS AN ENGINE FOR
Institution addresses its responsibilities to the CONTINUOUS IMPROVEMENT
public, and how the Institution practices good
citizenship. The MBNQA seeks to improve national com-
. Strategic planning. This category examines how petitiveness by building active partnerships in the
the institution sets strategic directions, and how private sector, and between the private sector and
it develops key action plans to support the all levels of government. The National Institute of
directions; also how plans are deployed and Standards and Technology (NIST) promotes US
how performance is tracked. economic growth by working with industry to
. Knowledge of student needs and expectations. develop and deliver high-quality measurement
Describes how the institution determines tools, data, and services necessary for the nation's
longer-term requirements, expectations, and technology infrastructure.
preferences of present and future students; For more than a decade, the Baldrige Criteria
also describes how the institution employs this for Performance Excellence have been a significant
information to understand and anticipate needs, tool used by thousands of US companies to assess
and to create an overall climate conducive to and then improve performance on the critical
learning. factors that drive their overall success. In the
. Analysis and review of school performance. most competitive business sectors, organizations
Describe how the Institution analyzes and with world-class results are able to achieve a score
reviews overall performance to assess progress above 700 on the 1000-point Baldridge Scale. Even
relative to plans and goals, and to identify key if an organization does not win the Award, submit-
opportunities for improvement. ting an application in itself has valuable benefits.
. Faculty and staff education, training. Describe Every applicant receives a detailed feedback
how the Institution's education and training reportÐbased on an independent external assess-
support the accomplishment of key institution ment conducted by a panel of specially trained and
action plans and addresses institutions needs, recognized expertsÐoutlining the strengths and
including building knowledge, skills, and cap- opportunities for improvement.
abilities, and contributing to improved faculty Many recipients indicate that their greatest rate
and staff performance and development. of improvement occurs the year after receiving the
. Faculty and staff well-being and satisfaction. award. There is only one requirement of recipients:
Describe how the institution maintains a work that they share information from their application
environment and work climate that support summary, and participate in the Quest for Excel-
The Role of Accreditation in Promoting Quality Assurance of Technical Education 95

lence Conference, the next year, so that the others managed to accomplish a number of thingsÐ
might learn from their success. The award itself is such as the definition of criteria and weighting
traditionally presented by the President of the US therefor, the preparation of a set of four docu-
at a special ceremony in Washington, D. C. ments, including manuals and Questionnaires,
organization of training programs for accreditors,
and accreditation of over 400 programs, covering
THE STRATEGIC PLANNING AND both UG and PG levels.
QUALITY ASSURANCE INITIATIVES AT IIT Some recent issues and concerns are highlighted
MADRAS here:
. There are a large number of programs of engin-
Beginning in 1996, IIT-Madras has embarked
eering colleges and polytechnics which are
on two initiatives, one for the evolution of a
waiting to be accredited; there is an acute short-
Strategic Plan and the other of ISO-9001 certifica-
age of competent assessors, particularly from
tion, essentially of the support services. In this
industry.
process, a quality policy for the institute activities . There are multiple inspection agencies, such as
has been generated, essentially through a bottoms-
the University Grants Commission (UGC), the
up decentralized approach:
All India Council for Technical Education
. Impart quality education in technology and (AICTE), universities, often with overlapping
science for professional excellence and instill jurisdiction.
commitment to sustainable development. . The visiting teams are handicapped by lack of
. Perform world class research to advance the secretarial support, particularly if the chairman
frontiers of knowledge. and assessors are retired professors.
. Provide innovative solutions through research, . In the affiliating system prevailing in India, the
consultancy and continuing education for satis- individual institutions are not in control of the
fying current and future industrial and R&D curricula, as would be the case for autonomous
needs. institutions.
. Extend expertise towards improvement in the . It is not yet decided how the accreditation results
quality of technical education. would be utilized.
. Achieve excellence in the support services of the
institute through continuous improvement and
teamwork. CONCLUDING REMARKS
At the moment the strategic plan is getting ready
and the mission statement for the institute is being As in manufacturing and service industries,
evolved, again through institute-wide participation. quality is the hallmark of excellence and effective-
ness in engineering education. Every engineering
college and polytechnic should define their
SOME RECENT ISSUES AND CONCERNS quality policy and articulate their commitment to
achieve quality in all their activities and implement
The Indian National Board of Accreditation the policies energetically. It might mean the differ-
was established in September 1994, and has ence between survival, and success and failure.

REFERENCES

1. R. Pirsig, Zen and the Art of Motorcycle Maintenance.


2. A. Pilot, Accreditation and Quality Assurance in Engineering Education in The Netherlands, ABET
International Workshop, Washington, DC, Oct.26, 1997.
3. J. A. Pearce II and R. B. Robinson, Jr., Strategic Management, AITBS Publishers (1996).
4. R. S. Handscombe and P. A. Norman, Strategic LeadershipÐThe Missing Links, McGraw-Hill
Book Co. (1989).

R. Natarajan is the Director of the Indian Institute of Technology, Madras, India. He


obtained his Ph.D. from the University of Waterloo, Canada, for research in the area of
combustion. His research interests and publications are in the areas of combustion,
propulsion, energy, transport phenomena and engineering education. He has worked as
a National Research Council Research Fellow in Canada and as a Humboldt Research
Fellow in Germany. He is a Fellow of the Indian National Academy of Engineering, the
Institution of Engineers (India), the National Foundation of Indian Engineers and the
Indian Institution of Plant Engineers. He is a member of the editorial boards of
International Journal of Engineering Education, Fuel (London), Fuel Science and Technol-
ogy, and Indian Journal of Technical Education. He is also currently the editor of the Journal
of Plant Engineering, and the Journal of the Energy and Fuel Users' Association of India. Dr
96 R. Natarajan

Natarajan is a member of several national committees dealing with technical education,


energy, combustion and propulsion. He has shouldered a wide range of academic and
administrative responsibilities at IIT-Madras, Chennai, India, over the past 30 years, such
as dean of student affairs; chairman, Center for Continuing Education, head Mechanical
Engineering Department, etc. He is the recipient of six Best Paper Awards for his papers on
combustion, energy and engineering education. He is also the recipient of the Nayudamma
Award of the Nayudamma Center for Development Alternatives, Andhra Pradesh, India,
for his outstanding contribution to the welfare of mankind through his researches in the
fields of energy and environment; For the sake of Honor Award of the Rotary Club of
Madras Metro; The Eminent Engineer Award of the Institution of Engineers (India) for his
contribution to the mechanical engineering fraternity; and the Shivaram Karanth Award
for his contributions to sustainable development.

You might also like