Tourism Planning Policy and Development

9
“Policy Evaluation”

MS. AIRA MAE PAPA

 NO. 9
TPC5-TPPD

“Policy Evaluation”

❑ Understand policy evaluation.

❑ Know the practice of evaluation
NO. 9
TPC5-TPPD

What is Evaluation?
 NO. 9
TPC5-TPPD

▪ Evaluation is an increasingly important part of the policy process.

▪ Evaluation is defined as the disciplined and critical assessment of the
consequences of government policy and actions (Hall & Jenkins
1995; Cameron 2000).
▪ Evaluation involves the systematic collection of qualitative and/or
quantitative information, data and other outcomes of government
policy for the purposes of analyzing outcomes and for identifying
improvements to policy.
 NO. 9
TPC5-TPPD

▪ There are two broad approaches to policy

evaluation:
 NO. 9
TPC5-TPPD

▪ Quantitative Techniques- such as cost – benefit

analysis are frequently used to assist in
decision-making about policy options and are
based on projected or potential costs and benefits.
 NO. 9
TPC5-TPPD

▪ Qualitative Techniques- are used in situations

where there is a lack of quantitative data or where
issues cannot be readily reduced to economic
values or statistics. For example, evaluating the
effect of tourism development policies on
marginalized communities and cultures requires
more than numerical analysis
NO. 9
TPC5-TPPD

The Practice of Evaluation

 NO. 9
TPC5-TPPD

Evaluation activities have different approaches. These

include:

❖ Performance audits of organizations – evaluate how organizations

use their resources and whether this use is economical, efficient and
effective in meeting program objectives.
❖ Performance audits of policy outcomes –evaluate the effects and
outcomes of various programs and activities. These activities
might include, for example, cost-benefit analysis, benchmarking,
state of the environment (SoE) reporting and monitoring
activities.
 NO. 9
TPC5-TPPD

❖ Stakeholder audits – evaluate the effects of policies and

programs on particular groups and individuals in society.
For example, social welfare policy evaluation might seek to
evaluate effects of policies on disadvantaged groups
(low-income, single parent families and so on), welfare
services delivery organizations (e.g. Red Cross, Smith
Family etc.)

❖ Evaluations of the evaluation process – assess whether

the evaluation activities themselves were fair and just.
 NO. 9
TPC5-TPPD

Although evaluation is most often undertaken at the

end of the implementation stage, it can be
undertaken at any time during the policy formulation
process. For example, in each stage of the policy
process, evaluation could take place by asking the
following questions:
 NO. 9
TPC5-TPPD

o Issue identification: were the issues correctly

identified? Were the issues correctly prioritized?

o Policy analysis: were the methods and techniques

of analysis appropriate? Was the analysis
rigorous? Were the other approaches to analysis
that might have revealed different issues and
problems? Was the analysis reliable? Did the
policy analysts have appropriate expertise?
 NO. 9
TPC5-TPPD

o Policy Instrument: were all the available policy

instruments assessed? Were some policy
instruments or approaches not included in the
analysis? Why?
o Consultation: was the consultation process framed
appropriately? Did it incorporate and engage all
interests meaningfully?
 NO. 9
TPC5-TPPD

o Coordination: was coordination successful? What

were the problems in coordination, and did these
affect policy outcomes?
o Decision: how was the decision made? Was it
equitable and transparent? Was it the best
decision to adopt this particular policy?
 NO. 9
TPC5-TPPD

o Implementation: was the strategy for implementation successful?

What were the advantages and disadvantages of the implementation
process? In what ways did the process of implementation affect the
policy outcomes? How could implementation have been improved?

o Evaluation: was the evaluation of the policy just and equitable to all
interests? How was the evaluation framed? Was this the most
appropriate approach? Why?
 NO. 9
TPC5-TPPD

o Evaluation of policy should cover the following aspects:

o The strategic vision, policy goals and objectives: is the vision

possible and appropriate? Were the goals and objectives realistic
and achievable?
o The task: were the tasks appropriate? Were the agencies with
appropriate responsibilities identified?
o People: were the people involved in implementation committed to
the policy goals? Did they have sufficient training, and did they have
the capacity to undertake the implementation tasks?
 NO. 9
TPC5-TPPD

o Organizational structures: were the organizational structures

appropriate for the implementation of the policy? What were the
constraints and opportunities of the organizational structures for
implementation?
o Resources: was the implementation of the program adequately
resourced?
o Culture: did the culture of the organizations responsible for delivery
have a positive or negative influence on implementation? Was the
change management process adequately managed?
NO. 9

THINK PAIR SHARE

NO. 9