Professional Documents
Culture Documents
Module 9 Part A: Monitoring and Evaluation: Image Courtesy Of: World Lung Foundation
Module 9 Part A: Monitoring and Evaluation: Image Courtesy Of: World Lung Foundation
– What to monitor
– Principles and techniques
Management
Reporting
Accountability
Advocacy
Evaluation
Why Evaluate?
National-level: ETR
DO’s:
Listen and be prepared to
learn
Take notes – it’s your job.
Don’t be embarassed!
Ask follow-up questions and DONT’s:
explore the issues Don’t worry if the person
Compare one story against knows more than you
another! “Triangulate” Don’t take anything at face
value – CHECK all verbal
information against the data
Don’t threaten or intimidate
the people you speak to
Apply this Approach to
Determine How Register is Used
Level of knowledge:
‘Who should be entered into this register?’
‘Explain the process of how the register is used’
Attitude / Perception
‘Whose job is it to enter the data?’
‘How important is it that this register is
used properly?’
‘Are you comfortable with using it?’
Seek guidance
‘What needs to be done to improve how it is
used?’
Analysing the Suspect and
Sputum Dispatch Register
Indicator: Quality of
Programme Management
• % of new pulmonary TB (NPTB) suspects who have
3 initial sputums collected consecutively
• Formula:
• Tip: compare the result you get to last time. You can
learn a lot by comparing indicators over time
The TB Register
How does the data ‘look’?
Pulmonary
TB Cases EP Total %
Smear + Smear - No Smear Total
Formula
New cases 91 15 105 211 45 256 97%
94 M 9 16 66 44 17 5 2 0 159 60%
265
= 35% All
TB
Cases
F
Total
5
14
17
33
39
105
33
77
9
26
3
8
0
2
0
0
106
265
40%
100%
% 5% 12% 40% 29% 10% 3% 1% 0% 100%
M 1 7 23 15 6 2 0 0 54 59%
All F 0 7 15 13 3 0 0 0 38 41%
Smear +
Total 1 14 38 28 9 2 0 0 92 100%
Cases
% 1% 15% 41% 30% 10% 2% 0% 0% 100%
M 0 0 2 0 0 0 0 0 2 67%
43% All
Smear +
F
Total
0
0
1
1
0
2
0
0
0
0
0
0
0
0
0
0
1
3
33%
100%
Re-treat
% 0% 33% 67% 0% 0% 0% 0% 0% 100%
0 record(s) with missing age
What can it mean if cases diagnosed through AFB is
under 50%?
% Cases diagnosed with
AFB Microscopy 1. Too many cases being diagnosed
90 through x-ray
80 2. Too many extra-pulmonary cases
70 3. In comparison with previous
60
quarters an increase may imply
50
increasing reliance by clinicians on
40
30
smear microscopy…
20 • Is that good or bad?
10 • What could have caused the
0 change in District A?
1st Qtr 2nd Qtr 3rd Qtr 4th Qtr • Take a look at District C – if you
District A District B District C
were monitoring this province
what would you think if you saw
this trend?
• What about District B?
• Which is probably the best
result?
Botswana Tuberculosis Programme
Program Default Rate: Treatment Outcome Report
Report on the Outcome of Tuberculosis Treatment
347
= 6% Defaulted from treatment
Treatment outcome not evaluated
6
63
5%
53%
All tuberculosis cases 120 100%
Treatment completed
Smear negative at completion 0 0%
Smear positive at completion 0 0%
Less than All
Smear results not available
Treatment not completed
1 25%
Smear +
Died during treatment 0 0%
5% Re-treatment
Transferred to another unit
Defaulted from treatment
Treatment outcome not evaluated
0
0
3
0%
0%
75%
All tuberculosis cases 4 100%
Less than
5%
It’s important to understand what
‘default’ means:
The
Every
What
Something
patient
defaulting
do weis quite
know
is wrong
patient
likely
forinsure
=sill
the
a risk
sick
if
ofwe’re
program missing
MDR-TB
and thethe
andcontagious.
in
needs totarget?
community.
be fixed.
What does it mean if the program
default rate is not on target?
1. Is it to do with the patient?
• Is it embarassing for the patient?
• Are patients scared of the
side-effects?
• Does the patient know that you have to KEEP taking
the tablets?
2. Is it to do with the nurse?
• Are nurses doing the DOT?
• Is it dangerous / difficult to get to the patient?
3. Is it a problem of drug supply?
The defaulter rate is an important indicator for measuring quality of
treatment. But what are its limitations? Take a closer look at the
definition of ‘default’.
The Sputum Conversion Rate Botswana Tuberculosis Programme
Sputum Conversion Report
Report on Response to Initial Phase Tuberculosis
Are enough patients converting to smear Treatment
124
= 23% Defaulted from treatment 1 1% 3 3%
All smear + new cases 120 100% 120 100%
Treatment still ongoing
Converted to smear negative 1 25% 3 75%
Equal to or Remaining smear positive
Smear results not available
1
2
25%
50%
0
1
0%
25%
All
greater than Smear + Treatment discontinued
Re-treatment Died during treatment 0 0% 0 0%
Registered
HIV Status
(mmddyy)
Date
Reg Result
tested for HIV: Number Date
P
Formula 002/05 01/02/05
007/05 01/07/05
100%
7 6
What can it mean if less than 100% of patients are tested for HIV?
We have:
An understanding of the principles of M&E
Some experience and guidelines you can take
away with you on good ways to:
Observe
Communicate
Analyse
Next steps