Professional Documents
Culture Documents
2017 KnettelSlifjoInmanSilova
2017 KnettelSlifjoInmanSilova
net/publication/313580482
CITATIONS READS
17 1,602
4 authors:
Some of the authors of this publication are also working on these related projects:
Formative interviews with mental health providers in northern Tanzania. View project
All content following this page was uploaded by Iveta Silova on 08 March 2019.
To cite this article: Brandon A. Knettel, Shay E. Slifko, Arpana G. Inman & Iveta Silova (2017):
Training community health workers: an evaluation of effectiveness, sustainable continuity, and
cultural humility in an educational program in rural Haiti, International Journal of Health Promotion
and Education, DOI: 10.1080/14635240.2017.1284014
The training and implementation of community health workers (CHWs), local residents
who provide health consultations and basic treatment in the communities where they reside,
has been among the greatest trends in public health over the last ten years (Lehmann and
Sanders 2007; Gates et al. 2015). These workers ‘are integrated as an essential link in the
chain of access to care in a variety of settings,’ (Knettel and Slifko forthcoming) and provide
a variety of services, including health interventions such as administering vaccinations
Haiti are increasingly conducting formal program evaluations as a means of examining the
costs and benefits of their programs to the host nation.
Methods
Evaluation of the CHW training program was conducted by a doctoral student and a
Master’s student in education from Lehigh University, who accompanied the instruction
team to Haiti. The evaluators were not previously affiliated with the sponsoring organizations
INTERNATIONAL JOURNAL OF HEALTH PROMOTION AND EDUCATION 5
and were encouraged throughout the process to provide open and objective feedback. All
procedures were approved by Lehigh University’s ethical review board.
Participants
The participants in the evaluation were local volunteer CHWs, all of whom were Haitians
residing in the rural southern region of the country. In previous years, participants were
recruited by a general invitation and were required to pass a literacy test to participate.
However, the initial screening standards were not maintained and additional participants of
varying levels of education and literacy were allowed to participate in the training. A total
of 126 participants took part in one of three consecutive week-long CHW courses and all
of these participants agreed to take part in the evaluation; however, 13 participants were
absent on either the first or last day of their assigned course and therefore completed only
half of the evaluation tasks.
A total of 119 participants completed the demographic questions with 64.3% identifying
as male (n = 81) and 30.2% identifying as female (n = 38) with a mean age of 38 years (range
18–75). On average, participants had completed nine years of formal education. All partic-
ipants identified as African Origin, Black, or Haitian with the exception of one participant
identifying as Mixed Race/Multiracial. All participants (n = 119) indicated that they were
Haitian Creole speakers while 51 (42.9%) indicated that they had additional proficiency
in French. Participants travelled an average distance of 15.98 km to attend the class, with a
majority traveling exclusively by foot (n = 59, 50.9%).
Procedure
The evaluation of the course included quantitative pre- and post-course tests of knowledge
administered to the participants in the curriculum areas, a brief satisfaction survey, and
two semi-structured focus groups for each participant. These were administered on the
morning of the first day of the course, prior to the start of instruction, and the afternoon
of the last day, once all instruction had been completed. All evaluations were adminis-
tered solely by the research team and were conducted independent of the training course.
The consent form and all instruments were translated from English to Creole by native
Haitians prior to the course and read aloud prior to participants signing their informed
consent. Participation was entirely voluntary and a decision not to participate had no
impact on a CHW’s standing in the course. Throughout the test administration and focus
groups, Haitian interpreters read aloud each item and participants were encouraged to
ask questions.
Measures
Pre- and post-course focus group interviews
Focus groups were conducted with all participants on the first and last day of each course
with participants of each week’s course randomly split into two focus groups. The goal of
these groups was to examine participants’ expectations, goals, and reactions related to the
training. Pre-course interviews included questions such as ‘What motivated you to attend
this course?’ and ‘What do you hope to accomplish from taking this course?’ and post-course
6 B. A. KNETTEL ET AL.
interviews included questions about the most and least helpful aspects of the course as well
as potential implications for participants’ role in the community.
Data analysis
To interpret the data, we utilized repeated measures analysis of variance (ANOVA) to exam-
ine potential improvement in course knowledge and analysis of covariance (ANCOVA) to
compare participants who had attended previous trainings with new participants. Power
analyses were completed using G*Power software (Faul, Erdfelder, and Lang 2007) to con-
firm adequate power for the sample. A priori power analysis for the ANCOVA yielded a
suggested sample size of 128. The final number of participants was slightly below this total;
however, a post hoc power analysis yielded a 1–β value of .795, indicating adequate statistical
power (Cohen 1988).
Qualitative items, focus group data, and interview notes were analyzed using discov-
ery-oriented exploratory analysis (Mahrer and Boulet 1999). All responses were reviewed
independently by three graduate student coders familiar with the work. The coders first
created independent, preliminary lists of dominant themes in the responses for each
question, then consolidated these initial lists into one master list. Discrepancies and dis-
agreements in the themes were discussed until consensus was achieved. This analytical
process resulted in final structures ranging from three to six themes for each qualitative
item. Next, each of the 126 qualitative surveys was analyzed by the three coders to deter-
mine which themes were present in each response and all disagreements were once again
discussed to consensus.
INTERNATIONAL JOURNAL OF HEALTH PROMOTION AND EDUCATION 7
Table 1. Pre- and post-test knowledge scores for the three study groups.
Mean years Frequency of
education of return Improvement
Group participants participants Pre-test mean Post-test mean F (p)
Group 1 (n = 34) 8.50 91.2% 23.3 27.4 8.576 (.006)
Group 2 (n = 27) 9.29 3.7% 28.6 28.9 .189 (.668)
Group 3 (n = 52) 9.53 61.1% 28.1 29.7 13.331 (.001)
Total (n = 113) 9.09 54.8% 26.8 28.8 14.653 (<.001)
Note: Test scores out of a total of 35 questions/points.
Results
Effectiveness of the course
The effectiveness of the course was examined via the post-course satisfaction survey, pre-
and post-course tests of knowledge, and focus group responses. On the satisfaction survey,
participants overall reported that the course was ‘very helpful’ for their work in the com-
munity (n = 116, 92.1%), they would participate again if possible (n = 120, 95.2%), and
they would recommend the course to a friend or neighbor (n = 119, 94.4%). Participants
also progressed in their understanding of the course materials. Repeated measures ANOVA
with 113 participants who were present for both the pre-test and post-test showed sig-
nificant improvement in knowledge scores over time (Wilks’ lambda = .882, F(1, 110) =
14.653, p < .001) as can be observed in Table 1 above. It should be noted that Box’s M test
of the homogeneity of covariance matrices for these data yielded a significant result (Box’s
M = 59.782, F(6, 99,811) = 9.678, p < .001), indicating the assumption of homogeneity was
not met and results should be interpreted with caution (Leech, Barrett, and Morgan 2008).
In addition to significant improvement in scored from pre-test to post-test, a significant
interaction effect was observed between time point and course grouping (F(2, 110) = 3.947,
p = .022), indicating that differences from pre-test to post-test were not consistent among
the three groups who took the course. Using post hoc simple contrasts with a Bonferroni
correction, we determined that the level of improvement was significantly greater for par-
ticipants in the first week’s group than either the second (p = .003) or third week (p < .001).
Participants in Group 1 had substantially lower levels of formal education and lower pre-test
scores than other participants, which indicates that the course content may have been more
novel for these participants and thus more likely to improve their knowledge.
Interestingly, an ANCOVA comparing the baseline knowledge of return participants
against first-time participants (with education level included as a covariate) showed that
attendance at the previous year’s training did not significantly predict a difference in pre-
test score (F(2, 104) = .416, p = .661), indicating potential concerns about the retention of
course content between trainings. However, this lack of significance may be at least partially
explained by the change in focus of this year’s course (maternal and child health) from prior
years’ content on more general health knowledge.
The course’s effectiveness was also addressed in the focus groups. The qualitative analysis
revealed a common theme that participants valued the course and that it provided longer,
more detailed, and more helpful training than other health education they had access to,
particularly in this rural area where such opportunities for learning were rare. There was
also a distinct emphasis on the practical application of the knowledge to improve the over-
all health of the community. For example, when asked about motivations for attending
8 B. A. KNETTEL ET AL.
the course, one participant expressed, ‘My neighbors were suffering from cholera and I
heard about this program. I decided to come here to learn more and be able to help them.’
Others placed this desire in direct relation to the lack of other local health resources: ‘I am
learning more health knowledge to help my community that has limited access to a clinic
or hospital in an emergency.’
Cultural humility
In addition to recommendations for improved sustainability, we identified culturally
nuanced challenges in this short-term program that require closer examination. Upon
arriving in Haiti, the cultural distance between the CHW instructors and their Haitian hosts
was apparent. Volunteer instructors wore different clothing, spoke different languages, and
held different views about health concerns and treatment. It is therefore unsurprising that
several areas of the curriculum did not reflect the social and economic realities of the Haitian
participants. Some of the training content suggested unfamiliar, expensive, or hard-to-find
treatments such as a three-part series of immunizations for the Human Papillomavirus and
expensive sterile supplies for labor and delivery.
The course instructors frequently stated their desire to improve health knowledge and
outcomes in Haiti. Several also demonstrated a stance reflecting cultural humility: keeping
an open mind about cultural differences, seeking to learn first and teach second, and adapt-
ing their content to the local context. However, the challenges of making these adaptations
with little or no prior experience in Haiti were readily apparent. Despite clear improvement
in their cultural understanding as the courses progressed, the instructors’ lack of famili-
arity with the daily circumstances of the participants’ lives clearly impacted the cultural
compatibility of the course.
Discussion
International partnerships between developed and underdeveloped nations are imperative to
the improvement of global health. However, grassroots, collaborative, and community-based
approaches are increasingly emerging as vital alternatives to top-down ‘provider and recip-
ient’ relationships (Murphy et al. 2013). Mutually beneficial partnerships strengthen health
systems and create a two-way conduit of knowledge-sharing for both the international
partners (often from high income countries) and the hosting region (often low and middle
income countries). Such partnerships foster the understanding of health and education as
truly global areas of inquiry without sacrificing the importance of cultural context.
While the goal of partnerships is to work together in order to reduce the burden of
preventable disease and ongoing health disparities, partnerships come with their share of
challenges. Without an international partner for the CHW training evaluated in the current
research, the program would most certainly not exist due to a deficit in resources. However,
our findings indicate that the participation and support being offered have also come with
disparities in power and voice.
The findings of the current evaluation indicate that the CHW course is effective at
improving health-related knowledge among participants in the short term. However, the
evaluation also revealed a lack of sustainable continuity to support the logistical needs of
CHWs during and between trainings, including a lack of needed resources, ongoing train-
ing, oversight, and financial support. Finally, the results showed a considerable gap in the
cultural understanding between the sponsoring organization and the program participants.
The following recommendations outline methods for improving the current program, as
well as implications for similar CHW and community health partnerships.
10 B. A. KNETTEL ET AL.
Finally, a core concept of cultural humility is that participants should be able to collab-
orate with, see images of, and learn from people who share their linguistic, racial, ethnic
and cultural identities. Therefore, we believe that Haitian instructors must be involved in
ongoing training programs held in this country and that Haitian contributors should receive
substantial, continuous support in the implementation of programs in their communities.
This will aid in addressing the shortcomings of the short-term volunteer model by fostering
cultural compatibility, strengthening community ownership, and advancing sponsoring
organizations’ mission of sustainability.
Disclosure statement
No potential conflict of interest was reported by the authors.
References
Arredondo, P., and Z. G. Tovar-Blank. 2013. “Multicultural Competencies: A Dynamic Paradigm for
the 21st Century.” In APA Handbook of Multicultural Psychology Vol. 2, edited by F. T. L. Leong,
L. Comas-Diaz, and G. C. Nagayama Hall, 19–34. Washington, DC: American Psychological
Association.
Bamberger, M., and S. Cheema. 1990. “Case Studies of Project Sustainability.” The World Bank. http://
elibrary.worldbank.org/doi/pdf/10.1596/0-8213-1614-1.
Barnett, M., and T. G. Weiss. 2008. Humanitarianism in Question: Politics, Power, and Ethics. Ithaca,
NY: Cornell University Press.
Bhutta, Z. A., Z. S. Lassi, G. Pariyo, and L. Huicho. 2010. Global Experience of Community Health
Workers for Delivery of Health Related Millennium Development Goals: A Systematic Review, Country
Case Studies, and Recommendations for Integration into National Health Systems. The World Health
Organization. www.who.int/workforcealliance/knowledge/resources/chwreport/en/
Biquet, J. 2013. “Haiti: Between Emergency and Reconstruction, an Inadequate Response.”
International Development Policy 4 (3). http://poldev.revues.org/1600.
12 B. A. KNETTEL ET AL.
CIA (Central Intelligence Agency). 2013. The World Factbook: Haiti. www.cia.gov/library/publications/
the-world-factbook/geos/ha.html
Christopher, J. C., D. C. Wendt, J. Marecek, and D. M. Goodman. 2014. “Critical Cultural
Awareness: Contributions to a Globalizing Psychology.” American Psychologist 69 (7): 645–655.
10.1037/a0036851.
Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Erlbaum.
Curci, M. 2012. “Task Shifting Overcomes the Limitations of Volunteerism in Developing Nations.”
Bulletin of the American College of Surgeons. http://bulletin.facs.org/2012/10/task-shifting/.
Farmer, P. 2011. Haiti After the Earthquake. New York: Public Affairs.
Faul, F., E. Erdfelder, and A. G. Lang. 2007. “G*Power 3: A Flexible Statistical Power Analysis Program
for the Social, Behavioral, and Biomedical Sciences.” Behavior Research Methods 39 (2): 175–191. doi:
10.3758/2fbf03193146.
Gates, C., S. Vardhan, R. Arole, and A. Barab. 2015. “A Sustainable, Comprehensive, Community-
based Primary Health Care Approach: The Jamkhed Model.” Presented at the 143rd American
Public Health Association Annual Meeting, Chicago, IL. https://apha.confex.com/apha/143am/
webprogram/Paper336519.html.
Jason, L. A., C. B. Keys, Y. Suarez-Balcazar, R. R. Taylor, and M. I. Davis. 2004. Participatory Community
Research: Theories and Methods in Action. Washington, DC: American Psychological Association.
Katz, J. M. 2013. The Big Truck That Went By: How the World Came to Save Haiti and Left Behind a
Disaster. New York: St. Martin’s Press.
Knettel, B. A., and S. E. Slifko. Forthcoming. “Community Health Workers as Agents of Change: Case
Studies from Haiti, Tanzania, and Burmese Refugees in the United States.” In Why Global Health
Matters, edited by C. E. Stout and G. Wang. Seattle, WA: Amazon.
Knettel, B. A., and S. E. Slifko. 2013. “Teaching Prenatal Health, Postpartum Care, Communicable
Disease Prevention and Family Planning in Rural Haiti: Evaluation of a Public Health Care Worker
Training Program.” Unpublished manuscript. College of Education, Lehigh University.
Lasker, J. N. 2016. Hoping to Help: The Promises and Pitfalls of Global Health Volunteering. Ithaca,
NY: Cornell University Press.
Leech, N. L., K. C. Barrett, and G. A. Morgan. 2008. SPSS for Intermediate Statistics: Use and
Interpretation. 3rd ed. New York: Taylor & Francis.
Lehmann, U., and D. Sanders. 2007. Community Health Workers: What Do We Know About Them?
www.who.int/hrh/documents/community_health_workers.pdf
Mahrer, A. R., and D. B. Boulet. 1999. “How to do Discovery-oriented Psychotherapy Research.”
Journal of Clinical Psychology 55: 1481–1493.
Murphy, J., V. R. Neufeld, D. Habte, A. Aseffa, K. Afsana, A. Kumar, M. de Lourdes Larrea, and
J. Hatfield. 2013. “Ethical Considerations of Global Health Partnerships.” In An Introduction to
Global Health Ethics, edited by R. Upshur and A. Pinto, 117–128. New York: Routledge.
Perry, H. 2013. “A Brief History of Community Health Worker Programs.” USAID Maternal and Child
Health Integrated Program. www.mchip.net/sites/default/files/mchipfiles/02_CHW_History.pdf
Perry, H. B., R. Zulliger, and M. M. Rogers. 2014. “Community Health Workers in Low-, Middle-, and
High-Income Countries: An Overview of Their History, Recent Evolution, and Current Effectiveness.”
Annual Review of Public Health 35: 399–421. 10.1146/annurev-publhealth-032013-182354.
Richter, L. M., and A. Norman. 2010. “AIDS Orphan Tourism: A Threat to Young Children in Residential
Care.” Vulnerable Children and Youth Studies 5: 217–229. 10.1080/17450128.2010.487124.
Shediac-Rizkallah, M. C., and L. R. Bone. 1998. “Planning for the Sustainability of Community-
based Health Programs: Conceptual Frameworks and Future Directions for Research, Practice
and Policy.” Health Education Research 13 (1): 87–108. 10.1093/her/13.1.87.
Schwartz, T. T. 2008. Travesty in Haiti: A True Account of Christian Missions, Orphanages, Fraud,
Food Aid and Drug Trafficking. Charleston, SC: BookSurge.
Slifko, S. E. 2014. Cultural Competence: A Content Analysis of a Public Health Curriculum for a
Community Health Training Program in Haiti. College of Education, Lehigh University.
Tervalon, M., and J. Murray-García. 1998. “Cultural Humility Versus Cultural Competence: A Critical
Distinction in Defining Physician Training Outcomes in Multicultural Education.” Journal of Health
Care for the Poor and Underserved 9: 117–125. 10.1353/hpu.2010.0233.