Using competency based assessment instruments

Chapter 4

04/29/2024 Training Facilitation Skills 1

 Introduction

Why Knowledge, Skill and Attitude assessment is

important ?

04/29/2024 Training Facilitation Skills Cha_

 Introduction
Assessment:
• Must be meaningful
• Must provide an accurate and reliable measure of learners
progress
• Shared responsibility among trainees and trainers

04/29/2024 Training Facilitation Skills Cha_

 Chapter Objective

After completing this chapter, the participant will be able to:

• Use competency-based assessment tools

04/29/2024 Training Facilitation Skills Cha_

 Enabling Objectives

• Discuss the principle of competency based assessment

• Use competency based assessment tools

• Administer competency-based assessments

• Use assessment results to improve learning

04/29/2024 Training Facilitation Skills Cha_

 4.1. Principles of Competency Based Assessment

• Assessment seems an easy task

• Determine their mastery to perform the desired competencies

• Assessment methods should adhere to few key principles

04/29/2024 Training Facilitation Skills Ch-4

Principles of Competency Based Assessment

Validity Reliability Objectivity Feasibility

Measures what it Produces Free of Easy to

intends to consistent trainer administer
measure result biases

04/29/2024 Training Facilitation Skills Ch-4

 Principles of Competency Based Assessment…

Formative assessment:
“assessment for learning”, - assess progress and development of
competency

Summative assessment:
“assessment of learning”- make decision about learners readiness to
progress

04/29/2024 Training Facilitation Skills Ch-4

 Principles of Competency Based Assessment…

Effective assessment requires:

• Clear learning objectives(SMART)

• Use of a variety of appropriate assessment procedures

• Consistency among the learning objectives

04/29/2024 Training Facilitation Skills Ch-4

 Principles of Competency Based Assessment…
Effective assessment requires…

• Procedures that are fair to everyone

• Clear criteria for judging successful performance

• Feedback to trainees

• Support of a comprehensive grading and reporting system

04/29/2024 Training Facilitation Skills Ch-4
 Principles of Competency Based Assessment…
Individual Activity 4-1: Case study

Mr. X scored 85% in his final post – test exam and got competent on a certain IST course which
comprises knowledge, skills and attitude competencies. The exam administered was only
written type.
 Do you think Mr. X is competent in the competencies taught in the course?
 If your answer is ‘no’, what was the problem with the assessment?
 What do you suggest to improve the assessment?
 5 min

04/29/2024 Training Facilitation Skills Cha_

4.2. Use Competency Based Assessment
Methods

• Use a variety of assessment tools

• Better suited assessment tools (competency domains)

04/29/2024 Training Facilitation Skills Ch-4

Use Competency Based Assessment Methods

04/29/2024 Training Facilitation Skills Ch-4

 Use Competency Based Assessment Methods…

Paper slip game:

Varity of Methods/tools for KSA knowledge

Page 73-74 table 4-1

Time: 20 minutes

04/29/2024 Training Facilitation Skills Ch-4

 Use Competency Based Assessment Methods

• Determine an appropriate pass score

• Ensuring personal opinion does not affect the results

• Ensure that methods are feasible

04/29/2024 Training Facilitation Skills Ch-4

 4.3. Administer Assessment

Administer a Knowledge Assessment

• Give directions before the examination

• Focus on how the trainee should complete the test

• knowledge assessment (Before, during and after training)

04/29/2024 Training Facilitation Skills Ch-4

 Administer a skill Assessment

• Structure a clinical encounter that mimics a realistic situation

• Administered in an comfortable area

• OSCE

04/29/2024 Training Facilitation Skills Ch-4

 Administer a skill Assessment…

Setting up OSCE

• Each station is numbered and the signal or bell checked

• Clearly marked movement from station to station

04/29/2024 Training Facilitation Skills Ch-4

 4.4. Use of assessment result to improve
performance

• Formative assessments

- Help trainees decide what content areas they need to spend more

time

• Summative assessment:

- Determine if trainees are meeting the learning objectives

04/29/2024 Training Facilitation Skills Ch-4
 Summary

• Trainer think about how to assess learners

• Importance of ongoing formative assessment

• Summative assessment evaluate progress towards

competency

04/29/2024 Training Facilitation Skills Cha_

 Summary

• Assessment tools must be linked to desired competency

• Formative assessment is assessment for learning

• Summative assessment is assessment of learning

04/29/2024 Training Facilitation Skills Ch-4