Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 17

Bonfire.

Measurement & Evaluation


Recommendations Meeting
Value of Measurement

Grow and expand the business


● Case examples and impact to business results is necessary to be able to sell to new clients and to expand in existing client organizations

Ensure content and facilitator quality


● Content designers and developers need regular feedback from participants to ensure the experience is positive, the content is relevant and
applicable, and the materials are supportive
● Until there is a steady faculty of facilitators, participant feedback is needed to monitor and calibrate performance

Manage introduction of digital platform and virtual learning environment


● With the recent introduction of Bonfire Beyond and virtual cohorts, feedback is needed to monitor the effectiveness of these
learning environments, independently and in relation to the in-person cohorts

Drive efficiency of resources and processes


● As Bonfire continues to grow and expand in offerings, managing investment in and coordination of resources will be an
important piece to managing the quality of the program and the ongoing efficacy of the business

Copyrights 2021 © Bonfire.


Measurement Strategy Development Process

OBJECTIVE: Develop a scalable and sustainable approach to measuring and


evaluating the impact and effectiveness of the Bonfire experience. How to measure
meaningful change? How do we establish Bonfire as the premiere talent accelerator?

1. Benchmark Assessment:

2. Discovery Phase:

3. Interviews:

4. Present findings, recommendations & finalize selection measurement criteria:

Copyrights 2021 © Bonfire.


Current State: Measurement & Evaluation Capability
Measurement Capability Strengths Gaps

Desire for consistent measurement Lack of measurement oversight


Leadership and governance and
Eager for cross team learning Lack of communication from management regarding desired results
overarching culture in which data
informs decisions and action Lack of information sharing between areas

Value learning measurement Lack standard and repeatable process


Great interest in higher level data, Level Only collecting Level 1 Reaction, some Level 2 - Knowledge/Skills
Integrate evaluation into the end-to-end
learning process, enabled by 3 Application and Level 4 Results Limited reporting capability
technology Eagerness to leverage a common Data in multiple systems lacking integration
technology
Lack of knowledge regarding technology capabilities

Clarify roles and skills needed and Desire to assign responsibility and Lack clear accountability
assign accountabilities accountability for M&E activities
Lack defined roles and responsibilities

Opportunity to leverage knowledge and Lack consistency in data collection methodologies


Develop standards and common tools standard tools from other areas No standard or consistent metrics

Strong desire for data to be reported Current decision making based off Level 1 or 2 data
enabling rapid time to insight Decision making inhibited by lack of solid reporting tools
Ensure results are acted upon
Data used at tactical level
Recommendations Considerations

Best Practices
Support data-driven
Ensure high quality
decision making for all
measurement practices
● Use standard survey items stakeholders

● Ask predictive questions, and follow up

FOCUS 5:
● Use demographics to analyze data further MEASUREMENT
PRINCIPLES
Establish Streamline
processes
● Understand the ‘burden of proof’ that your accountability

stakeholders require when investing in


measurement activities (e.g., predictive,
self-report, actual business results,
correlation, etc.) Enable consistent
data collection
 
Curriculum  + Learning Objectives    
  TOPIC NAME LEARNING OBJECTIVE  
  Welcome to Bonfire Gain a clear understanding of what Bonfire is about, how it works, and what you can expect to accomplish in the program.  
  MODULE 1 CLAIM YOUR VOICE  
  Lead with Purpose, On Purpose Reflect upon your own purpose path and the various ways you can make that manifest in the world.  
  Broaden Your Diversity Lens Expand your self-awareness and perspectives on difference to become more consciously inclusive and equitable.  
Reboot Your Introduction Prompt the conversations you want to have by asking better questions, claiming your expertise. and introducing yourself in a
  deliberate way.  
Develop a (Pointy) Point of View Identify and deliver your distinctive points of view in a way that invites constructive conversations.
   
       
  MODULE 2 USE YOUR POWER  
Promote Your Public Identity Craft and communicate your public identity so you show up confidently and in alignment with the power you bring to the world.
   
  Be a Dazzling Storyteller Explore why stories are powerful and how to capture. craft and deliver the right story at the right time. for the biggest impact.  
Manage Difficult Conversations Determine the difficult conversations you want to have and enter them with empathy, clarity, and confidence in your
  communication.  
Create a more strategic network structure by understanding the benefits and concerns of different types of connectivity and how
  Work Your Network to diversify  
  your network to catalyze change.  
       
  MODULE 3 MATTER MORE  
Examine the origins of your own sense of mattering, the significance of matter more in your life. and how you want to continue
  Matter More your mattering  
  journey moving forward.  
Boost Your Influence IQ: Explore the key principles of strategic influence to have a more intentional impact on behalf of what matters to you.
  Principles  
Boost Your Influence IQ: Implement the most effective strategies in achieving influence that advance goals larger than yourself.
  Strategies  
  Lift While You Climb Pass on the Bonfire Way to others—men and women—by lifting while you climb so that ALL RISE.  
       
       
Copyrights 2021 © Bonfire.
Recommendation: Measurement Maturity

PHASE 0: one week


● Learning Measurement Philosophy: Communicate the plan for measurement + KPIs
● RACI: Clarify roles and learning measurement expectations of all staff
● Culture: Analyze current culture to gauge openness to feedback and continuous improvement

PHASE 1: three weeks


● “Measurement Process Owner”: Assign an operational resource to oversee implementation
● KPIs: Define and agree upon key performance indicators (see sample KPI Library)
● Surveys: Design survey items and instruments (see sample surveys)
● Technology: Identify and leverage to develop standard data collection tools and stakeholder reports

PHASE 2: two months


● Reports: Develop a comprehensive reporting strategy for stakeholders, to include reporting cadence and format
● Results: Use results in performance management and goal setting of learning professionals
● Targets: Identify credible sources for benchmarks and set targets/goals for key programs
Copyrights 2021 © Bonfire.
Steps for Implementation

IMPACT:
INPUTS: ACTIVITIES:
OUTPUTS: Business
KPIs Surveys
Reports Results
Data Source Data
Communication
Collection
Plan

Copyrights 2021 © Bonfire.


Bonfire.
ALL RISE

IMPLEMENTATION PLAN
Bonfire M&E Strategy Workbook
Measurement & Evaluation Calendar
SURVEY SURVEY SURVEY SURVEY
ASSESSMENT ASSESSMENT ASSESSMENT ASSESSMENT
OBSERVATION OBSERVATION OBSERVATION OBSERVATION

PRE- PRE-
ASSESSMENT ASSESSMENT

Onboard CYV UYP MM Onboard CYV UVP

MAR APR MAY JUN JUL AUG SEP OCT NOV DEC

Onboard CYV UYP MM

PRE-
ASSESSMENT

COHORT 1 SURVEY SURVEY SURVEY


ASSESSMENT ASSESSMENT ASSESSMENT
COHORT 2 OBSERVATION OBSERVATION OBSERVATION

COHORT 3 +SURVEY +CONTENT


+ASSESSMENT +DEVELOPMENT
+OBSERVATION +PRODUCT
Copyrights 2021 © Bonfire.
Measurement & Evaluation Calendar
SURVEY SURVEY
SURVEY
ASSESSMENT ASSESSMENT
ASSESSMENT
OBSERVATION OBSERVATION
OBSERVATION

MAR APR MAY JUN JUL AUG SEP OCT NOV DEC

COHORT 1 SURVEY SURVEY


ASSESSMENT ASSESSMENT
OBSERVATION OBSERVATION
COHORT 2

COHORT 3 +SURVEY +CONTENT


+ASSESSMENT +DEVELOPMENT
+OBSERVATION +PRODUCT
Copyrights 2021 © Bonfire.
Bonfire.
ALL RISE

EXAMPLES
EXPLORANCE: Metrics That Matter Reporting Example
  Post Event Follow Up Manager
  My Data Benchmark My Data Benchmark My Data Benchmark
Post Training Support    
Participant materials useful on the job 5.09. 5.82. 5.19 5.09 N/A N/A
Set expectations with manager prior to training 5.00. 5.30. N/A N/A 5.38. 5.09.
Determined use of training after the training 4.98. 5.33. 5.24 4.29 5.26. 5.05.
Provided adequate resources to apply training on lob 5.00. 5.61. 5.22 5.25 5.22. 5.70.
Level 4 Business Results    
Training estimated impact on improved performance/productivity 5.07. 5.56. 5.16. 4.93. 5.17. 5.03.
lob Performance Change    
Job Performance Change    
Total percent improvement in performance, including training 65.60% 54.75% 69.45% 43.93% 74.76.% 44.79.%
Training's contribution to improved performance 64.03% 55.26% 70.34% 47.19% 81.79.% 48.24.%
Percent of work time requiring knowledge/skills 65.60% 55.92% 69.20% 46.34% 74.22.% 48.77.%
Percent improvement due to training 27.55% 16.92% 33.80% 9.61% 45.38.% 10.54.%
Adjustment factor for confidence in estimations 65.00% 65.00% 65.00% 65.00% 65.00.% 65.00.%
Adjusted percent improvement due to training 17.91% 11.00% 21.97% 6.24% 29.50.% 6.85.%
Business Results Significantly Impacted:    
Increasing quality 48.82% 63.11% 12.73% 58.58% 34.95% 58.95%
Decreasing costs 51.18% 26.56% 10.45% 19.61% 50.00% 17.51%
Decreasing cycle time 35.55% 23.18% 9.55% 18.47% 41.26% 17.37%
Increasing productivity 54.98% 57.90% 33.18% 53.37% 44.17% 57.19%
Increasing sales 52.61% 24.35% 38.64% 17.02% 43.69% 15.30%
Increasing customer satisfaction 50.71% 55.01% 44.09% 44.59% 34.47% 46.25%
Increasing employee satisfaction 60.66% 49.69% 45.00% 45.59% 43.20% 64.03%
Level 5 Return on Expectations    
Worthwhile investment in career development 5.12 5.55 5.24 5.45 5.49 5.59
Worthwhile investment for the employer N/A N/A 5.21 5.49 5.26 5.64
Level 5 Return on Investment    
Costs(per person) 1000.00 1020.85 1000.00 1020.85 1000.00 1035.55 1000.00 1062.35
Monetary Benefits(per person) 8955.00 5504.07 10990.00 3124.04 14750.00 3453.50
Benefit to Cost Ratio 8.96. 5.39. 10.99 3.02 14.75. 3.25.
WI Percentage 795.50.% 439.17.% 999.00.% 201.68.% 1375.00.% 225.08.%
Payback Period(months) 1.34 2.23 1.09 3.98 0.81 3.69

Copyrights 2021 © Bonfire.


Dashboard

EXPERIENCE CLAIM YOUR VOICE USE YOUR POWER MATTER MORE

58% 100% 50% 25%


+SURVEY
+OBSERVATIONS
PARTICIPANT MANAGER BONFIRE +ASSESSMENT

Copyrights 2021 © Bonfire.


KPI LIBRARY - Test
2021 2022 2023

OUTCOME

EFFECTIVENESS

EFFICIENCY

Copyrights 2021 © Bonfire.


Bonfire. ALL RISE

Questions: Asked & Answered


Performance Management (e.g, facilitators, product, - leadership and governance)

You might also like