狠狠撸

狠狠撸Share a Scribd company logo
Story Telling with Learning Data
Talent Analytics Trends Meeting December 2, 2014
The Work Institute
2
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Agenda Story Telling with Learning Data—Presentation
Story Telling Activity
Triads: Story Teller, Audience, Coach
Webinar Topics
3
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Story Telling: Movies
? Anyone a movie buff?
? Baseball movies?
? Kevin Costner baseball movies? ? Famous line from each?
4
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Story Telling
? There are many stories
? But according to some, there are
only 10 plots in fiction
? What plots do you know?
? Some of those plots are:
? Cinderella—under-regarded, downtrodden
overlooked boy or girl overcomes all odds
and comes out transformed the winner (Sam
Witwicky in Transformers; Luke Skywalker)
? Romeo & Juliet —boy meets girl, boy loses
girl, boy finds girl—happy ending = Rom
Com; tragic ending = Shakespeare
? Achilles—The fatal flaw; the most powerful
hero is brought low by his weakness
? Beauty & the Beast —Little Red Riding Hood
in reverse—the ugly monster is transformed
? Reference
http://www.docstoc.com/docs/69309695/THE
-ONLY-TEN-PLOTS-IN-THE-WORLD
5
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
? The Quest for the Holy Grail
? Every story begins with the conscious realization that something is absent
? Freedom
? Love
? Power
? Skill / Knowledge / Enlightenment
There is only ONE plot
Every Indiana Jones
Moneyball
The Lego Movie
6
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Our Plot: The Search for the Holy Grail
? What is missing?
? Information about the impact of training on business outcomes
? What must be done to fill the void?
? Gather, analyze and report data—turn data into information
? What happens at the end of the movie?
? The award winning report allows leaders to make data-driven decisions
7
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Our Plot: The Search for the Holy Grail
? What is missing?
? Information about the impact of training on business outcomes
? What must be done to fill the void?
? Gather, analyze and report data—turn data into information
? What happens at the end of the movie?
? The award winning report allows leaders to make data-driven decisions
8
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
What are Executives Interested in Knowing?
Source: How Executives View Learning Metrics by Patti and Jack Phillips, CLO Magazine, Dec 2010
Ranked Importance to
Exec’s
Measure Learning
Evaluation Level
Example Currently Measured
1 Impact 4 “The Accel project contributed 20% to our reduction in error
rates this fiscal.”
8%
2 Value 5 “Within one year, the East program will achieve a 2:1
benefit-cost ratio.”
4%
3 Awards 0 “Our learning program won an award from Chief Learning
Officer magazine.”
40%
4 Application 3 “78% are applying their new skills to their jobs” 11%
5 Learning 2 “92% of participants increased their skills” 32%
6 Activity 0 “Last year 7,800 employees participated in our learning
programs”
94%
7 Efficiency 0 “Formal learning costs $2.15 per hour” 78%
8 Reaction 1 “Employees rated our training very high with an average of
4.5 on a 5 point scale”
53%
9
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
What are Executives Actually Get
Source: How Executives View Learning Metrics by Patti and Jack Phillips, CLO Magazine, Dec 2010
Ranked Importance to
Exec’s
Measure Learning
Evaluation Level
Example Currently Measured
1 Impact 4 “The Accel project contributed 20% to our reduction in error
rates this fiscal.”
8%
2 Value 5 “Within one year, the East program will achieve a 2:1
benefit-cost ratio.”
4%
3 Awards 0 “Our learning program won an award from Chief Learning
Officer magazine.”
40%
4 Application 3 “78% are applying their new skills to their jobs” 11%
5 Learning 2 “92% of participants increased their skills” 32%
6 Activity 0 “Last year 7,800 employees participated in our learning
programs”
94%
7 Efficiency 0 “Formal learning costs $2.15 per hour” 78%
8 Reaction 1 “Employees rated our training very high with an average of
4.5 on a 5 point scale”
53%
10
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Another view….think data visualization
0%
20%
40%
60%
80%
100%
Activity Cost Reaction Learning Application Impact ROI Awards
We current measure this We should measure thisWe currently measure this We should measure this
11
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Case Study—Story and Visualization
? Arthur Andersen, LLC (former accounting firm) wanted to know whether an
Executive Onboarding program was a worthwhile investment.
? The following case study tells a story to answer the question
? Note the Infographic at the end which summarizes the results
12
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Evaluation Design
13
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Results: Tables vs. Graphs
A Table vs. A Graph
The table shows the entire data set at
one point in time.
A Table vs. A Graph
The graph shows every day over two years
Reporting tip: Know your audience
14
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Visual Variations Provide Insight
Use additional markings and notations to emphasize differences
and draw out the meaningful information
15
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Impact
Each day = billable time = revenue
250 days gained due to training
16
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Monetizing Outcomes
$80M ROI
17
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Infographic Summary
1 2 3
Three days of training
Leads to… 1 2 3 250
250 extra days of employment
$1M
invested
$21M
returned
ROI of 21 : 1
20%
80%
No Training
Turnover Retention
5%
95%
Training
Turnover Retention
5% turnover vs. 20% turnover
18
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Summary: Story Telling & Visualization
Story Telling
? Tell a dynamic story, not a “We collected
data, analyzed it, and here are the
results” story
? There are only a few plots; select yours
? Tell the story with visuals at the right level
for with a targeted message to the
audience
? Leave the audience with one memorable
line (ROI of 21:1 or Decrease Scrap &
Increase Performance)
Visualization
? Use graphic representations when
possible
? Make sure they are simple & clear
? Use variations to help tell the story
(e.g., variations on survival curves)
? Create Infographics to summarize the
story in one slide
19
? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate]
Activity
? Break into triads
? Quickly assign roles:
? Story teller
? Audience (e.g., training manager, HR Director, CEO, etc.)
? Observer / Coach
? Tell a story and give feedback
? Rotate roles so everyone gets to tell a story
John R. Mattox, II, Ph.D.
Senior Measurement Consultant
615 714 7299
jmattox@executiveboard.com
Ad

Recommended

Shannon Smedstad - Employer Branding & Culture Fit
Shannon Smedstad - Employer Branding & Culture Fit
Looksharp
?
#GDSummit Presentation: Richard Mosley from Universum
#GDSummit Presentation: Richard Mosley from Universum
Glassdoor
?
Daniel Riskey - Thinking Ahead: Engaging the Future Generations
Daniel Riskey - Thinking Ahead: Engaging the Future Generations
Looksharp
?
Employee Value Propositions & Employer Branding
Employee Value Propositions & Employer Branding
Engage Me
?
Let's Stay Together - Hiring For Keeps in a Candidate-Driven Market
Let's Stay Together - Hiring For Keeps in a Candidate-Driven Market
Mattersight
?
CEB Conference
CEB Conference
Alan Agnew
?
How to create a compelling employer value proposition | Talent Connect 2016
How to create a compelling employer value proposition | Talent Connect 2016
LinkedIn Talent Solutions
?
CEB_Branding For Influence_Oct 14
CEB_Branding For Influence_Oct 14
LinkedIn
?
Learning Metrics: Building Your Training Scorecard
Learning Metrics: Building Your Training Scorecard
Cornerstone OnDemand Foundation
?
Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?
Javier Amaro Castillo
?
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
BizLibrary
?
Measuring Learning Impact
Measuring Learning Impact
Iskandar Noor
?
Measures That Matter: How to Capture and Communicate the Value of Your Learni...
Measures That Matter: How to Capture and Communicate the Value of Your Learni...
Casey Cramer
?
Measuring the Impact of Employee Soft Skills Training
Measuring the Impact of Employee Soft Skills Training
BizLibrary
?
Measures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning Programs
Noelle Akins
?
5 Barriers to Effective Employee Training Programs and How to Crush Them
5 Barriers to Effective Employee Training Programs and How to Crush Them
BizLibrary
?
Learning ≠ Education: How people really learn and what it means for security ...
Learning ≠ Education: How people really learn and what it means for security ...
Infosec
?
Train the Trainer awareness session for employees
Train the Trainer awareness session for employees
surnil7785
?
Make a Hard Core Impact with Soft Skills Training | Webinar 07.23.15
Make a Hard Core Impact with Soft Skills Training | Webinar 07.23.15
BizLibrary
?
Talking to the C-Suite: Building a Business Case for Employee Development and...
Talking to the C-Suite: Building a Business Case for Employee Development and...
BizLibrary
?
Truths About Training Evaluation
Truths About Training Evaluation
David Kelly
?
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
BizLibrary
?
HR206 Week 4 Beal University- Training Evaluation
HR206 Week 4 Beal University- Training Evaluation
BealCollegeOnline
?
5 Barriers to Effective Employee Training Programs - Webinar 08.21.14
5 Barriers to Effective Employee Training Programs - Webinar 08.21.14
BizLibrary
?
SCORECARD SESSION 4
SCORECARD SESSION 4
dmdk12
?
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
Human Capital Media
?
80 PPTS-TRAINING FOR DUMMIES-KEY IDEAS
80 PPTS-TRAINING FOR DUMMIES-KEY IDEAS
Indranil Bhaduri
?
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
BizLibrary
?
Advanced_English_Pronunciation_in_Use.pdf
Advanced_English_Pronunciation_in_Use.pdf
leogoemmanguyenthao
?
Grote OSM datasets zonder kopzorgen bij Reijers
Grote OSM datasets zonder kopzorgen bij Reijers
jacoba18
?

More Related Content

Similar to Talent Analytics, Trends, and Story telling (20)

Learning Metrics: Building Your Training Scorecard
Learning Metrics: Building Your Training Scorecard
Cornerstone OnDemand Foundation
?
Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?
Javier Amaro Castillo
?
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
BizLibrary
?
Measuring Learning Impact
Measuring Learning Impact
Iskandar Noor
?
Measures That Matter: How to Capture and Communicate the Value of Your Learni...
Measures That Matter: How to Capture and Communicate the Value of Your Learni...
Casey Cramer
?
Measuring the Impact of Employee Soft Skills Training
Measuring the Impact of Employee Soft Skills Training
BizLibrary
?
Measures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning Programs
Noelle Akins
?
5 Barriers to Effective Employee Training Programs and How to Crush Them
5 Barriers to Effective Employee Training Programs and How to Crush Them
BizLibrary
?
Learning ≠ Education: How people really learn and what it means for security ...
Learning ≠ Education: How people really learn and what it means for security ...
Infosec
?
Train the Trainer awareness session for employees
Train the Trainer awareness session for employees
surnil7785
?
Make a Hard Core Impact with Soft Skills Training | Webinar 07.23.15
Make a Hard Core Impact with Soft Skills Training | Webinar 07.23.15
BizLibrary
?
Talking to the C-Suite: Building a Business Case for Employee Development and...
Talking to the C-Suite: Building a Business Case for Employee Development and...
BizLibrary
?
Truths About Training Evaluation
Truths About Training Evaluation
David Kelly
?
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
BizLibrary
?
HR206 Week 4 Beal University- Training Evaluation
HR206 Week 4 Beal University- Training Evaluation
BealCollegeOnline
?
5 Barriers to Effective Employee Training Programs - Webinar 08.21.14
5 Barriers to Effective Employee Training Programs - Webinar 08.21.14
BizLibrary
?
SCORECARD SESSION 4
SCORECARD SESSION 4
dmdk12
?
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
Human Capital Media
?
80 PPTS-TRAINING FOR DUMMIES-KEY IDEAS
80 PPTS-TRAINING FOR DUMMIES-KEY IDEAS
Indranil Bhaduri
?
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
BizLibrary
?
Does your learning solution solve business performance problems?
Does your learning solution solve business performance problems?
Javier Amaro Castillo
?
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
5 Barrier to Effective Employee Training Programs and How to Crush Them | Web...
BizLibrary
?
Measuring Learning Impact
Measuring Learning Impact
Iskandar Noor
?
Measures That Matter: How to Capture and Communicate the Value of Your Learni...
Measures That Matter: How to Capture and Communicate the Value of Your Learni...
Casey Cramer
?
Measuring the Impact of Employee Soft Skills Training
Measuring the Impact of Employee Soft Skills Training
BizLibrary
?
Measures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning Programs
Noelle Akins
?
5 Barriers to Effective Employee Training Programs and How to Crush Them
5 Barriers to Effective Employee Training Programs and How to Crush Them
BizLibrary
?
Learning ≠ Education: How people really learn and what it means for security ...
Learning ≠ Education: How people really learn and what it means for security ...
Infosec
?
Train the Trainer awareness session for employees
Train the Trainer awareness session for employees
surnil7785
?
Make a Hard Core Impact with Soft Skills Training | Webinar 07.23.15
Make a Hard Core Impact with Soft Skills Training | Webinar 07.23.15
BizLibrary
?
Talking to the C-Suite: Building a Business Case for Employee Development and...
Talking to the C-Suite: Building a Business Case for Employee Development and...
BizLibrary
?
Truths About Training Evaluation
Truths About Training Evaluation
David Kelly
?
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
BizLibrary
?
HR206 Week 4 Beal University- Training Evaluation
HR206 Week 4 Beal University- Training Evaluation
BealCollegeOnline
?
5 Barriers to Effective Employee Training Programs - Webinar 08.21.14
5 Barriers to Effective Employee Training Programs - Webinar 08.21.14
BizLibrary
?
SCORECARD SESSION 4
SCORECARD SESSION 4
dmdk12
?
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
THE ROI DILEMMA: MEASURING RESULTS OF YOUR LEARNING PROGRAMS
Human Capital Media
?
80 PPTS-TRAINING FOR DUMMIES-KEY IDEAS
80 PPTS-TRAINING FOR DUMMIES-KEY IDEAS
Indranil Bhaduri
?
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
How to Measure the Impact of Employee Soft Skills Training | Webinar 06.02.15
BizLibrary
?

Recently uploaded (20)

Advanced_English_Pronunciation_in_Use.pdf
Advanced_English_Pronunciation_in_Use.pdf
leogoemmanguyenthao
?
Grote OSM datasets zonder kopzorgen bij Reijers
Grote OSM datasets zonder kopzorgen bij Reijers
jacoba18
?
Attendance Presentation Project Excel.pptx
Attendance Presentation Project Excel.pptx
s2025266191
?
最新版美国亚利桑那大学毕业证(鲍础毕业证书)原版定制
最新版美国亚利桑那大学毕业证(鲍础毕业证书)原版定制
Taqyea
?
定制翱颁础顿学生卡加拿大安大略艺术与设计大学成绩单范本,翱颁础顿成绩单复刻
定制翱颁础顿学生卡加拿大安大略艺术与设计大学成绩单范本,翱颁础顿成绩单复刻
taqyed
?
Prescriptive Process Monitoring Under Uncertainty and Resource Constraints: A...
Prescriptive Process Monitoring Under Uncertainty and Resource Constraints: A...
Mahmoud Shoush
?
Module 1Integrity_and_Ethics_PPT-2025.pptx
Module 1Integrity_and_Ethics_PPT-2025.pptx
Karikalcholan Mayavan
?
SQL-Demystified-A-Beginners-Guide-to-Database-Mastery.pptx
SQL-Demystified-A-Beginners-Guide-to-Database-Mastery.pptx
bhavaniteacher99
?
Data Warehousing and Analytics IFI Techsolutions .pptx
Data Warehousing and Analytics IFI Techsolutions .pptx
IFI Techsolutions
?
lecture12.pdf Introduction to bioinformatics
lecture12.pdf Introduction to bioinformatics
SergeyTsygankov6
?
最新版美国加利福尼亚大学旧金山法学院毕业证(鲍颁尝补飞厂贵毕业证书)定制
最新版美国加利福尼亚大学旧金山法学院毕业证(鲍颁尝补飞厂贵毕业证书)定制
taqyea
?
THE LINEAR REGRESSION MODEL: AN OVERVIEW
THE LINEAR REGRESSION MODEL: AN OVERVIEW
Ameya Patekar
?
SUNSSE Engineering Introduction 2021.pdf
SUNSSE Engineering Introduction 2021.pdf
Ongkino
?
KLIP2Data voor de herinrichting van R4 West en Oost
KLIP2Data voor de herinrichting van R4 West en Oost
jacoba18
?
25 items quiz for practical research 1 in grade 11
25 items quiz for practical research 1 in grade 11
leamaydayaganon81
?
最新版美国芝加哥大学毕业证(鲍颁丑颈肠补驳辞毕业证书)原版定制
最新版美国芝加哥大学毕业证(鲍颁丑颈肠补驳辞毕业证书)原版定制
taqyea
?
英国毕业证范本利物浦约翰摩尔斯大学成绩单底纹防伪尝闯惭鲍学生证办理学历认证
英国毕业证范本利物浦约翰摩尔斯大学成绩单底纹防伪尝闯惭鲍学生证办理学历认证
taqyed
?
Measurecamp Copenhagen - Consent Context
Measurecamp Copenhagen - Consent Context
Human37
?
llm_presentation and deep learning methods
llm_presentation and deep learning methods
sayedabdussalam11
?
@Reset-Password.pptx presentakh;kenvtion
@Reset-Password.pptx presentakh;kenvtion
MarkLariosa1
?
Advanced_English_Pronunciation_in_Use.pdf
Advanced_English_Pronunciation_in_Use.pdf
leogoemmanguyenthao
?
Grote OSM datasets zonder kopzorgen bij Reijers
Grote OSM datasets zonder kopzorgen bij Reijers
jacoba18
?
Attendance Presentation Project Excel.pptx
Attendance Presentation Project Excel.pptx
s2025266191
?
最新版美国亚利桑那大学毕业证(鲍础毕业证书)原版定制
最新版美国亚利桑那大学毕业证(鲍础毕业证书)原版定制
Taqyea
?
定制翱颁础顿学生卡加拿大安大略艺术与设计大学成绩单范本,翱颁础顿成绩单复刻
定制翱颁础顿学生卡加拿大安大略艺术与设计大学成绩单范本,翱颁础顿成绩单复刻
taqyed
?
Prescriptive Process Monitoring Under Uncertainty and Resource Constraints: A...
Prescriptive Process Monitoring Under Uncertainty and Resource Constraints: A...
Mahmoud Shoush
?
Module 1Integrity_and_Ethics_PPT-2025.pptx
Module 1Integrity_and_Ethics_PPT-2025.pptx
Karikalcholan Mayavan
?
SQL-Demystified-A-Beginners-Guide-to-Database-Mastery.pptx
SQL-Demystified-A-Beginners-Guide-to-Database-Mastery.pptx
bhavaniteacher99
?
Data Warehousing and Analytics IFI Techsolutions .pptx
Data Warehousing and Analytics IFI Techsolutions .pptx
IFI Techsolutions
?
lecture12.pdf Introduction to bioinformatics
lecture12.pdf Introduction to bioinformatics
SergeyTsygankov6
?
最新版美国加利福尼亚大学旧金山法学院毕业证(鲍颁尝补飞厂贵毕业证书)定制
最新版美国加利福尼亚大学旧金山法学院毕业证(鲍颁尝补飞厂贵毕业证书)定制
taqyea
?
THE LINEAR REGRESSION MODEL: AN OVERVIEW
THE LINEAR REGRESSION MODEL: AN OVERVIEW
Ameya Patekar
?
SUNSSE Engineering Introduction 2021.pdf
SUNSSE Engineering Introduction 2021.pdf
Ongkino
?
KLIP2Data voor de herinrichting van R4 West en Oost
KLIP2Data voor de herinrichting van R4 West en Oost
jacoba18
?
25 items quiz for practical research 1 in grade 11
25 items quiz for practical research 1 in grade 11
leamaydayaganon81
?
最新版美国芝加哥大学毕业证(鲍颁丑颈肠补驳辞毕业证书)原版定制
最新版美国芝加哥大学毕业证(鲍颁丑颈肠补驳辞毕业证书)原版定制
taqyea
?
英国毕业证范本利物浦约翰摩尔斯大学成绩单底纹防伪尝闯惭鲍学生证办理学历认证
英国毕业证范本利物浦约翰摩尔斯大学成绩单底纹防伪尝闯惭鲍学生证办理学历认证
taqyed
?
Measurecamp Copenhagen - Consent Context
Measurecamp Copenhagen - Consent Context
Human37
?
llm_presentation and deep learning methods
llm_presentation and deep learning methods
sayedabdussalam11
?
@Reset-Password.pptx presentakh;kenvtion
@Reset-Password.pptx presentakh;kenvtion
MarkLariosa1
?
Ad

Talent Analytics, Trends, and Story telling

  • 1. Story Telling with Learning Data Talent Analytics Trends Meeting December 2, 2014 The Work Institute
  • 2. 2 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Agenda Story Telling with Learning Data—Presentation Story Telling Activity Triads: Story Teller, Audience, Coach Webinar Topics
  • 3. 3 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Story Telling: Movies ? Anyone a movie buff? ? Baseball movies? ? Kevin Costner baseball movies? ? Famous line from each?
  • 4. 4 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Story Telling ? There are many stories ? But according to some, there are only 10 plots in fiction ? What plots do you know? ? Some of those plots are: ? Cinderella—under-regarded, downtrodden overlooked boy or girl overcomes all odds and comes out transformed the winner (Sam Witwicky in Transformers; Luke Skywalker) ? Romeo & Juliet —boy meets girl, boy loses girl, boy finds girl—happy ending = Rom Com; tragic ending = Shakespeare ? Achilles—The fatal flaw; the most powerful hero is brought low by his weakness ? Beauty & the Beast —Little Red Riding Hood in reverse—the ugly monster is transformed ? Reference http://www.docstoc.com/docs/69309695/THE -ONLY-TEN-PLOTS-IN-THE-WORLD
  • 5. 5 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] ? The Quest for the Holy Grail ? Every story begins with the conscious realization that something is absent ? Freedom ? Love ? Power ? Skill / Knowledge / Enlightenment There is only ONE plot Every Indiana Jones Moneyball The Lego Movie
  • 6. 6 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Our Plot: The Search for the Holy Grail ? What is missing? ? Information about the impact of training on business outcomes ? What must be done to fill the void? ? Gather, analyze and report data—turn data into information ? What happens at the end of the movie? ? The award winning report allows leaders to make data-driven decisions
  • 7. 7 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Our Plot: The Search for the Holy Grail ? What is missing? ? Information about the impact of training on business outcomes ? What must be done to fill the void? ? Gather, analyze and report data—turn data into information ? What happens at the end of the movie? ? The award winning report allows leaders to make data-driven decisions
  • 8. 8 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] What are Executives Interested in Knowing? Source: How Executives View Learning Metrics by Patti and Jack Phillips, CLO Magazine, Dec 2010 Ranked Importance to Exec’s Measure Learning Evaluation Level Example Currently Measured 1 Impact 4 “The Accel project contributed 20% to our reduction in error rates this fiscal.” 8% 2 Value 5 “Within one year, the East program will achieve a 2:1 benefit-cost ratio.” 4% 3 Awards 0 “Our learning program won an award from Chief Learning Officer magazine.” 40% 4 Application 3 “78% are applying their new skills to their jobs” 11% 5 Learning 2 “92% of participants increased their skills” 32% 6 Activity 0 “Last year 7,800 employees participated in our learning programs” 94% 7 Efficiency 0 “Formal learning costs $2.15 per hour” 78% 8 Reaction 1 “Employees rated our training very high with an average of 4.5 on a 5 point scale” 53%
  • 9. 9 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] What are Executives Actually Get Source: How Executives View Learning Metrics by Patti and Jack Phillips, CLO Magazine, Dec 2010 Ranked Importance to Exec’s Measure Learning Evaluation Level Example Currently Measured 1 Impact 4 “The Accel project contributed 20% to our reduction in error rates this fiscal.” 8% 2 Value 5 “Within one year, the East program will achieve a 2:1 benefit-cost ratio.” 4% 3 Awards 0 “Our learning program won an award from Chief Learning Officer magazine.” 40% 4 Application 3 “78% are applying their new skills to their jobs” 11% 5 Learning 2 “92% of participants increased their skills” 32% 6 Activity 0 “Last year 7,800 employees participated in our learning programs” 94% 7 Efficiency 0 “Formal learning costs $2.15 per hour” 78% 8 Reaction 1 “Employees rated our training very high with an average of 4.5 on a 5 point scale” 53%
  • 10. 10 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Another view….think data visualization 0% 20% 40% 60% 80% 100% Activity Cost Reaction Learning Application Impact ROI Awards We current measure this We should measure thisWe currently measure this We should measure this
  • 11. 11 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Case Study—Story and Visualization ? Arthur Andersen, LLC (former accounting firm) wanted to know whether an Executive Onboarding program was a worthwhile investment. ? The following case study tells a story to answer the question ? Note the Infographic at the end which summarizes the results
  • 12. 12 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Evaluation Design
  • 13. 13 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Results: Tables vs. Graphs A Table vs. A Graph The table shows the entire data set at one point in time. A Table vs. A Graph The graph shows every day over two years Reporting tip: Know your audience
  • 14. 14 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Visual Variations Provide Insight Use additional markings and notations to emphasize differences and draw out the meaningful information
  • 15. 15 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Impact Each day = billable time = revenue 250 days gained due to training
  • 16. 16 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Monetizing Outcomes $80M ROI
  • 17. 17 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Infographic Summary 1 2 3 Three days of training Leads to… 1 2 3 250 250 extra days of employment $1M invested $21M returned ROI of 21 : 1 20% 80% No Training Turnover Retention 5% 95% Training Turnover Retention 5% turnover vs. 20% turnover
  • 18. 18 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Summary: Story Telling & Visualization Story Telling ? Tell a dynamic story, not a “We collected data, analyzed it, and here are the results” story ? There are only a few plots; select yours ? Tell the story with visuals at the right level for with a targeted message to the audience ? Leave the audience with one memorable line (ROI of 21:1 or Decrease Scrap & Increase Performance) Visualization ? Use graphic representations when possible ? Make sure they are simple & clear ? Use variations to help tell the story (e.g., variations on survival curves) ? Create Infographics to summarize the story in one slide
  • 19. 19 ? 2014 CEB. All rights reserved. Version: X.X Last modified: [insert date format: DD Month YYYY]. CONFIDENTIAL OR CONFIDENTIAL-RESTRICTED [Delete as appropriate] Activity ? Break into triads ? Quickly assign roles: ? Story teller ? Audience (e.g., training manager, HR Director, CEO, etc.) ? Observer / Coach ? Tell a story and give feedback ? Rotate roles so everyone gets to tell a story
  • 20. John R. Mattox, II, Ph.D. Senior Measurement Consultant 615 714 7299 jmattox@executiveboard.com