Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

The role of stories

in data storytelling
by Shawn Callahan

As Edward R. Tufte published each of his beautiful What follows is a framework for how story
books on the visual display of complex data – The techniques can help the data analysis process.
Visual Display of Quantitative Information (1983)1, It is useful for any individual (or group) working
Envisioning Information (1990) 2 and Visual with data, whether you’re a scientist, a marketer,
Explanations (1997) 3 – I became more and more an engineer or a policy-maker. The challenge in
fascinated by the question of how to grab the each case is similar: how do you put yourself in
attention of decision-makers and inspire them the best position to make sense of a mass of data
to act based on the data. in order to gain insights, and then inspire people
to change based on the discoveries?
I remember an early success back at the start of
the 1990s. I was helping some councillors see We are starting to see things written about the
the need for a tree-planting program to provide role of stories in data analysis. For example, Brent
nature corridors across their shire. Before they Dykes over at Forbes5 has written a compelling
saw the results of our geographic systems analysis piece describing the need for data storytelling,
(what we called computerised mapping before showing that the emphasis today is on data
Google Maps), the councillors had told themselves manipulation and analysis tools and skills. He
the story of how, over the years, they’d invested in predicts there will be a shift to storytelling when
planting trees and that’s why their towns had such the gap widens between the analysts who are
leafy surrounds. They felt they’d done more than discovering the insight and the decision-makers
enough. So when we unfurled maps showing tiny who are learning about it in a way that helps them
and mostly unconnected stands of mature trees and care. Cole Nussbaumer Knaflic’s Storytelling with
a vast expanse of paddock, they were more than Data6 also points to the popularity of the idea.
surprised. After the initial shock and some resistance,
However, Nussbaumer Knaflic’s book is really
they agreed to fund the tree-planting project.
a guide to data visualisation, with only a single
Cognitive psychologist Gary Klein has said that chapter on storytelling. And while Dykes laments
‘insight is when you unexpectedly come to a the missing link between the analyst and the
better story’.4 These councillors had just had an decision-maker, his article doesn’t take the
insight, one that we helped them to have. opportunity to appreciate the wider role stories
play in data analysis, beyond just inspiring the
Back then, I was unaware of the role stories play
decision-maker.
in the process of making sense of the data and
communicating insights the analyst uncovers. Here, we will explore the three types of story
But over the last 15 years, my work in business work, the role stories play before, during and
story techniques and my interest in conveying the after the data analysis, and the various story
results of data analysis have merged, and I now patterns that could be employed to inspire a
see a strong role for story work beyond just telling decision-maker to take action.
the story of the results.

Page 1 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


The three types of story work number of leaders in a company, or a broader
In addition to storytelling, there are at least two population of people with a specific demographic,
other ways to employ story work. You can elicit such as overweight, 50+ men prone to heart
stories to find out what is really happening and disease. Regardless of the size and shape of the
how people are thinking. I call this story-listening. group you plan to influence, it’s useful to get an
You can also trigger the telling of a new story idea of the stories they already tell, especially the
by doing something remarkable that others will ones they tell themselves.
remark on. I call this story-triggering. Long before Jon Snow became famous for being
the King of the North, a more mild-mannered
Figure 1 John Snow, a doctor, lived in London, just when
some of the biggest outbreaks of cholera hit in the
mid-19th century.7 Even in the 1850s London was
Story telling a massive city, but with one big difference from
today: it didn’t have a sewage system. London
Story stank. And to make matters worse, although the
triggering lisStory
tening flushing toilet had just been invented, there was
no sewer to flush it into.

So when cholera broke out, it was common


© Anecdote Pty Ltd
practice to blame the spread of the disease on
the miasma – the stench – that sat over the city.
All three forms of story work – storytelling, The thinking was that, as citizens produced more
story-listening and story-triggering – play a role unsanitary smells, cholera would float from one
in discovering an insight and influencing a neighbourhood to another. This story went deep.
decision-maker to act. In one survey of that time, only 5% of doctors
thought cholera was a waterborne contagion.
Let’s explore these three types of story work from
three perspectives of data analysis: what happens The miasma-causes-cholera story was told
before analysis, what happens during it, and what publicly and pervaded the medical literature in
happens after the insight has been discovered. John Snow’s time. But more often than not, the
stories that are informing the way people think
BEFORE data analysis
are hidden. So you need to actively seek out
In business, data DATA STORYTELLING—THE
analysis serves a purpose. The ROLE OF STORIES
these stories, those that lie under the surface, to
results of an analysis are designed to inform or
know what you are dealing with. I call this story-
even inspire decisions – we are not talking about
BEING AWARE OF listening: the active collecting of the stories that
pure research here. And you typically Tknow who’s
HE ANALYS T S’ S TORIE S,
FINDING THE PREPARING TO NOT ICE are being told in any defined population.
DOMINANT S TORIE S AND DE AL WIT H BIA SE S
going to make theseIN decisions. ItION
T HE POPUL AT might be a select S TO RY T E L L I N G
S TO RY-L I S T E N I N G S TO RY-T R I G G E R I N G
S TO RY-L I S T E N I N G S TO RY T E L L I N G S TO RY-L I S T E N I N G

Figure 2

BEFORE DURING AFTER


DATA DATA DATA
ANALYSIS ANALYSIS ANALYSIS

DATA E X P L A N AT I O N D I S C O V E RY TRIGGERING
S TO RY S TO RY STORY A NEW STORY
T IME SERIE S POINT POINT T IME SERIE S
DATA IN T IME IN T IME OR POINT
DATA DATA IN T IME DATA

Page 2 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


Running anecdote circles is an effective technique graduates got a job within a month of finishing
for collecting stories. It’s much like running focus their degrees. But compared with what? What
groups, but instead of seeking opinions you happened to graduates in other cities? You then
elicit stories. We wrote a popular guide called discover that 2000 people got jobs right out of
The Ultimate Guide to Anecdote Circles,8 which uni in another city. But what is the relative size of
shows you how to prepare and run them. each city? What are the demographics of each
population? What’s the employment rate? What
Getting back to John Snow, to change the
industries are employing these graduates?
minds of the medical professional and also the
policy-makers of Victorian England, he needed Each answer fills out the story, either making it
to tell a new story with data. His now-famous stronger or triggering more questions. A good
map showing the cholera deaths in and around analyst uses the data along with their imagination,
Soho’s Broad Street (now called Broadwick curiosity and experience to conjure new scenarios
Street) did the trick by clearly illustrating the and see if the data rules them in or out, or they
connection between the street’s water pump, use the data to prompt new possible stories.
the people who drew water from it, and those
Business storytelling specialist Paul Smith, author
who perished from cholera. (Figure 3)
of Sell with a Story,9 was once a market analyst for
It would be folly to think that this one map and Procter & Gamble. The Pampers business called
the associated story Snow told changed the minds him in to get the data together and run a strategy
of the miasma camp in one fell swoop. The fact session for them. Now Paul was familiar with
is that Snow had been campaigning for years to the dominant story in this business: if you want
convince people that cholera was a waterborne to generate more profit, you need to increase
disease. That said, his map marked a turning volume of sales. (Figure 4)
point. It illustrated what can happen when data
The data did show this strong correlation, but only
and story combine, especially when you know the
up to 1984. After that, there was a marked change
prevailing story you are up against.
in the pattern Smith was seeing, with no discernible
DURING data analysis link between profit and volume. He had to start
The act of analysing data involves a constant flow testing a range of alternative stories to explain what
of evolving stories. For example, in your analysis had happened. Had the change occurred when
you might discover that in your city, 1000 university competitor Kimberly-Clarke launched Huggies?

Figure 3

Page 3 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


Figure 4 PA M P E R S   D I A P E R S   Figure 5 PA M P E R S   D I A P E R S  

1982-2000
correlation = 0%
Profits

Profits
1961-1982 1961-1982
correlation = correlation =
94% 94%

Sales Sales
Source: Sell with a Story, by Paul Smith Source: Sell with a Story, by Paul Smith
Source: Sell with a Story, by Paul Smith Source: Sell with a Story, by Paul Smith

Was it when commodity costs got out of control? The connection between cause and effect, how-
Paul chased down each hypothesis and in the end ever, doesn’t have to get down to root causes.
discovered that it was when the market reached Marketers have discovered that if you can uncover
full penetration. (Figure 5) a reliable correlation, then you can make decisions
– I’m sure this sends the scientists nuts, but for
Paul tells the story this way:
a business it can be a practical approach. For
“Before we launched disposable diapers in the example, large retailers collect masses of data
early ’60s, everyone used cloth diapers. But around loyalty cards, such as purchases, dates,
it’s not like once disposable diapers came out, times, geographies, shopper demographics
everybody switched from cloth immediately. It and so on. An analyst can explore this data for
took years for that to happen. In fact, it turns strong correlations, and once they are found,
out it took exactly 21 years.” predictions can be drawn.

“By 1983, the market for disposable diapers The following scenario, told by Charles Duhigg
had essentially reached 100 percent of in The New York Times,11 is from the retailer
households with kids who wore diapers, and Target. A woman aged 23 buys cocoa-butter
cloth diapers had almost entirely vanished from lotion, a purse large enough to double as a
the marketplace. Up to that point, everyone diaper bag, zinc and magnesium supplements,
making disposable diapers had rapidly growing and a bright blue rug. Target can predict she
sales numbers, and the rapidly growing profit has an 87% chance of being pregnant and
numbers to go with them. The cloth diaper will have her baby in five months. With that
makers, of course, were going out of business.” knowledge, they can then send brochures
directly to the woman, encouraging pregnancy-
“What that means is that the disposable diaper
related purchases.
business in the United States went from a
‘developing market’ to a ‘mature market’ in As Target discovers, though, you have to be
1983. And apparently, we (Procter & Gamble) careful with this knowledge. Their analysis results
failed to notice it. We’re still following the same in a high-school girl receiving advertisements
basic ‘sell more’ strategy we’ve been using of maternity clothing and nursery furniture.
during the developing market period.”10 Her father is enraged and complains to a Target
manager about the obvious mistake. A few days
Analysis is a battle of stories in a very Darwinian
later the manager calls to apologise again to the
fashion. The one with the best fit with the data
father. A little sheepishly, the dad admits he’s
wins. It’s the job of the analyst to explore the
had a conversation with his daughter and she
many possible stories that might explain what
is due in August.
they are seeing.

Page 4 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


Whether you are telling the story of the root A story has people in it who are doing things. It’s
causes during analysis or exploring the possible a giveaway when you hear dialogue, as dialogue
stories that explain strong correlations, it’s the can only be delivered in a story.
stories that help the analyst make meaning out
Finally, in a story, something unanticipated
of what they discover and see whether the data
happens. When the audience hears it, they are
supports, complicates or refutes the story.
a little surprised. It’s news to them.
AFTER data analysis
With these simple giveaways, you can now spot
As I’ve said, there’s often a chasm between stories. So what types of stories should you tell?
an analyst’s insight and the decision-makers
who need to have this insight. Part of the There are three story types and one story
challenge stems from the background disciplines technique you should consider using in data
of the analysts. They typically are steeped in storytelling.
mathematics, statistics and IT, and are more The data story
comfortable digging into the data than conversing
When you have a time series and the data does
with decision-makers about what they’ve found.
something unanticipated, then you can tell a
On the flip side, decision-makers often assume
story about it – a data story.
that people trained in STEM disciplines are
poor communicators. But the more I work with Here’s an example. From the 1920s to the 1930s
engineers, technologists and the many other in Norway, deaths from heart disease steadily
flavours of number-cruncher, the more I’ve rose.15 Then in 1939 they plummeted and stayed
learned that many do just fine communicating low until 1945, after which they quickly began to
their discoveries once they have the basic skills rise again. So why would that happen? (Figure 6)
under their belts. And they are keen to learn.
Well, in 1939 the Nazis occupied Norway and
When you add to that the simple fact that we confiscated all of its livestock, forcing the
are all storytellers, helping analysts convey their Norwegians to live off a plant-based diet for the
findings in interesting and compelling ways using duration of World War II. This diet reversed the
story techniques becomes a straightforward task. death rate from heart disease. When the war
ended in 1945, livestock returned and meat and
Spotting stories
dairy was added back into the Norwegian diet,
The first thing you need to have clear in your and heart disease came back.
mind is exactly what we mean when we say
‘story’. This is vital because you won’t get all The story about Procter & Gamble and its
the benefits of sharing stories unless what Pamper strategy is also a data story.
you’re sharing is actually a story. I’ve offered a The data story typically has this basic structure:
definition in Putting Stories to Work12 and also • In the past…
on our blog here13 and here.14 But in a nutshell, • Then something happened…
you can tell whether something is a story if it • As a result…
has the following characteristics.
One of the ways to present a data story is to share
A story begins with a time marker or a place a high-level version of the narrative and then ask
marker. So when you hear someone say, the audience what they think is happening. This
“A couple of days ago…” or “Last year…” is like presenting the audience with a mystery to
or “A while back…”, then it’s likely to be the be solved and asking them to be the detectives
beginning of a story. It could also start with (we love mystery stories16). When they come to
a place, like, “We were next to the river…” the right answer, you can show them the full data
A story has a series of events connected in a way story. Now they own the results – they have had
that infers causality: this happened a couple of some involvement in working it out.17
days ago, but then that happened, and as a result
this happened.

Page 5 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


Figure 6 MORTALIT Y FROM C I RCUL ATORY DISE ASES
Norway 1927-1948. Death Rate per 10,000 people

32

30

28

26

24

1927 1930 1935 1940 1945 1948

Source: A. Strom, R. A. Jensen, M. D. Oslo and M. D. Oslo (1951), ‘Mortality from


Circulatory Diseases in Norway 1940–1945’, The Lancet, 257(6647): 126–9.

A data story is vulnerable in one way: it can be you could say it’s likely that on 28 August 1854,
usurped by a better story. For example, in relation the water pump on Broad Street became infected
to the Norway story, what if scientists discovered when the cesspool for the block overflowed
that when humans are under extreme stress, we because of broken brickwork. Houses on Broad
produce a chemical in our blood that reduces the Street fell first – as water was taken from the
likelihood of heart failure? Then the story could pump, you could see a fanning out of the disease
become something like the following. and the resulting deaths in a radial pattern.
Interestingly, there were no deaths at the nearby
Before the war, Norwegians were a relatively
brewery as everyone there drank beer to hydrate
relaxed population, and the incidence of heart
and they had their own well to take water from.
disease increased on a par with other Western
The few other unaffected households in the area
cultures. But when the war began, Norwegians’
were discovered to prefer the water from a pump
stress levels went through the roof. Their bodies
that was further afield and unaffected by cholera.
produced heaps of chemical X, and heart disease
almost disappeared. But when the war and its John Snow wrote extensively on how the disease
stresses ended, the Norwegians resumed their spread in London and explained all the anomalies
old stress-free lives, and rates of heart disease he found in the data. His story was a compelling
climbed again. account and, as I said earlier, it changed public
health policy in England. As Steve Johnson,
OK, it’s perhaps not the most compelling
author of The Ghost Map18 and my source for
alternative story, but you get my meaning. A key
John Snow’s epic data storytelling, has noted:
story principle is that you can’t beat a story with
“It was going to take more than body counts to
fact. You can only beat it with a better story.
prove that the pump was the culprit behind the
Stories of the past are often overtaken by new Broad Street epidemic. Snow was going to need
discoveries. Clearly, the founder of IBM couldn’t footprints too.”
have imagined the scale of future technology
The discovery story
when he predicted the world would only ever
need a handful of computers. Sometimes you have to explain how a discovery
was made for the audience to both appreciate
The explanation story the insight and understand how much work
When your analysis is not a time series, then your went into having it.
story could explain your insight. John Snow’s
Google recently completed a comprehensive
cholera map is a good example. On its own,
study19 into what makes a team productive.
without a story, the map lacks meaning. However,

Page 6 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


They concluded there were five factors: Now you would share the five factors that affect
1. Psychological safety – people can and team performance.
do speak up
This story would then lead to the next obvious
2. Dependability – you do what you promise
question, which is how to get these norms
to do
established in your team. Again, you might tell
3. Structure and clarity – goals are clear and
the discovery stories of the trials and errors that
the process for getting there is known
led to very practical approaches. Or you could
4. Meaning of work – everyone is here for
tell the story of how one manager did something
more than just a paycheque
so simple, yet it had a significant impact on
5. I mpact of work – the team can see how their
psychological safety.
contribution makes a difference.
People want to hear how you made a discovery.
So they are the facts of the study. But to really
It adds plausibility to your results. If there isn’t an
appreciate the work that went into it, and the
obvious story in the data, then tell the story of
twisting and turning the researchers did to find
how you discovered the insight.
the five aforementioned factors, you need to
hear the story of the discovery of the insight. Story-triggering
The discovery story adds meaning. Sometimes your data is so remarkable and so
New York Times reporter Charles Duhigg does a against the dominant story that people just
wonderful job of telling this story. Of course, you don’t believe what you’re saying, despite how
wouldn’t relate all the detail in Duhigg’s article20 good your data and story are. In 1984, Dr Barry
in an oral telling of the story, but the plot points Marshall faced this challenge.
provide a handy guide to what you might cover. Back then, the dominant story about stomach
Here are some of the things I would tell before ulcers was that they were caused by stress. The
sharing the results of the Google study. crazy lives of executives caused more acid to be
Back in 2012, Google kicked off a study in their stomachs, which resulted in ulcers. Barry
codenamed Project Aristotle to understand what Marshall had discovered through his research that
makes a great team. The research team started by ulcers were actually caused by bacteria. But when
reviewing a stack of academic literature on teams, he presented his results, no-one believed him.
then applied what they found to 180 Google He needed to trigger a new story that was so
teams, but they couldn’t find any patterns. Also, remarkable, it would replace the dominant story.
in the past, Google had thought that putting the Marshall took the radical step of brewing a batch
best people together would simply allow magic to of the ulcer-causing Helicobacter pylori bacteria
happen. But the researchers’ initial investigation and infecting himself with it. Over a period
showed that ‘who’ was on the team wasn’t the of several days when he became incredibly ill,
determining factor regarding performance. Marshall tested himself for ulcers, which were
The researchers then started searching the data confirmed in abundance. Then he drank his
for anything on group norms: those things that antibiotic antidote and the ulcers disappeared.
a group does that denote its habits, its patterns The media found out and reported his findings
of behaviour, its culture. This avenue of inquiry under the headline: ‘Guinea-Pig Doctor Discovers
explained the patterns of performance better New Cure for Ulcers’. Medical opinion changed
than the characteristics of the team members. overnight, and in 2005 Marshall won the Nobel
Prize in Physiology for this groundbreaking work.
Then the team uncovered the idea of
psychological safety in the literature and it was as If you find something remarkable in your data
if everything fell together. The patterns became which goes against the grain of what’s regarded
clearer, and five factors emerged that have the as deeply true, then test your results by doing
biggest impact on team performance… something so remarkable that it will trigger a
story. That said, please don’t drink a flask of
poisonous chemicals!

Page 7 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com


Conclusion
It’s true that storytelling can help bridge the gap
between discovering an insight in the data and
influencing decision-makers to use that insight
to take action. But we are leaving so much on
the table by just thinking of story work in these
narrow terms. Story is fundamental to all parts
of the data analysis process.

Hopefully, we will give more thought to the role


story plays before, during and after data analysis.
And when stories are told about the data, we will
look at the multitude of ways in which they can
be told, and the most effective story patterns
to employ to have the greatest impact.

1
The Visual Display of Quantitative Information
http://amzn.to/29Ks9V9 Shawn Callahan is the author of
2
Envisioning Information http://amzn.to/29W9dWy Putting Stories to Work and the
3
Visual Explanations http://amzn.to/29W81Ts Founder at Anecdote, the world’s
4
Klein, G. A. (2013). Seeing what others don’t: the largest business storytelling
remarkable ways we gain insights. New York, PublicAffairs.
company.
5
www.forbes.com/sites/brentdykes/2016/03/31/data-
storytelling-the-essential-data-science-skill-everyone-
You can get his book at
needs/#7acea305f0c8
www.puttingstoriestowork.com
6
Storytelling with Data http://amzn.to/2aorpHu
7
The facts presented here about John Snow and the cholera
He works with Global 1,000 companies
epidemic of 1854 are drawn from Steven Johnson’s terrific
2007 book, The Ghost Map: A Street, an Epidemic and the such as Shell, Danone, Microsoft, TESCO,
Hidden Power of Urban Networks (Penguin Books). Allianz and Bayer all around the world.
8
The Ultimate Guide to Anecdote Circles www.anecdote.
com/pdfs/papers/Ultimate_Guide_to_ACs_v1.0.pdf Other articles by Shawn and the
9
Paul Smith (2016). Sell with a Story: How to Capture Anecdote team at www.anecdote.com
Attention, Build Trust, and Close the Sale, AMACOM
http://amzn.to/2aEsSbV You can automatically receive Shawn’s
10
Paul Smith (2016), Sell with a Story: How to Capture
future articles via email by subscribing to
Attention, Build Trust, and Close the Sale, AMACOM
11
Charles Duhigg in The New York Times www.nytimes.
Anecdote’s newsletter at
com/2012/02/19/magazine/shopping-habits.html www.anecdote.com/subscribe
12
Putting Stories to Work http://amzn.to/29Y4Mrm
13
www.anecdote.com/2014/09/story-framework-infographic/ Contact Shawn at:
14
www.anecdote.com/2013/01/storytelling-tips-for- Phone: +61 1300 720 537
leaders-spotting-stories/
www.anecdote.com
15
A. Strom, R. A. Jensen, M. D. Oslo and M. D. Oslo (1951),
‘Mortality from Circulatory Diseases in Norway 1940–1945’,
shawn.callahan@anecdote.com
The Lancet, 257(6647): 126–9. twitter.com/shawncallahan
16
Mystery stories www.anecdote.com/2008/04/why-
should-we-care-about-mystery-stories/
17
My friend and fellow story practitioner Paul Smith pointed
out this approach to me.
18
The Ghost Map http://amzn.to/2aoyg3I
19
Comprehensive study https://rework.withgoogle.com/
blog/five-keys-to-a-successful-google-team/
I would like to thank my friends Paul Smith,
20
Duhigg’s article www.nytimes.com/2016/02/28/
magazine/what-google-learned-from-its-quest-to-build- Andrew Ford and Walter Adamson who helped
the-perfect-team.html me think through my ideas.

Page 8 of 8 | © 2016 Anecdote Pty Ltd www.anecdote.com

You might also like