The Danger of Single [Data] Story [Metric]

In 2009, Nigerian bestselling author Chimamanda Adichie delivered a TED Conferences talk about the danger of a single story.

I recently re-read the speech and couldn’t help but draw parallels between the danger she described of a single story and the danger lurking in data storytelling.

The highlights of her talk:
1.    A ‘single story’ is a narrative that repeatedly presents only one perspective
2.    The resulting danger is that it results in outlooks based on stereotypes
3.    And stereotypes are dehumanizing, incomplete, flat, and one-dimensional

Through these highlights, we see examples of the “single data metric”:
1.    Use of a single favourite metric to make an investment decision, highlight a visual, or push a policy.
2.    Deploy a non-representative dataset for machine learning model training.
3.    Employ a narrow objective in prescriptive optimization models.
4.    Overbearing influence of the HiPPO (Highest Paid Person’s Opinion) on “decisioneering.”

Adichie recommends a “balance of stories” to avert the danger of the single story.

Similarly, best practise for avoiding the danger posed by the “single data metric” will be a “balance of data metrics”:
1.    Use a basket of metrics for investment decisions.
2.    Present data visualizations in alternative ways.
3.    Capture a diverse and representative dataset for model training.
4.    Employ the “delphi” method, consultation, stakeholder engagement for decision making.

These best practices can build an inclusive, multi-dimensional data-driven, evidence-based business and policy environment.
Do you have any examples of where a “single data metric” is at play and the dangers it poses? What challenges do organizations/businesses face in collecting and utilizing a “balance of data metrics”? I’ll be happy to hear your thoughts in the comments.

Credits: The image is of a military plane, with red dots indicating the location of bullet holes after missions. It illustrates “survivorship bias” where only aircraft surviving WW2 missions were studied ignoring those shot down.