Search the site...

  phil mora
  • The Global Nomad
  • About
  • Portfolio
  • Contact and Book
  • The Training Log
  • The Global Nomad
  • About
  • Portfolio
  • Contact and Book
  • The Training Log


​The Global Nomad
(JAN-APR 22 = currently in the Philadelphia area.)

about

Balancing big data analytics with intuition

6/17/2013

4 Comments

 
Picture
Picture
Picture
Picture
Sure, Big Data Is Great. But So Is Intuition. With the growing potential of data and analytics, where is the shifting line between analytics and intuition?

[Reproduced from MIT Sloan management Review]
Analytics and Intuition: Finding Equilibrium
[By Renee Boucher Ferguson 03.05.13]

As the practice of using data analytics to make organizational decisions grows, where is the line between analytics and intuition? Is there a perfect balance between experience versus data, or data versus experience?

With the growing potential of data and analytics, how should managers balance analytics and intuition?

Just before the New Year, New York Times writer Steve Lohr wrote a blog post, Sure, Big Data Is Great. But So Is Intuition, which addresses a question we here at MIT Sloan Management Reviewhave been researching for the past year: With the growing potential of data and analytics, where is the shifting line between analytics and intuition?

In other words, is there a “correct” balance between analytics and intuition in making good business decisions?

Lohr bases his post on comments made by a number of speakers who presented at a recent MIT Center for Digital Business conference, Big Data: The Management Revolution, including Claudia Perlich, chief scientist at Media6Degrees and Rachel Schutt, a senior statistician at Google Research. His central premise:

Personally, my…concern is that the algorithms that are shaping my digital world are too simple-minded, rather than too smart.

It’s encouraging that thoughtful data scientists like Ms. Perlich and Ms. Schutt recognize the limits and shortcomings of the Big Data technology that they are building. Listening to the data is important, they say, but so is experience and intuition. After all, what is intuition at its best but large amounts of data of all kinds filtered through a human brain rather than a math model?

As I read Lohr’s article, I couldn’t help but think of our own findings around the theme of analytics versus intuition.

In conjunction with our corporate partner SAS, we have conducted research into how organizations are using data and analytics to both compete and innovate. As part of that research, we asked 2,500 survey respondents to rate the extent to which they rely on intuition versus analytics to make decisions in a number of areas, from enhancing customer experience to allocating annual budgets.

We found that while organizations have access to more useful data than they did a year ago — another finding from our survey — the extent to which managers are using that data to make business decisions varies greatly (see “Addressing Analytics Equilibrium”).

ADDRESSING ANALYTICS EQUILIBRIUM

Not surprisingly, many respondents said that for traditionally quantitative functions — establishing financial forecasts, managing supply chain or logistics, and allocating annual budgets — they use “mostly or purely” analytics.

In contrast, only a third of respondents said they rely more on data and analytics (rather than intuition and experience) to address issues connected with organizational risk, new product development, marketing campaigns, and identifying strategic objectives. And less than a third of our respondents said they rely on data and analytics to address the “softer” processes: enhancing customer experience, assessing employee performance and matching sales representatives with customers.

We also found is that there is an interesting dynamic playing out among organizations across the globe: a struggle to find an analytics equilibrium — a balance between the use of data and intuition to make important business decisions.
In our interviews with executives from across industries, the balance issue elicited several points — potential roadblocks, really — to finding analytics equilibrium. These points suggest how complicated the process is at the organizational level, not to mention among individual managers:

·         Culture Clash: In some cases, managers have different perspectives and experiences with data and analytics. These differences create organizational tension. A top-down approach — a CEO who understands and values data — may be necessary to reduce this tension.

·         Data Hiders: Executives often win their positions based on experience, skill and knowhow. Not only do they keep this intellectual property close to the vest, they often rely on it in place of data.

·         Data Mistrusters: An older generation of executives — those not brought up on the Internet — are often distrusting of data. They require education about the benefits of utilizing (or at least considering) data to make decisions.

But here’s what we’ve found: In those situations where there is reliable data to utilize, and a culture that embraces analytics, the analytics equilibrium is skewing towards data. In our qualitative research, for example, we spoke with data scientists from such “digital native” companies as LinkedIn, PayPal and Match.com. These organizations overwhelmingly rely on data to make major strategic decisions, from new products and services to mergers and acquisitions.

We believe that there is no right way to apply the “correct” percentage of analytics over intuition — or even that there is a correct percentage. What counts as an appropriate analytics equilibrium can vary, depending on a number of different factors including the skill level and experience of those utilizing data, the prevalence of data usage in the organization, the data goals of the organization — and, of course, the data culture.

The key lies in finding what is right for your organization, with this thought in mind: While an analytics equilibrium is determined, in part, by the individual manager’s comfort level and experience with data, the organizational environment plays a significant role as well.

That was Rachel Schutt’s point at the MIT conference: “I don’t worship the machine,” she said, even though as a data scientist, Schutt lives and breathes analytics. Her prescription for a good data scientist, as Lohr points out, is “someone who has a deep, wide-ranging curiosity, is innovative, and is guided by experience as well as data.”

4 Comments
gst consultant near me link
1/8/2021 10:08:37 pm

Apply GST registration online. One of our GST Experts will call you and clarify all your doubts. And then we will get your Online GST Registration done. We are no. 1 GST number online registration
cheap gst registration,charges for gst registration,gst registration filing,gst registration rate gst registration lowest price,gst number online registration,gst registration center chennai,gst registration in tamilnadu,apply gst registration online,gst registration agent near me,new gst registration fees,gst number registration charges,gst registration near me,gst registration fees in chennai,online gst registration in chennai,gst registration consultants in chennai,gst registration apply online,gst registration agent

Reply
GST filing in Chennai, Tamilnadu link
3/19/2021 06:38:49 am

Are you looking for GST filing in Chennai? mygstzone has a team of qualified GST filing consultants in Chennai to help you with GST filling. We providing File GSTR-1 Online Chennai, GST return filing service provider etc…

Reply
Hoarding Advertising in Chennai link
11/17/2021 03:38:25 am

Get CMBT bus stand advertising agency and Hoardings in Chennai through Eumaxindia over Chennai cities. Look at cities, pics and get a free quote.

Reply
TERASAKI Dubai UAE link
5/30/2022 09:49:18 am

JIS Electrical is U.A.E's leading Electro-mechanical supplier of Quality proven European products since 2000. We expertise in LV components/ Lighting & Distribution / EV Charging & Energy Storage.

Reply



Leave a Reply.

    head of product in colorado. travel 🚀 work 🌵 food 🍔 rocky mountains, tech and dogs 🐾

    Picture

    Categories

    All
    Change Agents
    Experiences
    Fitness
    Hacking Work
    Technology

    Archives

    February 2022
    January 2022
    December 2021
    November 2021
    October 2021
    September 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    July 2018
    June 2018
    May 2018
    April 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    July 2017
    June 2017
    May 2017
    April 2017
    March 2017
    February 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    January 2016
    October 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015
    December 2014
    November 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2014
    April 2014
    March 2014
    February 2014
    January 2014
    December 2013
    November 2013
    October 2013
    September 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    February 2013
    January 2013
    December 2012
    August 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    January 2012
    December 2011
    October 2011
    September 2011
    August 2011
    June 2011
    May 2011
    April 2011
    March 2011
    February 2011
    January 2011
    December 2010
    November 2010
    October 2010
    September 2010
    August 2010
    July 2010

    RSS Feed

Phil Mora
​San Francisco .Rennes .Fort Collins .Philadelphia
Phone: (415) 315-9787 . Twitter
@philippemora .  braintrust | polywork | behance

Copyright © 1999-2022 Marshall Tucker by Bold (MT2B) All Rights Reserved