Although most organizations won’t make headlines with such expensive failures, relatively few are successful in making a breakthrough in their analytics
programs. In a recent survey of leaders innovating in big data analytics, three quarters reported revenue or cost improvements of less than 1 per cent.90 In another study, only 27 per cent reported success in their big data initiatives.32 The Harvard Business Review describes an MIT researcher recently addressing a group of 150 machine learning enthusiasts. He started with the question, ‘How many of you have built a machine learning model?’ to which roughly one third raised their hands. He then asked how many had also deployed and/or used that model to generate value and then evaluated the results. None kept their hands up.
None.91
In my experience, and in speaking with colleagues about their experiences, many organizations have taken steps, sometimes significant steps, to find new value from data and analytics, only to reap little practical benefit. Sometimes this is because the problems are very difficult, but it more often reflects problems with staffing, project management or organizational dynamics. Still, we’ve seen other organizations launch analytics projects and reap substantial returns.
So how can you maximize the likelihood that your big data and data science initiatives will succeed?
Here are some principles to follow.
Become data-driven
Keep asking questions about your business
Ask basic questions, such as ‘What customers or products account for the top 20 per cent of our revenue?’ Ask more nuanced questions, such as ‘What motivates our customers to purchase?’ and ‘What sequences of cross-channel actions are the strongest signals that l might soon lose a valued customer?’ You can come up with hundreds of questions like these. Focus on answering the ones most critical for your business.
Challenge your basic assumptions
Especially do this if you are very familiar with your business. When colleagues propose answers to your (sometimes obvious) questions, ask for data to back up those answers. In their book, Yes, And,92 Kelly Leonard and Tom Yorton
describe how a bit of data shattered some basic assumptions they had held about their 50-year-old Chicago theatre. When an outsider asked them why they
thought their guests were coming to the theatre, they immediately responded with the obvious answer: the guests obviously wanted to see the show playing that night. The questioner then surveyed the guests, who gave very different reasons.
The guests were actually using the theatre as a novelty event: to celebrate a birthday or the achievement of a business milestone, to entertain out-of-town guests, or because they had received the tickets as gifts or purchased them at charity events. Not a single patron gave the expected answer. Not a single one was there simply because they wanted to see the show playing that night.
Seasoned management had been so certain and yet completely wrong in their assumptions. (‘Yes, And’ (p. 174). HarperCollins. Kindle Edition)
Create and monitor KPIs
If you’re not keeping score, you’re just practising. Don’t simply monitor the obvious KPIs, such as revenue. Track your micro- and macro-conversion rates and your churn rate. Track your lead indicators, including those from customer activity. Track stickiness, including frequency metrics. Display the KPIs your teams can influence in places where they can see them. Set goals. Celebrate the goals. This part isn’t rocket science.
Get new ideas
Technology applications quickly spread within industry sectors as employees change jobs or attend industry events, but to stay ahead you’ll want to look at what’s happening in other sectors. If you’re in banking, look at what e-commerce companies are doing. If you’re in e-commerce, look at what logistics companies are doing. Go to industry conferences and talk to vendors and analysts about use cases they’ve seen.
Organize your data
If you follow the advice above, you should very quickly become frustrated with the current state of your data systems. Hire and engage people who can shepherd
and draw insights from your data. Train staff across your organization to use your BI tools, particularly self-service tools which allow them to explore data on their own. Selectively move data from silos to a central data warehouse.
Get the right people on board
Hire people who understand how to apply data science to business. Hire data scientists and hire data-driven people across the organization, ideally from the top down. The higher the level of buy-in within the organization, the better the chance that analytics initiatives will be funded and supported and that the entire organization will catch the vision. Top level buy-in is still relatively rare, as demonstrated by a recent industry survey. When CEOs were asked whether they were leading their companies’ analytics agendas, 38 per cent said yes. However, when the other C-suite executives were asked, only 9 per cent said the CEO was indeed leading that agenda.90
Be aware that analytics efforts often illuminate internal shortcomings, some of which directly implicate powerful colleagues. Expect internal resistance,
sometimes as ambiguous criticism or stalled cooperation, often appearing after the release of incriminating analysis.
A data-driven approach affects hiring and training throughout your organization, not only in data and analytics teams. Consider the case of General Electric (GE).
GE started a major digital initiative around the beginning of 2010, acquiring companies and creating thousands of roles related to data science. In a recent interview,70 GE’s CEO Jeff Immelt recounted some key learnings from this process. He described how, even beyond staffing the data science roles, GE found they needed to hire thousands of new product managers and different types of commercial people. The impact of the transformation extended to onsite
support and even sales people.
Keep in mind
Transforming into a data-driven organization requires changes throughout your organization. It’s not enough to simply create a data and analytics team.
I have seen companies start data science initiatives by bringing in a few newly minted ‘data scientists’ and setting them loose to find their own way within the organization, hoping to somehow reap tangible benefits. We wouldn’t do this with an IT initiative, and we shouldn’t do it with an analytics initiative. Projects should be done in project teams consisting of well-vetted staff with
complementary skills who are ultimately connected in meaningful ways with use- cases and stakeholders. The stakeholders, in turn, should continually feed
business intuition back into the development process. This should all go without saying in a mature organization, and yet we often don’t see it happening.
I would suggest you stop using the same vendors to meet your staffing and project needs. Talk with newer, smaller companies you haven’t yet used. Your new initiatives should start small, so let a small company with a few competent, creative professionals help you start it. Don’t expect that large service providers can provide top-notch staff for every engagement, and don’t expect that updated job titles reflect updated capabilities. One of the problems highlighted during the audit of the Watson–Anderson shipwreck was non-robust vendor selection.93 As an analytics programme matures, it will likely grow into a hybrid of
centralized teams and decentralized analysts sitting within business units. The centralized teams will include a BI team and one or more teams of analytics specialists. Some of the decentralized analysts located within business units will have originally joined those units in non-analytic roles, over time assuming analytic responsibilities. As you transform your organization in its use of data, keep these people in their analytic roles if they can efficiently retrieve data, ask relevant business questions, perform basic analysis, and communicate results clearly. If not, cut your losses and replace them in this function with more analytically adept staff.
Find senior analytics leadership who can form a vision, a roadmap, and a team.
Although an organization may organically grow in its ability to be data-driven by hiring or re-purposing de-centralized analysts, it will generally be limited to spreadsheet-level analytics until it commits to recruiting a senior analytics leader and building out a strong analytics team. Empower that team not only with the resources and flexibility they need to collect data and build models but also with access to stakeholders and key decision makers.
Without such a team, typically centralized, you will be very limited in your ability to recruit top analytics talent, and the talent you do secure will repeatedly be pulled into ‘urgent’ business problems and have little time for long-term strategic initiatives. In addition, effectively deploying analytic projects such as recommendation engines, natural language processing, advanced customer segmentations and deep learning models will typically require the synergy of a centralized team of experts.
Break down silos
Data silos severely limit your ability to draw maximum value from your data, but you’ll need extensive stakeholder management and significant technical
resources to consolidate the siloed data spread across your functional units and legal entities (particularly following acquisitions). Business units tend to be protective, if not of their data then at least of their IT resources. How to best
navigate this gauntlet depends on how your organization functions, but executive-level support goes a long way.
Focus on business value
It is very important to keep your data scientists focused on providing business value. There are non-technical people in your company who have developed a deep understanding of the customer, the product and the market. Your data scientists should speak with them at the very start of an analytics project. They should go back to them on a regular basis to show data and intermediate results.
The business colleagues will quickly identify flawed assumptions or inappropriate interpretations of data. In some cases, they can even provide valuable assistance in constructing your analytic models.
Measure results
We talked earlier about promoting the use of KPIs within the organization, and this applies to data science efforts. Don’t start a data science project unless you know why you’re doing it and what it looks like when it succeeds. Are you looking to increase conversion rates? Marketing ROI? Market share? Customer lifetime value? Measure your starting point, set a target, and estimate resulting revenue gains. By the end of the year, you may have an ROI for the analytics programme itself.
Stay agile
Remember to stay agile, starting with minimum viable products (MVP) and working with short delivery cycles. It goes against our academic training, but we need to progressively work towards incomplete solutions rather than an
immediate 100 per cent solution. Start your analysis on just a sample of the data.
If you start by collecting and cleaning all possible data, you’re no longer working with an MVP and you’ll waste weeks or months before getting far enough to see any pitfalls that might exist in your approach. Start with simple models, such as decision trees, statistical regression and naïve Bayes. Refine your models once you’ve found applications with demonstrable business value.
As far as possible, get specialists working on specialized problems. Find people to extract and clean data who are skilled in this, rather than asking your
statisticians and AI experts to do it.
Don’t let your data scientists reinvent the wheel; instead leverage as much
existing tooling and software as possible. Don’t spend several months re-building an AI tool that is already available on a pay-per-use basis from Amazon, Google or Salesforce unless you need a custom feature or have hit a usage threshold
making it more cost-effective to develop in-house. Your in-house efforts should be spent fitting existing tooling to your business.