Gartner Industrial Analytics Newsletter
Gartner Industrial Analytics Newsletter
Gartner Industrial Analytics Newsletter
Industrial Analytics
Powered by the Internet
of Things
The next wave of business transformation
1
Welcome
3
Research from Gartner:
Industrial Analytics Revolutionizes
Big Data in the Digital Business
10
About Datawatch Corporation
Welcome
The Internet of Things (IoT) is ushering in a new wave of low cost sensor
devices and their associated data streams. Gartner has identified
industrial analytics as the next wave of business transformation for
those organizations that can effectively harness this information for more
meaningful and timely decisions. But traditional BI and analytic approaches
will not be sufficient in an era of high speed, high volume data streams.
Industrial analytics requires a combination of streaming data analytics and visual data discovery
that allows operators to be alerted when an important event occurs and to enrich this with the
business context to make better, faster decisions and take action. As most sensor information
and machine log files include time series data that is continuous and very granular, it needs
to be cached and analyzed in a very different manner than traditional BI which expects time
in days, weeks and months. And the format of the data is often multi-structured and requires
complex preparation in real-time before it can be visualized. You also need to enhance your
understanding by applying predictive analytics on the fly.
Datawatch is pleased to provide this important Gartner research on industrial analytics.
Datawatch customers have been at the forefront of this next wave by applying our next
generation visual data discovery solutions to a variety of industrial use cases. Datawatch has
been recognized by Gartner as a Cool Vendor for its unique in-memory architecture and ability
to visualize streaming data and join this with other sources including OT repositories, time series
databases, conventional relational and columnar databases, and multi-structured data.
We hope you enjoy this research report and encourage you to reach out to us to learn how you
can begin to transform your organization.
Dan Potter
Vice President, Product Marketing
Datawatch Corporation
Key Challenges
As the cost of sensors and
communications comes down, and
as storage capability and processing
speed increase (for example, Hadoop),
enormous troves of operational
technology (OT) data are being collected
and stored, but remain unused or
underused.
OT is markedly different from IT in
application, architectural characteristics
and need for different governance. Data
scientists versed in OT are consequently
rare.
Combining IT and OT holds
transformational possibilities in analytics
for asset-intensive industries, but
will require new approaches to data
integration and management, and an
evolution of infrastructure and skills for
data integration, management, and
analytics.
Recommendations
CIOs of asset-intensive companies:
Audit your data. Find underutilized OT
data (or dark data), and look for new
Introduction
This document was revised on 27 August
2014. The document you are viewing is the
corrected version. For more information, see
the Corrections page on gartner.com.
The basis of competition for asset-intensive
companies is shifting from physical assets
to information assets derived from the
equipment. More specifically, the search for
competitive advantage is starting to focus
on companies ability to capture information
from a wide spectrum of sources, and
then visualize, analyze, propagate and
contextualize it in a way that will drive the
next wave of business transformation.
In asset-intensive industries (such as
energy, manufacturing, oil and gas, mining,
transportation, healthcare and utilities),
sensors embedded in equipment and
infrastructure are generating and collecting
terabytes of raw data, most of which is
Analysis
Industrial Analytics Powered by the Internet of Things is published by Datawatch. Editorial content supplied by Datawatch is independent of Gartner analysis. All Gartner research is used with Gartners permission, and
was originally published as part of Gartners syndicated research service available to all entitled Gartner clients. 2014 Gartner, Inc. and/or its affiliates. All rights reserved. The use of Gartner research in this publication
does not indicate Gartners endorsement of Datawatchs products and/or strategies. Reproduction or distribution of this publication in any form without Gartners prior written permission is forbidden. The information
contained herein has been obtained from sources believed to be reliable. Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. The opinions expressed herein are subject
to change without notice. Although Gartner research may include a discussion of related legal issues, Gartner does not provide legal advice or services and its research should not be construed or used as such. Gartner
is a public company, and its shareholders may include firms and funds that have financial interests in entities covered in Gartner research. Gartners Board of Directors may include senior managers of these firms or
funds. Gartner research is produced independently by its research organization without input or influence from these firms, funds or their managers. For further information on the independence and integrity of Gartner
research, see Guiding Principles on Independence and Objectivity on its website, http://www.gartner.com/technology/about/ombudsman/omb_guide2.jsp.
FIGURE 1
Industries Are Adopting Different Types of Big Data at Very Different Rates
Which types of big data does your organization currently analyze?
Manu. & Media/
Nat. Res. Comm. Svcs. Govt. Edu. Retail Banking Insur. Health. Trans.
Transactions
73%
62%
67%
67%
54%
93%
83%
81%
75%
79%
Log Data
44%
57%
58%
59%
54%
40%
66%
61%
33%
71%
Emails/
Documents
27%
43%
43%
41%
46%
27%
34%
39%
17%
29%
Social Media
Data
32%
52%
39%
26%
54%
73%
27%
13%
50%
Machine Data
37%
24%
29%
19%
23%
20%
27%
29%
42%
29%
Free-Form Text
17%
24%
28%
30%
31%
20%
34%
35%
67%
21%
Geospatial Data
27%
14%
19%
19%
38%
27%
27%
26%
8%
29%
Sensor Data
36%
29%
12%
30%
23%
7%
7%
29%
25%
29%
Images
19%
24%
17%
11%
38%
13%
5%
16%
25%
7%
Video
8%
29%
12%
7%
31%
13%
6%
8%
7%
Audio
10%
19%
8%
4%
8%
6%
Other
8%
14%
13%
15%
8%
7%
10%
16%
42%
14%
n=
59
21*
127
27*
13*
15*
41
31
12*
14*
1 Monitor
3 Manage
4 Optimize
Each level builds on the previous.
Level 2
Level 1
In Level 1, companies can monitor and
report on asset behavior and even track
interactions between them. They can
track location and monitor use, including
wear and tear. Monitoring not only
improves insight into conditions for better
maintenance but also can lead to new
business models. For example:
Jet engine manufacturers are creating
new business models by retaining
ownership of their products while
FIGURE 2
IT/OT Opportunities
IT
ERP
OT
Costs
CRM
Demand
Management
Financial
Planning
Network
Optimization
State
Context
Orders
Constraints
Visualization
Prediction
Smart Machines
Location
Condition
Monitoring
Specs.
Control Systems
Events
Location
Systems
Environmental
Sensors
Bar Codes/RFID
Level 3
The Level 3 state enables organizations
to manage the performance of asset and
processes. This includes examples such as:
Danfoss which supplies products
and technologies for cooling food,
heating and air conditioning buildings,
controlling electric motors and powering
mobile machinery was able to create
predictive and preventative maintenance
strategies that help companies shift from
unplanned maintenance to predictive
maintenance, resulting in 70% fewer
alarms.
Sensors and data links used in healthcare
can monitor a patients behavior and
symptoms in real time and at relatively
low cost, allowing physicians to better
diagnose disease and to prescribe
tailored treatment regimens.
A manufacturer of equipment that
manages skids that automate the custody
transfer of hydrocarbons in the petroleum
value chain for multiple industries (such
as oil production, trucks and tankers)
built a cloud-based remote monitoring
system. Data collected from the flow
meters that monitor temperature in the
skids is sent to the cloud. The data is, in
turn, provided to customers as a service
to help drive process improvements, and
to provide the basis for predictive and
preventative maintenance programs,
as well as financial processes (accurate
billing) improvement. This avoided system
degradation, which can lead to quality
and cost issues where a 1% error each
day can add more than $1 billion of lost
revenue per year.
Level 4
Level 4 is about optimizing decisions,
processes and systems. This impacts
logistics for:
Data Maturity
Sensor Integration
Sensor integration will range from tightly
coupled integration with proprietary
standards at Level 1 up to Internet-connected
sensors to cross-sensor integration, to
sensors with distributed processing and selflearning and healing capabilities at Level 4.
Key to this process will be the introduction
and wide adoption of common standards
similar to those that enabled the proliferation
of the Internet of people. Currently, a few
standards are beginning to emerge, such
as message queue telemetry transport
(MQTT), data distribution service (DDS) and
Common Industrial Protocol supporting
different layers of the stack. The newly
formed Industrial Internet Consortium is
another standards body attempted to create
common standards. Integrating the OT
data from sensors must be a coordinated
and integrated part of the information
management capabilities framework plan
and road map.
Analytics
From an analytics perspective, as shown in
Figure 4, maturity will involve expanding from
the purely descriptive (What happened?) to
diagnostic (Why did it happen?) to predictive
(What will happen?) to prescriptive (What
should be done about it?):
Descriptive (Level 1) would leverage
descriptive analytics: Which parts/
equipment have failed? Which parts
failed over time by equipment and
manufacturer?
Diagnostic (Level 2) would leverage
diagnostic analytics: Which parts/
suppliers/factories are the primary
causes of failures? Are there correlations
between part failures?
Source: Gartner (August 2014)
Context-Based Decisions
The value of leveraging OT data is less in
the technology per se, but in how the data is
used to automate and improve operational
impacts on business outcomes. Critical to this
context is the ability to define and maintain
models of multiple, related information
sources, and to maintain persistent, functional
and operational models (relationships)
between the data over an extended hierarchy
of time scales and business priorities that
extend significantly beyond the operations
environment, portraying OT data alongside
enterprise data.
A chemicals company combined historical
data and unit metrics on asset performance,
cost, yield and cycle times by shift, day
and month. It uses these models against
FIGURE 4
Analytics Capabilities
Analytics
Human Input
Descriptive
What happened?
Diagnostic
Data
Decision Action
Predictive
Prescriptive
Decision Automation
Technologies/Approaches:
Event processing
Sensor integration
and other data
Optimization (e.g., linear
programming, mixed integer
programming)
Decision analysis,
influence diagrams
Game theory
Predictive (or
descriptive, or
diagnostic) analytics,
plus rules
Control systems
Cognitive systems
Table 1. Industrial Analytics Maturity Find and Develop the Skills for IT/OT Integration
Level 1
Monitor
Level 2
Diagnose and Control
Level 3
Manage
Level 4
Optimize
Decisions
Pockets of fact-based
decisions, rule-based,
predictive
Operationalized predictive
models in applications,
pervasive fact-based
decision making
Human-augmented,
collaborative; real-time
embedded, automated,
decision optimized
IT/OT Convergence
Identify how
convergence (OT looks
like IT) is happening in
your business
Consensus that
convergence means a
change in managing OT
Integration of IT and OT
systems and infrastructure,
resources and management
Infrastructure
Deployments
On-premises
Skills
OLAP = online analytical processing; SPSS = Statistical Package for the Social Sciences
Source: Gartner (August 2014)
Recommendations:
Consider the build solution path if you
already have analytics skills in-house,
if the required analytics are a critical
differentiator, or you require a high level
of agility and granularity of control.
Consider the buy solution path when
packaged applications are available, and
the time to solution is more important
than any potential differentiation.
Consider the outsource solution path if
you lack the in-house skills to build your
own solution, and packaged applications
dont meet your needs or require
significant customization to do so.
10