Getting Started With MDM
Getting Started With MDM
Intelligent
Business
Strategies
By Mike Ferguson
Intelligent Business Strategies
March 2008
Prepared for:
Getting Started With Master Data Management
Table of Contents
Introduction ...................................................................................................................................... 3
Conclusions.................................................................................................................................... 21
INTRODUCTION
All businesses, no matter what their size, rely on data to record and analyse
business activity. It is the lifeblood of any business operation. Data enters the
enterprise during specific process activities, either through the keyboard, via
electronic messages or via electronic files. It then flows throughout the
enterprise to support every process activity from registering new customers
Two broad categories
and sales order taking to supplier procurement, product fulfilment, product
of structured data
underpin business delivery, invoicing and payment collection. Yet, when you boil down the
operations - master complexity of business operations and look at data underpinning it in simple
data and transaction terms, there are two broad categories of structured data that any business
data relies on. These are:
• Master data
• Transaction data
Master data is data Master data is simply the data associated with core business entities such as
associated with core customer, employee, supplier, product, partner, asset, etc. This data can
business entities reside in many different systems. For example, customer data may reside in a
such as customer, sales force automation system, an e‐commerce system, a marketing system, a
product, asset, etc. billing system and a distribution system. Equally, product data may reside in
product development systems, manufacturing systems, planning systems and
storage systems. A trait of master data, therefore, is that subsets of it are
Master data is often needed in multiple systems to control continuity of business operations as
present in multiple
processes progress throughout the enterprise.
systems
Transaction data, on the other hand, is very simple and straight forward. This
is the recording of business transactions such as orders in manufacturing,
mortgage, loan and credit card payments in banking, and premium payments
and claims in insurance. In retail, transaction data is product sales, either at
point‐of‐sale terminals in stores or online. In aviation it is airline ticket sales.
Having understood the simple way in which master and transaction data
record business activity, this paper focuses on the former of these, namely
master data. More specifically, we will look at what it is, why it is needed, how
to get started in managing it, and methodologies for implementing master
data management. Master data management forms part of an overall
enterprise governance program that aims to establish trusted data throughout
the enterprise.
“Master data management (MDM) is a set of processes, policies,
services and technologies used to create, maintain and manage data
associated with a company’s core business entities as a system of
record (SOR) for the enterprise.”1
Multiple master data Core master data entities include customer, supplier, partner, employee,
entities are asset, etc. Therefore, MDM is about managing customer data, supplier data,
increasingly being employee data, asset data etc., making sure it is formally defined, high quality,
managed in an MDM integrated as a system of record, and that changes to it are synchronised
system across all systems using it. The trend here is towards multiple entity master
data management where a single MDM system can deal with the
management of multiple entities and not just one.
MDM systems should From this definition we can see that MDM is not just about data. It is about
manage data and putting processes and policies in place with respect to governing master data,
processes as well as putting services in place that provide common ways to access,
associated with that maintain and manage it. MDM is, therefore, about data and the processes
data associated with that data. This includes processes associated with business
use of master data as well as processes associated with management of it, e.g.
managing master data definitions (metadata), data modelling, master data
discovery and mapping, master data quality profiling, hierarchy management,
master data cleansing, master data integration, provisioning, and master data
synchronisation.
1
Definition taken from Intelligent Business Strategies master class on Enterprise Data
Governance and Master Data Management.
A number of Furthermore, when subsets of master data exist in multiple operational
business problems systems, it is not uncommon to see that data being independently maintained
can occur when by each of those systems. When this happens, it is obvious that multiple data
master data is not entry applications can cause problems that affect business operations,
managed centrally business performance and customer satisfaction. These problems include:
• Data conflicts
• Confusion when duplicate master data does not agree
• Process delays and process defects caused by data errors
• Inability to respond when changes to master data require prompt
business action
• Additional operational costs to solve problems caused by data
conflicts
In order to counter these problems companies have over the years put in
place various techniques to synchronise master data subsets across multiple
systems as and when this data changes. These synchronisation techniques
vary widely and include batch processing and file transfer, application
messaging (e.g. via messaging), emailing and re‐keying of data in attached
Excel spreadsheets etc. Over time, all these mechanisms between systems can
result in a ‘spaghetti architecture’ emerging much like that shown in Figure 1:
Point-to-point data
flow and data Master Data Synchronisation – The Spaghetti Architecture
management often
leads to a spaghetti
architecture
Figure 1
Also in this kind of set‐up, cross‐system verification to check if synchronisation
has been carried out correctly is often overlooked. This kind of complexity
sooner or later starts to raise a number of questions. For example:
• Where is the complete set of master data for customer or product or
asset?
• How do you get the master data you need when you need it?
• With so many definitions for master data in so many systems, what is
the meaning of these data items and are there several data items in
multiple systems that mean the same thing?
Master data that is • Can the data be trusted?
unmanaged can • How do you know if the data is complete and correct?
become erroneous • How do you get master data in the form that you need when pieces of
and untrustworthy it reside in multiple systems?
• If changes happen to master data in one system, how long is it before
these changes get to all other parts of the enterprise that need to
know about them?
• How do you know where this data goes and if it flows correctly?
• How do you control it?
And perhaps the most probing question of all is “How much does it cost the
business to operate this way?”
Spaghetti For many companies, the complexity of this kind of architecture is increasing
architectures drive faster than the business value coming from it. Spaghetti architectures, and no
up operational costs single system of record for master data, will slow any business down. It can
and can cause delays cause errors that incur additional operational costs to resolve, delays in
in business operations, delays in decision‐making and delays in overall business
operations responsiveness all of which can impact customer satisfaction.
Centralised
Master Data
supplier
Master data integration
Operational
customer Common
Systems
(disparate master data
data definitions asset definitions
for master (MDM‐SBV)
data) product
…….
Capture, Clean,
De‐duplicate
Integrate
Create central data stores for master data by capturing, cleaning and integrating subsets
of master data from disparate systems
Copyright ©Intelligent Business Strategies, 2008
Figure 2
Master data
managagement is However undertaking master data management in any business involves a lot
more than just more than data integration. Full MDM implementation involves:
integrating data to
store it centrally Defining master data using shared business vocabulary (MDM‐SBV ) of
common data names and definitions for use across the enterprise
Locating master data in all disparate systems and identifying
relationships across disparate master data
Mapping master data in disparate systems to common master data
definitions
Creating master data models and XML schemas using MDM‐SBV
definitions so that master data is consistently defined everywhere it is
used
Managing master data models and data integrity rules
Creating master data integration services to acquire, clean, match and
integrate (consolidate) master data to hold in a master data store (as
in Figure 2)
Creating event‐driven and on‐demand master data integration
services
Implementing an enterprise wide master data quality ‘firewall’ using
data quality services
Providing common services that maintain centralised master data to
other applications and processes
Supplying master data changes to all transactional and BI systems that
need it in order to ensure master data consistency and
synchronisation
Managing changes to master data and metadata, e.g. to reflect
product hierarchy changes, organisation unit changes and customer
detail changes, etc.
Managing change to applications and processes to move to a single
data entry system for master data
Changes to master All of this needs to be done using an integrated suite of data management
data need to be fed to tools that support the aforementioned tasks.
all operational and BI
systems that need to Once created, an MDM system should ultimately feed master data to
remain synchronised operational systems and data warehouses as shown in Figure 3.
with it
Master Data Changes Need To Be Synchronised Across
All Systems That Rely on That Master Data
Copyright ©Intelligent Business Strategies, 2008
Figure 3
• Building a business case
• Scoping the MDM project
• Assessing the current state of your master data
• Creating an MDM system architecture
• Building a project plan based on an iterative MDM implementation
methodology
• Consideration of MDM implementation options – Build vs. Buy
These are discussed in more detail below in the sub‐sections that follow.
• Define strategic objectives
• Define key performance indicators (KPIs) to help measure if the
business is on track to achieving its objectives
• Define KPI targets representing where the business wants to get to in
terms of performance
• Define initiatives to help achieve the stated objectives, budgets and
plans
• Describe KPI relationships so that you can distinguish between driver
and outcome metrics
MDM Business Case – How Does MDM Contribute To
Improving Business Performance Metrics
Opportunity Assessment
Customer MDM
Rev. Growth
% Costs of
Cash-To-Cash
Sales, General
Days
& Admin
Your
Company
Days AP (Days Days AR (Day
Purchasing Sales
Outstanding) Outstanding)
BIC
Days Inventory
%…
BIC = Best in Class
Figure 4
than necessary to solve problems caused by defects, thereby driving up costs.
If a company’s competition can do this quicker and at lower cost, then it may
well be the case that the client decides to do business there instead. Loss of
business caused by fractured customer data can be considerable in situations
like this.
There are many other examples that could be given here. When building an
MDM business case, having a detailed understanding of business strategy and
the business processes associated with specific master data is a distinct
advantage. For each identified critical KPI, a business case should define how
the benefits of sharing master data across business processes and applications
would maximise improvement in that KPI. Then, by ranking candidate
business cases, the best MDM return on investment (ROI) project can be
selected from the candidate list. This kind of approach imposes immediate
business focus on an MDM project and results in direct alignment with
business strategy and business priorities with tangible business benefits.
In many cases, the answers to these questions come out in favour of an MDM
project that could initially be restricted to one data entity such as customer or
product — or alternatively to multiple similar entities e.g., supplier, partner,
or employee. In this latter case, all of the similar entities used in this example
are people, businesses or both. Individuals could be employees or customers
or both while businesses can be customers, suppliers and partners. Therefore,
dealing with the problems that arise in managing data about people or
businesses can be universally applied to all similar entities.
While MDM is a key initiative aimed at bringing data associated with core
business entities under control, it should be part of a wider enterprise data
governance program that also includes:
If any standards, technologies or services have been deployed as part of a data
governance program it should be possible for an MDM project to exploit
these.
collaboration tools such as emails to/from customers. For most companies,
the scope of the data tends to remain restricted to structured data rather than
encompassing unstructured data as well. In that sense, many companies look
to strive towards both structured and unstructured.
Master Data Is Required In Many Kinds of Systems And Other Related
Information Can Be Associated With It – E.g. Insurance
E.G Customer Master Data Related Information
Under‐ Content/Document/
Claims ERP BI Collaboration
writing Records Managem’t
system system system tools
system System
Documents about a customer’s insured and declined risks
Customer quotations
Customer risk assessment reports
Customer claims assessment reports and images
Copyright ©Intelligent Business Strategies, 2008
Figure 5
When scoping an MDM project, restrictions can be applied to more than the
master data to be managed. Scope can also be applied to the functionality of
the MDM system. By functionality we refer to the capabilities of the MDM
system with respect to its management of data associated with specific
master data entities like customer, product, asset, etc.
The following table shows functionality options that could be provided,
starting with the least functionality and finishing with the most
comprehensive functionality.
Option MDM Functional Scope
1 Master data synchronisation
2 Option 1 + Master data integration + Master data vocabulary
3 Option 2 + A consolidated master data system of record (SOR)
4 Option 3 + Master data hierarchy management
5 Option 4 + Master data CRUD services
6 Option 5 + Single Master data entry system (MDES)
7 Option 6 + New master data business processes
Obviously, the cost and time to implement increases as you move towards
richer functionality options. Nevertheless, many organisations strive to at least
get to option 4.
Also, process overlap and duplication (if any) may also surface, bringing to
light inefficiencies as well as activities where master data defects can result.
All of this strengthens knowledge of business operation, highlights
opportunity to strengthen business cases, and provides a more thorough
assessment and understanding of the challenge ahead.
By the end of this exercise, the extent of the challenge that needs to be
undertaken should be well understood and a project plan can be built based
on a thorough understanding of what work needs to be done to bring the data
under control.
prod cust
Master data
Systems Master data
(disparate services
data Shared master D (standardise interactions
definitions data with master data)
for master
data) ESB
modern service oriented architecture (SOA) as services on an enterprise
service bus (ESB).
While this may not be exactly the architecture needed in the early phases of
MDM implementation, some kind of equivalent is needed.
Define
Control Explore
Data
Governance
Improve Analyse
Figure 7
Drilling into each step in this methodology, it can be seen from the table
below that each step is associated with one or more data governance
processes that need to be applied to each master data entity.
Note that the define and explore steps are not associated with automated
Complete data
governance run‐time processes, since people are needed to define enterprise master data
methodology applied using an enterprise SBV. People are also required in data modelling and need
to EACH master data to have some involvement in data exploration, data mapping and data
entity profiling.
Using this methodology, it is possible to create a set of executable data
Project plans should governance services directly associated with and dedicated to each defined
also allocate time
master data entity. For example, for product master data we would have:
and resources to
change management • Product data definition (SBV)
• Product data modelling (using SBV data definitions)
• Product data exploration and data mapping services (disparate
product data to product SBV‐defined key and attributes)
• Product data profiling and analysis services (on disparate product
data)
• Product data cleansing service (quality)
• Product data integration services
• Product data enrichment services
• Product data provisioning services
• Product data monitoring services
In addition to the implementation of MDM, plans also need to take into
account the impact of an MDM system on existing processes and systems. In
other words is there a ‘knock‐on’ impact that would trigger change
Moving to a single
management across other systems? If only a centralised master data system
master data system
of entry will cause of record is being implemented, then the implications for change are nowhere
significant change in near as severe as the implications of deploying a centralised master data
existing applications system of record that is also to be a master data single data entry system for
and processes specific master data entities. In this latter case, an MDM project that is also
intent on introducing only one central way to maintain master data will cause
considerable change across existing screens, processes, applications, data
stores and even business documents such as forms. In this case, project plans
have to include tasks and allocate time and resources to this additional change
management program once an MDM system is deployed.
It may be best to buy an MDM product when:
If master data is
• Master data is heavily fractured across many different systems
heavily fractured with
a large number of • Significant numbers of process defects and customer problems arising
data entry systems it from missing, inconsistent and erroneous master data
may be better to buy • Problems exist with multiple conflicting master data entry systems
an MDM solution
There are many other factors that will influence the choice to build or buy
including cost to build versus cost to buy and skills needed versus skills
available within the enterprise.
When buying an MDM solution, it is important to understand the business
problem(s) that an MDM solution needs to address, and that an MDM solution
is selected that matches what the business is trying to achieve.
• Data governance tools
• Master data quality
• Master data integration services
• A centralised master data store serving as a system of record
• Master data entry
• Master data services
• Master data synchronisation services
• Hierarchy management
• Role‐based security
• Workflow
• Version management
• Scalability
• Integration with other infrastructure technologies e.g. portals, ESB etc.
CONCLUSIONS
Understanding When undertaking a master data management project there is a lot to
existing processes consider. Mission critical success factors include having a deep understanding
associated with of existing processes and business problems caused by fractured master data
master data is key to in order to create solid business cases that will attract executive sponsorship.
success It is also important that MDM is part of a wider enterprise data governance
program and that there is an iterative methodology to support incremental
Data standards roll‐out of each core business entity under the management of an MDM
should be adopted in system.
an MDM system
Data standards also need to be supported with the adoption of a shared
Do not underestimate business vocabulary for master data attributes and standardisation on master
the potential change data quality, data integration and data synchronisation services. Finally,
management caused irrespective of whether an MDM solution is built or bought, the impact on
by the introduction of existing systems and processes, in terms of potential change management,
an MDM system should not be underestimated especially if the MDM system is to become a
single data entry system as well as a centralised system of record.