Introduction to data

management
MANAJEMEN DATA
MAGISTER TEKNOLOGI INFORMASI
 Objectives

o Informing about the nature and importance

of data management.
o To provide an overview of a structured
approach to developing and implementing a
detailed data management policy including
frameworks, standards, project, team and
maturity

INTRODUCTION TO DATA MANAGEMENT 2

 Information
o Information in all its forms –
Applications input, processed, outputs – is a
core component of any IT
system
o Applications exist to process
data supplied by users and
other applications
Processes Information
o Data breathes life into
applications
IT Systems o Data is stored and managed by
infrastructure – hardware and
software
o Data is a key organization asset
with a substantial value
o Significant responsibilities are
People Infrastructure imposed on organizations in
managing data

INTRODUCTION TO DATA MANAGEMENT 3

 Data, Information, & Knowledge

• Data is the representation of facts as text, numbers,

graphics, images, sound or video
• Data is the raw material used to create information
• Facts are captured, stored, and expressed as data
• Information is data in context
• Without context, data is meaningless – we create
meaningful information by interpreting the context
around data
• Knowledge is information in perspective, integrated into a
viewpoint based on the recognition and interpretation of
patterns, such as trends, formed with other information
and experience
• Knowledge is about understanding the significance of
information
• Knowledge enables effective action

INTRODUCTION TO DATA MANAGEMENT 4

 2. The format in which the data is presented.

3. The timeframe represented by the data.

Data, information, and knowledge

4. The relevance of the data to a given usage.

Data is the raw material we interpret as data consumers to continually create

information, as shown in Figure 1.1. The resulting information then guides our
decisions.

Figure 1.1 Data, Information, and Knowledge

The official or widely accepted meanings of commonly used terms also represent a
valuable enterprise resource, contributing to a shared understanding of meaningful
INTRODUCTION TO DATA MANAGEMENT 5
 Information is an organization asset

o Tangible organization assets are seen as

having a value and are managed and
controlled using inventory and asset
management systems and procedures
o Data, because it is less tangible, is less widely
perceived as a real asset, assigned a real value
and managed as if it had a value
o High quality, accurate and available
information is a pre- requisite to effective
operation of any organisation

INTRODUCTION TO DATA MANAGEMENT 6

 Data management and project success

o Data is fundamental to the effective and efficient

operation of any solution
◦ Right data
◦ Right time
◦ Right tools and facilities
o SMART – specific, measurable, achievable (or
actionable), realistic, and timely, with a specified
target timeframe
o Without data the solution has no purpose
o Data is too often overlooked in projects
o Project managers frequently do not appreciate
the complexity of data issues

INTRODUCTION TO DATA MANAGEMENT 7

 Generalized information management
lifecycle

Enter, Create,
Acquire, Derive, Generalised lifecycle
•
Update, Capture that differs for
Store, Manage, Ma
Ad nag
specific information
Replicate and mi etypes
Distribute nis , Co
ter ntr
ol
an
d
Protect and Recover

• Design, define and

implement framework to Archive and Recall
manage information
through this lifecycle
Delete/Remove

INTRODUCTION TO DATA MANAGEMENT 8

 Expanded Generalized management
Information lifecycle
Plan, Design and
Specify

De
Implement sig
Underlying n,
Im
Infrastructure ple
me
nt,
Enter, Create, Ma
Acquire, Derive, na
ge
Update, Capture ,C
on
tro
Store, Manage, l an
Replicate and dA
Distribute
dm
ini
ste
r
• Include phases for information
Protect and Recover
management lifecycle design
and implementation of
appropriate hardware and Archive and Recall

software to actualise lifecycle

Delete/Remove
INTRODUCTION TO DATA MANAGEMENT 9
 Data and information management

o Data and information management is a

business process consisting of the planning
and execution of policies, practices, and
projects that acquire, control, protect, deliver,
and enhance the value of data and
information assets

INTRODUCTION TO DATA MANAGEMENT 10

Data and Information Management

To manage and utilise information as a strategic asset

To implement processes, policies, infrastructure and solutions to

govern, protect, maintain and use information

To make relevant and correct information available in all business

processes and IT systems for the right people in the right context at
the right time with the appropriate security and with the right quality

To exploit information in business decisions, processes and

relations

INTRODUCTION TO DATA MANAGEMENT 11

 Data Management Goals

o Primary goals
◦ To understand the information needs of the enterprise
and all its stakeholders
◦ To capture, store, protect, and ensure the integrity of data
assets
◦ To continually improve the quality of data and
information, including accuracy, integrity, integration,
relevance and usefulness of data
◦ To ensure privacy and confidentiality, and to prevent
unauthorized inappropriate use of data and information
◦ To maximize the effective use and value of data and
information assets

INTRODUCTION TO DATA MANAGEMENT 12

 Data Management Goals

o Secondary goals
◦ To control the cost of data management
◦ To promote a wider and deeper understanding of the
value of data assets
◦ To manage information consistently across the
enterprise
◦ To align data management efforts and technology
with business needs

INTRODUCTION TO DATA MANAGEMENT 13

 Data Management Principles

o Data and information are valuable enterprise

assets
o Manage data and information carefully, like any
other asset, by ensuring adequate quality,
security, integrity, protection, availability,
understanding and effective use
o Share responsibility for data management
between business data owners and IT data
management professionals
o Data management is a business function and a set
of related disciplines
INTRODUCTION TO DATA MANAGEMENT 14
 Organization Data Management
Function

o Business function of planning for, controlling

and delivering data and information assets
o Development, execution, and supervision of
plans, policies, programs, projects, processes,
practices and procedures that control, protect,
deliver, and enhance the value of data and
information assets

INTRODUCTION TO DATA MANAGEMENT 15

 Scope of complete Data Management
Function
Data Management
Functions

Data Governance Data Architecture

Data Modeling & Design Data Storage & Operations

Data Security Data Integration & Interoperability

Data Quality Reference and Master Data

Data Warehousing and Business

Document and Content Management
Intelligence

Metadata Management

INTRODUCTION TO DATA MANAGEMENT 16

 Shared Role between business and IT

o Data management is a shared responsibility

between data management professionals within
IT and the business data owners representing the
interests of data producers and information
consumers
o Business data ownership is the concerned with
accountability for business responsibilities in
data management
o Business data owners are data subject matter
experts
o Represent the data interests of the business and
take responsibility for the quality and use of data
INTRODUCTION TO DATA MANAGEMENT 17
 Why develop and implement a data
management framework

o Improve organization data management efficiency

o Deliver better service to business
o Improve cost-effectiveness of data management
o Match the requirements of the business to the
management of the data
o Embed handling of compliance and regulatory rules into
data management framework
o Achieve consistency in data management across systems
and applications
o Enable growth and change more easily
o Reduce data management and administration effort and
cost
o Assist in the selection and implementation of appropriate
data management solutions
o Implement a technology-independent data architecture

INTRODUCTION TO DATA MANAGEMENT 18

 Data Management Issues

o Discovery - cannot find the right information

o Integration - cannot manipulate and combine
information
o Insight - cannot extract value and knowledge
from information
o Dissemination - cannot consume information
o Management – cannot manage and control
information volumes and growth

INTRODUCTION TO DATA MANAGEMENT 19

 Information Management challenges

o Explosive Data Growth

◦ Value and volume of data is overwhelming
◦ More data is see as critical
◦ Annual rate of 50+% percent
o Compliance Requirements
◦ Compliance with stringent regulatory requirements and
audit procedures
o Fragmented Storage Environment
◦ Lack of enterprise-wide hardware and software data storage
strategy and discipline
o Budgets
◦ Frozen or being cut

INTRODUCTION TO DATA MANAGEMENT 20

 Data Management-Frameworks

• TOGAF (and other enterprise architecture standards) define a

process for arriving an at enterprise architecture definition, including
data
• TOGAF has a phase relating to data architecture
• TOGAF deals with high level
• DMBOK translates high level into specific details
• COBIT is concerned with IT governance and controls:
− IT must implement internal controls around how it operates
− The systems IT delivers to the business and the underlying business processes
these systems actualise must be controlled – these are controls external to IT
− To govern IT effectively, COBIT defines the activities and risks within IT that
need to be managed
• COBIT has a process relating to data management
• Neither TOGAF nor COBIT are concerned with detailed data
management design and implementation

INTRODUCTION TO DATA MANAGEMENT 21

 DMBOK, TOGAF and COBIT
Can be a DMBOK Is a Specific and
Precursor to Comprehensive Data
Implementing Oriented Framework
Data
Management DMBOK Provides Detailed
for Definition,
Implementation and
TOGAF Defines the Process Operation of Data
for Creating a Data Management and Utilisation
Architecture as Part of an
Overall Enterprise
Architecture
Can Provide a Maturity
Model for Assessing
Data Management

COBIT Provides Data

Governance as Part of
Overall IT Governance

INTRODUCTION TO DATA MANAGEMENT 22

DMBOK, TOGAF and COBIT –
Scope and Overlap
Data Modeling & Design
DMBOK
Data Storage & Operations
Reference and Master Data
Data Warehousing and Business Intelligence
TOGAF Document and Content Management
Metadata
Data Quality

Data Architecture
Data Integration & Interoperability

Data
Governance
Data Security COBIT

INTRODUCTION TO DATA MANAGEMENT 23

 Data Management book of knowledge
(dmbok)

o DMBOK is a generalization and comprehensive

framework for managing data across the entire
lifecycle
o Developed by DAMA (Data Management
Association)
o DMBOK provides a detailed framework to assist
development and implementation of data
management processes and procedures and
ensures all requirements are addressed
o Enables effective and appropriate data
management across the organization
o Provides awareness and visibility of data
management issues and requirements

INTRODUCTION TO DATA MANAGEMENT 24

 Data Management body of knowledge
(DMBOK)

o Not a solution to your data management

needs
o Framework and methodology for developing
and implementing an appropriate solution
o Generalized framework to be customized to
meet specific needs
o Provide a work breakdown structure for a
data management project to allow the effort
to be assessed
o No magic bullet
INTRODUCTION TO DATA MANAGEMENT 25
Scope and Structure of Data Management Book of
Knowledge (DMBOK)

Data Management Environmental

Factors

Data Management
Knowledge Areas

INTRODUCTION TO DATA MANAGEMENT

26
 DMBOK Data Management
Knowledge Areas
Data Management
Knowledge Areas

Data Governance Data Architecture

Data Modeling & Design Data Storage & Operations

Data Security Data Integration & Interoperability

Data Quality Reference and Master Data

Data Warehousing and Business

Document and Content Management
Intelligence

Metadata

INTRODUCTION TO DATA MANAGEMENT 27

DMBOK Data Management Knowledge
Areas – DAMA Wheel

INTRODUCTION TO DATA MANAGEMENT 28

 DMBOK Management Knowledge Areas

o Data Governance - planning, supervision and control over data management and use
o Data Architecture - defining the blueprint for managing data assets
o Data Modeling & Design - discovering, analysing, representing, and communicating
data requirements in a precise form called the data model
o Data Storage & Operations - design, implementation, and support of stored data
o Data Security - Ensuring privacy, confidentiality and appropriate access
o Data Integration and Interoperability - processes related to the movement and
consolidation of data within and between data stores, applications, and organization
o Data Quality - planning and implementation of quality management techniques to
measure, assess, and improve the fitness of data for use within an organization
o Reference and Master Data - managing master versions and replicas
o Data Warehousing and Business Intelligence Management - enabling reporting and
analysis
o Document and Content Management - managing data found outside of databases
o Metadata Management - integrating, controlling and providing metadata

INTRODUCTION TO DATA MANAGEMENT

29
 Core Knowledge Areas Key Points
q DataGovernance
Ø Data Governance and Stewardship * New to DMBOK2
Ø Business Cultural Development *
Ø Data in the Cloud*
Ø Data Handling Ethics *
q DataArchitecture
Ø Establish Enterprise DataArchitecture
Ø Design and Implement Data Architecture
§ Different architecture for different solutionspaces *
q Data Modeling & Design
Ø Build, review and manage data model
Ø Overview of models for different formats – E/R, UML, fact-based, object-role, fullcommunication oriented, data vault,
anchor, nosql*.
q Data Storage & Operations
Ø Database Support
Ø Data Technology Management *
Ø Types of databases and File systems (expanded) *
Ø Configuration Management *
Ø Virtualization (cloud) *
Ø Manage availability of data throughout the data lifecycle
Ø Ensure the integrity and compliance of dataassets
Ø Manage performance of datatransactions
Ø Protect data assets and data integrity

INTRODUCTION TO DATA MANAGEMENT 30

 Core Knowledge Areas Key Points
q DataSecurity
Ø Define and Develop Appropriate Data Security Classifications. * New to DMBOK2
Ø Define and Develop Categories of Data Regulatory Requirements
Ø Manage and Maintain Data Security
Ø Manage Data Regulations
Ø Assess Database Vulnerabilities*
§ Ethical hacking
Ø Define Data Sensitivity in Meta-data *
q Data Integration & Interoperability (DII)*
Ø Data Integration *
Ø Operational Intelligence Support *
q Documents & Content
Ø Develop Records and Content Management Strategies*
Ø Understand Records and Content Requirements
Ø Determine Information Architecture, Content and Semantic Models, Content Organization*
Ø Develop E-Discovery *
Ø Capture and Manage Records and Content
Ø Capture, Manage, Retain, Publish and Deliver, Dispose and Archive Records and Content
Ø Information Governance *

INTRODUCTION TO DATA MANAGEMENT 31

 Core Knowledge Areas Key Points
q Reference & MasterData
Ø Identify Business Reference and Master Data Needs * New to DMBOK2
Ø Determine Data Requirements
Ø Assemble and Reconcile Data Definitions
Ø Identify and Analyze Data Sources
Ø Establish Data Sharing/Integration Architecture *
Ø Identify Trusted Reference and Master Data
Ø Develop/Implement Data Sharing/Integration Services*
Ø Use Reference and Master Data
q Data Warehousing & BusinessIntelligence
Ø Understand Functional and Non-Functional Requirements
Ø Define and Maintain the DW-BIArchitecture
Ø Conceptual Data Warehousing/ Big Data/ BI/ Integration Architecture*
Ø Implement Data Warehouses and Data Marts
§ Real time and near real time*
Ø Populate the DataWarehouse
Ø Implement Business Intelligence Portfolio *
Ø Maintain Data Products
Ø Use Open Data*
Ø Define DW/BI Production Support Processes

INTRODUCTION TO DATA MANAGEMENT 32

 Core Knowledge Areas Key Points
o Meta-data
Ø Meta-data Strategy
* New to DMBOK2
Ø Understand Meta-data Requirements
Ø Define the Meta-data Architecture
Ø Create Meta-Model *
Ø Apply Meta-data Standards
Ø Manage Meta-data Stores
Ø Create and Maintain, Integrate, Distribute, Deliver Meta-data
Ø Query, Report and Analyze Meta-data
q Data Quality
Ø Data Importance Ranking*
Ø Create a Data Quality Framework
Ø Perform Preliminary Data Quality Assessment
Ø Define Data Quality Requirements
Ø Assess Data Quality
Ø Develop and Deploy Data Quality Operations
Ø Perform Measurement and Monitoring of Data Quality

INTRODUCTION TO DATA MANAGEMENT 33

 DMBOK Data Management Knowledge
Areas – Alternative to DAMA Wheel

DAMA Functional Area Dependencies

INTRODUCTION TO DATA MANAGEMENT 34

DMBOK Data Management Environmental
Factors Hexagon

INTRODUCTION TO DATA MANAGEMENT 35

 DMBOK Data Management
Environmental Factors

o Goals and Principles - directional business goals of each function and the fundamental
principles that guide performance of each function
o Activities - each function is composed of lower level activities, sub-activities, tasks and
steps
o Deliverables - information and physical databases and documents created as interim and
final outputs of each function. Some deliverables are essential, some are generally
recommended, and others are optional depending on circumstances
o Roles and Responsibilities - business and IT roles involved in performing and supervising
the function, and the specific responsibilities of each role in that function. Many roles will
participate in multiple functions
o Techniques - common and popular methods and procedures used to perform the
processes and produce the deliverables and may also include common conventions, best
practice recommendations, and alternative approaches without elaboration
o Tools - software package types to support activities
o Organisation and Culture – this can include issues such as management metrics, critical
success factors, reporting structures, budgeting, resource allocation issues, expectations
and attitudes, style, cultural, approach to change management

INTRODUCTION TO DATA MANAGEMENT 36

 DMBOK Data Management
Environmental Factors
Goals and Activities Deliverables Roles and Techniques Tools Organisation
Principles Responsibilities and Culture
Data
Governance
Data
Architecture
Data
Modeling & Design
Data
Storage & Operations Scope of Each Data Management Knowledge Areas
Data Security
Data Integration &
Interoperability
Reference and
Master Data
Data
Warehousing and
Business Intelligence
Document and
Content Management
Metadata

Data Quality

INTRODUCTION TO DATA MANAGEMENT 37

DMBOK Knowledge Area Context
Diagram

INTRODUCTION TO DATA MANAGEMENT 38

 Scope of data management body of knowledge (dmbok) data
management framework
o There are 11 knowledge areas and 55 activities (102 activities in DMBOK 1)
o There are more than 17 activities within a knowledge areas (data
governance)
o Hierarchy
◦ Knowledge Areas
◦ Activity
◦ Sub-Activity (not in all cases)
o Each activity is classified as one (or more) of:
◦ Planning Activities (P)
◦ Activities that set the strategic and tactical course for other data management activities
◦ May be performed on a recurring basis
◦ Development Activities (D)
◦ Activities undertaken within implementation projects and recognised as part of the systems
development lifecycle (SDLC), creating data deliverables through analysis, design, building,
testing, preparation, and deployment
◦ Control Activities (C)
◦ Supervisory activities performed on an on-going basis
◦ Operational Activities (O)
◦ Service and support activities performed on an on- going basis

INTRODUCTION TO DATA MANAGEMENT 39

 DMBOK Knowledge Areas and Activity
Services
Data Management
( ) number of activities
Knowledge Areas

Data Governance (17) Data Architecture (2)

Data Modeling & Design (4) Data Storage & Operations (2)

Data Security (3) Data Integration & Interoperability (4)

Data Quality (7) Reference and Master Data (2)

Data Warehousing and Business

Document and Content Management (3)
Intelligence (6)

Metadata Management (5)

INTRODUCTION TO DATA MANAGEMENT 40

DMBOK Knowledge Areas and
Activity

INTRODUCTION TO DATA MANAGEMENT 41

 Reference

o Structured and Comprehensive Approach

Data to Management and Data Management
Body of Knowledge (DMBOK). Alan
McSweeney. August 20, 2016.
o The DAMA Guide to The Data Management
Body of Knowledge (DAMA-DMBOK
Guide). 1st Edition and 2nd Edition. Mark
Mosley, Michael Brackett, and Susan Earley.
Dama International. USA. 2009
o DAMA-DMBOK Functional Framework.
Mark Mosley. September 10, 2008

INTRODUCTION TO DATA MANAGEMENT 42