Foundations of Business Intelligence (BI) From Concept To Implementation
Foundations of Business Intelligence (BI) From Concept To Implementation
• How much is resilient and sustainable your organization in terms of data and staff?
Business Intelligence and Data Management Page: 2
Topics
• New Digital Age • Data Strategy • Data Management • Why BI?
• DX requirements • DM Culture basics • Common Myths on
• DMBOK Framework BI
• Data Literacy
• DAMA Wheel
• DM Governance • How BI works?
• DM technology
DX: Motives and Data-Driven A glance to
What is BI?
Enablers to BI Organization DMBOK2
to Digital Innovation
More resiliency
Greater agility
Increased responsiveness
Greater innovation
Increased revenue
By A.Morshedsolouk
Continued relevancy
Business Intelligence and Data Management Page: 7
What DX bring us?
Assets
• Physical assets
• Hub, modems, routers, BW, .. Inventory, staff, time, …
• Virtual assets
• Licenses, reputation, time, .. AND Data
• Work flow-> Data flow -> (data -> insight -> decide -> action) -> (improve) work flow (Cycle)
• Reducing cost through more efficient, data-driven processes – both administrative and
operational – such as overtime or inventory management
Business Intelligence and Data Management Page: 15
Why a data-driven organization?
• Increased quality
• Quality in this context is highly connected to accuracy in decision making, sustainability and reputation.
• More data-driven, and hence more qualified decisions, run all the way through your organization , ensuring:
• Increased trust
• Improved environment, health & safety (HSE) procedures
• Fewer decisions and reduced loss during production
• Increased product quality
• Increased customer satisfaction
• As for corporate reputation, having precise, actionable data available – and the
know-how to apply them – allows you to:
• Make better business decisions (~BI)
• more precisely communicate with target audiences, where market data are available, strengthening organization-
stakeholder relationship
• being at the bleeding-edge of what is often referred to as the fourth industrial
revolution
• Increases brand awareness
• augments market sentiment
• Attracts tech-savvy, aspiring young talent
• A data-driven organization manages data in such a way that it creates a single
By A.Morshedsolouk
1.Data Governance
• provides direction and oversight for data management by establishing a system of decision rights over
data that accounts for the needs of the enterprise.
2.Data Architecture
• defines the blueprint for managing data assets by aligning with organizational strategy to establish
strategic data requirements and designs to meet these requirements.
• includes the design, implementation, and support of stored data to maximize its value. Operations
provide support throughout the data lifecycle from planning for to disposal of data.
5.Data Security
By A.Morshedsolouk
• ensures that data privacy and confidentiality are maintained, that data is not breached, and that data
is accessed appropriately.
• includes processes related to the movement and consolidation of data within and between data
stores, applications, and organizations.
• includes planning, implementation, and control activities used to manage the lifecycle of data and
information found in a range of unstructured media, especially documents needed to support legal
and regulatory compliance requirements.
• includes ongoing reconciliation and maintenance of core critical shared data to enable consistent
use across systems of the most accurate, timely, and relevant version of truth about essential
business entities.
• includes the planning, implementation, and control processes to manage decision support data and
to enable knowledge workers to get value from data via analysis and reporting.
10.Metadata
• includes planning, implementation, and control activities to enable access to high quality,
integrated Metadata, including definitions, models, data flows, and other information critical to
understanding data and the systems through which it is created, maintained, and accessed.
By A.Morshedsolouk
11.Data Quality
• includes the planning and implementation of quality management techniques to measure, assess,
and improve the fitness of data for use within an organization.
Low quality data (inaccurate, incomplete, or out-of-date) obviously represents risk because its information is not right
Organizations get the most value from the highest quality data –
Information gaps – the difference between what we know and what we need to know to make an effective decision; and so profound impacts on
operational effectiveness and profitability.
It’s about educating regular business users about the information available to them and organizing this information
in a way that makes it easy to identify and consume.
When a data governance team acknowledges the importance of data literacy in an organization’s data governance
strategy, the result is a well-defined data catalog that any member of staff can access.
When they don’t, many users are left without access to important data impeding their ability to perform
professionally and contribute to the overall growth of a data-driven company.
Without widespread data literacy and clearly defined data terms and frameworks, communication channels can
break down—and the results can be catastrophic.
Before implementing a data literacy program your data team needs to ask these key questions:
• How do we find and determine which terms are necessary for our company?
• How do we achieve consensus on, define, and present these terms?
• How do we provide universal access when confidential user data is included in the data catalog?
Business Intelligence and Data Management Page: 26
Data Quality
By A.Morshedsolouk
• And
BI comprises the strategies and technologies used by enterprises for the data
analysis of business information.
BI is the process of turning raw data into actionable information that can
improve business decisions.
By A.Morshedsolouk
It is an umbrella term that stands for both processes and solutions — the
process of transforming data into actionable insights and the tools that access
and analyze data and present those findings in an accessible way.
develop stronger drive higher sales and gain a competitive It can monitor Transparency,
business strategies new revenues by Trend advantage over rival customer behavior and Efficiency, Profitability,
(Data-Driven Business) Awareness companies Improve CX Sustainability
Common functions of BI
• Reporting
• Online analytical processing
• Data mining
• Process mining
• Complex event processing
• Business performance management
• Benchmarking
• Text mining
• Descriptive analytics
• Predictive analytics
• Prescriptive analytics
By Business Intelligence,
By A.Morshedsolouk
Hindsight
•This second outcome of the Analytics & Business Intelligence umbrella provides the analysis needed to understand why
we have the current numbers we do –what were the factors, the environment, and decisions which impacted the outcome
of these numbers. It answers questions such as:
•Why are we performing this way?
•Which investments proved to be successful?
•What are we learning from the results of A/B testing?
•What customer factors affected the sales outcomes?
•Hindsight also determines and provides knowledge and understanding of the context.
Foresight
•The third outcome is about foresight. This showcases the true value of analytics, depending how you define it, because
through the exploration of historical and live data and application of different statistical, data mining, predictive, and
other analytics’ methods, it provides us with a better understanding of the future and the potential paths to follow. It
answers questions such as:
•How will the organization perform in the future?
•How can we gain a competitive advantage?
By A.Morshedsolouk
Traditional BI
• Traditionally, BI was designed for executives only. Since the number of users and
types of data is limited, there’s no need for full automation. So, a traditional BI flow
type requires technical staff as an intermediary between the reporting tool and the
end user.
• If an end user wants to extract some data, he or she has to make a request and tech
staff will generate a report from the required data. In this case, your IT department
acts as a power user, a user that can access data and influence its transformation.
• The traditional approach offers a more secure and controlled data flow. But, relying
By A.Morshedsolouk
• relies on real-time and historical data. In essence, it tells organizations what’s happening and how
Business
intelligence
things got to this point
• focuses on predicting what is going to happen in an organization in the future based on past
Business
analytics
trends and offering suggestions for things that could be done differently for improved outcomes
• What is Business Analysis? Answer: BA -> BABOK; BI -> DMBOK; DA -> DSBOK
By A.Morshedsolouk
Question:
Interactive dashboards, Modeling, Query, metrics, KPIs definitions, Languages (DAX, R, Python, …)
Alerts and notifications (set thresholds for high or low numbers)/can be outside of BI tools
Embedded Analytics (visualization in the company web page, cloud app, or for customer access, …)
BI reporting tools
Predictive analytics
•forecast future events based on current and historical data. By drawing connections between data sets, these software applications predict the likelihood of future events, which can lead to a huge competitive advantage
for businesses.
Descriptive modeling
•seeks to reduce data into manageable sizes and groupings. Descriptive analytics works well for summarizing information such as unique page views or social media mentions.
Decision analytics
•Take into account all the factors related to a discrete decision. Decision analytics predict the cascading effect an action will have across all the variables involved in making that decision.
•Data comes in three main forms: structured, semi-structured, and unstructured. Unstructured data is the most common, and includes text documents and other types of files that exist in formats that computers can’t
read easily.
•also known as text analytics software, combs large sets of unstructured data to find hidden patterns.
• Design, host, and administer secure, modern, and low-code business websites.
• You can leverage the Power BI Chart, Graphs, KPIs, Reports, and Dashboards to
analyze the data and get interactive insights.
Business Intelligence and Data Management Page: 46
Power BI Components
By A.Morshedsolouk
AI Support
• Power BI allows users to deploy Artificial Intelligence (AI) techniques such as Image Recognition and Text Analytics to prepare
data, develop Machine Learning models, and quickly extract actionable insights from structured and unstructured data.
Report Sharing
• Power BI is built for developing security that allows teams to share access in a very controlled manner. Users can easily share
their reports with other team members without compromising data security.
Real-Time Dashboards
• Power BI has the capability to display real-time data and visuals in any report or dashboard. Power BI dashboards update in
real-time allowing users to instantly solve issues and uncover opportunities.
Customized Visualization
• Power BI offers high customizability and allows users to leverage its custom visualization library to create visualizations as per
their needs.
By A.Morshedsolouk
• In addition to that, analysts can also generate highly customizable visuals for their next Power BI report by using open-source
data-viz modules from R and Python
Business Intelligence and Data Management Page: 51
Power BI languages
• Query language
M-Language • Used by Power Query
• ETL functions
• Data Analysis Expressions
• A general calculation language to create columns and
DAX language measures
• Rich functions
• The statistical language R support Using R for
R language preparing data models, reports, data cleansing,
advanced data shaping, dataset analytics, etc.
Python language
• Data analysts can use BI tools to save time and make their jobs easier. And, as we’ve seen, BI tools can also provide insights that data
analysts might miss on their own.
• So even if you have a data analyst on staff, it’s still worth considering whether a BI tool could be beneficial for your business.
Business Intelligence and Data Management Page: 67
7 common myths about BI tools
Myth 4: “I don’t need a BI tool, I can just use Excel.”
• Another common myth about BI tools is that they’re not necessary if you’re already using Excel.
• While it’s true that Excel can be used for some basic data analysis, it’s not designed for complex tasks like data visualization or reporting.
• BI tools are much better suited for these tasks, and they can save you a lot of time.
• So even if you’re already using Excel, you don’t necessarily have to completely reject the idea of using a BI tool.
• In fact, you might find that using both Excel and a BI tool can be beneficial for your business.
• BI tools have been around for many years, and they’re only getting more popular.
• In fact, Gartner predicts that BI and analytics will be one of the most important trends in business in the coming years.
Business Intelligence and Data Management Page: 68
Why BI is better than Excel?
Huge Capacity
Collaboration,
Automated
Distribution,
Reporting
and Publishing
By A.Morshedsolouk
Mobility Visualizations
• Can I use MS BI personally in company? • What other costs we incur for BI implementation?
• Yes. If your IT policy allows. • BI server and SQL server and access and security and .. administration costs
(usual IT costs)
• Does BI kill creativity? • For migrating data into database you need a SQL developer (extra
• Mainly No, Maybe Yes! ~20MT/M) for possibly around 6 Months
• Can BI data be wrong and misguiding? • How much is hard to learn MS-BI compared to excel?
• Yes, Ask your Operator, (GIGO) • For simple reports it is easy, for advanced reports a BI developer is needed
for DAX programming.
• Am I dependent to BI developer forever? • For enterprise deploy an IT/IS/SQL expert is needed.
• The same like Aryan, Hamkaran, MS Office & CRM tools and your IT team, • Collaboration of all managers is needed for data governance.
• Excel also is not easy to master for advanced features
• How long it takes I design and implement MS BI?
By A.Morshedsolouk
• Depends on your current DATA readiness, no. of reports needed and scope
of work and KPI complexities and your budget
• Is it possible my BI project fails?
data-refresh rate
• Can I use Enterprise BI from outside and on public IP address rather
private ones?