0% found this document useful (0 votes)
64 views75 pages

Foundations of Business Intelligence (BI) From Concept To Implementation

An detailed Introduction to Business Intelligence and Data Management concepts Guides you through all concepts and standards (DMBOK) and tools for understanding BI and implementing it in your organization A free .ppt to download
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
64 views75 pages

Foundations of Business Intelligence (BI) From Concept To Implementation

An detailed Introduction to Business Intelligence and Data Management concepts Guides you through all concepts and standards (DMBOK) and tools for understanding BI and implementing it in your organization A free .ppt to download
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 75

Basics of

Business Intelligence (BI)


and Data Management
(Part1)
By Ali Morshedsolouk
Oct 2022
This is Summary version – You Can Free download the Full version at:
https://www.slideshare.net/amorshed/amkbidmv10publishpdf
By A.Morshedsolouk

Business Intelligence and Data Management Page: 1


Our Pain Points
• Vosoole Motalebat (Fund Collection) Issues
• Inventory Issues, Asset Values, Asset Selling, Asset Purchasing Criteria, Asset Status,…
• Customer Feedbacks…
• Customers asking for innovations, Customers asking for online reports
• Regulatory Asking for CRM access
• Reporting is Ad-hoc (Salary, Costs, Bank accounts, ..)
• How much is Efficiency of Sat BW usage
• How much is the costs of each customer, How much is its value?
• e.g. Dabirkhane..what if this guy left us? Staff dependency?
• Knowledge base? How do you store your know-how?
• How do you measure your team/staff performance?
• Do your staff misguide and mislead you on their data?
By A.Morshedsolouk

• How much is resilient and sustainable your organization in terms of data and staff?
Business Intelligence and Data Management Page: 2
Topics
• New Digital Age • Data Strategy • Data Management • Why BI?
• DX requirements • DM Culture basics • Common Myths on
• DMBOK Framework BI
• Data Literacy
• DAMA Wheel
• DM Governance • How BI works?
• DM technology
DX: Motives and Data-Driven A glance to
What is BI?
Enablers to BI Organization DMBOK2

• BI Tools features • Steps to • Plans • Summary


• Market leaders implement BI • Challenges • Any Question?
• MS Power BI • Outcomes
• Demo
By A.Morshedsolouk

An overview to BI ICASAT BI case


Q&A
BI Tools Implementation study

Business Intelligence and Data Management Page: 3


DX: Enabler for BI
By A.Morshedsolouk

Business Intelligence and Data Management Page: 4


What is DX (Digital Transformation)?
We are at the age of DX (Next Digital Universe); Digital Game Players:
•Cloud solutions: DC-> IaaS/PaaS/SaaS/(Desktop-> Enterprise (private cloud)-> Edge ->
Public Cloud)/Hybrid/Multi-Cloud/
• ST Engineering: Idirect + NewTech & Comtec + UHP Romantis  New VSAT Hub is cloud-
based!/Multi-Orbit (GEO/MEO/LEO)
•Connectivity: 5G/6G/Mobile standards/WiFi6/WiFi6E/WiFi7/LoRaWAN
•Block chain: DeFi/Crypto/NFT/(VARA in Dubai, Virtual Assets Regulatory Authority)
•AI/ML/DL/Intuitive AI/Conversational AI/NLP/Vision/Robots/Robotics/AIoT
•Data Science/Big Data/Data Analytics/MIDS degree
•AR/VR (augmented reality/virtual reality)
Digital transformation
•X-verse: Metaverse/Gaming/Web 3/UAE vision: top 10 cities in Metaverse economy/attract
is the incorporation of 5000 metaverse companies in 5Y (Healthcare, manufacturing, education, retail, future of
new computer-based work, gaming)
technologies into an •Remote Working/WFH/Emirates: 42000 virtual Jobs by 2030 for $4Billion
organization's •New IT/IS management best practices: Agile/DevOps/DevSec/CI-CD/DataOps/MLOps/New
products, processes Job functions/Kubernetes/100,000 Golden Visa by UAE for top coders!/
and strategies. •Low-code, No-code/focus on customer and employee experiences
•SDN (software defined networks)/A case on VSAT last year in CABSAT/SDSN: SpaceBridge
•Adopting API framework (delivering data securely)
•IoT/IIoT/AIoT/Smart Home/Smart City/Industry 4.0/Digital Twins/Drones/UAV/
•Digital economy/Digital smart cities/Autonomous vehicles/Future Mobility(flying
taxis)/Health Care/Fintec/Energy/Education/Data economy/CX
•BI/RPA/cybersecurity/edge computing

• The Demand is Changing


By A.Morshedsolouk

to Digital Innovation

Business Intelligence and Data Management Page: 5


Cloud Service Model
By A.Morshedsolouk

Business Intelligence and Data Management Page: 6


Benefits of DX
Increased efficiency and productivity

Better resource management

More resiliency

Greater agility

Improved customer engagement

Increased responsiveness

Greater innovation

Faster time to market

Increased revenue
By A.Morshedsolouk

Continued relevancy
Business Intelligence and Data Management Page: 7
What DX bring us?

Should decide on any So big impact:


changes needed in the DX is a key driver guiding
organization broad Data Strategy and
•New business opportunities Data Management goals
Customers are asking •New Strategies Digital Age and DX and activities
Should sync with this Should not lag the •Digital Culture relies totally on
and chasing DX Shall think “Data-driven”
global fast track journey competitors •Improved Processes
innovations “DATA” on all these levels
•Digital-literate peoples and
hires •Should Setup a
•Considering New Data-Driven Organization
technologies
•Planning New IT/IS solutions
By A.Morshedsolouk

Business Intelligence and Data Management Page: 8


DX Journey
By A.Morshedsolouk

Business Intelligence and Data Management Page: 9


Data-Driven
Organization
“Without Data you’re jut another person with an opinion”
W. Edwards Deming, Data Scientist
By A.Morshedsolouk

Business Intelligence and Data Management Page: 10


Data-Driven companies
What does a manager do?
• Controlling and exploiting the best out of its assets

Assets
• Physical assets
• Hub, modems, routers, BW, .. Inventory, staff, time, …
• Virtual assets
• Licenses, reputation, time, .. AND Data

Work flows ->generates Data flows

Data Hierarchy (data/information/knowledge->Wisdom)


• Informed decisions via High quality data

Poor or low quality data


• Inhibits integration
• misguides analyze
• Failure to decide
• Blockage to action

So What does a manager do?


• Deciding (by deriving value from data) and Acting
By A.Morshedsolouk

• Work flow-> Data flow -> (data -> insight -> decide -> action) -> (improve) work flow (Cycle)

There is a strong need to do Data Management (BI is part of DM)

Business Intelligence and Data Management Page: 11


Decision Making Levels
By A.Morshedsolouk

Business Intelligence and Data Management Page: 12


Data-Driven companies
At which DATA (Management) level our organization resides?
• Data Strategy?
• Data Culture?
• Data Governance?
• Authority, control, decision-making on managing data assets
• Data governance is the process of organizing, securing, managing, and presenting data using methods and technologies that ensure it remains correct, consistent, and accessible to
verified users
• Data Architecture
• A pillar of digital transformation, connects business strategy and technical execution
• Data Modeling
• Documenting the core business rules and relations around data
• Data technology? Data warehouse?
• Data quality?
• Data quality is the degree to which data is accurate, complete, timely, and consistent with your business’s requirements
• Data literacy?
• Data literacy ensures all data users within an organization are educated to a level that enables them to consume data with confidence within a specific business context
• Data Security? Privacy?
• Data Access? (visibility)

Data Usage? Do we Derive value? (informed Decisions or Daily operations?)


By A.Morshedsolouk

What is our “Data Maturity level” in organization/enterprise?


Business Intelligence and Data Management Page: 13
Data Maturity Model
By A.Morshedsolouk

Business Intelligence and Data Management Page: 14


Why a data-driven organization?
• Gaining a competitive edge through better decision-making and increased efficiency
• increase revenue and reduce costs
• a data-driven organization can trust that it always makes informed decisions upon a foundation that is always reliable and up to date.
• Reducing cost through more efficient, data-driven processes – both administrative and operational – such as overtime or
inventory management
• As such, you remove whim and guesswork from the equation, while simultaneously negating the
garbage-in-garbage-out problem
• Bolstering the quality of products, reputation and organizational processes
• Decision support for operational systems and processes
• which can range from sales, production and marketing, to maintenance, logistics, service delivery, HR and other industry specific needs
• More nimbly (agilely and smartly) adjust to market changes
• Paves the way for being more innovative, proactive and agile
• letting the data reveal new business opportunities for which to adapt
• On top of this, the organization frees up human capital that can be allocated towards efforts
of creating additional value
• Empower your employees, equipping them with the tools to increase their autonomy and
strengthen their decision-making foundation
• a leaner, more efficient organization – and reduced dependency on external assistance
By A.Morshedsolouk

• Reducing cost through more efficient, data-driven processes – both administrative and
operational – such as overtime or inventory management
Business Intelligence and Data Management Page: 15
Why a data-driven organization?
• Increased quality
• Quality in this context is highly connected to accuracy in decision making, sustainability and reputation.
• More data-driven, and hence more qualified decisions, run all the way through your organization , ensuring:
• Increased trust
• Improved environment, health & safety (HSE) procedures
• Fewer decisions and reduced loss during production
• Increased product quality
• Increased customer satisfaction
• As for corporate reputation, having precise, actionable data available – and the
know-how to apply them – allows you to:
• Make better business decisions (~BI)
• more precisely communicate with target audiences, where market data are available, strengthening organization-
stakeholder relationship
• being at the bleeding-edge of what is often referred to as the fourth industrial
revolution
• Increases brand awareness
• augments market sentiment
• Attracts tech-savvy, aspiring young talent
• A data-driven organization manages data in such a way that it creates a single
By A.Morshedsolouk

version of the truth


• This means and requires that the data is both relevant, reliable and available
Business Intelligence and Data Management Page: 16
Data-Driven Organization
By A.Morshedsolouk

Business Intelligence and Data Management Page: 17


Data Strategy
Building a data-driven organization must be rooted in your
organization’s business strategy How to gain support for your data strategy
Both clear budgetary allocations and leadership involvement on
Data Strategy and Data Culture • Transparency: share data across the business
It is crucial at this stage to start with your business needs, not • Readability: present data that anyone can
technology
understand
What is the problem I need to solve?
• Trackability: track data that monitors business
What kind of data would help? performance
• Actionability: source data that pinpoints where to
Where will I source it from? take action
How will I store and safeguard it?

How will I analyze it?

Who will be responsible?

How will it be shared across the team?


By A.Morshedsolouk

How will it be implemented into the team’s working processes?

Business Intelligence and Data Management Page: 18


Data Strategy!
By A.Morshedsolouk

Business Intelligence and Data Management Page: 19


A Glance at DMBOK2.0
Framework
By A.Morshedsolouk

Business Intelligence and Data Management Page: 20


Data Management
• Is currency, life blood, new oil
• Is an (virtual) asset like any other (physical) asset
• Is a meta-asset that describes other assets
• Key to competitive advantage
• Enabler for decision-making
• Failure to manage data is like failure to manage capital
Data • Is the means by which an organization knows itself
• So it is a strategic goal: to get (derive) value from data (assets)
• Not only assets but also vital to the day-to-day operations
• When it is exchanged (internally or externally); it can provide information about how an
organization functions -> shows department or company’s data maturity level
• Assumption is that data simply exists. But data does not simply exist. Has to be created or
Obtained
• Data is a form of information and information is a form of data
By A.Morshedsolouk

• Both data and info should be managed

Business Intelligence and Data Management Page: 21


Data Management Goals
Understanding and supporting the information needs of the enterprise and its stakeholders, including
customers, employees, and business partners

Capturing, storing, protecting, and ensuring the integrity of data assets

Ensuring the quality of data and information

Ensuring the privacy and confidentiality of stakeholder data

Preventing unauthorized or inappropriate access, manipulation, or use of data and information


By A.Morshedsolouk

Ensuring data can be used effectively to add value to the enterprise

Business Intelligence and Data Management Page: 22


The DAMA-DMBOK Framework
The DAMA Wheel

• defines the 11 Data Management Knowledge Areas

1.Data Governance

• provides direction and oversight for data management by establishing a system of decision rights over
data that accounts for the needs of the enterprise.

2.Data Architecture

• defines the blueprint for managing data assets by aligning with organizational strategy to establish
strategic data requirements and designs to meet these requirements.

3.Data Modeling and Design

• is the process of discovering, analyzing, representing, and communicating data requirements in a


precise form called the data model.

4.Data Storage and Operations

• includes the design, implementation, and support of stored data to maximize its value. Operations
provide support throughout the data lifecycle from planning for to disposal of data.

5.Data Security
By A.Morshedsolouk

• ensures that data privacy and confidentiality are maintained, that data is not breached, and that data
is accessed appropriately.

Business Intelligence and Data Management Page: 23


The DAMA-DMBOK Framework
6.Data Integration and Interoperability

• includes processes related to the movement and consolidation of data within and between data
stores, applications, and organizations.

7.Document and Content Management

• includes planning, implementation, and control activities used to manage the lifecycle of data and
information found in a range of unstructured media, especially documents needed to support legal
and regulatory compliance requirements.

8. Reference and Master Data

• includes ongoing reconciliation and maintenance of core critical shared data to enable consistent
use across systems of the most accurate, timely, and relevant version of truth about essential
business entities.

9.Data Warehousing and Business Intelligence

• includes the planning, implementation, and control processes to manage decision support data and
to enable knowledge workers to get value from data via analysis and reporting.

10.Metadata

• includes planning, implementation, and control activities to enable access to high quality,
integrated Metadata, including definitions, models, data flows, and other information critical to
understanding data and the systems through which it is created, maintained, and accessed.
By A.Morshedsolouk

11.Data Quality

• includes the planning and implementation of quality management techniques to measure, assess,
and improve the fitness of data for use within an organization.

Business Intelligence and Data Management Page: 24


Data Risk and Data Quality
Data not only represents value, it also represents risk

Low quality data (inaccurate, incomplete, or out-of-date) obviously represents risk because its information is not right

But data is also risky because it can be misunderstood and misused

Organizations get the most value from the highest quality data –

available relevant complete accurate consistent timely usable meaningful understood


By A.Morshedsolouk

Information gaps – the difference between what we know and what we need to know to make an effective decision; and so profound impacts on
operational effectiveness and profitability.

Business Intelligence and Data Management Page: 25


Data Literacy
Data literacy is about making users that are not part of an organization’s data team more data literate.

It’s about educating regular business users about the information available to them and organizing this information
in a way that makes it easy to identify and consume.

When a data governance team acknowledges the importance of data literacy in an organization’s data governance
strategy, the result is a well-defined data catalog that any member of staff can access.

When they don’t, many users are left without access to important data impeding their ability to perform
professionally and contribute to the overall growth of a data-driven company.

Without widespread data literacy and clearly defined data terms and frameworks, communication channels can
break down—and the results can be catastrophic.

Before implementing a data literacy program your data team needs to ask these key questions:

• How can we organize our data so people can find it easily?


By A.Morshedsolouk

• How do we find and determine which terms are necessary for our company?
• How do we achieve consensus on, define, and present these terms?
• How do we provide universal access when confidential user data is included in the data catalog?
Business Intelligence and Data Management Page: 26
Data Quality
By A.Morshedsolouk

Business Intelligence and Data Management Page: 27


DMBOK Framework : BI Definition
• Data Warehousing and Business Intelligence
• Processes for :
• Planning
• Implementation
• Control
• to manage decision support data

• And

• to Enable knowledge workers


• to Get value from data via Analysis and Reporting
By A.Morshedsolouk

Business Intelligence and Data Management Page: 28


What is BI?
By A.Morshedsolouk

Business Intelligence and Data Management Page: 29


Definitions of BI
BI is a technology-driven process for analyzing data and delivering actionable
information that helps executives, managers and workers make informed
business decisions.

BI is a set of practices of collecting, structuring, analyzing, and turning raw


data into actionable business insights.

BI considers methods and tools that transform unstructured data sets,


compiling them into easy-to-grasp reports or information dashboards.

BI comprises the strategies and technologies used by enterprises for the data
analysis of business information.

BI is the process of turning raw data into actionable information that can
improve business decisions.
By A.Morshedsolouk

It is an umbrella term that stands for both processes and solutions — the
process of transforming data into actionable insights and the tools that access
and analyze data and present those findings in an accessible way.

Business Intelligence and Data Management Page: 30


Benefits of BI

speed up and improve Cost cutting by increase operational identify emerging


decision-making spot business problems
optimize internal and organizational business and market
that need to be
(Faster Analysis by business processes and efficiency and trends, Why changed?
addressed
Visualization) Single Truth productivity What changed?

develop stronger drive higher sales and gain a competitive It can monitor Transparency,
business strategies new revenues by Trend advantage over rival customer behavior and Efficiency, Profitability,
(Data-Driven Business) Awareness companies Improve CX Sustainability

Centralized Intuitive Clear Accountability Time Efficiency by Allows manpower to


It can help optimize
KPI dashboards and through efficient shortening decision- focus on skillful tasks
processes and Govern
Easy to access and Governance and making process & Story rather than
Data
share info, No Silo Reporting Telling monotonous tasks
By A.Morshedsolouk

Business Intelligence and Data Management Page: 31


BI Functions

Common functions of BI

• Reporting
• Online analytical processing
• Data mining
• Process mining
• Complex event processing
• Business performance management
• Benchmarking
• Text mining
• Descriptive analytics
• Predictive analytics
• Prescriptive analytics

BI solutions provide historical, current and


predictive views of business operations

By Business Intelligence,
By A.Morshedsolouk

Transform data into successful decisions

Business Intelligence and Data Management Page: 32


BI outcomes
Insight
•Reports which tell us the current or former status of our data. This insight answers questions such as:
•How is the organization performing?
•How much revenue did we incur?
•Where do our constituents live?
•How much funds did we raise?
•What is the average patient discharge rate during weekends?
•Reports providing insight are valuable, but they mostly offer an operational perspective. Some are used to inform strategic
decisions, but they don’t always provide the full picture as to why the numbers and outcomes are the way they are.

Hindsight
•This second outcome of the Analytics & Business Intelligence umbrella provides the analysis needed to understand why
we have the current numbers we do –what were the factors, the environment, and decisions which impacted the outcome
of these numbers. It answers questions such as:
•Why are we performing this way?
•Which investments proved to be successful?
•What are we learning from the results of A/B testing?
•What customer factors affected the sales outcomes?
•Hindsight also determines and provides knowledge and understanding of the context.

Foresight
•The third outcome is about foresight. This showcases the true value of analytics, depending how you define it, because
through the exploration of historical and live data and application of different statistical, data mining, predictive, and
other analytics’ methods, it provides us with a better understanding of the future and the potential paths to follow. It
answers questions such as:
•How will the organization perform in the future?
•How can we gain a competitive advantage?
By A.Morshedsolouk

•What effect might certain changes have on our bottom line?


•Where will most alumni move to one year after graduation?
•Which customers are more likely to purchase?
•What impact will the next flu season have on the respiratory clinic?

Business Intelligence and Data Management Page: 33


Self-service BI vs. Traditional BI (Static Reports)
Self-service BI
• Today, modern companies and solution providers utilize self-service BI. This approach
allows business users as well as executives to get the reports that are automatically
generated by the system.
• Automated reporting doesn’t need power users (admins) from your IT to process
each request to your data warehouse; however, technical staff is still required to set
up the system.
• Automation may lower the quality of the end reports and their flexibility as it will be
limited by the way the reporting is designed. But, as a benefit, the self-service
approach doesn’t require actual technical staff to operate in the system all the time.
Users that are not tech-savvy will be able to serve a report for themselves or access a
dedicated section of the data storage.

Traditional BI
• Traditionally, BI was designed for executives only. Since the number of users and
types of data is limited, there’s no need for full automation. So, a traditional BI flow
type requires technical staff as an intermediary between the reporting tool and the
end user.
• If an end user wants to extract some data, he or she has to make a request and tech
staff will generate a report from the required data. In this case, your IT department
acts as a power user, a user that can access data and influence its transformation.
• The traditional approach offers a more secure and controlled data flow. But, relying
By A.Morshedsolouk

on the IT department may introduce a lag in flexibility and speed in case of


processing big amounts of data (especially for big data). If you strive for more report
control and precision of reports, form a dedicated IT team to take care of queries and
report formation.
Business Intelligence and Data Management Page: 34
BI team Roles
• BI managers who work closely with: And Also with:
• BI architects • Data architects • Business analysts
• BI developers • Data engineers • End users
• BI analysts • Other data management
• BI specialists professionals (DMP)
By A.Morshedsolouk

Business Intelligence and Data Management Page: 35


Data Analysis and Data Analytics
• Data Analysis
• Data analysts must observe, transform, clear, and raw model data to maximize a strategy or process.
• Is "depth analysis of data"
• The data is already in existence, it has to do with the past:
• "What happened?"
• The scope of data analysis is constrained to a pre-existing dataset
• Involves looking at, sorting, and challenging the readily available information
• Data Analytics
• “Data analytics" refers to the process of "organized computational data analysis"
• Involved with conducting logical, analytical, and logical reasoning to provide insight into future actions
• Data analytics encompasses all of the human and machine-assisted procedures that you take to identify,
interpret, visualize, and communicate the storyline of trends in your data.
• To make insights accessible and understandable to other stakeholders
• Applied statistical data, machine learning, AI, and Data Science all fall under data analytics
• An obvious tangible outcome of an analytics process is the production of well-planned reporting that
incorporates data visualization.
• Data analytics can assist you in the following ways:
• Recognize patterns and trends
• Identify opportunities
By A.Morshedsolouk

• Identify potential threats and benefits


• Decide on a plan of action

Business Intelligence and Data Management Page: 36


Business Intelligence or Business Analytics?
• Are not the same
BI & BA

• relies on real-time and historical data. In essence, it tells organizations what’s happening and how
Business
intelligence
things got to this point

• focuses on predicting what is going to happen in an organization in the future based on past
Business
analytics
trends and offering suggestions for things that could be done differently for improved outcomes

• can be a part of the business intelligence process


B. Analytics

• What is Business Analysis? Answer: BA -> BABOK; BI -> DMBOK; DA -> DSBOK
By A.Morshedsolouk

Question:

Business Intelligence and Data Management Page: 37


How does BI work?
By A.Morshedsolouk

Business Intelligence and Data Management Page: 38


BI Architecture
By A.Morshedsolouk

Business Intelligence and Data Management Page: 39


How BI Works?

Transactional Analytical(Slicing, Diced, Roll-up, Drill-down)


By A.Morshedsolouk

Business Intelligence and Data Management Page: 40


Top BI tools in 2022

According to Mordor Intelligence, the business intelligence industry is so


popular that it is predicted to reach a value of USD 40.50 billion by 2026
By A.Morshedsolouk

Business Intelligence and Data Management Page: 41


BI Tools features
Data visualization

ETL, Integration, Data warehouses

Interactive dashboards, Modeling, Query, metrics, KPIs definitions, Languages (DAX, R, Python, …)

Alerts and notifications (set thresholds for high or low numbers)/can be outside of BI tools

Embedded Analytics (visualization in the company web page, cloud app, or for customer access, …)

BI reporting tools

Desktop, Cloud, PaaS, SaaS, Enterprise , Self-service

Data Mining, Big Data (Hadoop)


•Also known as “data discovery,” data mining involves automated and semi-automated data analysis to uncover patterns and inconsistencies. Common correlations drawn from data mining include grouping specific sets
of data, finding outliers in data, and drawing connections or dependencies from disparate data sets.

Predictive analytics
•forecast future events based on current and historical data. By drawing connections between data sets, these software applications predict the likelihood of future events, which can lead to a huge competitive advantage
for businesses.

Descriptive modeling
•seeks to reduce data into manageable sizes and groupings. Descriptive analytics works well for summarizing information such as unique page views or social media mentions.

Decision analytics
•Take into account all the factors related to a discrete decision. Decision analytics predict the cascading effect an action will have across all the variables involved in making that decision.

NLP (Natural Language Processing)


By A.Morshedsolouk

•Data comes in three main forms: structured, semi-structured, and unstructured. Unstructured data is the most common, and includes text documents and other types of files that exist in formats that computers can’t
read easily.
•also known as text analytics software, combs large sets of unstructured data to find hidden patterns.

Business Intelligence and Data Management Page: 42


25 BI Tools Gartner magic Quadrant (2022)
• Top Business Intelligence Tools
• Enterprise Business Intelligence Platforms
• #1) Oracle NetSuite
• #2) Integrate.io
• #3) Zoho Analytics
• #4) HubSpot
• #5) Query.me
• #6) SAS
• #7) Birst
• #8) WebFOCUS
• #9) BusinessObject
• #10) IBM Cognos
• #11) MicroStrategy
• #12) Pentaho
• Database Integrated Products
• #13) Microsoft BI and Power BI
• #14) Oracle BI (OBIEE+ and Endeca)
• #15) SAP BW + HANA
• #16) Oracle Hyperion
• Data Discovery And Visualization
• #17) Qlik and QlikSense
• #18) Tableau
• #19) Board
• #20) Sisense
• #21) Adaptive Discovery
• Niche And Innovative
• #22) Yellowfin BI

By A.Morshedsolouk

#23) Style Intelligence


• #24) Bizzscore
• #25) Jaspersoft

Business Intelligence and Data Management Page: 43


Microsoft Power BI
Bridge the gap between data and decision making
Microsoft is named a Leader in the March 2022 Gartner®
Magic Quadrant™ for Analytics and Business Intelligence Platforms.
By A.Morshedsolouk

Business Intelligence and Data Management Page: 44


Microsoft Power Platform
• Power BI
• Power BI is an interactive data visualization software product developed by Microsoft with a primary focus on business intelligence.
• Turn your unrelated sources of data into coherent, visually immersive, and interactive insights.
• Unify data from many sources to create interactive, immersive dashboards and reports that provide actionable insights and drive
business results.
• Power Virtual Agents
• Chatbots use artificial intelligence (AI) and natural language processing (NLP) to help users interact with web services or apps
through text, graphics, or speech. Chatbots can understand natural human language, simulate human conversation, and run
simple, automated tasks.
• Create powerful bots using a guided, no-code graphical interface without the need for data scientists or developers.
• Easily build chatbots to engage conversationally with your customers and employees—no coding required.
• Power Apps
• Power Apps is a suite of apps, services, and connectors, as well as a data platform, that provides a rapid development environment
to build custom apps for your business needs.
• Quickly build low-code apps that modernize processes and solve tough business challenges in your organization using Power Apps.
• Build apps in hours—not months—that easily connect to data, use Excel-like expressions to add logic, and run on the web, iOS, and
Android devices.
• Power Automate
• Microsoft Power Automate, formerly known as Microsoft Flow until November 2019, is an iPaaS platform by Microsoft for
automation of recurring tasks.
• Power Automate is a service that helps you create automated workflows between your favorite apps and services to synchronize
files, get notifications, collect data, and more.
• Include powerful workflow automation directly in your apps with a no-code approach that connects to hundreds of popular apps
and services.
• Power Pages
• A new way to build business websites-(Design Studio)
By A.Morshedsolouk

• Design, host, and administer secure, modern, and low-code business websites.

Note Dynamics 365 is MS CRM and ERP applications


Business Intelligence and Data Management Page: 45
What is Power BI?
• Power BI is a Business Intelligence (BI) tool and a Data Visualization platform
offered by Microsoft that allows organizations to analyze business data and
generate reports.
• Power BI comes with a set of built-in tools, apps, and connectors that can
deeply delve and work with data to provide actionable insights, immersive
visuals, and interactive reports.
• Power BI is actually self-service BI which means that you can easily aggregate
data, analyze data, visualize data, and produce some fantastic-looking visual
reports.
• Power BI lets you pull data in from multiple sources such as Oracle, SAP, or a
Data Warehouse of your choice.
• It can handle everything from your simple Excel file all the way to massive
amounts of data.
By A.Morshedsolouk

• You can leverage the Power BI Chart, Graphs, KPIs, Reports, and Dashboards to
analyze the data and get interactive insights.
Business Intelligence and Data Management Page: 46
Power BI Components
By A.Morshedsolouk

Business Intelligence and Data Management Page: 47


How Power BI works?
By A.Morshedsolouk

Business Intelligence and Data Management Page: 48


Power BI Architecture
By A.Morshedsolouk

Business Intelligence and Data Management Page: 49


Power BI Connection Types: DirectQuery, Live, or Import?
By A.Morshedsolouk

Business Intelligence and Data Management Page: 50


Key Features of Power BI
Easy Integrations
• Power BI offers integrations with multiple connectors that allow users to pull in data from various data sources.

AI Support
• Power BI allows users to deploy Artificial Intelligence (AI) techniques such as Image Recognition and Text Analytics to prepare
data, develop Machine Learning models, and quickly extract actionable insights from structured and unstructured data.

Report Sharing
• Power BI is built for developing security that allows teams to share access in a very controlled manner. Users can easily share
their reports with other team members without compromising data security.

Real-Time Dashboards
• Power BI has the capability to display real-time data and visuals in any report or dashboard. Power BI dashboards update in
real-time allowing users to instantly solve issues and uncover opportunities.

Customized Visualization
• Power BI offers high customizability and allows users to leverage its custom visualization library to create visualizations as per
their needs.
By A.Morshedsolouk

• In addition to that, analysts can also generate highly customizable visuals for their next Power BI report by using open-source
data-viz modules from R and Python
Business Intelligence and Data Management Page: 51
Power BI languages

• Query language
M-Language • Used by Power Query
• ETL functions
• Data Analysis Expressions
• A general calculation language to create columns and
DAX language measures
• Rich functions
• The statistical language R support Using R for
R language preparing data models, reports, data cleansing,
advanced data shaping, dataset analytics, etc.

Python language

Optimized with Azure and SQL


• Through ML models created in Azure Machine
Predictive analytics Learning Studio.

• AI-powered data modeling with AutoML, Cognitive


Data modeling Services, Azure ML (Power BI Premium).
By A.Morshedsolouk

Business Intelligence and Data Management Page: 52


Power BI Products and Pricing
By A.Morshedsolouk

Business Intelligence and Data Management Page: 53


BI implementation
By A.Morshedsolouk

Business Intelligence and Data Management Page: 54


Steps for BI Implementation
Establish a BI Vision, Mission and Strategy
Assess current situation
Develop a BI roadmap and prioritize initiatives
Establish BI Governance and funding process
Establish a BI Competency Center (BICC)
Align Business and IT and BI teams
Start Data Architecture and Deploy a Data Dictionary/Master Data
Measure and track ROI/Benefits from BI
Identify CSFs, KPIs, KRIs, PIs, RIs, Metrics, Measures, Monitoring period and their Targets

Choose your BI Tools, Technology, Infra, DWH


Identify Data Sources, start ETL and Modeling
Design and Implement BI Reports
Onboard Stakeholders and End-users
By A.Morshedsolouk

Build Trust in the system, Govern your Data


Close the Cycle by Continuous Improvement
Business Intelligence and Data Management Page: 55
Chief “Something” Officer -- CDO?!
By A.Morshedsolouk

Business Intelligence and Data Management Page: 56


Steps from a Mission and Vision to Performance Measures that Work
By A.Morshedsolouk

Business Intelligence and Data Management Page: 57


Six-Perspective Balanced Scorecard (BSC)
By A.Morshedsolouk

Business Intelligence and Data Management Page: 58


From CSF to PI or RI
By A.Morshedsolouk

Business Intelligence and Data Management Page: 59


BI Funnel
By A.Morshedsolouk

Business Intelligence and Data Management Page: 60


By A.Morshedsolouk

Business Intelligence and Data Management Page: 61


By A.Morshedsolouk

Business Intelligence and Data Management Page: 62


‫‪BI Developer/Engineer/Expert‬‬
‫‪#‬استخدام‬ ‫•‬
‫شرح موقعیت شغلی‬ ‫•‬ ‫عنوان شغل‪ :‬کارشناس هوش تجاری‬ ‫•‬
‫مسلط به ‪SQL Server‬‬ ‫•‬ ‫شرکت‪ :‬بیمه معلم‬ ‫•‬
‫مسلط به ‪T-SQL‬‬ ‫روز و ساعت کاری‪ 7:30 :‬شنبه تا چهارشبه تا ‪( 16:30‬نیم ساعت •‬ ‫•‬
‫مسلط به ابزارهای ‪SSIS/SSDT/Power BI‬‬ ‫•‬ ‫شناوری )‬
‫موقعیت مکانی‪ :‬تهران میدان ونک‬ ‫•‬
‫آشنایی کامل با مفاهیم طراحی انباره داده ( )‪DW‬‬ ‫•‬
‫آشنایی با مفاهیم هوش تجاری‬ ‫•‬ ‫شرایط احراز شغل‪:‬‬ ‫•‬
‫توانایی درک و ارزیابی منابع داده ای و مدل سازی منطقی و فیزیکی‬ ‫•‬ ‫تحصیالت ‪ :‬کارشناسی ارشد|کامپیوتر ‪ /‬فناوری اطالعات‬ ‫•‬
‫داده ها‬ ‫سن ‪32-25 :‬‬ ‫•‬
‫توانایی برگزاری جلسات‪ ،‬جمع آوری‪ ،‬تحلیل و پیاده سازی نیازمندی‬ ‫•‬ ‫حقوق‪ 20 :‬تا ‪ – 30‬توافقی بر اساس عملکرد‬ ‫•‬
‫ها‬ ‫جنسیت ‪ :‬تفاوتی ندارد‬ ‫•‬
‫توانایی تجزیه و تحلیل و حل مساله‬ ‫خدمت سربازی‪ :‬اتمام خدمت سربازی و یا معافیت از آن الزامی است •‬ ‫•‬
‫مهارت ارتباطی قوی و انجام کار تیمی‬ ‫•‬
‫زبان انگلیسی متوسط رو به باال‬ ‫•‬
‫تسلط بر مفاهیم مدیریت ریسک مزیت محسوب می شود‪.‬‬ ‫•‬ ‫نرم افزارها‪:‬‬ ‫•‬
‫‪SSIS‬پیشرفته‬ ‫•‬
‫‪T-Sql‬پیشرفته‬ ‫•‬
‫‪By A.Morshedsolouk‬‬

‫‪Power bi‬پیشرفته‬ ‫•‬

‫‪Business Intelligence and Data Management‬‬ ‫‪Page: 63‬‬


Power BI Developer - Salary Estimates
• These are the salary estimates
of a Power BI professional in
the USA. The salary range
depends on your experience
level, expertise, and
qualification.
• $35,000 (Rs.24,06,180.00)
• $52,100 (Rs.35,81,770.80)
• $72,000 (Rs.49,49,856.00)
• $80,900 (Rs.55,61,713.20)
• $100,600 (Rs.69,16,048.80)
By A.Morshedsolouk

Business Intelligence and Data Management Page: 64


SIGNS OF MES (Manufacturing Execution System) FAILURE VS. ASSET DATA-CENTRIC SOLUTIONS

MES PERFORMANCE FAILURE DATA-CENTRIC SOLUTION


SCRAMBLING FOR PARTS SOLUTION
Inaccurate parts count leads to production delays and unified orders. An automated, accurate parts count preempts costly downtime. Reordering can
also be fully automated.
FAILING OR BROKEN EQUIPMENT SOLUTION
Inefficient calendar-based maintenance schedules lead to over-maintenance, which waste Drive maintenance systems with machine data based on usage or condition.
resources, OR under-maintenance, which results in costly machine breakages and downtime.
Use data to diagnose and predict various types of failures so personal can stop
disruptions from happening in the first place.
CHALLENGES ACHIEVING CONSISTENT QUALITY SOLUTION
Reliance on manually tracked data limits ability to pinpoint the source of quality issues due Automated data collection monitor machine and tooling conditions to quickly
to worn tools and other equipment issues.
detect and diagnose machine issues that compromises part quality, triggering
work flows to people and systems that prevent parts from being scrapped or
reworked.
UNEXPLAINED DOWNTIME & INCONSISTENT THROUGHPUT SOLUTION
Undetected chronic productivity problems and manual Intelligent, automated process data capture can eliminate error, detect trends,
data input errors quickly cut into narrow margins and damage customer satisfaction.
rapidly identify choke points, and optimize throughput.
SCHEDULING BASED ON APPROXIMAT IONS SOLUTION
Highly unpredictable equipment that varies widely by personnel hampers downstream Software allows you to log an anticipated setup time, automate scheduling, and
performance.
alert operators if they are at risk of missing the allotted task window. Standards
of work such as cycle times can be updated in real-time for accurate
performance benchmarks.
By A.Morshedsolouk

DIFFICULTY WITH CUSTOMIZATION & SCALE SOLUTION


Complicated Production flow updates and/or volume expansion lead to expensive and time Data-centricity ensures that time and resource use are continuously optimized
consuming delays.
with tools versatile enough to implement changes and scale with minimal
manual upkeep.
Business Intelligence and Data Management Page: 65
Common Myths on BI
By A.Morshedsolouk

Business Intelligence and Data Management Page: 66


7 common myths about BI tools
Myth 1: “This is too expensive for my business.”
• One of the most common myths about BI tools is that they’re only for huge enterprises with deep pockets.
• This simply isn’t true.
• There are BI tools available for businesses of all sizes, and many of them are very affordable.
• In fact, some BI tools are even free.
• BI tools can save businesses a lot of time and money. So, even if you’re on a tight budget, a BI tool may be an investment you can’t
afford to pass up.

Myth 2: “I don’t need a BI tool because I already have a reporting system.”


• Another common myth about BI tools is that they’re unnecessary if you already have a reporting system in place.
• But the truth is that BI tools can do much more than just generate reports.
• As we’ve seen, they can also provide insights through data visualizations and dashboards that businesses might not be able to get from
their reporting system alone.
• This can help businesses save time and make better decisions.

Myth 3: “I don’t need a BI tool because I have a data analyst.”


• Another common myth about BI tools is that they’re only needed if you don’t have a data analyst on staff.
• But the truth is that BI tools can be helpful even if you do have a data analyst.
By A.Morshedsolouk

• Data analysts can use BI tools to save time and make their jobs easier. And, as we’ve seen, BI tools can also provide insights that data
analysts might miss on their own.
• So even if you have a data analyst on staff, it’s still worth considering whether a BI tool could be beneficial for your business.
Business Intelligence and Data Management Page: 67
7 common myths about BI tools
Myth 4: “I don’t need a BI tool, I can just use Excel.”
• Another common myth about BI tools is that they’re not necessary if you’re already using Excel.
• While it’s true that Excel can be used for some basic data analysis, it’s not designed for complex tasks like data visualization or reporting.
• BI tools are much better suited for these tasks, and they can save you a lot of time.
• So even if you’re already using Excel, you don’t necessarily have to completely reject the idea of using a BI tool.
• In fact, you might find that using both Excel and a BI tool can be beneficial for your business.

Myth 5: “I don’t need a BI tool because I have a CRM.”


• Another common myth about BI tools is that they’re not needed if you have a customer relationship management (CRM) system.
• But the truth is that BI tools can be very helpful for businesses that have CRMs.
• CRMs can be complex, and it can be difficult to get the information that you need from them.
• But BI tools can make it much easier to access and analyze your CRM data.
• CRMs are great for managing customer data, but they’re not always the best tool for analyzing that data.
• With BI tools, you can easily access your CRM data and generate reports that will help you make better business decisions.

Myth 6: “BI tools are only for big companies.”


• This is another myth that simply isn’t true. As we’ve seen, BI tools can be beneficial for businesses of all sizes.
• They can help small businesses save time and money, and they can provide insights that businesses might not be able to get from their data alone.
• This myth is likely based on the fact that BI tools have traditionally been expensive and difficult to use. But as we’ve seen, there are now many BI tools that
are affordable and easy to use.

Myth 7: “BI tools are a passing tech fad.”


By A.Morshedsolouk

• BI tools have been around for many years, and they’re only getting more popular.
• In fact, Gartner predicts that BI and analytics will be one of the most important trends in business in the coming years.
Business Intelligence and Data Management Page: 68
Why BI is better than Excel?
Huge Capacity

Scalability and Data


Performance Connectivity

Collaboration,
Automated
Distribution,
Reporting
and Publishing
By A.Morshedsolouk

Mobility Visualizations

Business Intelligence and Data Management Page: 69


Some Questions You may Have
• Can I do BI with only excel? • Yes! But No!, It depends to you, With leader commitment and managers
admittance and using proper DA and BI developers: No! Depends on your
• Yes, with lower features and not flexible and scalable as PBI, self..
• more develop time and more cost..
• not public visuals, not sharing features, not governance, .. • Can I postpone BI Project after more public acceptance..?
• Yes, but you may lose opportunities and lag the competitions.. The sooner
• Can I use Persian Language in MS (Microsoft) BI the better
• Yes, Although still visuals cannot be right-to-left, not important! • How much is the BI develop costs per year or per Project?
• Can I use Persian calendar in MS BI • It depends on your work complexity and No. Of reports you want to

Directly No!, indirectly Yes, implement and No. of KPIs you need and … For ICASAT, for the BI developer
part we forecasted ~20-~25MillionTomans/M for around 2Y which is less

We have sanction or Microsoft limitations possible due to sanctions, will be than 1.2% of Total Cost/Y. I used my experience for BA and DA and DG,
solved later freely!
• Time Intelligence functions need tricks and workaround • How much around is the Costs for BI infrastructure?
• Can We use other tools like Qlik, Tableau, Oracle instead of MS BI? • We already had major parts, just we needed to add a enough powerful BI
• Yes, depends on your cost server (VM) and Network Security

• Can I use MS BI personally in company? • What other costs we incur for BI implementation?
• Yes. If your IT policy allows. • BI server and SQL server and access and security and .. administration costs
(usual IT costs)
• Does BI kill creativity? • For migrating data into database you need a SQL developer (extra
• Mainly No, Maybe Yes! ~20MT/M) for possibly around 6 Months

• Can BI data be wrong and misguiding? • How much is hard to learn MS-BI compared to excel?
• Yes, Ask your Operator, (GIGO) • For simple reports it is easy, for advanced reports a BI developer is needed
for DAX programming.
• Am I dependent to BI developer forever? • For enterprise deploy an IT/IS/SQL expert is needed.
• The same like Aryan, Hamkaran, MS Office & CRM tools and your IT team, • Collaboration of all managers is needed for data governance.
• Excel also is not easy to master for advanced features
• How long it takes I design and implement MS BI?
By A.Morshedsolouk

• Depends on your current DATA readiness, no. of reports needed and scope
of work and KPI complexities and your budget
• Is it possible my BI project fails?

Business Intelligence and Data Management Page: 70


Some Questions You may Have
• What is the future of PBI? • Yes, needs some more IT/security efforts
• It is a Microsoft product! It is already a winner. Guess the rest. • Can I use my mobile phone for BI access?
• What features do I lose with MS-BI private server compared to Microsoft • Yes, there is an app for this (Android, iOS)
Cloud Service? • it needs first designing reports for mobile layout
• Workspaces, Apps, • Usually only KPI cards is applicable
• CAPEX -> OPEX Model,
• How many of peoples have been involved in ICASAT BI develop?
• Dashboards
• Me as CDO (BA & DA) plus one-two BI developers for designing and
• Some AI features, Some access and Security features (RLS, access) developing
• Possibly MS Azure and Power Automate • One IT expert for IT infra (CPU and storage and access) & servers
• MS Cloud costs vs. Internal costs installations and configurations and troubleshooting and administration
• Native cloud vs. public cloud • ICASAT mid-managers for data preparation
• How BI server is updated? • Can we have BI without ERP or CRM?
• By now from MS web site • Yes!, Yet you have data & you can use excel
• No downward compatibility, upward compatibility is okay • CRM is transactional system, BI is Analytical system, they complement each
other, they do not confront
• If Microsoft Stop it, our BI will be stopped
• If Microsoft change Activation policy, we are again stopped until cracked • Can we have BI (DM) without a BI tool?
• Is it possible that some data of reports be wrong? • Yes, even with paper form or excel but not very effective
• But you need data management as your underlying base always
• For measures yes, it is normal in DAX or any develop case, but can be
debugged • Can I use MS-BI as a simple ERP/CRM?
• Can we hand-over implemented BI reports to another developer if • Generally No!, But to some level Maybe.
required? • depends on your requirement, the exact answer depends on your exact
• Sure… not too hard requirement
• How BI data is refreshed?
• With proper design and a scheduled refresh policy requested by user or
By A.Morshedsolouk

data-refresh rate
• Can I use Enterprise BI from outside and on public IP address rather
private ones?

Business Intelligence and Data Management Page: 71


Some Questions You may Have
• Can I give access to the BI reports to outside users like • Can I define access rules for BI report such as only this guy
customers or regulators or partners? see this report and cannot see other reports?
• Yes. That is part of BI benefit. • Yes, DG is part of BI structure and MS BI implement it.. The
• You should just consider your DM/BI policies and limitations security level is even higher than this.. Needs more sophisticated
and a senior BI developer is needed
• Can we define team performance and staff performance • Can I build an enterprise level BI report on top of functional
KPIs with BI? (departmental) BI reports?
• Yes, with great visibility and full parameterized
• Yes, although it takes time and it needs more advanced modeling
• It is a mix of performance process design and BI develop and BI and needs a strict DG (like Master Data, Reference Data,…)
usage
• It can even be monetized in BI automatically so that team or staff • What are the limitations of BI?
can see it online • BI is not CRM. BI is not SQL.
• It can show defects and weakness points.. • BI is just an analysis tool
• you should start with pain points and define your desired KPIs and
see how you can quantize and digitize it and then trace trends • What is the replacement for BI?
• Just BI! You can change your tool and DWH or platform, but at the
• Can the staffs fool the BI data? (change, fraud, …) end of the day they are all BI!
• It depends on how you create and collect data • BI is BI, just like CRM is CRM, and excel is excel.
• In SQL No.; In Excel yes, they can manipulate it; there are some
tricks that even in excel we can ban this, needs more effort and • These are some questions I thought you may have; You can
develop time also write your own questions and email me
• Our next phase of data warehouse is SQL-based [email protected] to be brought up in the next meeting
• If they want they can.. But the data cheat is shown more easily and
outliers are visible
• How BI server updates (refreshes) it data from Data source?
• Data source are kept in DWH (data warehouse)
By A.Morshedsolouk

• We define a refresh policy (every day or every week or every hour


or …) for each report dependently and apply that policy to the
report
Business Intelligence and Data Management Page: 72
Voting time
• How much do you think you need to • 5- Customer demand or happiness
deploy DM/BI in your department or • 6- Centralized shared silo-less data
organization? • 7- Decision Making
• 1- A must • 8- Finding Weak points & Process
• 2- An advantage Improvement
• 3- Yet Not sure • 9- Increase Staff Replaceability
• 4- Useless (Substitutability)
• 5-First CRM then BI • 0- Team Management
• 6-CRM has BI in it, no need to extra BI • A- Project Management
• 7- No Idea • B- Regulator Requirement
• C- Competitor advantage
• What are your major expectations • D: Clear Accountability
from DM and BI in your department?
• 1- Reporting
• 2- Performance • Your Answers specify How much My
By A.Morshedsolouk

• 3- Visibility & Transparency presentation has been successful?


• 4- Time saving
Business Intelligence and Data Management Page: 73
BI Budget?
By A.Morshedsolouk

Business Intelligence and Data Management Page: 74


Thank You for taking your time!
Any Questions?
By A.Morshedsolouk

Business Intelligence and Data Management Page: 75

You might also like