Chapter 2: Data Science

 An Overview of Data Science:

 Data science is the application of computational and statistical
techniques to address some problem in the real world

 Is much more than simply analysing data.

 It offers a range of roles and requires a range of skills.

 They possess a strong quantitative background in statistics and

linear algebra as well as programming knowledge

1
 Cont…
What are data and information?
 Data: can be defined as a representation of facts, concepts, or
instructions in a formalized manner, which should be suitable
for communication, interpretation, or processing, by human or
electronic machines.

 It can be described as unprocessed facts and figures.

 It is represented with the help of characters such as alphabets
(A-Z, a-z), digits (0-9) or special characters (+, -, /, *, <,>, =,
etc.).
 Information: is the processed data on which decisions and
actions are based.
2
 Data Processing Cycle:
 Data processing is the re-structuring or re-ordering of data by
people or machines to increase their usefulness and add values
for a particular purpose.

 Data processing consists of the following basic steps - input,

processing, and output.

 These three steps constitute the data processing cycle.

Figure: Data Processing Cycle

3
 Cont…
 Input − in this step, the input data is prepared in some
convenient form for processing.

 The form will depend on the processing machine.

 Example, when electronic computers are used, the input data

can be recorded on any one of the several types of storage
medium, such as hard disk, CD, flash disk and so on.

4
 Cont…
 Processing − in this step, the input data is changed to produce
data in a more useful form.

 Example, interest can be calculated on deposit to a bank, or a

summary of sales for the month can be calculated from the
sales orders.

 Output − at this stage, the result of the proceeding processing

step is collected and the particular form of the output data
depends on the use of the data.

 Example, output data may be payroll for employees.

5
 Data types and their representation
Data types from Computer programming perspective:

 Almost all programming languages explicitly include the

notion of data type, though different languages may use
different terminology.

6
 Data types and their representation
 Common data types include:

 Integers (int)- is used to store whole numbers, mathematically

known as integers

 Booleans(bool)- is used to represent restricted to one of two

values: true or false

 Characters(char)- is used to store a single character

 Floating-point numbers(float)- is used to store real numbers

 Alphanumeric strings(string)- used to store a combination of

characters and numbers.

7
 Cont…
 A data type makes the values that expression, such as a variable
or a function

 This data type defines the operations that can be done on the
data, the meaning of the data, and the way values of that type
can be stored.

What Is Big Data?

 Big Data' is also a data but with a huge size.

 Used to describe collection of data that is huge in size and yet

growing exponentially with time.

8
 Cont..
 Normally we work on data of size MB(Word Doc, Excel) or
maximum GB(Movies, Codes) but data in Peta bytes i.e. 10^15
byte size is called Big Data.

 Such a data is so large and complex that none of the traditional

data management tools are able to store it or process it
efficiently.

Examples Of 'Big Data; Social Media Impact:

 Statistic shows that 500+terabytes of new data gets ingested

into the databases of social media site Facebook, Google,

LinkedIn, every day.
9
 Cont..
 This data is mainly generated in terms of photo and video
uploads, message exchanges, putting comments etc.

 Weather Station: All the weather station and satellite gives

very huge data which are stored and manipulated to forecast
weather.

 Telecom company: Telecom giants like Airtel, Vodafone study

the user trends and accordingly publish their plans and for this
they store the data of its million users.

10
 Categories Of Big Data
 Big data' could be found in three forms:

 Structured

 Unstructured

 Semi-structured

 Structured:

 Data containing a defined data type, format, and structure

 An 'Employee' table in a database is an example of

Structured Data

11
 Cont…
 Unstructured :

 Data that has no inherent structure

 Typical example of unstructured data is, a heterogeneous

data source containing a combination of simple documents,
PDFs, images, and video etc.
 Output returned by 'Google Search'

 Semi-structured:

 Semi-structured data can contain both the forms of data.

 Example of semi-structured data is a data represented in

Extensible Markup Language [XML] file.
12
 Cont…
Big data is characterized by 3V :

 Volume: large amounts of data Zeta bytes/Massive datasets

 Velocity: Data is live streaming or in motion

 Big Data Velocity deals with the speed at which data flows in

from sources like business processes, application logs,

networks and social media sites, sensors, Mobile devices,
etc.

 The flow of data is massive and continuous.

13
 Cont…
 Variety

 Refers to heterogeneous sources and the nature of data,

both structured and unstructured.

 During earlier days, spreadsheets and databases were the

only sources of data considered by most of the applications.

 Now days, data in the form of emails, photos, videos,

monitoring devices, PDFs, audio, etc. is also being

considered in the analysis applications.

14
 Cont…
Benefits of Big Data Processing:
 Businesses can utilize outside intelligence while taking
decisions.
 Improve customer service.

 Early identification of risk to the product/services, if any.

 Better operational efficiency.

15
 What is Hadoop
 Hadoop is an open source framework from Apache software
foundation.

 It is written in Java and is not OLAP (online analytical

processing).

 It is used for batch/offline processing.

 It is used to store process and analyse data which are very huge
in volume.

 It is being used by Facebook, Yahoo, Google, Twitter, LinkedIn

and many more.

16
 Why to use Hadoop
 Apache Hadoop is not only a storage system but is a platform
for data storage as well as processing.

 It is scalable (as we can add more nodes on the fly).

 Fault tolerant (Even if nodes go down, data processed by

another node).

 It efficiently processes large volumes of data on a cluster of

commodity hardware.

 Hadoop is for processing of huge volume of data.

17
 Why to use Hadoop
Hadoop components
1) Hdfs -storage
 HDFS : Hadoop uses HDFS (Hadoop Distributed File
System) which uses commodity hardware to form clusters
and store data in a distributed fashion.
 It works on Write once, read many times principle.

2) MapReduce-processing.
 Map Reduce processing is applied to data distributed over
network to find the required output.

18
 Clustered Computing
 Because of the qualities of big data, individual computers are
often inadequate for handling the data at most stages.

 To better address the high storage and computational needs of

big data, computer clusters are a better fit.

 Big data clustering software combines the resources of many

smaller machines, seeking to provide a number of benefits:

 Resource Pooling

 High Availability

 Easy Scalability

19
 Debre Birhan University
College of Engineering
Department of Electrical and Computer Eng.

Introduction
to
Emerging Technologies

Juhar M. (MSc in Communication Eng.)

Chapter 3: Artificial Intelligence (AI)
out line
 What is Artificial Intelligence (AI)
 History of AI
 Levels of AI
 Types of AI
 Influencers of artificial intelligence
 Applications of AI
 AI tools and platforms
 What is Artificial Intelligence?
 Artificial defines "man-made," and intelligence defines
"thinking power", or “the ability to learn and solve problems”

 hence Artificial Intelligence means “a man-made thinking

power”.

 So, we can define Artificial Intelligence (AI) as the branch of

computer science by which we can create intelligent machines
which can behave like a human, think like humans, and able to
make decisions.

22
 Cont…
 Intelligence, is the ability to acquire and apply knowledge

 Knowledge is the information acquired through experience.

 Experience is the knowledge gained through exposure

(training).

 Artificial Intelligence exists when a machine can have human-

based skills such as learning, reasoning,

 Solving problems with Artificial Intelligence you do not need

to pre-program a machine to do some work,

 We can create a machine with programmed algorithms which

can work with own intelligence
23
 Cont…
 Intelligence is composed of:

 Reasoning

 Learning

 Problem Solving

 Perception

 Linguistic Intelligence

 An AI system is composed of an agent and its environment.

 An agent (e.g., human or robot) is anything that can perceive its

environment through sensors and acts upon that environment

through effectors.
24
 Cont…
 High-profile examples of AI include :

 autonomous vehicles (such as drones and self-driving cars),

 medical diagnosis,

 creating art (such as poetry)

 proving mathematical theorems,

 playing games (such as Chess or Go),

 search engines (such as Google search),

 image recognition in photographs,

 prediction of judicial decisions and targeting online

advertisements
25
 cont.…
 AI deals with the area of developing computing systems that are
capable of performing tasks that humans are very good at, for
example recognizing objects, recognizing and making sense of
speech, and decision making in a constrained environment.

 Introduction to Emerging Technologies MODULE.pdf

 Need for Artificial Intelligence
 To create expert systems that exhibit intelligent behaviour with
the capability to learn, demonstrate, explain and advice its
users.

 Helping machines find solutions to complex problems like

humans do and applying them as algorithms in a computer-
friendly manner.

27
 Goals of Artificial Intelligence
 Following are the main goals of Artificial Intelligence::

 Replicate human intelligence

 Solve Knowledge-intensive tasks

 An intelligent connection of perception and action

 Building a machine which can perform tasks that requires

human intelligence

 Creating some system which can exhibit intelligent behaviour,

learn new things by itself, demonstrate, explain, and can advise
to its user

28
 What Comprises to Artificial Intelligence?
 To create the AI-first we should know that how intelligence is
composed,

 so Intelligence is an intangible part of our brain which is a

combination of Reasoning, learning, problem-solving,
perception, language understanding, etc.

 Artificial Intelligence requires the following disciplines:

29
 Advantages of Artificial Intelligence
 High Accuracy with fewer errors

 High-Speed

 High reliability

 Useful for risky areas

 Digital Assistant

 Useful as a public utility

30
 Disadvantages of Artificial Intelligence
 High Cost

 Can't think out of the box

 No feelings and emotions

 Increase dependence on machines

 No Original Creativity

31
History of AI

32
 History of AI……..
 Maturation of Artificial Intelligence (1943-1952)

 The birth of Artificial Intelligence (1952-1956)

 The golden years-Early enthusiasm (1956-1974)

 The first AI winter (1974-1980)

 A boom of AI (1980-1987)

 The second AI winter (1987-1993)

 The emergence of intelligent agents (1993-2011)

 . Deep learning, big data and artificial general intelligence (2011-

present) Introduction to Emerging Technologies MODULE.pdf
 Levels of AI
 Stage 1 – Rule-Based Systems

 Stage 2 – Context Awareness and Retention

 Stage 3 – Domain-Specific Expertise

 Stage 4 – Reasoning Machines

 Stage 5 – Self Aware Systems / Artificial General Intelligence (AGI)

 Stage 6 – Artificial Superintelligence (ASI)

 Stage 7 – Singularity and Transcendence

 Introduction to Emerging Technologies MODULE.pdf
Levels of AI……
 Types of AI
 Artificial Intelligence can be divided into various types, there
are mainly two types of the main categorization which are based
on capabilities and based on functionally of AI.
 Types of AI……
A. Based on Capabilities
 Weak AI or Narrow AI

 General AI
 Super AI:
B. Based on the functionality
 Reactive Machines
 Limited Memory
 Theory of Mind
Self-Awareness

Introduction to Emerging Technologies MODULE.pdf

 Influencers of artificial intelligence
The following are influencers of AI:

 Big data: Structured data versus unstructured data

 Advancements in computer processing speed and new

chip architectures

 Cloud computing

 The emergence of data science

38
 Applications of AI
Artificial Intelligence has various applications in today's
society

 AI in agriculture:

 Agriculture is an area that requires various resources,

labour, money, and time for the best result

 Now a day's agriculture is becoming digital, and AI is

emerging in this field

39
 Applications of AI
 AI in Healthcare:

 In the last, five to ten years, AI becoming more

advantageous for the healthcare industry and going to

have a significant impact on this industry

 Healthcare Industries are applying AI to make a better

and faster diagnosis than humans.

40
 Cont..
 AI in Finance and E-commerce

 The finance industry is implementing automation, adaptive

intelligence, algorithm trading, and machine learning into

financial processes.

 AI is providing a competitive edge to the e-commerce

industry, and it is becoming more demanding in the e-

commerce business.

 AI is helping shoppers to discover associated products with

recommended size, colour, or even brand.

41
 Cont..
 AI in Data Security:
 The security of data is crucial for every company and cyber-
attacks are growing very rapidly in the digital world.

 AI can be used to make your data more safe and secure.

 Some examples such as AEG bot, AI2 Platform, are used to

determine software bugs and cyber-attacks in a better way.

42
 Cont..
 AI in Social Media:

 Social Media sites such as Facebook, Twitter, and Snapchat

contain billions of user profiles, which need to be stored and

managed in a very efficient way.

 AI can organize and manage massive amounts of data.

 AI can analyse lots of data to identify the latest trends,

hashtags, and requirements of different users.

43
 Cont..
 AI in Travel &Transport:

 AI is capable of doing various travel related works such as

from making travel arrangements to suggesting the hotels,

flights, and best routes to the customers.

 Travel industries are using AI-powered chatbots which can

make human-like interaction with customers for a better

and fast response.

44
 Cont..
 AI in the Automotive Industry:

 Some Automotive industries are using AI to provide virtual

assistants to their use for better performance.

 Such as Tesla has introduced TeslaBot, an intelligent virtual

assistant.

 Various Industries are currently working for developing self-

driven cars which can make your journey more safe and
secure.

45
 Cont..
 AI in Robotics:
 Artificial Intelligence has a remarkable role in Robotics.

 Usually, general robots are programmed such that they can

perform some repetitive task,

 but with the help of AI, we can create intelligent robots

which can perform tasks with their own experiences without

pre-programmed.

 Humanoid Robots are the best examples for AI in robotics,

 recently the intelligent Humanoid robot named Erica and

Sophia has been developed which can talk and behave like
humans.
46
 AI tools and platforms
 The business has workflows that are repetitive, tedious and
difficult which tend to slow down production and also
increases the cost of operation.

 To bring down the costs of operation, businesses have no

option rather than automate some of the functions to cut down
the cost of production.

 By digitizing repetitive tasks, an enterprise can cut costs on

paperwork and labour which further eliminates human error
thus boosting efficiency leading to better results.

47
 Cont..
 AI platforms are defined as some sort of hardware architecture
or software framework (including application frameworks),
that allows the software to run.

 It involves the use of machines to perform the tasks that are

performed by human beings.

 Artificial intelligence (AI) platforms provide users a tool kit to

build intelligent applications.

 These platforms combine intelligent, decision-making

algorithms with data, which enables developers to create a
business solution.
48
 Cont..
 AI has developed a large number of tools to solve the most
difficult problems in computer science, like:

 Search and optimization

 Logic

 Probabilistic methods for uncertain reasoning

 Classifiers and statistical learning methods

 Neural networks

 Control theory

 Languages

49
 Cont..
 The most common artificial intelligence platforms include:

 Microsoft AZURE Machine Learning,

 Google Cloud Prediction API

 IBM Watson

 TensorFlow etc.

50
Quiz (10%)
 List advantage and disadvantage of AI?

 List some application of AI?

 Debre Birhan University
College of Engineering
Department of Electrical and Computer Eng.

Introduction
to
Emerging Technologies

Juhar M. (MSc in Communication Eng.)

Chapter 4: Internet of Things (IoT)
Outline
 Overview of IoT

 What is IoT

 Challenges of IoT

 How does it work?

 Architecture of IoT

 IoT Tools and Platforms

 Applications of IoT
 Overview of IoT
 The most important features of IoT include:

 artificial intelligence

 Connectivity

 Sensors

 Active engagement

 small device use

 Overview of
 Artificial Intelligence (AI)
IoT …
 IoT essentially makes virtually anything “smart”, meaning it
enhances every aspect of life with the power of data
collection, artificial intelligence algorithms, and networks.
• Connectivity
 New enabling technologies for networking and specifically
IoT networking, mean networks are no longer exclusively tied
to major providers.
• Sensors :IoT loses its distinction without sensors. They act as
defining instruments that transform IoT from a standard passive
network of devices into an active system capable of real-world
integration.
 Overview of IoT
 Active Engagement
 Much of today's interaction with connected technology
happens through passive engagement. IoT introduces a new
paradigm for active content, product, or service engagement.

• Small Devices –
 Devices, as predicted, have become smaller, cheaper, and more
powerful over time.

 IoT exploits purpose-built small devices to deliver its precision,

scalability, and versatility.
 What is IoT?
 IoT is the interaction of everyday object’s computing devices
through the Internet that enables the sending and receiving of
useful data.

 The term Internet of Things (IoT) according to the 2020

conceptual framework is expressed through a simple formula
such as:

IoT= Services+ Data+ Networks + Sensors

58
 Cont..
 Generally, The Internet of Things (IoT) is the network of
physical objects or "things" embedded with electronics,
software, sensors, and network connectivity, which enables
these objects to collect and exchange data.

 IoT is a system of interrelated computing devices, mechanical

and digital machines, objects, animals or people that are
provided with unique identifiers

 The ability to transfer data over a network without requiring

human-to-human or human-to-computer interaction.

59
 Cont..
 IoT is a network of devices that can sense, accumulate and transfer

data over the internet without any human intervention.

 The internet of things (IoT) has found its application in several areas

such as :

 connected industry,

 smart-city, smart-home, smart-energy

 connected car and smart agriculture,

 connected building and campus,

 health care and logistics,

60
 IoT − Advantages
 Improved Customer Engagement
 Technology Optimization
 Reduced Waste
 Enhanced Data Collection

61
 Challenges of IoT
 Security:
 IoT creates an ecosystem of constantly connected devices
communicating over networks.
 The system offers little control despite any security
measures.
 This leaves users exposed to various kinds of attackers.
 Privacy:
 The sophistication of IoT provides substantial personal data

in extreme detail without the user's active participation.

 Flexibility:

 Many are concerned about the flexibility of an IoT system to

integrate easily with another.

62
 Cont..
 Complexity:
 Some find IoT systems complicated in terms of design,
deployment, and maintenance given their use of multiple
technologies and a large set of new enabling technologies.
 Compliance:

 IoT, like any other technology in the realm of business, must

comply with regulations.

 Its complexity makes the issue of compliance seem

incredibly challenging when many consider standard

software compliance a battle.
63
 How does it work?
 An IoT ecosystem consists of web-enabled smart devices that use
embedded processors, sensors and communication hardware to
collect, send and act on data they acquire from their environments.
 IoT devices share the sensor data they collect by connecting to an IoT
gateway or another edge device where data is either sent to the cloud to
be analyzed or analyzed locally.
 The connectivity, networking and communication protocols used with
these web-enabled devices largely depend on the specific IoT
applications deployed
 Architecture of IoT
 The architecture of IoT devices comprises four major
components: sensing, network, data processing, and
application layers (as depicted in Figure below)

65
 Cont..
Sensing Layer:
 The main purpose of the sensing layer is to identify any
phenomena in the devices’ peripheral and obtain data from the
real world, and this layer consists of several sensors.
 Using multiple sensors for applications is one of the primary
features of IoT devices.
 Sensors in IoT devices are usually integrated through sensor
hubs.
 A sensor hub is a common connection point for multiple
sensors that accumulate and forward sensor data to the
processing unit of a device.
66
 Cont..
 Actuators can also intervene to change the physical conditions
that generate the data.

 An actuator might, for example, shut off a power supply, adjust

an airflow valve, or move a robotic gripper in an assembly
process.

 Sensors in IoT devices can be classified into three broad

categories as described below:

A. Motion Sensors: Motion sensors measure the change in

motion as well as the orientation of the devices.

67
 Cont..
 There are two types of motions one can observe in a
device: linear and angular motions.
 The linear motion refers to the linear displacement of an
IoT device while the angular motion refers to the
rotational displacement of the device.
B. Environmental Sensors: Sensors such as Light sensors,
Pressure sensors, etc. are embedded in IoT devices to sense the
change in environmental parameters in the device’s
peripheral.

68
 Cont..
 The primary purpose of using environmental sensors in IoT
devices is to help the devices to take autonomous decisions
according to the changes of a device’s peripheral.

 For instance, environment sensors are used in many

applications to improve user experience (e.g., home
automation systems, smart locks, smart lights, etc.).
C. Position sensors: Position sensors of IoT devices deal with
the physical position and location of the device.
 The most common position sensors used in IoT devices are
magnetic sensors and Global Positioning System (GPS)
sensors.
69
 Cont..
 Magnetic sensors are usually used as digital compass and help to fix
the orientation of the device display.
 On the other hand, GPS is used for navigation purposes in IoT
devices.

Network Layer
 The network layer acts as a communication channel to transfer
data, collected in the sensing layer, to other connected devices.
 In IoT devices, the network layer is implemented by using
diverse communication technologies (e.g., Wi-Fi, Bluetooth,
Zigbee, ZWave, LoRa, cellular network, etc.) to allow data flow
between other devices within the same network.
70
 Cont..
Data Processing Layer :
 The data processing layer consists of the main data processing
unit of IoT devices.

 The data processing layer takes data collected in the sensing

layer and analyses the data to make decisions based on the
result.

 This layer may share the result of data processing with other
connected devices via the network layer.

71
 Cont..
Application Layer:

 The application layer implements and presents the results of

the data processing layer to accomplish disparate applications
of IoT devices.

 The application layer is a user-centric layer that executes

various tasks for the users.

 There exist diverse IoT applications, which include smart

transportation, smart home, personal care, healthcare, etc.

72
 IoT Tools and Platforms
 There are many vendors in the industrial IoT platform
marketplace, offering remarkably similar capabilities and
methods of deployment.
 IoT platform –
KAA

Site where

Thing speak

Dives Hive

Zetta

Things Board
 Applications of IoT
Agriculture:
 For indoor planting, IoT makes monitoring and management
of microclimate conditions a reality, which in turn increases
production.

 For outside planting, devices using IoT technology can sense

soil moisture and nutrients, in conjunction with weather data,
better control smart irrigation and fertilizer systems.
Consumer Use
 For private citizens, IoT devices in the form of wearables and
smart homes make life easier.

74
 Cont..
Manufacturing
 The world of manufacturing and industrial automation is
another big winner in the IoT sweepstakes.

 RFID and GPS technology can help a manufacturer track a

product from its start on the factory floor to its placement in
the destination store, the whole supply chain from start to
finish.

 These sensors can gather information on travel time, product

condition, and environmental conditions that the product was
subjected to.

75
 Cont..
 Sensors attached to factory equipment can help identify
bottlenecks in the production line, thereby reducing lost time
and waste.
 Other sensors mounted on those same machines can also track
the performance of the machine, predicting when the unit will
require maintenance, thereby preventing costly breakdowns.
Transportation
 By this time, most people have heard about the progress being
made with self-driving cars.
 But that’s just one bit of the vast potential in the field of
transportation.
76
 Cont..
 The GPS, which if you think of it is another example of IoT, is
being utilized to help transportation companies plot faster

 There’s already significant progress made in navigation, once

again alluding to a phone or car’s GPS.

 But city planners can also use that data to help determine
traffic patterns, parking space demand, and road construction
and maintenance

77
 IoT Based Smart Home
 These “smart” devices have the potential to share information
with each other given the permanent availability to access the
broadband internet connection.

 Remote Control Appliances

 Weather

 Smart Home Appliances

 Safety Monitoring

 Intrusion Detection Systems

 Energy and Water Use

78
 IoT Based Smart City
 In cities, the development of smart grids, data analytics, and
autonomous vehicles will provide an intelligent platform to
deliver innovations in energy management, traffic
management, and security, sharing the benefits of this
technology throughout society.
 Structural Health: Monitoring of vibrations and material
conditions in buildings, bridges and historical monuments.
 Lightning: intelligent and weather adaptive lighting in
street lights.
 Safety: Digital video monitoring, fire control management,
public announcement systems.
79
 Cont..
 Transportation: Smart Roads and Intelligent High-ways with
warning messages and diversions according to climate
conditions and unexpected events like accidents or traffic jams.
 Smart Parking: Real-time monitoring of parking spaces
available in the city making residents able to identify and
reserve the closest available spaces,
 Green Houses: Control micro-climate conditions to maximize
the production of fruits and vegetables and its quality.
 Compost: Control of humidity and temperature levels in
alfalfa, hay, straw, etc. to prevent fungus and other microbial
contaminants.
80
 Cont..
 Animal Farming/Tracking: Location and identification of
animals grazing in open pastures or location in big stables,
Study of ventilation and air quality in farms and detection of
harmful gases from excrements.

 Offspring Care: Control of growing conditions of the

offspring in animal farms to ensure its survival and health.

 Field Monitoring: Reducing spoilage and crop waste with

better monitoring, accurate ongoing data obtaining, and
management of the agriculture fields, including better control
of fertilizing, electricity and watering.
81
 Chapter Four Review Questions
1 What are the main parts of the IoT system?
2. What are the security concerns related to IoT?
3. Explain IoT Protocol stack?
4. What is meant by a smart city regarding the IoT?
5. Give examples of the impact of IoT on our lives?
6. What influence will the IoT have on monetary growth?
7. Why will be the IoT successful in the coming years?
8. What impact will the IoT have on the health care sector?
9. What are the main social and cultural impacts of IoT?
10. What the main challenges of an IoT?
11. What role does the network play in the IoT of everything?
12. How wireless communication might affect the development
and implementations of IoT?
 Debre Birhan University
College of Engineering
Department of Electrical and Computer Eng.

Introduction
to
Emerging Technologies

Juhar M. (MSc in Communication Eng.)

 Chapter 5: Augmented Reality (AR)
 outline
 Overview of augmented reality

 Virtual reality (VR)

 Augmented Reality (AR) vs Mixed Reality (MR)

 The architecture of AR Systems

 Applications of AR Systems
 Overview of augmented reality

 is a form of emerging technology that allows users to overlay

computer generated content in the real world.

 refers to a live view of a physical real-world environment whose

elements are merged with augmented computer-generated
images creating a mixed reality.

 is the integration of digital information with the user's

environment in real-time.

 It uses the existing environment and overlays new information

on top of it.

86
 Cont..
 A live direct or indirect view of a physical, real-world
environment whose elements are augmented by computer-
generated sensory input such as sound, video, graphics or GPS
data.

Virtual reality (VR):

 VR is fully immersive, which tricks your senses into thinking

you’re in a different environment or world apart from the real
world.

 It is also called a computer-simulated reality.

87
 Cont..
 Advanced VR environment will engage all five senses (taste,
sight, smell, touch, sound),

 but it is important to say that this is not always possible

 The most advanced VR experiences even provide freedom of

movement – users can move in a digital environment and hear
sounds.

88
Augmented Reality vs. Virtual Reality

Augmented Reality Virtual Reality

 System augments the real world  Totally immersive environment
scene
 Senses are under control of
 User maintains a sense of
system
presence in real world
 Need a mechanism to feed
 Needs a mechanism to combine
virtual world to user
virtual and real worlds
 Hard to make VR world
 Hard to register real and virtual
interesting
 Cont..
Mixed Reality (MR):
 Mixed Reality (MR), sometimes referred to as hybrid reality,

 is the merging of real and virtual worlds to produce new

environments and visualizations where physical and digital
objects co-exist and interact in real-time.

 It means placing new imagery within a real space in such a way

that the new imagery is able to interact, to an extent, with what
is real in the physical world we know

90
 Cont..
 In mixed reality, you interact with and manipulate both
physical and virtual items and environments, using next-
generation sensing and imaging technologies.

 One of the most obvious differences among augmented reality,

virtual reality, and mixed reality is:

 the hardware requirements and also VR is content which is

100% digital and can be enjoyed in a fully immersive
environment,

91
 The architecture of AR Systems
 The first Augmented Reality Systems (ARS) were usually
designed with a basis on three main blocks,
 Infrastructure Tracker Unit,

 Processing Unit, and

 Visual Unit.

 The Infrastructure Tracker Unit was responsible for collecting

data from the real world, sending them to the Processing Unit,
which mixed the virtual content with the real content and sent
the result to the Video Out module of the Visual Unit.

92
Cont..

93
 Cont..
 The Visual Unit can be classified into two types of system,
depending on the followed visualization technology:

 Video see-through: It uses a Head-Mounted Display (HMD)

that employs a video-mixing and displays the merged images
on a closed-view HMD.

 Optical see-through: It uses an HMD that employs optical

combiners to merge the images within an open-view HMD.

94
 Combining the Real and Virtual Worlds
We need:
 Precise models

 Locations and optical properties of the viewer (or camera)

and the display
 Calibration of all devices

 To combine all local coordinate systems centered on the

devices and the objects in the scene in a global coordinate
system
 Combining the Real and Virtual Worlds

 Register models of all 3D objects of interest with their

counterparts in the scene
 Track the objects over time when the user moves and
interacts with the scene
 Realistic Merging

Requires:

 Objects to behave in physically plausible manners

when manipulated

 Occlusion

 Collision detection

 Shadows
 Display Technologies
 Monitor Based

 Laptops

 Cell phones

 Projectors (more Ubiquitous Computing)

 Head Mounted Displays:

 Video see-through

 Optical see-through
 Monitor Based Augmented Reality
 Simplest available

 Treat laptop/PDA/cell phone as a window through which you

can see AR world.

 Sunglasses demo
 Monitor Based AR
 Successful commercialization

 Yellow line in football broadcasts

 Glowing hockey puck

 Replace times square billboards with own commercials

during New Year’s Eve broadcasts

 Baseball cards

 Ad campaigns
Optical see-through HMD
Video see-through HMD
Advantages of Video see-through HMD

 Flexibility in composition strategies

 Real and virtual view delays can be matched
Advantages of Optical see-through HMD
 Simplicity
 Resolution
 No eye offset
 Applications of AR Systems
 One of the newest developing technologies is augmented reality
(AR),
 which can be applied to many different disciplines such as education,
medicine, entertainment, military, etc.
AR in education:
 allows flexibility in use that is attractive to education.
 AR technology can be utilized through a variety of mediums
including desktops, mobile devices, and smartphones.
 AR can be used to enhance content and instruction within the
traditional classroom, supplement instruction in the special
education classroom, extend content into the world outside the
classroom, and be combined with other technologies to enrich their
individual applications
105
 AR in education:
 More importantly, the following reasons for using augmented reality in
education:

 Affordable learning materials

 Interactive lessons
 Higher engagement
 Higher retention
 Boost intellectual curiosity
 Cont..
AR in Medicine:

 augmented reality has already made significant changes in the

following medical areas:

 surgery (minimally invasive surgery);

 education of future doctors;

 diagnostics;

 AR tools may also aid to detect the signs of depression and

other mental illnesses by reading from facial expressions, voice
tones, and physical gestures.

107
In medicine, AR has the following applications:

 Describing symptoms
 Nursing care
 Surgery
 Ultrasounds
 Diabetes management
 Navigation
 Generally, AR provides the following benefits to
patients and healthcare workers:

 Reduce the risks associated with minimally invasive surgery

 Better informed decisions about the right treatment and illness

prevention.

 Make procedures more tolerable.

 Better aftercare

 Medical training and education.

 Assistance in medical procedures and routine tasks

 AR In Entertainment
 Augmented reality can be used in various “entertainment” industries:

 AR in games

 AR in music

 AR on TV

 AR in eSports

 AR in the theater
Headsets, Glasses and
Devices
Oculus Rift
HTC Vive
Samsung Gear
Google Cardboard
Zeiss VR One and Zeiss VR
One GX
Sony PS4
Google Glass
Microsoft Holo lens
 Chapter Five Review Questions

1. what is augmented, virtual and mixed reality and its application?

2. what are good examples of augmented, virtual and mixed reality?

3. what is the difference between augmented, virtual and mixed reality?

4. How is augmented, virtual and mixed reality achieved?

5. What is the benefit of augmented, virtual and mixed reality?

6. How Can AR, VR, and MR improve engineering instructions?

7. Can VR be a substitute for Real Life Experience?

8. What is the impact of VR on Educational Learning rather than games?

9. What is the most technical challenge for MR?

THANK YOU!!!