CLOUD COMPUTING Provisioned by the Service Provider Adopted

from: Effectively and Securely Using the Cloud

WEEK 13 IT ELEC 111
Computing Paradigm by peter Mell, Tim Grance
WHAT IS CLOUD COMPUTING?
Cloud Definition By NIST
Cloud Computing is a general term used to
The U.S. National Institute of Standards and
describe a new class of network based computing
Technology (NIST) defines cloud computing as:
that takes place over the Internet,
• Cloud computing is a model for enabling
basically a step on from Utility Computing
ubiquitous, convenient, on-demand network access
a collection/group of integrated and networked to a shared pool of configurable computing
hardware, software and Internet infrastructure resources (e.g., networks, servers, storage,
(called a platform). applications, and services) that can be rapidly
provisioned and released with minimal
Using the Internet for communication and
management effort or service provider interaction.
transport provides hardware, software and
networking services to clients Cloud characteristics

These platforms hide the complexity and details Rapid elasticity

of the underlying infrastructure from users and
You can go from 5 servers to 50 or from
applications by providing very simple graphical
50 servers to 5
interface or API (Applications Programming
Interface). Measured service
What is Cloud Computing? You pay for what you use
In addition, the platform provides on demand On-demand self-service
services, that are always on, anywhere, anytime
You get elasticity automatically
and any place.
Ubiquitous network access
Pay for use and as needed, elastic
You can access the cloud from anywhere
scale up and down in capacity and functionalities
Location-independent resource pooling
The hardware and software services are available
to You work with virtual machines that
could be hosted anywhere
general public, enterprises, corporations and
businesses markets

Shared pool of configurable computing resources

On-demand network access
 Hosts guest operating systems (Virtual
Machines) using one or more VM
hypervisors
Resource interface depends on the type of
cloud (horizontal/vertical cloud)
Storage nodes
Compute nodes only provide temporary
storage space for users/applications
Storage nodes provide long term data
storage solutions
Can be mapped to specific processes
CLOUD COMPONENTS running on compute

3 components TYPES OF CLOUDS

Clients Public Cloud

Datacenter -Marketed based on

Distributed servers Resources offered, availability,

security, price
Clients
Local/Private Cloud
Mobile
-Cloud architectures tailored to an organization’s
-SmartPhones, Tablets, Service Hubs
needs.
Thin
Hybrid Cloud
-no internal hard drives, lets servers do all work,
-Combination of public and local cloud resources.
displays info
Thick
-Laptops, desktop computers
Which is the best?
-Thin - lower costs, security, power consumption,
easy to replace, less noise
DATA CENTER
Data Center – facility used to house computer
systems and associated components
DISTRIBUTED SERVERS Machines in the cloud
Servers host the resources needed by cloud users Can I move my VM elsewhere?
Compute nodes Storage in the cloud
Provides CPU, Memory, Scratch Storage, Can I move my data elsewhere?
and Networking resources through
Databases in the cloud
virtualized interfaces.
Can I move my data elsewhere?
 Applications in the cloud Mobile software
Can I run my application elsewhere? Mobile communication
There are four basic things people are doing in Refers to the infrastructure put in place to ensure
the cloud: that seamless and reliable communication goes on.
Machines in the cloud These would include devices such as protocols,
services, bandwidth, and portals necessary to
Storage in the cloud
facilitate and support the stated services.
Databases in the cloud
Mobile communications refers to a form of
Applications in the cloud communications which does not depend on a
physical connection between the sender and
In addition to these four basics, cloud providers
receiver. It facilitates the users to move from one
offer other services such as message queues and
physical location to another during communication.
data mining All of these things are lumped into the
generic term “cloud computing” Mobile hardware
Mobile Application Includes mobile devices or device components
that receive or access the service of mobility.
There are TWO aspects of mobile computing
They would range from portable laptops,
User mobility :- User communicate "anytime",
smartphones, tablet Pc's, Personal Digital
Anywhere, with anyone.
Assistants.
Device Portability:- Device can be connected
These devices will have a receptor medium that
anytime, anywhere to network
is capable of sensing and receiving signals.
Mobile computing systems
• These devices use an existing and established
Mobile computing systems are computing systems network to operate on. a wireless network
that may be easily moved physically and whose
• These devices are configured to operate in full
computing capabilities may be used while they are
duplex, (they are capable of sending and receiving
being moved.
signals at the same time)..
Examples are laptops, personal digital assistants
Mobile software
(PDAs), and mobile phones.
Is the actual program that runs on the mobile
HOW TO DISTINGUISH MOBILE
hardware.
COMPUTING SYSTEMS FROM OTHER
COMPUTING SYSTEMS A mobile Software, most commonly referred to
as an app, is a type of application software designed
Tasks that they are designed to perform,
to run on a mobile device, such as a smartphone or
The way that they are designed, tablet computer.

The way in which they are operated. Mobile Software frequently serve to provide
users with similar services to those accessed on
these added functionalities are the reason for
PCs.
separately characterizing mobile computing
systems.
THE CONCEPTS OF MOBILE COMPUTING
The main concept of mobile computing involves
Mobile communication Network
Mobile hardware
WEEK 15 AND 16 ELEC112
LECTURE 1: INTRODUCTION TO AI, DEEP
LEARNING AND MACHINE LEARNING
What is artificial intelligence?
Artificial intelligence is the ability of a computer to
perform tasks commonly associated with
intelligent beings.
What is machine learning?
Machine learning is the study of algorithms that
learn from examples and experience instead of
relying on hard-coded rules and make predictions
on new data.
What is deep learning?
Deep learning is a subfield of machine learning • Many different kinds exist
focusing on learning data representations as
• densely connected
successive layers of increasingly meaningful
representations. • convolutional
Main types of machine learning • recurrent
• Supervised learning • pooling, flattening, merging, normalization,
• Unsupervised learning etc.
• Self-supervised learning • Input: one or more tensors
• Reinforcement learning output: one or more tensors
Fundamentals of machine learning • Usually have a state, encoded as weights
Data • learned, initially random
• Humans learn by observation and unsupervised • When combined, form a network or a model
learning
Input data and targets
• model of the world / common sense reasoning
• The network maps the input data X to predictions
• Machine learning needs lots of (labeled) data to Y′
compensate
• During training, the predictions Y′ are compared
• Tensors: generalization of matrices to n to true targets Y using the loss function
dimensions (or rank, order, degree)
• The quantity to be minimized (optimized) during
• 1D tensor: vector training
• 2D tensor: matrix • the only thing the network cares about
• 3D, 4D, 5D tensors • there might also be other metrics you care about
• numpy.ndarray(shape, dtype) • Common tasks have “standard” loss functions:
• Training – validation – test split (+ adversarial • mean squared error for regression
test)
• binary cross-entropy for two-class classification
• Minibatches
• categorical cross-entropy for multi-class
• small sets of input data used at a time classification
• usually processed independently • etc
Deep learning Optimizer
Anatomy of a deep neural network • How to update the weights based on the loss
function
• Layers
• Learning rate (+scheduling)
• Input data and targets
• Stochastic gradient descent, momentum, and their
• Loss function
variants
• Optimizer
• RMSProp is usually a good first choice
Layers
• more info
• Data processing modules
Deep learning frameworks
• Actually tools for defining static or dynamic
general-purpose computational graphs
• Automatic differentiation
• Seamless CPU / GPU usage
• multi-GPU, distributed
• Python/numpy or R interfaces
• instead of C, C++, CUDA or HIP
• Open source
• Keras is a high-level neural networks API
• we will use TensorFlow as the compute backend
• included in TensorFlow 2 as tf.keras
•https://keras.io/ ,
https://www.tensorflow.org/guide/keras
• PyTorch is:
• a GPU-based tensor library
• an efficient library for dynamic neural networks
• https://pytorch.org/

WEEK 17 ELEC 112

LECTURE 9: VIRTUAL AND AUGMENTED

ENVIRONMENTS FOR DESIGN DR.
XIANGYU WANG

Outline

• Mixed Reality (MR) ‘

– Virtual Reality (VR)

– Augmented Reality (AR)

– Augmented Virtuality (AV)

Mixed Reality

• Mixed Reality (MR) is a term that has been used

to refer to the entire spectrum of situations that span
the continuum between virtual reality and actual
reality.

Mixed Reality Continuum

• Mixed reality includes augmented reality, • Projection-Based Systems: A front-projected or
augmented virtuality, and other mixed rear-projected system in which the user is
configurations. surrounded by images, projected onto large screens,
create high immersion sense.
Virtual Reality
• Blue-c system by ETH institutes: collaborative
• What is “Virtual Reality”? virtual reality

– Brooks (1999) defines it as: “[an] experience .. in • Workbenches: flat, rear-projection screens that
which the user is effectively immersed in a display images in stereo, and can be set up in a
responsive virtual world” … horizontal or tilted position, create partially
immersion and high object presence.
– Sherman and Craig (2003) defines it as a medium
composed of interactive computer simulations that • Hot Open Challenges:
sense the participant’s position and actions and
replace or augment the feedback to one or more – Interactive more effectively with virtual worlds:
senses, giving the feeling of being mentally
immersed or present in the simulation (a virtual • Manipulation
world)
• Wayfinding
– Immersive, Semi-immersive, Non-immersive
– Measuring the illusion of presence
• Four Key Elements in Experiencing Virtual
Video for Virtual Reality
Reality
• Video: Collaborative Immersive Networked
– A virtual world an imaginary space, often (but not
Environments (CINE)
necessarily) realized through a medium (rendering
pipeline, display, etc.) – http://www.youtube.com/watch?v=mVQrhsjOl
wU
– Immersion (physical and mental) having a sense
of “presence” within an environment; this can be Augmented Reality
purely a mental state, or can be accomplished
through physical means. • Augmented Reality (AR) is a technology or an
environment where the additional information
• Mental Immersion: a state of being deeply generated by a computer is inserted into the user’s
engaged, with suspension of disbelief. view of real world scene.
• Physical Immersion: bodily/physically entering • The augmenting information may consist of
into a projected area virtual geometric objects placed into the
environment, or a display of non-geometric
– Sensory feedback: visual/aural/haptic feedback
information about existing real objects such as
to a participant
distribution of room temperature.
– Interactivity: in a virtual reality experience,
• Optical see-through: Partly transmissive optical
participants are able to move around and change
combiners are placed in front of the user’s eyes,
their viewpoint, generally through movements of
allowing the user to see in them the reflection of
their head.
virtual images portrayed on miniature displays in
• VR Technology: Displays their line of sight.

– Head Mounted Displays: Tiny displays, mounted • Uses miniature cameras to capture the view of the
on the head, fully immersive, needs tracker to track world that would be seen by each eye. The video
the position and orientation of user’s head images of the real world are then combined with
the computer- generated images of the virtual • AV describes all the cases where the real object is
world, to create augmented-reality images that can inserted into a computer-generated environment.
be displayed on a traditional (non see-through)
HMD • A system in which real multi-sensory input is
provided, which supplements the visually
AR Applications presented virtual environment.

• Applications of Augmented Reality • Examples of AV

– Medical: Display of acquired data from – Visual example

ultrasound, superimposed over the live patient
• Insert real video stream (e.g., video conferencing)
– Goal - to facilitate minimally invasive operations into virtual environment
such as fine needle biopsies, and laproscopic
surgeries – Olfactory example

Augmented Reality in Cooperative Design • Directing the smell of coffee grounds to a user
when s/he passes near a virtual coffee maker in the
• Collaborative Virtual Environment virtual environment

Mixed Reality view through head- mounted display – Haptic example

MRCVE collaboration scenario • Turning on a heat lamp over the user when s/he
approaches a spot in the virtual environment that is
• AR-based Videoconferencing exposed to full sun
• Turning on a fan in front of the user when s/he
Video for Augmented Reality
approaches a spot in the virtual environment that is
• Video: Magicbook exposed to wind

–http://www.hitlabnz.org/wiki/Video_- Augmented Virtuality in Cooperative Design

_MagicBook
• AV-based videoconferencing Video for
• Video Augmented Virtuality

-\ARTennis • Video: CARPE (Tangible Teleconferencing) a

good example for distributed Augmented
–http://www.hitlabnz.org/wiki/Video_- Virtuality environment
_AR_Tennis
– http://www.hitlabnz.org/wiki/Video-_CARPE
• Video: AR for Urban Design

–http://www.hitlabnz.org/wiki/Video_-
AR_Urban_Design

• Video: Shared Design Space (tangible

interaction)

–
http://www.youtube.com/watch?v=kS_G4WLhw
ZU

Augmented Virtuality