Data Analytics with Python

Mathematical Computing Using NumPy

 Learning Objectives

By the end of this lesson, you will be able to:

Explain NumPy and its importance

Discuss the basics of NumPy, including its fundamental objects

Demonstrate how to create and print a NumPy array

Analyze and perform basic operations in NumPy

Utilize shape manipulation and copying methods

Demonstrate how to execute linear algebraic functions

Build basic programs using NumPy

NumPy
 Quick Recap: Lists

Below are some of the properties of lists:

List

Collection of values

Multiple types (heterogeneous)

Add, remove, update
 Limitations of Lists

Though you can change individual values in a list, you cannot apply a mathematical operation over the entire list.

Mathematical operation over the entire distance and time lists

Error
 Why NumPy?

Numerical Python (NumPy) supports multidimensional arrays over which you can easily apply mathematical operations.

Numpy

26 43 52

Arrays like lists, but BETTER

Import NumPy

Create “distance” and “time” NumPy arrays

Mathematical function applied over the entire “distance” and “time” arrays

Output
 NumPy: Overview

NumPy is the foundational package for mathematical computing in Python.

It has the following properties:

Supports fast and efficient

multidimensional arrays (ndarray)
Executes element-wise
computations and mathematical
calculations
Performs linear algebraic
operations, fourier transforms,
and random number generation

Has tools for reading or writing

array-based datasets to disk

Stores and manipulates data

efficiently

Has tools for integrating language

codes (C, C++)
 Properties of ndarray

An array in NumPy has the following properties:

Collection of values Multidimensional

Add, remove, change ndarray Mathematical function support

Single type (homogeneous) Fast and efficient

 Purpose of ndarray

The ndarray in Python is used as the primary container to exchange data between algorithms.

Algorithm

[1, 2, 1]

Question/Problem
[[ 1, 0, 0],
[ 0, 1, 2]]

Sharing
Data
([[ 2, 8, 0, 6],
Algorithm [ 4, 5, 1, 1],
[ 8, 9, 3, 6]])

ndarray

Write Program

Algorithm
 Types of Arrays

Arrays can be one-dimensional, two-dimensional, three-dimensional, or multidimensional.

One-Dimensional Array Two-Dimensional Array Three-Dimensional Array

Printed as rows Printed as matrices (2x3) Printed as list of matrices (3x3x3)

array([[[ 0, 1, 2],
1 axis [ 3, 4, 5],
array([5, 7,9]) array([[ 0, 1, 2], 2 axes
rank 1 [ 6, 7, 8]],
[ 5, 6, 7]]) rank 2
Length = 3 [[ 9, 10, 11],
3 axes
[12, 13, 14],
rank 3
Length = 3 [15, 16, 17]],

[[18, 19, 20],

5 7 9 0 1 2 [21, 22, 23],
y axis (0,0) (0,1) (0,2) [24, 25, 26]]])
0 1 2 5 6 7
x axis (1,0) (1,1) (1,2) y axis
Length = 3
x axis
x axis
z axis
Create and Print NumPy Arrays

Objective: Create the following types of NumPy arrays:

- One-dimensional array
- Array with zeros
- Array with ones
- Two-dimensional array
- Three-dimensional array

Access: To execute the practice, follow these steps:

• Go to the PRACTICE LABS tab on your LMS
• Click the START LAB button
• Click the LAUNCH LAB button to start the lab
 Class and Attributes of ndarray: .ndim

Numpy array class is ndarray, also referred to as numpy.ndarray. The attributes of ndarray are:

This refers to the number of axes (dimensions) of the array. It is also called the rank of the
ndarray.ndim array.

ndarray.shape

ndarray.size
Two axes or 2D array Three axes or 3D array

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .ndim

The array np_city is one-dimensional, while the array np_city_with_state is two-dimensional.

ndarray.ndim

ndarray.shape

ndarray.size

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .shape

Numpy array class is ndarray, also referred to as numpy.ndarray. The attributes of ndarray are:

This consists of a tuple of integers showing the size of the array in each dimension. The
ndarray.ndim length of the shape tuple is the rank or ndim.

ndarray.shape

2 rows, 3 columns 2 rows, 3 columns, 2 ranks

ndarray.size

Shape: (2, 3) Shape: (2, 3, 2)

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .shape

Numpy’s array class is “ndarray,” also referred to as “numpy.ndarray.” The attributes of ndarray are:

The shape tuple of both the arrays indicate their size along each dimension.
ndarray.ndim

ndarray.shape

ndarray.size

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .size

Numpy’s array class is “ndarray,” also referred to as “numpy.ndarray.” The attributes of ndarray are:

It gives the total number of elements in the array. It is equal to the product of the elements
ndarray.ndim of the shape tuple.

ndarray.shape

Array contains 6 elements Array contains 12 elements

ndarray.size

Array a = (2, 3) Array b = (2, 3, 2)

Size = 6 Size = 12

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .size

Numpy’s array class is “ndarray,” also referred to as “numpy.ndarray.” The attributes of ndarray are:

Look at the examples to see how shape tuples of the arrays are used to calculate their size.
ndarray.ndim

ndarray.shape

ndarray.size

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .dtype

Numpy’s array class is “ndarray,” also referred to as “numpy.ndarray.” The attributes of ndarray are:

It’s an object that describes the type of the elements in the array. It can be created or
ndarray.ndim specified using Python.

ndarray.shape

Array contains integers Array contains floats

ndarray.size Array a = [3, 7, 4] Array b = [1.3, 5.2, 6.7]

[2, 1, 0] [0.2, 8.1, 9.4]

[2.6, 4.2, 3.9]

[7.8, 3.4, 0.8]

ndarray.dtype
Concept Example
 Class and Attributes of ndarray: .dtype

Numpy’s array class is “ndarray,” also referred to as “numpy.ndarray.” The attributes of ndarray are:

Both the arrays are of string data type (dtype) and the longest string is of length 7, which is
ndarray.ndim Houston.

ndarray.shape

ndarray.size

ndarray.dtype
Concept Example
Operations
 Basic Operations

Using the following operands, you can easily apply various mathematical, logical, and comparison operations
on an array.

Mathematical Operations Logical Operations Comparison Operations

Addition + And & Greater >

Subtraction - Or | Greater or equal >=
Multiplication * Not ~ Less <
Division / Less or equal <=
Exponentiation ** Equal ==
Not equal !=
 Basic Operations: Example

NumPy uses the indices of the elements in each array to carry out basic operations. In this case, where we are
looking at a dataset of four cyclists during two trials, vector addition of the arrays gives the required output.

First trial

Second trial

Total distance

Array (First trial) Array (Second trial) Array (Total distance)

10 15 17 26 + 12 11 21 24 = 22 26 38 50

0 1 2 3 0 1 2 3

Index Index
Vector addition
Executing Basic Operations in NumPy Array

Objective: Create a NumPy array and perform the following basic operations:
- Mathematical operations
- Comparison operations
- Logical operations

Access: To execute the practice, follow these steps:

• Go to the PRACTICE LABS tab on your LMS
• Click the START LAB button
• Click the LAUNCH LAB button to start the lab
Performing Operations Using NumPy Array

Objective: Perform the following operations using NumPy array:

- Count the number of times each value appears in an array of integers
- Create a NumPy array [[0, 1, 2], [ 3, 4, 5], [ 6, 7, 8],[ 9, 10, 11]]) and filter the elements greater than five
- Create a NumPy array having NaN(Not a Number) and print it; also, print the same array omitting all
elements which are NaN
Example: array([ nan, 1., 2., nan, 3., 4., 5.])
- Create a 10x10 array with random values and find the minimum and maximum values

Access: To execute the practice, follow these steps:

• Go to the PRACTICE LABS tab on your LMS
• Click the START LAB button
• Click the LAUNCH LAB button to start the lab
Unassisted Practice: Operations Using NumPy Array

Counts the occurrence of each element

Output

Checks the elements greater than five

Output
Unassisted Practice: Operations Using NumPy Array

NumPy array with NaN

Eliminate the NaN from the array

Output

NumPy array of random values

Minimum and maximum value in the array

Output
 Accessing Array Elements: Indexing

You can access an entire row of an array by referencing its axis index.

1st set data 2nd set data

Create 2D array using cyclist trial data shown earlier

First trial data

Second trial data

2D array containing cyclists’ data

10 15 17 26 First trial (axis 0)

12 11 21 24 Second trial (axis 1)

 Accessing Array Elements: Indexing
You can refer the indices of the elements in an array to access them. You can also select a particular index of more
than one axis at a time.

First cyclist: first trial data

First cyclist: all trial data

(Use “:” to select all the rows of an array)

(0, 0) (0, 1) (0, 2) (0, 3) (0, 0) (0, 1) (0, 2) (0, 3)

Cyclist 1: first 10 15 17 26 Cyclist 1: all 10 15 17 26
trial data trials data
12 11 21 24 12 11 21 24
(1, 0) (1, 1) (1, 2) (1, 3) (1, 0) (1, 1) (1, 2) (1, 3)
 Accessing Array Elements: Slicing

Use the slicing method to access a range of values within an array.

Shape of the array

10 15 17 26
2 rows
Shape of the array 12 11 21 24

4 columns

Slicing the array

Use “:” to
10 15 17 26
select all rows 12 11 21 24

Slicing the array data [ : , 1 : 3] 0 1 2 3

where 1 is inclusive but 3 is not
Starting Ending
index (1) index (2)
 Accessing Array Elements: Iteration

Use the iteration method to go through each data element present in the dataset.

Iterate with “for loop”

through the entire
dataset

Iterate with “for loop” through

the “two cyclist” datasets
 Indexing With Boolean Arrays

Boolean arrays are useful when you need to select a dataset according to a set criteria.

Here, the original dataset contains test scores of two students. A Boolean array is used
to choose only the scores that are above a given value.
Test scores

Student 1 83 71 57 63 83 71 57 63
Student 2 54 68 81 45 54 68 81 45
Test score > 60
Test 1 Test 2 Test 3 Test 4

Set the passing score

Shows data elements which fit the

criteria (Boolean array)
Send passing score as an argument to test scores object
 Copy and Views

When working with arrays, data is copied into new arrays only in some cases.
Following are the three possible scenarios:

In this method, a variable is directly assigned the value of another variable. No new copy is made.

Simple Assignments

Original dataset

View or Shallow Copy

Assigned dataset

Shows both objects are the same

Deep Copy
 Copy and Views

A view, also referred to as a shallow copy, creates a new array object.

Simple Assignments
Original dataset

View or Shallow Copy Change value in “view” object

Original dataset
Deep Copy
changed
 Copy and Views

Copy is also called deep copy because it entirely copies the original dataset. Any change in the copy
will not affect the original dataset.

Simple Assignments
Shows copy and original
object are different

Shows copy object data is not

owned by the original dataset

View or Shallow Copy Change value in copy

Copy object changed

Original dataset
Deep Copy retained
Demonstrate the Use of Copy and Views

Objective: Demonstrate how the following copies and views are generated from a memory location:
- Simple Assignment
- View or Shallow Copy
- Deep Copy

Access: To execute the practice, follow these steps:

• Go to the PRACTICE LABS tab on your LMS
• Click the START LAB button
• Click the LAUNCH LAB button to start the lab
 Universal Functions (ufunc)

NumPy provides useful mathematical functions called universal functions. These functions operate element-wise on
an array, producing another array as output. Some of these functions are:

sqrt function provides the square sqrt cos function gives cosine values for all
root of every element in the array. elements in the array.
cos

floor
floor function returns the largest exp exp function performs exponentiation
integer value of every element in the
on every element in the array.
array.
ufunc: Examples

Numbers for which square root will be calculated

Square root values

Import pi*

Trigonometric functions

Return the floor of the input element-wise

Exponential functions for complex

mathematical calculations
 Shape Manipulation

You can use certain functions to manipulate the shape of an array.

The shape of an array can be changed according to the requirement using the NumPy library functions.

1 2 3
1 2 3 4 5 6 7 8 9 4 5 6
7 8 9

1 2 3
4 5 6
7 8 9

Array shape Data

manipulation Wrangling
methods
 Shape Manipulation

Some common methods for manipulating shapes are:

Flatten

Split Resize
Shape
Manipulation

Stack Reshape
Manipulate the Shape of an Array

Objective: Use common manipulation functions like ravel, reshape, resize, hsplit, and hstack to manipulate
the shape of a NumPy array.
Access: To execute the practice, follow these steps:
• Go to the PRACTICE LABS tab on your LMS
• Click the START LAB button
• Click the LAUNCH LAB button to start the lab
 Broadcasting

NumPy uses broadcasting to carry out arithmetic operations between arrays of different shapes. In this method,
NumPy automatically broadcasts the smaller array over the larger array.

array_a

2 3 5 8
Element-wise
multiplication
0.3 0.3 0.3 0.3
array_b

array_a
2 3 5 8
Broadcasting
0.3
scalar_c

If the shape doesn’t match with array_a, NumPy doesn’t have to create copies of scalar values.
Instead, broadcast scalar value over the entire array to find the product.
 Broadcasting: Constraints

Though broadcasting can help carry out mathematical operations between different-shaped arrays, they are subject
to certain constraints as listed below:

• When NumPy operates on two arrays, it compares their

shapes element-wise. It finds these shapes compatible
only if:
• Their dimensions are the same or
• One of them has a dimension of size 1
• If these conditions are not met, a ValueError is thrown,
indicating that the arrays have incompatible shapes.
 Broadcasting: Example

Let’s look at an example to see how broadcasting works to calculate the number of working hours of a worker per
day in a certain week.

Week one earnings

Week two earnings

Element-wise operation

Total earning for 2 weeks

Calculate week one hours

Hourly wage

Number of working hours

per day in week one
 Linear Algebra: Transpose

NumPy can carry out linear algebraic functions as well. The transpose() function can help you interchange rows as
columns, and vice-versa.

transpose()
Axis 1 Axis 1
83 71 57 63
54 68 81 45
Axis 0
Axis 0
 Linear Algebra: Inverse and Trace Functions

Using NumPy, you can also find the inverse of an array and add its diagonal data elements.

np.linalg.inv()

Inverse of the given array

* Can be applied only on a square matrix

np.trace()

Sum of diagonal elements “10” and “31”

 Key Takeaways

You are now able to:

Explain NumPy and its importance

Discuss the basics of NumPy, including its fundamental objects

Demonstrate how to create and print a NumPy array

Analyze and perform basic operations in NumPy

Utilize shape manipulation and copying methods

Demonstrate how to execute linear algebraic functions

Build basic programs using NumPy

Knowledge Check
Knowledge
Check
Which of the following arrays is valid?
1

a. [1, 0.3, 8, 6.4]

b. [“Lucy”, 16, “Susan”, 23, “Carrie”, 37]

c. [True, False, “False”, True]

d. [3.14j, 7.3j, 5.1j, 2j]

 Knowledge
Check
Which of the following arrays is valid?
1

a. [1, 0.3, 8, 6.4]

b. [“Lucy”, 16, “Susan”, 23, “Carrie”, 37]

c. [True, False, “False”, True]

d. [3.14j, 7.3j, 5.1j, 2j]

The correct answer is d

A NumPy ndarray can hold only a single data type, which makes it homogenous. NumPy supports integers, floats, Booleans,
and even complex numbers. Of all the options provided, only the array containing complex numbers is homogenous. All the
other options contain more than one data type.
Knowledge
Check Which function is most useful to convert a multidimensional array into a one-dimensional
array?
2

a. ravel()

b. reshape()

c. resize() and reshape()

d. All of the above

 Knowledge
Check Which function is most useful to convert a multidimensional array into a one-dimensional
array?
2

a. ravel()

b. reshape()

c. resize() and reshape()

d. All of the above

The correct answer is a

The function ravel() is used to convert a multidimensional array into a one-dimensional array. Though reshape() also functions
in a similar way, it creates a new array instead of transforming the input array.
Knowledge
Check
The np.trace() method gives the sum of _____.
3

a. the entire array

b. the diagonal elements from left to right

c. the diagonal elements from right to left

d. consecutive rows of an array

 Knowledge
Check
The np.trace() method gives the sum of _____.
3

a. the entire array

b. the diagonal elements from left to right

c. the diagonal elements from right to left

d. consecutive rows of an array

The correct answer is b

The trace() function is used to find the sum of the diagonal elements in an array. It is carried out in an incremental order of the
indices. Therefore, it can only add diagonal values from left to right and not vice-versa.
Knowledge
Check
The function np.transpose() when applied on a one-dimensional array gives _____.
4

a. a reverse array

b. an unchanged original array

c. an inverse array

d. all elements with zeros

 Knowledge
Check
The function np.transpose() when applied on a one-dimensional array gives _____.
4

a. a reverse array

b. an unchanged original array

c. an inverse array

d. all elements with zeros

The correct answer is b

Transposing a one-dimensional array does not change it in any way. It returns an unchanged view of the original array.
 Country GDP

Evaluate the dataset containing the GDPs of different countries to:

• Find and print the name of the country with the highest GDP
• Find and print the name of the country with the lowest GDP
• Print out text and input values iteratively
• Print out the entire list of the countries with their GDPs
• Print the highest GDP value, lowest GDP value, mean GDP value,
standardized GDP value, and the sum of all the GDPs
 Olympic 2012 Medal Tally

Evaluate the dataset of the Summer Olympics, London 2012, to:

• Find and print the name of the country that won maximum number
of gold medals
• Find and print the countries who won more than 20 gold medals
• Print the medal tally
• Print each country name with the corresponding number of gold
medals
• Print each country name with the total number of medals won
Thank You