Introduction

Applied Numerical Methods and

Programming in Engineering
Lecture Plan
Week Topic
1 Introduction
2 MATLAB Fundamentals
3 Modeling & Error Analysis
4 Structured Programming in MATLAB
5 Roots – Bracketing Methods
6 Roots – Open Methods
7 Systems of Equations
8 Curve Fitting – Linear Regression
9 Numerical Integration Formulas
10 Numerical Integration of Functions
11 Numerical Differentiation
12 Ordinary Differential Equations
13 Systems of ODEs

DR. MOHAMAD A. ALKHALIDI 2

Grade Distribution
a. Course Work 30%
– Graded Lab Activities 15%
– Assignments 5%
– Quizzes 10%

b. Term Exams 30%

c. Final Exam 40%

DR. MOHAMAD A. ALKHALIDI 3

Textbooks
APPLIED NUMERICAL METHODS WITH MATLAB: A PRACTICAL INTRODUCTION
MATLAB FOR ENGINEERS AND TO PROGRAMMING AND PROBLEM
SCIENTISTS SOLVING

DR. MOHAMAD A. ALKHALIDI 4

Exams
› 1st Term Exam Saturday 22 May 2021 (10:00-11:30)

› 2nd Term Exam Sunday 20 June 2021 (18:00-19:30)

› Final Exam Saturday 03 July 2021 (17:00-19:00)

DR. MOHAMAD A. ALKHALIDI 5

Quizzes
› Q01 (Online) – Vectors & Matrices Saturday 24 April 2021 (21:00-21:15)

› Certificate: MATLAB Onramp Saturday 01 May 2021

› Quiz 02 (Online) – Structured Programming Saturday 08 May 2021 (21:00-21:15)

› Certificate: MATLAB Fundamentals Saturday 15 May 2021

› Quiz03 (Online) – Systems of Equations Saturday 29 May 2021 (21:00-21:15)

› Quiz04 (Online) – Linear Regression Saturday 05 June (19:00-19:15)

› Quiz05 (Online) – Integration Formulas Saturday 12 June 2021 (19:00-19:15)

DR. MOHAMAD A. ALKHALIDI 6

01: Introduction & MATLAB Fundamentals
› What is the definition of
numerical methods?
– Numerical Methods are
Mathematical techniques
(Algorithms) used solve
mathematical and
engineering problems.
› A numerical method most
likely will produce an
approximate solution.

DR. MOHAMAD A. ALKHALIDI 7

01: Introduction & MATLAB Fundamentals
› What are the advantages of using numerical methods to
obtain engineering solutions?
– Time efficient and accurate. Numerical methods produce fast and
excellent approximation to the analytical/real solutions.
– Provide solution to problems that have no or hard to obtain analytical
solution.
– Provide information regarding the approximation error.
› In this course you will learn the basics of numerical methods
+ how to use computer programing to solve mathematical
problems numerically.
› We will focus on the Programing language MATLAB to apply
the methods and techniques that will be covered in this
course.

DR. MOHAMAD A. ALKHALIDI 8

01: Introduction & MATLAB Fundamentals
› What are the steps you must follow to solve engineering
problems?
Describe the problem

Build your model and test

Get the solution and test it

Apply your solution

DR. MOHAMAD A. ALKHALIDI 9

01: Introduction & MATLAB Fundamentals
› Computers:

DR. MOHAMAD A. ALKHALIDI 10

01: Introduction & MATLAB Fundamentals
› Computers:
– Central Processing Unit (CPU):The core that processes data and executes
tasks.

– Random Access Memory (RAM): A temporary storage space used by the CPU
while it’s working. The RAM content is deleted when the computer is turned
off or an application terminates.

DR. MOHAMAD A. ALKHALIDI 11

01: Introduction & MATLAB Fundamentals
› Computers:
– Storage (internal and external): Store the operating system, software, and
data.

DR. MOHAMAD A. ALKHALIDI 12

01: Introduction & MATLAB Fundamentals
› Computers:
– Computer operations:
› Receive input, data, or information from mouse, keyboard, screen, etc.
› Process the input, data, or information
› Produce output
› Store output

DR. MOHAMAD A. ALKHALIDI 13

01: Introduction & MATLAB Fundamentals
› Computers:
– Supercomputers:
› Supercomputers are very fast computers that has large memory and too
many processors.

› They are thousands of time faster than personal computers.

› They are featured with high performance multiple cores and need to be in
large, clean, and cool places

DR. MOHAMAD A. ALKHALIDI 14

01: Introduction & MATLAB Fundamentals
› Computers:
– Supercomputers:
› They are used to solve problems that require very intensive and multi tasks
and computations that are too difficult for standard computers. Examples
of Supercomputer uses are:
– Computational Science
– Ocean, climate, and weather forecast numerical models,
– Oil and Gas Exploration,
– credit card transaction processing, and
– Automobile and airplanes modeling and design
› Supercomputers have thousands of gigabytes of primary storage and
many terabytes of secondary storage

DR. MOHAMAD A. ALKHALIDI 15

01: Introduction & MATLAB Fundamentals
› Computers:
– Supercomputers:
› Disadvantages of supercomputers:
– Require large space,
– Require large power supply, and
– Require very efficient cooling system
› Storage Units – Bit, Byte, Nibble

DR. MOHAMAD A. ALKHALIDI 16

01: Introduction & MATLAB Fundamentals
› Software:
– Computer software, or simply software, is a collection of data
or computer instructions that tell the computer how to work.
– In computer science and software engineering, all
information processed by computer systems, programs and
data.
– Computer software includes computer programs, libraries
and related non-executable data, such as online
documentation or digital media.
– Computer hardware and software require each other, and
neither can be realistically used on its own.

DR. MOHAMAD A. ALKHALIDI 17

01: Introduction & MATLAB Fundamentals
› Software:
– System Software Operating Systems
(OS) are responsible for managing
and controlling all of the
computer’s hardware
– Application Software allows the user
to perform tasks to solve problems,
such as creating documents,
managing finances, or editing
images.

DR. MOHAMAD A. ALKHALIDI 18

01: Introduction & MATLAB Fundamentals
› Programming Languages:
– Programming language is a tool that is used to instruct a
computer to perform a task.
– It is a set of rules that provides a way of writing instructions that
instructs a computer on what operations to perform.
– Using programming language, we can let the PC to:
› Read/accept Input data
› Calculate or compare
› Store data
› Write or display Output and communication messages.

DR. MOHAMAD A. ALKHALIDI 19

01: Introduction & MATLAB Fundamentals
› Programming Languages:
– Programming refers to the process of writing computer programs
using a programming language
– Computer programming languages are governed by the structure
and syntax.
› Computer being a machine are receptive to only the exact syntax rules of
the language being used.

DR. MOHAMAD A. ALKHALIDI 20

01: Introduction & MATLAB Fundamentals
› Programming Languages:
– Programming languages can be classified into two broad
categories namely:
a. Low level languages; further classified into two generations
namely:
i. First Generation - Machine languages
ii. Second Generation - Assembly languages
b. High-level languages; further classified into three generations
namely:
i. Third Generation - Procedural languages
ii. Fourth Generation - Problem-oriented languages
iii. Fifth Generation - Natural languages

DR. MOHAMAD A. ALKHALIDI 21

01: Introduction & MATLAB Fundamentals
› Programming Languages:
– Programming languages can be classified into two broad
categories namely:
a. Low level languages; further classified into two generations
namely:
i. First Generation - Machine languages
ii. Second Generation - Assembly languages
b. High-level languages; further classified into three generations
namely:
i. Third Generation - Procedural languages
ii. Fourth Generation - Problem-oriented languages
iii. Fifth Generation - Natural languages

DR. MOHAMAD A. ALKHALIDI 22

01: Introduction & MATLAB Fundamentals
› MACHINE LANGUAGES (1GL)
– This is the oldest form of computer programming.
– Plug boards were used to represent data in binary (machine) form in the
computer circuitry.
– Data represented in 1s and 0s are said to be written in machine language. For
example, the code below represent a segment of a machine code:
1011010100
1010111101
1000100100
– Machine language also varies according to make of computer– another
characteristic that make them hard to work with.

DR. MOHAMAD A. ALKHALIDI 23

01: Introduction & MATLAB Fundamentals
› ASSEMBLY LANGUAGES (2GL)
– Assembly language use mnemonics such as ADD that are
automatically converted to the appropriate sequence of 1s and
0s by a translator called assembler.
– Compared to machine languages, assembly languages are much
easier for humans to understand and to use. The machine
language code we gave above could be expressed in assembly
languages as:
› ADD 210(8,13),02B(4,7)
› PACK 218(8,13),02F(4,7)
› MP 212(6,13),21D(3,13)

DR. MOHAMAD A. ALKHALIDI 24

01: Introduction & MATLAB Fundamentals
› Advantages of low-level programming languages
1. They are executed very fast since no translator or minimum
translation is involved.
2. They require very little memory space.
3. They have a high level of security since a program written in machine
language is difficult to change or alter
› Disadvantages of low-level programming languages
1. Machine languages are time-consuming because the binary code
instructions are complex.
2. They are difficult to understand.
3. They are difficult to debug and hence difficult to maintain.
4. They are not portable i.e., can only be used by specific computers.
DR. MOHAMAD A. ALKHALIDI 25
01: Introduction & MATLAB Fundamentals
› PROCEDURAL LANGUAGES (3GL)
– Procedural languages, also known as third generation languages
uses human like language. They are intended to solve general
problems. Examples of procedural languages are C, Pascal,
FORTRAN, COBOL, etc.
– Like assembly languages, procedural languages must be
translated into machine language so that the computer
processes it. Depending on the language this translation is
performed by either a compiler or an interpreter.

DR. MOHAMAD A. ALKHALIDI 26

01: Introduction & MATLAB Fundamentals
› High level languages-Translators
– A compiler converts the programmer's procedural language
program, called the source code, into a machine language called
the object code.
› This object code can then be saved and run later. Examples of procedural
languages using compilers are the standard version of PASCAL, COBOL,
and FORTRAN.
– An interpreter converts the Procedural languages one
statement at a time into machine code just before it is to be
executed. No object code is saved. An example of procedural
language using an interpreter is the standard version of BASIC.

DR. MOHAMAD A. ALKHALIDI 27

01: Introduction & MATLAB Fundamentals
› Processing a High Level Language Program:
– Source program created with an editor
– Source code translated into machine language by compiler
› Results in a . obj file (object code)
– Linker combines common library routines with object code
› Results in a .exe file (executable code)

› Loader brings executable code into memory and it is run

DR. MOHAMAD A. ALKHALIDI 28

01: Introduction & MATLAB Fundamentals
› PROBLEM ORIENTED LANGUAGES (4GL)
– Unlike general purpose languages, problem-oriented languages are designed
to solve specific problems. While 3rd GLs focus on procedures and how a
program will accomplish a specific task, 4th GLs are non-procedural and focus
on specifying what the program is to accomplish. 4th GLs are more English-
like, easier to program, and widely used by non-programmers .
– Some of these 4th GLs, are used for very specific applications.
– 4th GLs includes query languages e.g., SQL and application generators e.g.,
Visual Basic.

DR. MOHAMAD A. ALKHALIDI 29

01: Introduction & MATLAB Fundamentals
› NATURAL PROGRAMMING LANGUAGES (5 GL)
– As they have evolved through the generations, computer languages have
become more human-like. Clearly, the fourth-generation query languages
using commands that include words like SELECT, FROM and WHERE, is much
more human-like than the 0s and 1s of machine languages. However, 5th GLs
are still long way from natural languages such as English and Spanish that
people use.

– The standard definition of a 5th GL is a computer language that incorporates

the concepts of artificial intelligence to allow direct human communication.
Examples are PROLOG, LISP etc. Additionally, these languages would enable
a computer to run and to apply new information as people do. Rather than
coding by keying in specific commands we would communicate more directly
to a computer using natural languages or human languages such as English
or Spanish

DR. MOHAMAD A. ALKHALIDI 30

01: Introduction & MATLAB Fundamentals
› Advantages of high-level languages
– English-like phrasing of high-level languages makes them easy to understand.
– High level languages are portable i.e., they are transferable from one
computer to another.
– They are user-friendly and easy to use and learn.
– They are more flexible; hence they enhance creativity of the programmer and
increase productivity in the workplace.
– High level languages are far much easier to debug.
› Disadvantages of high-level languages
– Their nature encourages loading of instructions in a word or statement hence
the complexity of these instructions cause slower program processing.
– They must be interpreted or compiled for translation to machine language
before the computer can trace them.

DR. MOHAMAD A. ALKHALIDI 31

01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– MATLAB® is a programming platform designed specifically for
engineers and scientists. The heart of MATLAB is the MATLAB
language, a matrix-based language allowing the most natural
expression of computational mathematics.

DR. MOHAMAD A. ALKHALIDI 32

01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– What can you do with MATLAB?
› Using MATLAB, you can:
– Analyze data
– Develop algorithms
– Create models and applications
› The language, apps, and built-in math functions enable you to quickly
explore multiple approaches to arrive at a solution.
› MATLAB lets you take your ideas from research to production by deploying
to enterprise applications and embedded devices, as well as integrating
with Simulink® and Model-Based Design.

› Source: https://www.mathworks.com/discovery/what-is-
matlab.html
DR. MOHAMAD A. ALKHALIDI 33
01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– MATLAB Environment:

•Click on the link below to

watch a very useful video
Working in the Development
Environment

DR. MOHAMAD A. ALKHALIDI 34

01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– Command Window:
› You can execute commands by entering them in the command window after the MATLAB prompt (>>) and
pressing the Enter key. For example:
– >> 3*5
– ans =
› 15
› Unless otherwise specified, MATLAB stores calculations in a variable named ans.
– >> 7 + 3
– ans =
› 10
› To assign a variable to the execution, type the variable name before the "=" sign:
– >> m = 3*5
– m=
› 15
– The equals sign (=) in MATLAB is the assignment operator, meaning that the expression on the right of the
equals sign is assigned to the variable on the left.
– When you enter x = 3 + 4, MATLAB first evaluates 3 + 4 and then assigns the result (7) to the variable x
› Notice that the Workspace window (on the right) shows all the variables currently in the workspace.

DR. MOHAMAD A. ALKHALIDI 35

01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– Command Window:
› Adding a semicolon (;) to the end of a command will suppress the output,
though the command will still be executed, as you can see in the
workspace. When you enter a command without a semicolon at the end,
MATLAB displays the result in the command prompt.
– For example, enter k = 8 - 2; with a semicolon at the end. The result won't
appear in the command prompt, but you can see the value in the Workspace
window.
› You can recall previous commands by pressing the Up-arrow key on your
keyboard.
› When you enter just a variable name at the command prompt, MATLAB
returns the current value of that variable.

DR. MOHAMAD A. ALKHALIDI 36

01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– Naming Variables:
› You can name your MATLAB variables anything you'd like as long as
– they start with a letter and
– contain only letters, numbers, and underscores (_).
– MATLAB variables are also case sensitive.
– Example: Assign 8 to the variable a, -2 to the variable A, and
calculate the average of a and A. Assign the results to the
variable AvgAa:

DR. MOHAMAD A. ALKHALIDI 37

01: Introduction & MATLAB Fundamentals
› MATLAB FUNDAMENTALS:
– Naming Variables:
› You can save variables in your workspace to a MATLAB specific file format
called a MAT-file using the save command.
› To save the workspace to a MAT-file named filename.mat, use the
command:
– >> save filename
› You can remove all variables from your workspace by typing "clear" in
Command Window.
› You can load variables from a MAT-file using the load command;
– >> load filename

DR. MOHAMAD A. ALKHALIDI 38

01: Introduction & MATLAB Fundamentals
› MATLAB Operators and Special Characters:
– Arithmetic Operators

DR. MOHAMAD A. ALKHALIDI 39

01: Introduction & MATLAB Fundamentals
› MATLAB Operators and Special Characters:
– Relational Operators

– Logical Operators

DR. MOHAMAD A. ALKHALIDI 40

01: Introduction & MATLAB Fundamentals
› MATLAB Operators and Special Characters:
– Operator Precedence:
a. Parentheses ()
b. Transpose (.'), power (.^), complex conjugate transpose ('), matrix power
(^)
c. Multiplication (.*), right division (./), left division (.\), matrix multiplication
(*), matrix right division (/), matrix left division (\)
d. Addition (+), subtraction (-)
› For full operator Precedence list go to
https://www.mathworks.com/help/matlab/matlab_prog/operator-
precedence.html#:~:text=MATLAB%20always%20gives%20the%20%26%20ope
rator,containing%20combinations%20of%20%26%20and%20%7C%20.

DR. MOHAMAD A. ALKHALIDI 41

01: Introduction & MATLAB Fundamentals
› MATLAB Operators and Special Characters:
– MATLAB Formatting Command

DR. MOHAMAD A. ALKHALIDI 42

02: Introduction to Numerical Methods
› A SIMPLE MATHEMATICAL MODEL:
– Mathematical modeling is simply transforming a physical (real)
problem , design, or process to mathematical formulation or
equations.
› It has significant applications in engineering, science, and even in human
sciences:
– Example:
› Mathematical model: Develop a mathematical model to calculate the rate
of change of water liquid depth.
𝑑𝑑 𝐴𝐴𝐴𝐴
= 3𝑄𝑄 sin2 𝑡𝑡 − 𝑄𝑄
⏟
𝑑𝑑𝑑𝑑
𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖𝑖 𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂𝑂
𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐𝑐 𝑖𝑖𝑖𝑖 𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣𝑣 𝑑𝑑𝑑𝑑 𝑄𝑄 2 𝑄𝑄
= 3 sin 𝑡𝑡 −
𝑑𝑑𝑑𝑑 𝐴𝐴 𝐴𝐴

DR. MOHAMAD A. ALKHALIDI 43

02: Introduction to Numerical Methods
› A SIMPLE MATHEMATICAL MODEL:
– Models can be represented by a functional relationship between
dependent variables, independent variables, parameters, and forcing
functions.

– Dependent variable - a characteristic that usually reflects the behavior

or state of the system
– Independent variables - dimensions, such as time and space, along
which the system’s behavior is being determined
– Parameters - constants reflective of the system’s properties or
composition
– Forcing functions - external influences acting upon the system

DR. MOHAMAD A. ALKHALIDI 44

02: Introduction to Numerical Methods

DR. MOHAMAD A. ALKHALIDI 45

02: Introduction to Numerical Methods
› Engineering Problem Solving:

DR. MOHAMAD A. ALKHALIDI 46

02: Introduction to Numerical Methods
› Knowledge and understanding are prerequisites for the effective
implementation of any tool.
› Computers are particularly useless without a fundamental
understanding of how engineering systems work.
› Objectives of this course:
– Introduce mathematical modeling and its role in engineering problem solving
– Illustrate how numerical methods figure in the process
› The topics to be covered in this course are
– Roots of Equations
– Linear Algebraic Equations
– Curve Fitting
– Differentiation and Integration
– Ordinary Differential Equations
– Partial Differential Equations

DR. MOHAMAD A. ALKHALIDI 47

02: Introduction to Numerical Methods
› Introductory Example: In this example we will compare an
exact solution with numerical (approximate) solution:
– Falling Parachutist Example: A parachutist of mass 68.1 kg jumps
out of a stationary hot air balloon. Compute the velocity for the
first 12 s of free fall. Determine the terminal velocity that will be
attained for an infinitely long cord. The drag coefficient is equal
to 0.25 kg/s. The analytical solution is given by:
Exact solution, Dt = 2 s
t (s) v (m/s)
0 0.00
2 18.73
4 33.11
6 42.08
8 46.96
10 49.42
12 50.62

DR. MOHAMAD A. ALKHALIDI 48

02: Introduction to Numerical Methods
– Falling Parachutist Example:
› Numerical Solution: The first step to develop a numerical model is to
understand the physical meaning of the problem:
– We have a parachutist who is falling due to a net downward force.
– The first question we ask ourselves is what is the relationship between the fall
velocity of the parachutist and the net downward force?
› Off course we will think first of Newton second law of motion; F = ma, where
F is the net downward force, m is the mass of the object (in our case is the
parachutist mass), and a is the acceleration of the velocity.
– The second question we will ask is what is how can we develop a mathematical
model using this equation that relates the falling velocity the net force?
𝐹𝐹
› The Newton's second law can be rewritten as 𝑎𝑎 = , in this case a is the
𝑚𝑚
dependent variable, F is the forcing function, and m is a parameter.
– Now we have a mathematical equation that describes a natural process,
and it represents an idealization and simplification of reality.

DR. MOHAMAD A. ALKHALIDI 49

02: Introduction to Numerical Methods
› Falling Parachutist Example:
– Still, we need to introduce the velocity to our mathematical
model since we are interested in calculating the velocity at
different times.
› We know that the acceleration is the rate of change of velocity overtime.
𝑑𝑑𝑑𝑑 𝐹𝐹
So, we can write = .
𝑑𝑑𝑑𝑑 𝑚𝑚
› For a body falling within the vicinity of the earth, the net force is composed
of two opposing forces: the downward pull of gravity FD and the upward
force of air resistance FU.; 𝐹𝐹𝐷𝐷 = 𝑚𝑚𝑚𝑚 and 𝐹𝐹𝑈𝑈 = −𝑐𝑐𝐷𝐷 𝑣𝑣 2 . Now we have
a numerical mathematical model in the form:

DR. MOHAMAD A. ALKHALIDI 50

02: Introduction to Numerical Methods
› Falling Parachutist Example:

DR. MOHAMAD A. ALKHALIDI 51

02: Introduction to Numerical Methods
› Falling Parachutist Example:
– It is important that you realize that you need an initial value to
start with your solution.
› At t = 0, v = 0
› At t = 2, v = 0 + [9.81 - (0.25/68.1)*0](2 - 0) = 18.73 m/s
› At t = 4, v = 18.73 + [9.81 - (0.25/68.1)*18.732](4 - 2) = 33.11 m/s
› At t = 6, v = 33.11 + [9.81 - (0.25/68.1)*33.112](6 - 4) = 42.08 m/s
› At t = 8, v = 42.08 + [9.81 - (0.25/68.1)*42.082](8 - 6) = 46.96 m/s
› At t = 10, v = 46.96 + [9.81 - (0.25/68.1)*46.962](10 - 8) = 49.42 m/s
› At t = 12, v = 49.42 + [9.81 - (0.25/68.1)*49.422](12 - 10) = 50.62

DR. MOHAMAD A. ALKHALIDI 52

02: Introduction to Numerical Methods
› Falling Parachutist Example:

DR. MOHAMAD A. ALKHALIDI 53

02: Introduction to Numerical Methods
› Falling Parachutist Example:

DR. MOHAMAD A. ALKHALIDI 54

02: Introduction to Numerical Methods
› Falling Parachutist Example:

DR. MOHAMAD A. ALKHALIDI 55

02: Introduction to Numerical Methods
› Falling Parachutist Example:
60.00

50.00

40.00
v (m/s)

30.00

20.00

10.00

0.00
0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 10 10.5 11 11.5 12
t (s)

DR. MOHAMAD A. ALKHALIDI 56