Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
What is Problem?
A problem is a question to which we seek an answer.
Examples
Sorting - Sort a list S of n numbers in non-decreasing order
Searching - Determine whether the number x is in a list S of n numbers.
Shortest Path – Find shortest path between two nodes in a graph
Fibonacci Number - What is the 25 Fibonacci number?
and many more
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
Many of us start writing a computer program directly
Program
Programming
Problem Language
Statement Statements
C/C++
you can’t start writing a computer program directly, Because Statements
In case of inefficient, incorrect computer program
Create Destroy Create Destroy etc.
You can’t construct anything on trial and error basis.
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
You have to go through design and analysis phase
Algorithm Design and Analysis
Program
Analysis 1
Analysis 2
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
C/C++
Statements
If you want to solve the problem, the next step is DESIGNING.
Algorithmic Problem Solving Algorithms: Introduction
Why Algorithm Design ?
When we faced with a problem, the first thing we should do is
Draw a sketch of how we can solve the problem
The next step towards solving the problem is developing the algorithm.
Thinking algorithmically is a necessary step towards solving a problem by computer
As there can be more than one algorithm to solve the same problem.
problem
and
Algorithms for the same problem can be based on very different ideas and can solve the
problem with dramatically different speeds.
So,
We will select the best among them.
1
Algorithmic Problem Solving Algorithms: Introduction
Why Algorithm Design ?
There can be more than one algorithm to solve the same problem.
problem
EXAMPLE
Problem: Sorting
Algorithms
Insertion Sort
Bubble Sort Brute force
Selection Sort
Merge Sort Divide & Conquer
Quick Sort etc.
And we are concerned with a good algorithm.
1
Algorithmic Problem Solving Algorithms: Introduction
Why Algorithm Design ?
Good algorithm designers understand several fundamental algorithm design techniques,
including
Techniques (Problem Solving Strategies)
Brute Force
es
Divide and Conquer e c hni q u
t
o r th es e
Dynamic Programming
ble to f
aila
e av
Greedy Algorithms
hms ar
alg orit
Back Tracking
i c ie nt
Eff
Branch and Bounds
The knowledge of these problem solving strategies prevent us from investigating newer
strategy for our problem.
Problem can be designed by any one of the these techniques.
1
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
Algorithm Design and Analysis
Program
Analysis 1
Analysis 2
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Statements
Back Tracking,
Branch and Bounds etc.
We can find the resemblance of our problem with the problems that have been solved
using these techniques, so we can apply the same problem solving strategy to solve our
problem.
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer t ness
ec
Corr
is
t ste p
Algorithm Design and Analysis nex
The
Program
Analysis 1
Analysis 2
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Statements
Back Tracking,
Branch and Bounds etc.
Algorithmic Problem Solving Algorithms: Introduction
Why Correctness of Algorithm ?
Once the algorithm has been specified, you have to prove its correctness.
Algorithm yields a correct result for every legitimate input .
and
A correct Algorithm must terminate in a finite amount of time.
An incorrect algorithm
might halt with an incorrect answer, or
might not halt at all on some input instances
Algorithmic Problem Solving Algorithms: Introduction
Why Correctness of Algorithm ?
EXAMPLE
Greatest Common Divisor : (Consecutive Integer Checking Algorithm)
GCD ( m , n )
t = min(m, n)
while (t<=0) {
if (m % t = 0){
This algorithm does not work correctly when one
if (n % t = 0) of its input numbers is zero.
return t;
}
t = t – 1;
}
Observation:
An incorrect algorithm may work correctly for majority of inputs but crash on some
boundary value.
Algorithmic Problem Solving Algorithms: Introduction
Greatest Common Divisor (GCD):
Example: Find the greatest common divisor of 60, 24 The largest integer that divides both
numbers evenly
As we want Greatest Divisor
Solution: Start from 24
Obviously, such a common divisor can not be greater than the smaller of these numbers
60 mod 24 0 60 mod 19 0 60 mod 14 0
60 mod 23 0 60 mod 18 0 60 mod 13 0
60 mod 22 0 60 mod 17 0 60 mod 12 0
60 mod 21 0 60 mod 16 0
60 mod 20 0 60 mod 15 0 12 is the divisor of 60
20 is the divisor of 60 15 is the divisor of 60 Now check for 24
Now check for 24 Now check for 24 24 mod 12 0
24 mod 20 0 24 mod 15 0 12 is GCD
Algorithmic Problem Solving Algorithms: Introduction
Incorrect Algorithm
if we want to find GCD of (6,0),
Example: Find the greatest common divisor of 60, 24
It fails to produce correct result.
GCD(6,0):
6 mod 0 (Crash)
Solution:
Obviously, such a common divisor can not be greater than the smaller of these numbers
60 mod 24 0 60 mod 19 0 60 mod 14 0
60 mod 23 0 60 mod 18 0 60 mod 13 0
60 mod 22 0 60 mod 17 0 60 mod 12 0
60 mod 21 0 60 mod 16 0
60 mod 20 0 60 mod 15 0 12 is the divisor of 60
20 is the divisor of 60 15 is the divisor of 60 Now check for 24
Now check for 24 Now check for 24 24 mod 12 0
24 mod 20 0 24 mod 15 0 12 is GCD
Algorithmic Problem Solving Algorithms: Introduction
Why Correctness of Algorithm ?
Why it is necessary ?
Imagine what will happen if the computer inside missile has an program implemented by
using incorrect algorithm due to which missile strike your own city rather than the enemy
site.
In applications like
atomic power plants
Industrial safety systems
program correctness has to be guaranteed.
1
Algorithmic Problem Solving Algorithms: Introduction
One cannot demonstrate the correctness
by simply taking each of the possible input data, feeding it to the program, and
showing that the result is correct.
Tracing the algorithm’s correctness for a few specific inputs is not sufficient
you have to prove it for every input instance.
One of the most difficult requirement to satisfy is to show that a program works correctly,
outputting results in complete range of data.
How can computer programmer be sure that program is correct, without exhaustive
testing.
Rigorous Proof: Mathematical Induction
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer of n
a s e
e s ig
C tD
In e c
n c orr
I
Algorithm Design and Analysis
Try Another Design Model Program
Analysis 1
Analysis 2
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Mathematical Statements
Back Tracking, Induction
Branch and Bounds etc.
Algorithmic Problem Solving Algorithms: Introduction
r ithm
Solving a Problem With a Computer lg o
i ngA
al ys
n
is A
t step
Algorithm Design and Analysis nex
Try Another Design Model The Program
Analysis 1
Analysis 2
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Mathematical Statements
Back Tracking, Induction
Branch and Bounds etc.
Algorithmic Problem Solving Algorithms: Introduction
Why Analysing Algorithms ?
Suppose a program runs for 4 hours, has not generated any result,
We do not know, either
It is inefficient and simply consuming time or
It is incorrect and is looping indefinitely,
We simply abort the program. Those 4 hours of computer time is lost.
To avoid this situation, we have to analyse the algorithm before constructing the program.
We have to find time complexity of the algorithm.
Time Complexity - an analysis of the time required to solve a problem
1
Algorithmic Problem Solving Algorithms: Introduction
Why Analysing Algorithms ?
Time Complexity - an analysis of the time required to solve a problem
After finding the time complexity, you have to see it
Is it to give solution to the problem in reasonable time or not ?
If solution to the problem obtained in reasonable time and there are more than one
solution exist then decide which one is the best.
If not, then change your strategy (try for another solution)
1
Algorithmic Problem Solving Algorithms: Introduction
Case 1:
If solution to the problem obtained in reasonable time and there are more than one solution
exist
EXAMPLE:
Describe the algorithm for finding the maximum value in a finite sequence of integer.
Algorithm 1 Algorithm 2
Algorithm maximum (a1, a2, a3, . . . , an) Algorithm maximum (A)
max = a1 for j = 2 to n // Using Insertion Sort
for i = 2 to n key = A[ j ]
if max < i then i=j–1
max = ai while i > 0 and A[ i ] > key
return max A[ i+1 ] = A[ i ]
i=i–1
A[ i+1 ] = key
Time Complexity: n comparisons
return A[size-1]
Conclusion: Algorithm 1 is better. Time Complexity: n2 comparisons
1
Algorithmic Problem Solving Algorithms: Introduction
Case 2:
If solution is not obtained in reasonable time, change your strategy (try for another solution)
EXAMPLE: ( Divide and Conquer )
Fibonacii Number
Algorithm: Time Complexity > 2n/2
int fib ( int n ){
if (n ≤ 1)
return n;
else
return fib(n-1) + fib(n-2);
}
Takes
40,000 years to compute 200th term.
(which is intolerable compared with a human life span)
1
Algorithmic Problem Solving Algorithms: Introduction
Case 2:
If solution is not obtained in reasonable time, change your strategy (try for another solution)
EXAMPLE: ( Dynamic Programming )
Fibonacii Number
Algorithm: Time Complexity: n+1
int fib2 ( int n ) {
int i; int f[0..n];
f[0] = 0; Takes
if (n > 0) 201 nanoseconds to compute 200th term.
f[1]=1; (which is quite reasonable – highly efficient)
for ( i=2; i<=n; i++)
f[i] = f[i-1] + f[i-2];
}
return f[n];
} 1
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
Algorithm Design and Analysis
Try Another Design Model Program
Analysis 1
Analysis 2
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Mathematical Time Complexity Statements
Back Tracking, Induction
Branch and Bounds etc.
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer s e of
e si g
n
C a D
In i ent
n e ffic
I
Algorithm Design and Analysis
Try Another Design Model Program
Analysis 1
Analysis 2 Efficient
And
Programming
Correctness Correct
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Mathematical Time Complexity Statements
Back Tracking, Induction
Branch and Bounds etc.
Try Another Design Model Now you can start
Implementation
Choose data structure appropriate for the algorithm
Data Structures
Sometimes linked list version run longer than array in implementation
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer s e of
e si g
n
C a D
In i ent
n e ffic
I
Algorithm Design and Analysis
Try Another Design Model Program
Analysis 1
Analysis 2 Efficient
And
Programming
Correctness Correct
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
(Development of Model) C/C++
BF, D&C, DP, Greedy, Mathematical Time Complexity Statements
Back Tracking, Induction
Branch and Bounds etc.
Try Another Design Model Program
Algorithm Data Structures
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
Try Another Design Model
Program
Programming
Correctness
Problem Algorithm Analysing Language
of
Statement Design Algorithm Statements
Algorithm
C/C++
Statements
Try Another Design Model
Algorithmic Problem Solving Algorithms: Introduction
Solving a Problem With a Computer
Program
Exact
Programming
Vs Algorithm Correctness
Problem Analysing Language
Approximate Design of
Statement Algorithm Statements
Design Algorithm
Technique
C/C++
Statements
Thank You
