Design and Analysis of Algorithms 2015

DESIGN AND ANALYSIS OF ALGORITHMS

UNIT-I
________________________________________________________________________________
INTRODUCTION:
Algorithm,pseudocode for expressing algorithms,performance analysis- Time complexity and space
complexity, asymptotic noatation- O notation Omega notation and Theta notation and little on
notation,probabilistic analysis,amortized complexity.
DIVIDE AND CONQUER:
General Method, applications-Binary search,merge sort, quick sort, strassen’s matrix multiplication.
___________________________________________________________________________________-

P.Harikrishna Assistant Professor CSE Dept MRCET Page 1

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 2

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 3

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 4

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 5

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 6

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 7

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 8

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 9

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 10

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 11

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 12

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 13

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 14

Design and Analysis of Algorithms 2015

Divide and conquer

P.Harikrishna Assistant Professor CSE Dept MRCET Page 15

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 16

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 17

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 18

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 19

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 20

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 21

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 22

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 23

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 24

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 25

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 26

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 27

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 28

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 29

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 30

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 31

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 32

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 33

Design and Analysis of Algorithms 2015

Worst case

Strassen matrix multiplication

P.Harikrishna Assistant Professor CSE Dept MRCET Page 34

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 35

Design and Analysis of Algorithms 2015

P.Harikrishna Assistant Professor CSE Dept MRCET Page 36

Design and analysis of algorithms
2015 2015

UNIT-2

Efficient non recursive tree traversal algorithms

Non recursive Inorder traversal algorithm

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 1

Design and analysis of algorithms
2015 2015

Non recursive preorder traversal algorithm

Non recursive postorder traversal algorithm

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 2

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 3

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 4

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 5

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 6

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 7

Design and analysis of algorithms
2015 2015

Graph Traversals

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 8

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 9

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 10

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 11

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 12

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 13

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 14

Design and analysis of algorithms
2015 2015

Prims algorithm

1. Start with a tree which contains only one node.

2. Identify a node (outside the tree) which is closest to the tree and add the minimum weight edge from that
node to some node in the tree and incorporate the additional node as a part of the tree.
3. If there are less then n – 1 edges in the tree, go to 2

T = a spanning tree containing a single node s;

E = set of edges adjacent to s;
while T does not contain all the nodes {
remove an edge (v, w) of lowest cost from E
if w is already in T then discard edge (v, w)
else {
add edge (v, w) and node w to T
add to E the edges adjacent to w
}
}

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 15

Design and analysis of algorithms
2015 2015

Time complexity is O(n2) time.

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 16

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 17

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 18

Design and analysis of algorithms
2015 2015

return max;

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 19

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 20

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 21

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 22

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 23

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 24

Design and analysis of algorithms
2015 2015

P.HARIKRISHNA Assistant professor CSE Dept MRCET Page 25

Design and analysis of algorithms UNIT-3

UNIT-3 NOTES

Greedy method

P.Harikrishna Assistant Professor CSE Department MRCET Page 1

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 2

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 3

Design and analysis of algorithms UNIT-3

Time complexity is

P.Harikrishna Assistant Professor CSE Department MRCET Page 4

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 5

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 6

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 7

Design and analysis of algorithms UNIT-3

Algorithm:

Time complexity is O(n).

P.Harikrishna Assistant Professor CSE Department MRCET Page 8

Design and analysis of algorithms UNIT-3

Minimum weight is 7

P.Harikrishna Assistant Professor CSE Department MRCET Page 9

Design and analysis of algorithms UNIT-3

Prims algorithm

Time complexity=

n=number of nodes

P.Harikrishna Assistant Professor CSE Department MRCET Page 10

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 11

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 12

Design and analysis of algorithms UNIT-3

Cost=14

P.Harikrishna Assistant Professor CSE Department MRCET Page 13

Design and analysis of algorithms UNIT-3

Cost=17

P.Harikrishna Assistant Professor CSE Department MRCET Page 14

Design and analysis of algorithms UNIT-3

Kruskal algorithm

P.Harikrishna Assistant Professor CSE Department MRCET Page 15

Design and analysis of algorithms UNIT-3

Time complexity=O(E log V)

E is total number of edges.

V=total number of vertices.

n=number of nodes

P.Harikrishna Assistant Professor CSE Department MRCET Page 16

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 17

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 18

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 19

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 20

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 21

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 22

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 23

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 24

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 25

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 26

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 27

Design and analysis of algorithms UNIT-3

Time complexity

P.Harikrishna Assistant Professor CSE Department MRCET Page 28

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 29

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 30

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 31

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 32

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 33

Design and analysis of algorithms UNIT-3

Time complexity

P.Harikrishna Assistant Professor CSE Department MRCET Page 34

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 35

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 36

Design and analysis of algorithms UNIT-3

m1=1,m2=2,m3=2 as a solution to reliability design.

P.Harikrishna Assistant Professor CSE Department MRCET Page 37

Design and analysis of algorithms UNIT-3

Optimal binary search tree

P.Harikrishna Assistant Professor CSE Department MRCET Page 38

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 39

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 40

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 41

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 42

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 43

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 44

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 45

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 46

Design and analysis of algorithms UNIT-3

P.Harikrishna Assistant Professor CSE Department MRCET Page 47

Design and analysis of algorithms UNIT-3

Previous papers questions

P.Harikrishna Assistant Professor CSE Department MRCET Page 48

Design and analysis of algorithms UNIT-4

UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 1

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 2

Design and analysis of algorithms UNIT-4

N-Queen’s Problem

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 3

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 4

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 5

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 6

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 7

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 8

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 9

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 10

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 11

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 12

Design and analysis of algorithms UNIT-4

Branch & Bound (B & B) is general algorithm (or Systematic method) for finding optimal
solution of various optimization problems, especially in discrete and combinatorial
optimization.
 The B&B strategy is very similar to backtracking in that a state space tree is used to solve
a problem.
 The differences are that the B&B method
 Does not limit us to any particular way of traversing the tree.
 It is used only for optimization problem
 It is applicable to a wide variety of discrete combinatorial problem.
 B&B is rather general optimization technique that applies where the greedy method &
dynamic programming fail.
 It is much slower, indeed (truly), it often (rapidly) leads to exponential time complexities
in the worst case.
 The term B&B refers to all state space search methods in which all children of the “E-
node” are generated before any other “live node” can become the “E-node”
 Live node is a node that has been generated but whose children have not yet been
generated.
 E-nodeis a live node whose children are currently being explored.
 Dead node is a generated node that is not to be expanded or explored any further. All
children of a dead node have already been expanded.

 Two graph search strategies, BFS & D-search (DFS) in which the exploration of a new
node cannot begin until the node currently being explored is fully explored.
 Both BFS & D-search (DFS) generalized to B&B strategies.
 BFSlike state space search will be called FIFO (First In First Out) search as the list of
live nodes is “First-in-first-out” list (or queue).
 D-search (DFS) Like state space search will be called LIFO (Last In First Out) search
as the list of live nodes is a “last-in-first-out” list (or stack).
 In backtracking, bounding function are used to help avoid the generation of sub-trees that
do not contain an answer node.
 We will use 3-types of search strategies in branch and bound
1) FIFO (First In First Out) search

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 13

Design and analysis of algorithms UNIT-4

2) LIFO (Last In First Out) search

3) LC (Least Count) search

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 14

Design and analysis of algorithms UNIT-4

FIFO B&B:
FIFO Branch & Bound is a BFS.
In this, children of E-Node (or Live nodes) are inserted in a queue.
Implementation of list of live nodes as a queue
 Least() Removes the head of the Queue
 Add() Adds the node to the end of the Queue

Assume that node ‘12’ is an answer node in FIFO search, 1st we take E-node has ‘1’

LIFO B&B:
LIFO Brach & Bound is a D-search (or DFS).
In this children of E-node (live nodes) are inserted in a stack
Implementation of List of live nodes as a stack
 Least() Removes the top of the stack
 ADD()Adds the node to the top of the stack.

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 15

Design and analysis of algorithms UNIT-4

Least Cost (LC) Search:

The selection rule for the next E-node in FIFO or LIFO branch and bound is sometimes
“blind”. i.e., the selection rule does not give any preference to a node that has a very good
chance of getting the search to an answer node quickly.

The search for an answer node can often be speeded by using an “intelligent” ranking
function. It is also called an approximate cost function “Ĉ”.
Expended node (E-node) is the live node with the best Ĉ value.
Branching: A set of solutions, which is represented by a node, can be partitioned into
mutually (jointly or commonly) exclusive (special) sets. Each subset in the partition is
represented by a child of the original node.
Lower bounding: An algorithm is available for calculating a lower bound on the cost of any
solution in a given subset.

Each node X in the search tree is associated with a cost: Ĉ(X)

C=cost of reaching the current node, X(E-node) form the root + The cost of reaching an
answer node form X.
Ĉ=g(X)+H(X).

Example:
8-puzzle

Cost function: Ĉ = g(x) +h(x)

where h(x) = the number of misplaced tiles

and g(x) = the number of moves so far

Assumption: move one tile in any direction cost 1.

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 16

Design and analysis of algorithms UNIT-4

Note: In case of tie, choose the leftmost node.

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 17

Design and analysis of algorithms UNIT-4

Travelling Salesman Problem:

Def:- Find a tour of minimum cost starting from a node S going through other nodes
only once and returning to the starting point S.

Time Conmlexity of TSP for Dynamic Programming algorithm is O(n22n)

B&B algorithms for this problem, the worest case complexity will not be any better than
O(n22n) but good bunding functions will enables these B&B algorithms to solve some
problem instances in much less time than required by the dynamic programming alogrithm.

Let G=(V,E) be a directed graph defining an instances of TSP.

Let Cij cost of edge <i, j>

Cij =∞ if <i, j> ∉ E

|V|=n total number of vertices.
Assume that every tour starts & ends at vertex 1.
Solution Space S= {1, Π , 1 / Π is a permutation of (2, 3. 4. ----n) } then |S|=(n-1)!
The size of S reduced by restricting S
Sothat (1, i1,i2,-----in-1, 1}∈ S iff <ij, ij+1>∈ E. O≤j≤n-1, i0-in=1
S can be organized into “State space tree”.
Consider the following Example

State space tree for the travelling salesperson problem with n=4 and i0=i4=1

The above diagram shows tree organization of a complete graph with |V|=4.
Each leaf node ‘L’ is a solution node and represents the tour defined by the path from the root
to L.

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 18

Design and analysis of algorithms UNIT-4

Node 12 represents the tour.

i0=1, i1=2, i2=4, i3=3, i4=1

Node 14 represents the tour.

i0=1, i1=3, i2=4, i3=2, i4=1.
TSP is solved by using LC Branch & Bound:
To use LCBB to search the travelling salesperson “State space tree” first define a cost
function C(.) and other 2 functions Ĉ(.) & u(.)
Such that Ĉ(r) ≤ C(r) ≤ u(r)  1 for all nodes r.
Cost C(.) is the solution node with least C(.) corresponds to a shortest tour in G.

C(A)={Length of tour defined by the path from root to A if A is leaf

Cost of a minimum-cost leaf in the sub-tree A, if A is not leaf }
From1 Ĉ(r) ≤ C(r) then Ĉ(r)  is the length of the path defined at node A.
From previous example the path defined at node 6 is i0, i1, i2=1, 2, 4 & it consists edge of
<1,2> & <2,4>
Abetter Ĉ(r) can be obtained by using the reduced cost matrix corresponding to G.
 A row (column) is said to be reduced iff it contains at least one zero & remaining entries
are non negative.
 A matrix is reduced iff every row & column is reduced.

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 19

Design and analysis of algorithms UNIT-4

Given the following cost matrix:

𝑖𝑛𝑓 20 30 10 11
15 𝑖𝑛𝑓 16 4 2
3 5 𝑖𝑛𝑓 2 4
19 6 18 𝑖𝑛𝑓 3
[ 16 4 7 16 𝑖𝑛𝑓 ]
 The TSP starts from node 1: Node 1
 Reduced Matrix: To get the lower bound of the path starting at node 1
Row # 1: reduce by 10 Row #2: reduce 2 Row #3: reduce by 2

𝑖𝑛𝑓 10 20 0𝑖𝑛𝑓1 10 20 0 𝑖𝑛𝑓

1 10 20 0 1
15 𝑖𝑛𝑓 16 4132 𝑖𝑛𝑓 14 2 130 𝑖𝑛𝑓 14 2 0
3 5 𝑖𝑛𝑓 2 43 5 𝑖𝑛𝑓 2 4 1 3 𝑖𝑛𝑓 0 2
19 6 18 𝑖𝑛𝑓193 6 18 𝑖𝑛𝑓 193 6 18 𝑖𝑛𝑓 3
[ 16 4 7 16 [ 16
𝑖𝑛𝑓 ]4 7 16 𝑖𝑛𝑓
[ 16] 4 7 16 𝑖𝑛𝑓 ]
Row # 4: Reduce by 3: Row # 5: Reduce by 4 Column 1: Reduce by 1

𝑖𝑛𝑓 10 20 0 𝑖𝑛𝑓
1 10 20 0 𝑖𝑛𝑓
1 10 20 0 1
13 𝑖𝑛𝑓 14 2 130 𝑖𝑛𝑓 14 2 120 𝑖𝑛𝑓 14 2 0
1 3 𝑖𝑛𝑓 0 2 1 3 𝑖𝑛𝑓 0 2 0 3 𝑖𝑛𝑓 0 2
16 3 15 𝑖𝑛𝑓 160 3 15 𝑖𝑛𝑓 150 3 15 𝑖𝑛𝑓 0
[ 16 4 7 16 𝑖𝑛𝑓
[ 12] 0 3 12 𝑖𝑛𝑓
[ 11] 0 3 12 𝑖𝑛𝑓 ]
Column 2: It is reduced. Column 3: Reduce by 3 Column 4: It is reduced.
Column 5: It is reduced.

The reduced cost is: RCL = 25

So the cost of node 1 is: Cost (1) = 25

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 20

Design and analysis of algorithms UNIT-4

The reduced matrix is:

 Choose to go to vertex 2: Node 2

- Cost of edge <1,2> is: A(1,2) = 10
- Set row #1 = inf since we are choosing edge <1,2>
- Set column # 2 = inf since we are choosing edge <1,2>
- Set A(2,1) = inf
- The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 11 2 0
0 𝑖𝑛𝑓 𝑖𝑛𝑓 0 2
15 𝑖𝑛𝑓 12 𝑖𝑛𝑓 0
[ 11 𝑖𝑛𝑓 0 12 𝑖𝑛𝑓 ]
- The matrix is reduced:
- RCL = 0
- The cost of node 2 (Considering vertex 2 from vertex 1) is:
Cost(2) = cost(1) + A(1,2) = 25 + 10 = 35

 Choose to go to vertex 3: Node 3

- Cost of edge <1,3> is: A(1,3) = 17 (In the reduced matrix

- Set row #1 = inf since we are starting from node 1
- Set column # 3 = inf since we are choosing edge <1,3>
- Set A(3,1) = inf
- The resulting cost matrix is:

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 21

Design and analysis of algorithms UNIT-4

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

12 𝑖𝑛𝑓 𝑖𝑛𝑓 2 0
𝑖𝑛𝑓 3 𝑖𝑛𝑓 0 2
15 3 𝑖𝑛𝑓 𝑖𝑛𝑓 0
[ 11 0 𝑖𝑛𝑓 12 𝑖𝑛𝑓 ]
Reduce the matrix: Rows are reduced
The columns are reduced except for column # 1:
Reduce column 1 by 11:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

1 𝑖𝑛𝑓 𝑖𝑛𝑓 2 0
𝑖𝑛𝑓 3 𝑖𝑛𝑓 0 2
4 3 𝑖𝑛𝑓 𝑖𝑛𝑓 0
[ 0 0 𝑖𝑛𝑓 12 𝑖𝑛𝑓 ]
The lower bound is: RCL = 11
The cost of going through node 3 is:
cost(3) = cost(1) + RCL + A(1,3) = 25 + 11 + 17 = 53

 Choose to go to vertex 4: Node 4

Remember that the cost matrix is the one that was reduced at the starting vertex 1
Cost of edge <1,4> is: A(1,4) = 0
Set row #1 = inf since we are starting from node 1
Set column # 4 = inf since we are choosing edge <1,4>
Set A(4,1) = inf
The resulting cost matrix is:

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 22

Design and analysis of algorithms UNIT-4

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

12 𝑖𝑛𝑓 11 𝑖𝑛𝑓 0
0 3 𝑖𝑛𝑓 𝑖𝑛𝑓 2
𝑖𝑛𝑓 3 12 𝑖𝑛𝑓 0
[ 11 0 0 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce the matrix: Rows are reduced
Columns are reduced
The lower bound is: RCL = 0
The cost of going through node 4 is:
cost(4) = cost(1) + RCL + A(1,4) = 25 + 0 + 0 = 25

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 23

Design and analysis of algorithms UNIT-4

 Choose to go to vertex 5: Node 5

- Remember that the cost matrix is the one that was reduced at starting vertex 1
- Cost of edge <1,5> is: A(1,5) = 1
- Set row #1 = inf since we are starting from node 1
- Set column # 5 = inf since we are choosing edge <1,5>
- Set A(5,1) = inf
- The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

12 𝑖𝑛𝑓 11 2 𝑖𝑛𝑓
0 3 𝑖𝑛𝑓 0 𝑖𝑛𝑓
15 3 12 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 0 0 12 𝑖𝑛𝑓 ]
Reduce the matrix:
Reduce rows:
Reduce row #2: Reduce by 2

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

10 𝑖𝑛𝑓 9 0 𝑖𝑛𝑓
0 3 𝑖𝑛𝑓 0 𝑖𝑛𝑓
15 3 12 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 0 0 12 𝑖𝑛𝑓 ]
Reduce row #4: Reduce by 3

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

10 𝑖𝑛𝑓 9 0 𝑖𝑛𝑓
0 3 𝑖𝑛𝑓 0 𝑖𝑛𝑓
12 0 9 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 0 0 12 𝑖𝑛𝑓 ]
Columns are reduced
The lower bound is: RCL = 2 + 3 = 5
The cost of going through node 5 is:
cost(5) = cost(1) + RCL + A(1,5) = 25 + 5 + 1 = 31

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 24

Design and analysis of algorithms UNIT-4

In summary:
So the live nodes we have so far are:
 2: cost(2) = 35, path: 1->2
 3: cost(3) = 53, path: 1->3
 4: cost(4) = 25, path: 1->4
 5: cost(5) = 31, path: 1->5
Explore the node with the lowest cost: Node 4 has a cost of 25
Vertices to be explored from node 4: 2, 3, and 5
Now we are starting from the cost matrix at node 4 is:

 Choose to go to vertex 2: Node 6 (path is 1->4->2)

Cost of edge <4,2> is: A(4,2) = 3

Set row #4 = inf since we are considering edge <4,2>
Set column # 2 = inf since we are considering edge <4,2>
Set A(2,1) = inf
The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 11 𝑖𝑛𝑓 0
0 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 2
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 11 𝑖𝑛𝑓 0 𝑖𝑛𝑓 𝑖𝑛𝑓 ]

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 25

Design and analysis of algorithms UNIT-4

Reduce the matrix: Rows are reduced

Columns are reduced
The lower bound is: RCL = 0
The cost of going through node 2 is:
cost(6) = cost(4) + RCL + A(4,2) = 25 + 0 + 3 = 28

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 26

Design and analysis of algorithms UNIT-4

 Choose to go to vertex 3: Node 7 ( path is 1->4->3 )

Cost of edge <4,3> is: A(4,3) = 12
Set row #4 = inf since we are considering edge <4,3>
Set column # 3 = inf since we are considering edge <4,3>
Set A(3,1) = inf
The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

12 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 3 𝑖𝑛𝑓 𝑖𝑛𝑓 2
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 11 0 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce the matrix:
Reduce row #3: by 2:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

12 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 1 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 11 0 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce column # 1: by 11

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

1 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 1 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 0 0 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
The lower bound is: RCL = 13
So the RCL of node 7 (Considering vertex 3 from vertex 4) is:
Cost(7) = cost(4) + RCL + A(4,3) = 25 + 13 + 12 = 50

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 27

Design and analysis of algorithms UNIT-4

 Choose to go to vertex 5: Node 8 ( path is 1->4->5 )

Cost of edge <4,5> is: A(4,5) = 0
Set row #4 = inf since we are considering edge <4,5>
Set column # 5 = inf since we are considering edge <4,5>
Set A(5,1) = inf
The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

12 𝑖𝑛𝑓 11 𝑖𝑛𝑓 𝑖𝑛𝑓
0 3 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 0 0 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce the matrix:
Reduced row 2: by 11

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

1 𝑖𝑛𝑓 0 𝑖𝑛𝑓 𝑖𝑛𝑓
0 3 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 0 0 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Columns are reduced
The lower bound is: RCL = 11
So the cost of node 8 (Considering vertex 5 from vertex 4) is:
Cost(8) = cost(4) + RCL + A(4,5) = 25 + 11 + 0 = 36

In summary: So the live nodes we have so far are:

 2: cost(2) = 35, path: 1->2
 3: cost(3) = 53, path: 1->3
 5: cost(5) = 31, path: 1->5
 6: cost(6) = 28, path: 1->4->2
 7: cost(7) = 50, path: 1->4->3
 8: cost(8) = 36, path: 1->4->5
 Explore the node with the lowest cost: Node 6 has a cost of 28
 Vertices to be explored from node 6: 3 and 5

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 28

Design and analysis of algorithms UNIT-4

 Now we are starting from the cost matrix at node 6 is:

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 29

Design and analysis of algorithms UNIT-4

 Choose to go to vertex 3: Node 9 ( path is 1->4->2->3 )

Cost of edge <2,3> is: A(2,3) = 11
Set row #2 = inf since we are considering edge <2,3>
Set column # 3 = inf since we are considering edge <2,3>
Set A(3,1) = inf
The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 2
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 11 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce the matrix: Reduce row #3: by 2

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 11 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce column # 1: by 11

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 0
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 0 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
The lower bound is: RCL = 2 +11 = 13
So the cost of node 9 (Considering vertex 3 from vertex 2) is:
Cost(9) = cost(6) + RCL + A(2,3) = 28 + 13 + 11 = 52

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 30

Design and analysis of algorithms UNIT-4

 Choose to go to vertex 5: Node 10 ( path is 1->4->2->5 )

Cost of edge <2,5> is: A(2,5) = 0
Set row #2 = inf since we are considering edge <2,3>
Set column # 3 = inf since we are considering edge <2,3>
Set A(5,1) = inf
The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
0 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 𝑖𝑛𝑓 0 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce the matrix: Rows reduced
Columns reduced
The lower bound is: RCL = 0
So the cost of node 10 (Considering vertex 5 from vertex 2) is:
Cost(10) = cost(6) + RCL + A(2,3) = 28 + 0 + 0 = 28

In summary: So the live nodes we have so far are:

 2: cost(2) = 35, path: 1->2
 3: cost(3) = 53, path: 1->3
 5: cost(5) = 31, path: 1->5
 7: cost(7) = 50, path: 1->4->3
 8: cost(8) = 36, path: 1->4->5
 9: cost(9) = 52, path: 1->4->2->3
 10: cost(2) = 28, path: 1->4->2->5
 Explore the node with the lowest cost: Node 10 has a cost of 28
 Vertices to be explored from node 10: 3
 Now we are starting from the cost matrix at node 10 is:

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 31

Design and analysis of algorithms UNIT-4

 Choose to go to vertex 3: Node 11 ( path is 1->4->2->5->3 )

Cost of edge <5,3> is: A(5,3) = 0
Set row #5 = inf since we are considering edge <5,3>
Set column # 3 = inf since we are considering edge <5,3>
Set A(3,1) = inf
The resulting cost matrix is:

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓

𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓
[ 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 𝑖𝑛𝑓 ]
Reduce the matrix: Rows reduced
Columns reduced
The lower bound is: RCL = 0
So the cost of node 11 (Considering vertex 5 from vertex 3) is:
Cost(11) = cost(10) + RCL + A(5,3) = 28 + 0 + 0 = 28

State Space Tree:

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 32

Design and analysis of algorithms UNIT-4

0/1 knapsack problem

LC branch and bound solution

Cosider knapsack istace =4 with capacity m=15 such that pi={10,10,12,18},wi={2,4,6,9}

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 33

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 34

Design and analysis of algorithms UNIT-4

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 35

Design and analysis of algorithms UNIT-4

Important Questions for exam point of view:

1. (a) Write FIFOBB algorithm for the 0/1 knapsack problem

(b) Explain the general method of Branch and Bound.

2. Apply the Branch and Bound algorithm to solve the TSP, for the following cost matrix.

3. (a) Explain how the traveling salesperson problem is solved by using LC Branch
and Bound.
(b) Write the general algorithm for Branch and Bound.

4. What is traveling sales person problem? Solve the following sales person problem
instance using branch and bound.

5. (a) Draw the portion of the state space tree generated by FIFOBB using the variable tuple
size for the knapsack instances, n = 5 (P1, P2, P5) = (10, 15, 6, 8, 4),
(w1, w2,..., w5) = (4, 6, 3, 4, 2) and M = 12.
(b) Write the control abstraction of LC search.

6. a) What do you mean by bounding? Explain how these bound are useful in branch and
bound methods.
b) Explain the principles of
i) FIFO branch and Bound
ii) LC Branch and Bound

7. a) Explain the method of reduction to solve TSP problem using Branch and Bound.
b) Explain the principles of FIFO Branch and Bound.

8. (a) Explain the principles of the following:

i) FIFO branch and Bound ii) LC Branch and Bound
(b)Draw the portion of the state space tree generated by LCBB for the knapsack instances:
n=5, (P1, P2,… , P5) = (12,10,5,9,3), (w1, w2, ...,w5)=(3, 5, 2, 5, 3)
and M =12.

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 36

Design and analysis of algorithms UNIT-4

2 marks questions

1. Define backtracking.
2. What is meant by optimization problem?
3. Define Hamiltonian circuit problem.
4. What is Hamiltonian cycle in an undirected graph?
5. Define 8queens problem.
6. List out the application of backtracking.
7. Give the explicit and implicit constraint for 8-queen problem.
8. How can we represent the solution for 8-queen problem?
9. Give the categories of the problem in backtracking.
10. Differentiate backtracking and over exhaustive search.
11. What is state space tree?

P.Harikrishna Assistant Professor CSE Dept Mrcet Page 37

Design and Analysis of Algorithms UNIT-5

NP-Hard and NP-Complete Problems

P.Harikrishna Asst Professor CSE Dept MRCET Page 1

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 2

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 3

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 4

P
Design and Analysis of Algorithms UNIT-5

Nondeterministic algorithms

P.Harikrishna Asst Professor CSE Dept MRCET Page 5

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 6

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 7

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 8

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 9

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 10

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 11

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 12

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 13

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 14

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 15

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 16

P
Design and Analysis of Algorithms UNIT-5

P.Harikrishna Asst Professor CSE Dept MRCET Page 17

P