Genetic Algorithm
Genetic Algorithm
Presented by: Bharat Sharma(652) Keshav Raj Joshi(656) Krishna Prasad Neupane (657) Om Prakash Mahato (659)
Introduction
Algorithm: An algorithm is a sequence of instructions to solve a problem. Most of the algorithms are static.
A Genetic Algorithm(GA) is adaptive (dynamic) a model of machine learning algorithm that derives its behavior from a metaphor of some of the mechanisms of evolution in nature. Biological Background: Genetics
Living Bodies Organism Cell Chromosome Gene DNA
A gene is a short length of a chromosome which controls a characteristic of an organism. -The gene can be passed on from parent to offspring, e.g. a gene for eye-color.(trait)
---
Every Organism has set of rules describing how the organism is built. All living organisms consist of cells. A chromosome is a chain of genes, Set of DNA. And serves as model of whole organism. Each living object has a particular number of chromosomes, e.g. human beings have 46 chromosomes.
Genetic Algorithm is heuristic search algorithm based on the evolutionary ideas of natural selection and genetics. Genetic algorithm is inspired Darwins Theory about evolution : Survival of fittest. Given a problem that in some way involves a search, a genetic algorithm begins with chromosome which represents a solution (usually a binary string).
Human Chromosome Linear collection of bits (GA Chromosome)
Components of GA: - Population - consists of individuals who may be able to solve the given problem - Fitness function a function which determines how well each individual solves the problem - Offspring -child
GA Requirements
A typical genetic algorithm requires two things to be defined: a genetic representation of the solution domain, and a fitness function to evaluate the solution domain. A genetic processes to create a new better solution. Genetic Representation
Fitness function: The fitness function is defined over the genetic representation and measures the quality of the represented solution. The fitness function is always problem dependent.
As already noted, genetic algorithms try to mimic evolution. To do this, they use three basic processes. Reproduction: Production of new generations ,For reproduction following operations are proceeded: Selection : Reproduction is done using parents with higher fitness ratings, that is having a higher probability of finding the answer to problems: roulette wheel technique
Crossover: Changing the code within two strings at a random place and creating two new strings of code by merging the split strings. This process is used in nature where genes from parents combine to form a whole new chromosome.
Mutation: Changing one digit or more in the code on a random basis. For example, changing a 1 to a 0 without the processes of reproduction or crossover. This mimics random changes in genetic code and is especially useful where crossover does not provide an answer. Generally, Mutation probability is given by, rule of thumb (Pm) = 1/no. of bits in chromosome
10 1 2 3 4 5 6 7 8 9 10
10 1 2 3 4 5 6 7 8 9 10
f(x) = 2 (n-1) n
Fitness criteria
-70 0
-60
-50
-40
50 100 Generations
150
200
http://www.demon.co.uk/apl385/apl96/skom.htm
References
http://www.ro.feri.uni-mb.si/predmeti/int_reg/Predavanja/Eng/3.Genetic%20algorithm/_18.html
Introduction to Knowledge engineering : eBook, chapter 2; page 66. Global Optimization Algorithms Theory and Application eBook Thomas Weise, 2009 Lecture Slide1: Genetic Algorithm for Variable Selection Jennifer Pittman ISDS Duke University Lecture Slide2: Fundamental of Genetic Algorithms : AI course Lecture, BY RC chakraborty Lecture Slide 3: Genetic Algorithms by Muhannad Harrim Lecture Slide 4: Artificial Intelligence: Genetic Algorithms Dr. Richard Spillman PLU
Fall 2003 Recommended: Holland, J. (1992), Adaptation in natural and artificial systems , 2nd Ed. Cambridge: MIT Press Goldberg, D. (1989), Genetic algorithms in search, optimization and machine learning. Addison-Wesley.