An Interactive Visualization of Genetic Algorithm On 2-D Graph
An Interactive Visualization of Genetic Algorithm On 2-D Graph
net/publication/221471167
Conference Paper in International Journal of Software Science and Computational Intelligence · August 2011
DOI: 10.1109/COGINF.2011.6016133 · Source: DBLP
CITATIONS READS
0 1,375
4 authors:
All content following this page was uploaded by Humera Farooq on 12 November 2016.
Abstract—The visualization of search space makes it easy to techniques to explore the internal process of the GA, termed
understand the behavior of the Genetic Algorithms (GAs). We as the Interactive Genetic Algorithm (IGA).
proposed a novel way for representation of multidimensional IGA is a technique to design an environment with user
search space of the GA on 2-D graph. This visualization is carried
out based on the gene values of the current generation, and interaction to evaluate solutions. The visualization of the
user interruption is only required after several generations. The search space not only demonstrates the process of searching
main contribution of this research is to propose an approach with GA towards a fitted solution, but it also interacts with the
to visualize the GA search data and to improve the searching search space to help GA to search for the best solution in less
process of the GA with user’s intention in different generations. time. The Interactive Evolutionary Algorithm (IES) was first
Besides the selection of best individual or parents for the next
generation, interference of user is required to propose a new demonstrated by Dawkins [4], when he created a visualize
individual in the search space. Hence, the active user intervention tool to model an artwork called bimorphs. A detail survey
leads to a faster searching, resulting in less user fatigue. The on using Interactive Evolutionary Computation may be found
experiments were carried out by evolving the parameters to in [5] in which, Takagi divided the interactive evolution by
derive the rules for a Parametric L-System. These rules are then two definitions. The first one is a narrow definition according
used to model the growth process of branching structures in 3-D
space. The experiments were conducted to evaluate the ability to which human evaluation is used as the fitness value for
of the proposed approach to converge to optimized solution as an optimized solution , and the second is a broad definition
compared to the Simple Genetic Algorithm (SGA). according to which the optimized solution is obtained from a
Index Terms—Evolutionary Algorithm, Scientific visualization, human-machine interface.
Parametric L-System, Interactive Genetic Algorithm, 2D Graph- In the past, numerous works were done in the field of IGA.
ics
Cartoon style faces [6] were created on coffee mugs by using
the Neural Network with IGA. They used the Neural Network
I. I NTRODUCTION
(NN) to approximate the aesthetic intentions of the user. With
GA is a dynamic random searching algorithm used to solve the learning mechanism of NN, they inferred the desirable
the optimization problems. It was invented by John Holland in solution by the user, whereas IGA was used for evolving
1960’s [1] to explain the adaptive process of natural systems the next generation. In this way, they save the user from the
[2]. GA is based on the biological methods to produce the tiresome work of selecting and assigning fitness to the best
solutions (next population). Being a successful meta-heuristic design. In [7], IGA was used for aircraft design. A large search
technique, this algorithm is widely used for solving many space with multidimensional data was needed for the aircraft
optimization problems. GAs are stochastic search methods that design; therefore interaction in every generation becomes not
are successfully applied widely in the fields of engineering, only infeasible but also impossible. For that reason, they
medicine and machine learning problems. The problem is introduce interaction with the GA search space after a certain
represented in the form of a chromosome, which is converted number of generations, and an objective function was used
into genotype form. the performance of GA depends on many to calculate the fitness for each solution. In their application
factors including a good fitness function, population size and for representing multidimensional data, different graphs were
choice of GA operators (crossover and mutation). used. A fashion design application was developed by [8] in
In computer graphics, visualization plays an important part which the user’s intention is used to evolve the next generation.
in helping the users to understand the problems graphically The fitness for the fitter solution was also assigned by the user.
[3]. Visualization technology raises the level of understanding Applications on GA have extended from computer science to
multidimensional or high resolution data. Another advantage the other fields, i.e. engineering [7], physics, social science,
of using this technology is to reduce the work period. Visual- economics, molecular biology and biomedical engineering [9].
ization does not mean only to view the graphical pictures, but IGA is also used to graphically represent the evolution or
it also includes analyzing and interpreting the data. Over the modeling of plants. The evolved solutions are represented as
past few years scientists have taken advantage of visualization models onto the computer screen and the user evaluates and
selects the parents for the next generation [10], [11]. In [12] solutions in the search space, these visualization techniques
an interactive system is developed, which involves the creation are unable to determine the searching behavior of GA during
of procedural 3-D models of trees using IGA. The user adjusts the evolution process.
parameters to draw a tree. If the user misses some parameters We proposed a new way for interactive visualization of
adjustment, then it can be done by GA. The user can also give the GA search space data. Each generation of the search
ratings (evaluate) to trees for deciding the parents for the next space is displayed as a 2-D graph on the canvas, gives a
generation, but it is not forced to do so in every generation. clear picture of evolving gene values at different locations.
The main focus of their work is not on creating a virtual scene; The user participation is to propose a new individual instead
instead, it’s on giving an idea of how to adjust the parameters of the evaluating and assigning fitness to existing solutions.
interactively. This interaction depends on the convergence of GA present
For generating the plant like structure, GA is also used to as fitness versus generation graph in a separate graph. The
optimized the symbols or parameters for the L-System [13]. proposed individual becomes a part of the search space in the
The L-System uses a rewriting mechanisms such as Chomsky next generation. The output of IGA (fitted individuals) is used
grammar to create the models of the natural environment, to create the rules for generating branching structures using
animations and virtual scenes. Two main parts of the L-System Parametric L-System.
are the axiom and the rules. These rules are recursive by
III. P ROPOSED A PPROACH
nature and are used to model complex plant and tree structures.
To set and arrange these rules by hand is quite a difficult The objective of this study is to develop an interactive
and time consuming job. Therefore, scientists and researchers visualization of multidimensional data (n-D search space) of
introduced a way of using GA for optimized (best answer) and GA on 2D space. For achieving this goal, a tool named
random solutions to generate these branching structures with VIGA-2D (Visualization of Genetic Algorithm on 2-D Graph)
the L-System. was designed and developed. The purpose of developing this
A further extension of the L-System is known as Parametric visualization tool is to make a clear understanding of the
L-System. In the Parametric L-System, the associated param- searching process of GA in every generation and to make it
eters are used with symbols. These parameters are responsible feasible in a way that the user can actively participate during
for giving different angle values to generate trees onto the searching. For interaction, any generation may be interrupted
canvas. In the proposed work, we used an interactive approach by the user. Prior to becoming a part of the search space,
of GA to evolve parameters in order to derive the parametric the fitness of the new individual is compared with the average
rules for modeling the tree structures. The precipitation of fitness of the current generation. Thus, the higher the fitness of
the user is after several generations. The purpose of these the proposed individual, the more chance it has to be select in
interactions is to propose a new solution into search space. the next generation. This interaction also affects the population
size; each successful interaction will increase the population
II. P ROBLEM D EFINITION size. The complete procedure of the proposed approach has
In conventional GA, the search process remains hidden from been outlined in Fig 1. Listed below are the some advantages
the human eye. Only the optimized solution can be viewed of the proposed work.
on the screen. The performance of the algorithm is typically • The proposed interactive approach works with a human-
monitored by a fitness convergence (a graph with fitness versus machine interaction.
generation) rate. Using this graph, the user can only examine • The visualization is based on the gene values in each
the performance of algorithm over each generation. Thus to generation.
analyze these solutions and to change them is quite difficult. • Human interaction is not involved with the selection or
Also, there is less chance to understand the GA convergence or rating the solutions; instead the user proposes a new
the change in the parameters and functions during this search individual in the search space.
process [14]. Moreover, this technique also has not given • There is no need to keep the generation numbers smaller
satisfactory solutions when applied to artistic and aesthetic because the user interaction is not necessary in every
problems. generation.
On the other hand, IGA is found to be a flexible and user • Any generation may be interrupted by the user.
friendly technique for solving artistically and aesthetically • The working mechanism of the GA operators (crossover
relevant problems. The GA visualization gives a suitable and mutation) and selection of individuals work as a
solution for the problem in which the inference of the user hidden process.
is necessary to have an opinion for evaluation and selection of • The GA search process remain continues until the user
solutions [12]. These applications are mostly used for model terminates it.
representations of solutions [15][10][16]. The main problem of The problem is defined as a user input to the VIGA-2D.
traditional IGA is the continuous interaction of the user which It also involves the input of all necessary parameters from
cause fatigue to user and gives unwanted solutions. Moreover, the user which are necessary to initiate the VIGA-2D process.
these approaches require a small number of generations which Then, VIGA-2D is evolved until the user’s perception. The
reduces the user fatigue. Due to the model representation of user may generate the branching structures in any generation
Start Where parameter is a particular genes value, values is
the range of gene values, m = (0...populationsize) and l =
Next Visualization
Encoding Chromosome
Generation as 2-D graph (0....chromosomelength).
Fitness Function
After retrieving a particular gene value, the next step is to
Selection Method Evaluate
GA operators
genes values
for each
calculate the location of the y and x-axis. The calculation of
generation the y-axis is based on the Vunit as shown in Equation 3.
Add proposed genes
values into search
space Satisfied
N solution
N Y
yaxis = Vlength − (parameter − mvalues ) ∗ Vunit (3)
Increase Y User
population size
interaction
Visualization Where Vlength is the total vertical length of the graph,
Stop of branching
structures parameter is the gene values to display, mvalue is the
minimum range of the gene values and Vunit is the pixel ratio
Fig. 1. An overview of proposed approach along the vertical view. The location of the x-axis is based on
the calculation of the fixed interval as shown in Equation 4.
TABLE II
L IST OF ACCEPTED AND DISCARDED SOLUTIONS AT DIFFERENT
GENERATIONS WITH FITNESS VALUES
Modeled
at Generation 19 52 69 85
Interaction at 8,16 28,32, 57,61, 72,77,
Generation 42,49 66,69 82,85
Best Fitness
(b) Average Fitness Graph for VIGA-2D 0.32311 0.47497 0.37536 0.38665
Best Fitness
Fig. 4. Fitness/Generation Graph for SGA 0.41988 0.55434 0.36687 0.58923
Discarded at
Generation 16 Null 61 Null
(g) SGA Generation (h) VIGA-2D Gener- (i) SGA Generation (j) VIGA-2D Genera-
69 ation 69 85 tion 85
• the proposed color is green and it may produce unnecessary noise and distortion in the search
• when the convergence of the fitness according to the space. But due to using the objective function the GA may
fitness graph was not converging towards the fitter value. solve this problem in a few generations or it could be solved
The termination criteria were according to the user perception. more quickly by doing more interactions.
It was observed that there were several assumptions and ob-
servations taken by different users to terminate the procedure. C. Comparison with Traditional IGA
For example: Table III shows the difference between the proposed ap-
• According to the user, the distribution of gene values was proach and TIGA. For the traditional IGA applications, the
equally distributed. applications were based on the constant number of generations
• Most of the genes value’s color intensity was high (Dark [10][11] in which the interaction of the user is necessary
Blue Color), means the majority of the search space had in each generation for evaluating and assigning the fitness
fitter solutions. to the solutions. Moreover, in these applications, the user’s
• There was not any prominent difference between the perception is used to evaluate the fitness of solutions in a
distributions of gene values even with the interactions. population. These existing IGA applications gave a suitable
• There was no prominent difference between the generated solution for the problem in which the inference of the user is
structures in last few generations. necessary to have an opinion for evaluation and selection of
• Convergence of the fitness according to the fitness graph solutions [12]. The method used in these applications helps
was not converging towards a fitter value. the user to draw or select the individuals according to a visual
The color intensity also played an important role for the picture of that object in his mind. In this way, in TIGA, most of
decision of interactions. The user observed the variation of the applications are completely dependent on the user. On the
color and size of the ellipse with more interest as compared other hand, in human- machine interactions, the applications
to the fitness convergence. are based on the user’s preferences and selections or it may
The impact of variation in population size was also ana- use some classifiers to approximate fitness values.
lyzed. It was observed that the increment in population size The proposed algorithm is different from these applications
also impacted on the performance of the searching process. in that the interaction of the user is not necessary in each
With each interaction, the search space becomes wider. In generation. The fitness of the solutions is calculated with the
most of the experiments, the resultant population size was 50 objective function and there is no need to evaluate the solutions
percent bigger than the initial size. This feature gives a facility for the next generation.
to use a wider search space interactively.
On the other hand, our proposed methodology gives a V. CONCLUSIONS
chance to GA to make a decision to absorb the proposed values Research efforts made to understand the research presented
as a part of the evolution or discard them. In this way, the in this paper focus on exploring the technique to visualize
user performance could be easily monitored with the effect the multidimensional data of the GA search space. Based on
on population size. It was also observed that proposing gene the proposed method, a tool (VIGA-2D) has been developed in
values having worse fitness or allocating null values, directly which each generation is displayed visually. This visualization
impacted on the performance of the algorithm. For instance , gives a clear picture of evolving gene values at different
TABLE III
C OMPARISON BETWEEN PROPOSED APPROACH AND TIGA [9] G. Kkai, R. Vnyi, and Z. Tth, “Parametric l-system description of the
retina with combined evolutionary operators,” in Genetic and Evolution-
ary Computation Conference, GECCO, 1999.
Parameters VIGA-2D TIGA [10] H.-J. Min and S.-B. Cho, “Creative 3d designs using interactive genetic
Population size Variant de- algorithm with structured directed graph,” pp. 391–400, 2004.
pends on [11] R. Curry, “On the evolution of parametric l-systems,” 2000.
how many Constant [12] C. Clare Bates and H. M. Raymond, “Gentree: An interactive genetic al-
interaction gorithms system for designing 3d polygonal tree models,” in Genetic and
Generations Based on Evolutionary Computation GECCO 2003, vol. 2724/2003. Springer
user Constant Berlin / Heidelberg, 2003, p. 216.
Perception [13] P. Prusinkiewicz and A. Lindenmayer, The algorithmic beauty of plants.
Interaction Proposed Select from Springer-Verlag New York, Inc., 1990.
new [14] H. NISHINO, H. TAKAGI, and K. UTSUMIYA, “A 3d modeler for
Individual existing individuals aiding creative work using interactive evolutionary computation,” IEICE
Termination Based on Pre-defined Transactions on Information and Systems, vol. 85, pp. 1473–1483, 2002.
Criteria User Per- Criteria [15] S.-B. Cho, “Towards creative evolutionary systems with interactive
ception genetic algorithm,” Applied Intelligence, vol. 16, no. 2, pp. 129–138,
2002.
[16] H. Nishino, H. Takagi, C. Sung-Bae, and K. Utsumiya, “A 3d model-
ing system for creative design,” in Proceedings of 15th International
Conference on Information Networking, 2001.
locations. The fitness is calculated using the objective function [17] U. Aybars, “Path planning on a cuboid using genetic algorithms,”
and the GA selection method is responsible to select the fitted Information Science, vol. 178, pp. 3275–3287, 2008.
[18] I. Shin-Ichi, M. Yasue, M. Hiroko Nakamura, S. Takafumi, and F. Mi-
solution for the next generation. noru, “A visualization of genetic algorithm using the pseudo-color,” in
During searching process, a user may interact to propose a Neural Information Processing: 14th International Conference, ICONIP
new individual. The proposed approach does not depend on 2007, Kitakyushu, Japan., 2008.
[19] B. John, A. Peter, and L. Laura, “Neural network fitness functions for
continuous interaction of user. The interaction may be done in a musical iga,” in International Symposium on Intelligent Industrial
any generation and any number of times until a satisfactory Automation and Soft Computing, 1996.
solution is obtained. The proposed individual become a part [20] M. Ohsaki and H. Takagi, “Improvement of presenting interface by
predicting the evaluation order to reduce the burden of human interactive
of search space in next generation. The developed approach ec operators,” in IEEE International Conference on Systems, Man, and
has been used to evolve the parameters for deriving rules Cybernetics., 1998.
for Parametric L-System. These rules are then generate the [21] F. Humera, Z. M. Nordin, H. Mohd. Fadzil, and S. Suziah, An Approach
to Derive Parametric L-System Using Genetic Algorithm. Springer-
branching structures on a 3-D canvas. The performance of Verlag, 2009.
VIGA-2D had been analyzed with the help of subjective [22] W. Chin, “A visual genetic algorithm tool,” Master’s thesis, Faculty of
analysis. For this purpose, real values were evolved by the Computer Science,University of Malaya, 2006.
proposed approach to derive the rules for Parametric L-
System. The experiments performed with VIGA-2D shows
that it has the ability to perform efficiently as compare to
SGA. Furthermore, experiments show that the performance of
VIGA-2D really depends on the user interactions. Future work
involves analyzing the performance of the proposed work with
other applications.
R EFERENCES
[1] J. H. Holland, Adaptation in natural and artificial systems. MIT Press,
1992.
[2] P. Haroun, “Genetic algorithm and data visualization,” Ph.D. disserta-
tion, 1997.
[3] H. C. Purchase, N. Andrienko, T. Jankun-Kelly, and M. Ward, Theoret-
ical Foundations of Information Visualization. Springer-Verlag, 2008.
[4] R. Dawkins, “The evolution of evolvability,artificial life,” in Interdisci-
plinary Workshop on the Synthesis and Simulation of Living Systems,
C. Langton, Ed. Redwood City,CA: Addison-Wesley, 1989.
[5] H. Takagi, “Interactive evolutionary computation: fusion of the capabil-
ities of ec optimization and human evaluation.” in Proceedings of the
IEEE, vol. 89, 2001, pp. 1275–1296.
[6] Z. Gu, M. Xi Tang, and J. H. Frazer, “Capturing aesthetic intention
during interactive evolution,” Computer-Aided Design, vol. 38, no. 3,
pp. 224–237, 2006.
[7] O. Bandte, “A broad and narrow approach to interactive evolutionary
design–an aircraft design example,” Applied Soft Computing, vol. 9,
no. 1, pp. 448–455, 2009.
[8] R. Jie, G. Dun-Wei, S. Xiao-yan, Y. Jie, and L. Ming, Interactive Genetic
Algorithms with Variational Population Size, D.-S. H. Kang, K.-H. Jo,
H.-H. Lee, Hee-Jun, Bevilacqua, and Vitoantonio, Eds. Springer, 2009,
vol. 5755.