Creating a Chess-Playing Computer Program

Ulysse Carion,
Junior at La Jolla High School
February 2, 2013
Abstract
The goal of this project is to create a computer program that plays
a relatively strong game of chess using programming techniques used by
the top engines in use today. The result of this project is Godot, a Java
program that plays a redoubtable game of chess.
Godot uses bitboards (64-bit numbers representing a chessboard) to
implement board representation. When searching for moves, the Godot
uses the most common methods of the day, including alpha-beta pruning,
principal variation searching, history heuristics, iterative deepening, quiescent searching, static exchange evaluation, and null move pruning. The
program evaluates positions by taking into account many factors that are
typically an indication of a strong position. Godot can evaluate tens of
thousands of positions per second.
Godot also has an opening book based on a large database of thousands
of very high-quality games. At the time of this writing, Godots opening
database has a little over 252,000 positions pre-programmed into it.
The program is based on other chess engines, especially open-source
ones such as Stockfish, Carballo, and Winglet. Despite being based on
other programs, Godot has a distinctive style of play that has been
repeatedly described as appearing creative.
Godot has achieved an Elo ranking online of above 2100 at 1-minute
chess. It has also defeated multiple FIDE1 -titled players. Though certainly not nearly as strong as commercial chess engines, Godot certainly
plays a very respectable game of chess.

1 F
ed
eration

Internationale des Echecs;

the International Chess Federation

Contents
1 Acknowledgements

2 Introduction

3 Statement of Purpose

4 Review of Literature
4
4.1 Board Representation . . . . . . . . . . . . . . . . . . . . . . . .
4
4.1.1 Square-Centric Methods . . . . . . . . . . . . . . . . . . .
4
4.1.2 Piece-Centric Methods . . . . . . . . . . . . . . . . . . . .
4
4.1.3 Hybrid Methods . . . . . . . . . . . . . . . . . . . . . . .
5
4.2 Bitboards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5
4.2.1 Binary Operators . . . . . . . . . . . . . . . . . . . . . . .
5
4.2.2 Implementation . . . . . . . . . . . . . . . . . . . . . . . .
6
4.2.3 Zobrist Hashing . . . . . . . . . . . . . . . . . . . . . . . .
9
4.3 Searching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
4.3.1 Claude Shannons Types A & B . . . . . . . . . . . . . . 10
4.3.2 Minimax . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
4.3.3 Alpha-Beta Pruning . . . . . . . . . . . . . . . . . . . . . 12
4.3.4 Quiescent Searching . . . . . . . . . . . . . . . . . . . . . 13
4.3.5 Iterative Deepening, Principal Variation, and History Heuristic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
4.3.6 Null Move Pruning . . . . . . . . . . . . . . . . . . . . . . 16
4.4 Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
4.4.1 Material . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
4.4.2 Pawn Structure . . . . . . . . . . . . . . . . . . . . . . . . 18
4.4.3 Piece-Square Tables . . . . . . . . . . . . . . . . . . . . . 19
4.4.4 King Safety . . . . . . . . . . . . . . . . . . . . . . . . . . 19
5 Development
5.1 Version 0.1
5.2 Version 0.2
5.3 Version 0.3
5.4 Version 0.4
5.5 Version 0.5
5.6 GodotBot .

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

.
.
.
.
.
.

21
21
23
23
28
34
34

6 Results

36

7 Recommendations

37

ii

Acknowledgements

Id like to thank Mr. Greg Volger for helping me write my notebook, Dr. David
Groce for his support in the creation of this projects presentation, and Mr.
Martin Teachworth for guiding me and acting as my mentor.
In addition, Id like to thank the chess programming community for helping
me with more technical issues I faced.

Introduction
We stand at the brief corona of an eclipse - the eclipse of certain
human mastery by machines that humans have created.
Stephen Levy

Chess-playing programs have captivated the interest of computer scientists

since before computers have existed. Alan Turing, perhaps the first computer
scientist ever, created his program Turochamp and, lacking a computer to run
his program with, completed the arithmetic operations himself. In what could
be considered the first chess match between man and machine, Turings paper
machine lost against a colleague of Turings (Friedel, 2002).
Much progress has been made since Turings paper-and-pencil computer.
While many chess players asserted that computers would never play at a serious level, claiming that computers lacked the understanding of the game
necessary to defeat high-rated chess programs, programmers and programs were
only getting better. Finally, in 1997, world champion Garry Kasparov lost in a
six-game match against IBMs Deep Blue, a program that would be considered
mediocre by todays top programmers.
Creating a chess-playing program is extremely interesting for many reasons.
For one, it is a remarkably large challenge requiring a lot of research, planning,
coding, and testing. A chess program is not a trivial assignment; learning
the fundamentals of computer chess requires a thorough knowledge of many
different levels of a computer, from low-level bit manipulation to high-level
artificial intelligence algorithms. Secondly, due to the vast amount of work
that has been done in the field of computer chess, there exists a great amount of
creative freedom for programmers; no two programs will use the same techniques
to arrive at the same point. Finally, a chess program is interesting to create
because it endows the programmer with the capacity to create intelligence
out of simple 1s and 0s, a power that has inspired computer scientists for over
half a century to keep on pushing the limits of computer chess.

Statement of Purpose

Chess has always been at the heart of computer science and artificial intelligence.
The goal of this project is to research and develop a chess-playing program that
is unique and plays a strong game.
Creating a program that can compete at the level of play of current top-level
programs is almost impossible and not the objective of this projectthe goal is
to create an original program that uses a carefully-selected combination of the
hundreds of ways to assault the challenge of teaching a computer to play chess.

Review of Literature

Since the beginning of chess-playing programs in 1956, computer scientists and

avid programmers have created hundreds of chess engines of differing strengths.
Despite the large amount of different chess programs, most programmers choose
to use the same time-tested techniques in almost all of their creations. Vasik
Rajlich, creator of Rybka, one the strongest chess programs ever, remarked that
when two modern top chess programs play against each other maybe 95% of the
programs are algorithmically the same. What is classing is the other 5% (Riis,
2012).
There exist three major elements to a chess program that must be carefully
chosen and experimented with: representation, searching, and evaluation. A
strong combination of these three elements is what Rajlich calls the classing
elements of a program.

4.1

Board Representation

Board representation is the usage of some data structure to contain information about a chessboard. A good board representation makes move generation
(determining what moves are available in a position) and board evaluation (determining how strong a position ismore on this in Section 4.4) very fast. There
are overall three different methods of representing a board: square-centric, piececentric, and hybrid solutions.
4.1.1

Square-Centric Methods

A square-centric method is perhaps the most obvious: a program holds in memory what is on each square. Square-centric programs are optimal for quickly
figuring out what piece is on a squaregoing the other way around (viz., determining what square a piece is on) is more difficult. There are many ways
to represent a board in a square-centric method. The most obvious (and least
effective) method is to use an 8x8 array. Though this may seem simple, it is
in fact very cumbersome and requires a lot of work to make sure we do not go
outside the arrays bounds.
A more common square-centric method is the 0x88 method. This technique works by representing a chessboard as an 8 by 16 array. Though the
details of this implementation are complicated (and are not particularly useful
to know), 0x88 is quite fast because it takes little effort to determine if a square
is in boundsif a squares index ANDed2 with the hexadecimal number 0x88
returns anything else than 0, then the index is out of bounds. (Hyatt, 2004).
4.1.2

Piece-Centric Methods

The alternative method, piece-centric board representation, focuses on being

able to determine where a piece is rather than what is on a given square. Piece2 See

Section 4.2.1

centric methods are optimized for situations where we must find out where a
given piece is, but are far from optimal if we must find out what, if anything,
stands on a given square. The very first chess programs used such a method
called piece-lists, wherein a list storing where each piece stands on the board
is maintained. These piece-lists were optimal in the early days of computing,
when memory was very valuable, because they required very little space on the
computer. (Kotok, 1962). The modern variant of piece-centric representation,
bitboards, will be explained later in section 4.2 (Hyatt, 2004).
4.1.3

Hybrid Methods

Hybrid solutions involve both piece-centric and square-centric methods, and

have the advantages of both methods, at the cost of extra computation to maintain two separate data structures.

4.2

Bitboards

Bitboards are a piece-centric board representation that remains popular to this

day. Because most of the strongest engines of this day, including Houdini,
Critter, and Stockfish (respectively 1st, 2nd, and 3rd in world ranking at the
time of this writing), use bitboards, it is worthwhile to understand how they
work.
Bitboards are optimized for computers because they work directly with bitwise operations. Bitwise operations are simple processes that a computer processor uses to work with binary numbers. The five major bitwise operations are
the bitwise AND, bitwise OR, bitwise XOR, bitwise left shift, and bitwise right
shift.
4.2.1

Binary Operators

The bitwise operations AND, OR, and XOR all take two binary numbers as
arguments, and return another binary number as a result. The bitwise AND,
for instance, goes through each bit of its arguments, setting the nth bit of the
result to be 1 if the nth bit of both of its arguments is 1. For example, if we
were to try 10110100 AND 10011000, the result would be:
10110100
& 10011000
10010000
Notice how in the bitwise operator AND, we set the nth bit to 1 if the nth
bit of the first number is 1 and the nth bit of the second number is 1 as
well. Similar logic works for the bitwise OR operator, which sets the nth bit to
1 if the nth bit of the first number or the second number is 1. Thus, taking
the same example as last time,

10110100
| 10011000
10111100
Finally, the XOR operator, or the exclusive or operator, sets the nth bit
to 1 if the nth bit of the first or second (but not both) is 1. With the same
example as before3
10110100
10011000
00101100
The left-shift and right-shift operators are much simpler than the AND, OR,
and XOR operators. These operators simply move the bits of a number left or
right (as they appear when written out). Thus, 00100 left-shifted by 2 gives
10000, and right-shifted by 2 gives 00001. Note that the left-shift and rightshift operators do not replace numbers if they are shifted out; new bits being
inserted at either end of a number being shifted are unconditionally 0. If we
work with a number that has strictly eight bits,
10001010
left-shift by 1 = 00010100
(Note how the 1 at the left-end of the number was not replaced (carried)
back into the resulta zero will unconditionally be placed at the end of the
number.)
11001010
right-shift by 1 = 01100101
(Note how 0 was inserted where there was an opening as the number was
shifted right.)
All of these operators have symbols in programming languages. In C (and
related languages, such as C++ or Java) the operations AND, OR, and XOR
are represented as &, |, and , respectively. In Java, left-shift is <<, and
right-shift is >>> 4 .
4.2.2

Implementation

Bitboards are considered the best way to represent a chessboard because they
are optimized for usage with bitwise operations. The idea is to represent the
64 squares on a chessboard with the 64 bits in a 64-bit number. In Java, these
numbers are called longs (in C, these are called unsigned long longs). We
3 The example below denotes XOR with the symbol , which is also commonly used to
represent the logical XOR operator; however, this symbol is not used in any programming
languages.
4 Many languages represent right-shifting with >>, but in Java this symbol is used for
a variant of bit-shifting that preserves the state of the leftmost bit, an operation called an
arithmetic shift.

can represent the bottom-left square of a chess board as the last (rightmost) bit
of a long, and assign the top-right square to the first (leftmost) bit, as shown in
Figure 1.

57
49

41

33

25

17

9
1

58
50
42
34
26
18
10
2

59
51
43
35
27
19
11
3

60
52
44
36
28
20
12
4

61
53
45
37
29
21
13
5

62
54
46
38
30
22
14
6

63
55
47
39
31
23
15
7

64
56

48

40

32

24

16
8

Figure 1: The position of each bit; board shown from Whites perspective.
We can represent where any type of piece is using a single number thanks
to bitboards. For instance, if we wanted to represent the position of the white
bishops in the initial setup of the board, we would use the number 0000 [...]
000100100, which would correspond to the board shown in Figure 2.

0Z0Z0Z0Z
7
Z0Z0Z0Z0
6
0Z0Z0Z0Z
5
Z0Z0Z0Z0
4
0Z0Z0Z0Z
3
Z0Z0Z0Z0
2
0Z0Z0Z0Z
1
Z0A0ZBZ0
a
b
c
d
e
f
g h
8

0
0

0
0

0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
1

0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
1

0
0
0
0
0
0
0
0

0
0

0
0

Figure 2: White bishops at the starting position.

7

In the previous example, we saw how we could use a single bitboard to represent the white bishops. In the more general case, we have to represent 6 types of
pieces for 2 different colors, resulting in 12 total bitboards minimum. However,
most programs also use three extra bitboards, representing white pieces, black
pieces, and all pieces. Thus, we use 15 bitboards to represent a chess position.
There exist other factors as well (such as whose turn it is to move), but these
are trivial to implement.
Representing a board as a number is especially useful when we want to
evaluate a position. If we want to find all white pawns that are on blacks side
of the board, we can do this using one quick bitwise operation. Lets consider
the pawn position shown in Figure 3.

0Z0Z0Z0Z
Z0Z0Z0Z0
6
0Z0O0Z0Z
5
Z0Z0ZPZ0
4
0Z0Z0Z0Z
3
O0O0Z0O0
2
0O0Z0Z0Z
1
Z0Z0Z0Z0
a
b
c
d
e
f
g h
8
7

Figure 3: A pawn formation.

The bitboard to represent whites pawns is shown in Figure 4.

0
0

0
0

0
0
0
0
0
0
1
0

0
0
0
0
0
1
0
0

0
0
1
0
0
0
0
0

0
0
0
0
0
0
0
0

0
0
0
1
0
0
0
0

0
0
0
0
0
1
0
0

0
0

0
0

Figure 4: The bitboard for the pawns in Figure 3.

If we wanted to find all pawns that are on blacks half the board, we would
simply construct a bitboard representing blacks side and AND this number

with our white-pawns bitboard. The result is a bitboard of all white pawns on
blacks side, as shown in Figure 5.
0
0

1
0
0

0
0
0
0
0
0
1
0

0
0
0
0
0
1
0
0

0
0
1
0
0
0
0
0

0
0
0
0
0
0
0
0

0
0
0
1
0
0
0
0

0
0
0
0
0
1
0
0

1
0
0
1

0
1

0
1
&
0
0

0
0
0
0
0
0

1
1
1
1
0
0
0
0

1
1
1
1
0
0
0
0

1
1
1
1
0
0
0
0

1
1
1
1
0
0
0
0

1
1
1
1
0
0
0
0

1
1
1
1
0
0
0
0

0
1
1
0

1
0

1
0
=
0
0

0
0
0
0
0
0

0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0

0
0
1
0
0
0
0
0

0
0
0
0
0
0
0
0

0
0
0
1
0
0
0
0

0
0
0
0
0
0
0
0

0
0

0
0
0

Figure 5: Finding advanced pawns using bitboards.

In one fell swoop, we have can find all white pawns on the opponents side
of the board. Bitboard programs are very fast because they use many of these
bitboards to quickly find pieces. This is only a brief summary of a few of the
tricks we can enjoy with bitboardsthere exist countless methods people have
found to optimize their programs thanks to fancy operations with this useful
method.
4.2.3

Zobrist Hashing

One of the more difficult-to-handle aspects of board representation is the threefold repetition rule. This rule states that if a position is visited three times
during a game, either side can declare a draw. This rule must be accounted
for whenever the program considers a move, but poses a problem: how do we
efficiently keep a record of the positions our board has been in? The obvious
technique would be to keep a record of our complete previous state (in other
words, to have the board keep an array of previous states, or perhaps create a
linked list of boards), but this is extremely inefficient for two reasons: it would
require much more effort to make a move, and determining if two positions are
the same could require a lot of comparisons. There exists an easier solution:
Zobrist hashes.
Zobrist hashes rely on representing an entire board using a single 64-bit
number as hash of a position. Each element of a position, such as where pieces
are, whose turn it is to move, etc. is represented with a 64-bit bitstring which
we XOR into/out of the Zobrist hash for our position. For example, if we are
moving a pawn from b4 to c5, and we have a Zobrist hash Z of our position,
we would do the following changes:
Z = Z P awnAt[B4]
Z = Z P awnAt[C5]
To undo this change, we could repeat the same process. Because XOR is commutative (A B B A) and associative (A (B C) (A B) C), it
doesnt matter what order XOR things in or out, and we can always undo
our actions by simply repeating the XOR we have executed.

By using a Zobrist hash to represent our board position, to check for a

repeated position we simply need to maintain an array of previous Zobrist hashes
of our position and check to see if the same number appears three times. This
approach makes our process much faster and easier to implement, if at the price
of a (very rare) case of a hash collision5 (Zobrist, 1970).

4.3

Searching

Board representation is only the foundations for the actual point of a chess
program: searching. Searching is the process a chess program undergoes to look
for and find the best move available in its position.
4.3.1

Claude Shannons Types A & B

Chess artificial intelligence was formalized and developed in a paper, Programming a Computer for Playing Chess, by Claude Shannon. In his seminal work,
Shannon described two types of programs, which he called types A and B. Type
A would be a brute force algorithmall moves are examined, and the best
one is selected; type B would only examine plausible moves. Though it may
seem that a type B approach would be more effective, all strong programs are
nowadays type Athis is due to the fact determining if a move is plausible
takes too much work to be worthwhile. In fact, because type B programs are
essentially nonexistent, I will use the word search to mean a Shannon type A
search from this point forward.
Shannons work is also notable for his estimation of the number of possible
chess positions possiblehe provided the estimated number of different chess
positions that can arise. He finds that the number of positions that can arise is
on the order of
64!
1043
32! (8!)2 (2!)6
This number is stunningly high; so large, in fact, that it dispels any hope of
creating a chess-playing program that does not perform limited-depth searching (Shannon, 1950).
4.3.2

Minimax

The basis of chess artificial intelligence was explored far before computers existed; in 1928 John von Neumann described an algorithm nowadays known as
minimax that could help computers make decisions in games including chess (von
Neumann, 1928).
Minimax works by considering two players, aptly named min and max.
Mins goal is to try minimize the amount of points Max gets. Maxs goal,
obviously, is to try to maximize his score. Maxs technique is to attribute a
5 The likelihood of a collision in a Zobrist hash is remarkably unlikelyso unlikely that
Robert Hyatt (creator of Crafty) and Anthony Cozzie (creator of Zappa) remark that the
danger of collisions isnt a problem that should worry anyone

10

score to every move, and then choose the one with the highest score. Mins
technique is precisely the same thing, except he chooses the move the lowest
score. Max finds out how good a score is by asking Min what he thinks of it,
and Min finds out how good a score is by asking Max the very same question.
Of course, there is a problem hereif Max and Min just ask each other what
the score is all day, we will never find out what Maxs move is. To fix this, we
simply say that when we reach a certain search depth, we stop searching and
just give an estimation of how good a position is using an evaluation function.
In psuedocode, minimax is shown in Figure 6.
function min(depth)
if endOfGame() depth = 0
then
return estimation()
end if
min
for all moves do
makeTheMove()
score max(depth 1)
unmakeTheMove()
if score < min then
min score
end if
end for
return min
end function

function max(depth)
if endOfGame() depth = 0
then
return estimation()
end if
max
for all moves do
makeTheMove()
score min(depth 1)
unmakeTheMove()
if score > max then
max score
end if
end for
return max
end function

(b) Algorithm for Min

(a) Algorithm for Max

Figure 6: The Minimax algorithm

Minimax is perhaps best understood as a tree-searching algorithm. If we
imagine all the possible moves max and min can make as branches in a tree
(branches which, in turn, will have more sub-branches until we reach leaf
nodes), minimax looks for the best possible score knowing that min will always
chose the lowest possible value and max will always chose the highest possible
value. A graphical version of this tree is shown in Figure 7.6
There exist many optimizations for this basic minimax routine. For example,
in zero-sum games such as chess, any gain one player gains is to the detriment
of his opponent. This property can be summarized by saying that max(a, b) =
min(a, b). This property allows us to summarize Minimax by replacing
min and maxs cross-calling with a single function calling itself, as shown in
Figure 8.
This technique of summarizing minimax into one function is called negamax.
6 Image

credit: Wikimedia

11

Figure 7: Minimax as a Tree-Searching Algorithm

4.3.3

Alpha-Beta Pruning

Possibly the most difficult-to-grasp improvements to minimax is alpha-beta

pruning. This remarkable improvement was developed by Hart and Richards in
1961, and makes searching faster by avoiding searching when a move will never
be chosen (Adelson-Velskii et al., 1970; Edwards and Hart, 1961).
M. A. Weiss describes alpha-beta pruning with an example of alpha-beta for
a tic-tac-toe-playing program.
Suppose that the computer is considering five moves: C1 , C2 ,
C3 , C4 , C5 . Suppose also that the recursive evaluation of C1 reveals that C1 forces a draw. Now C2 is evaluated. At this stage, we
have a position from which it would be the human players turn to
move. Suppose that in response to C2 , the human player can consider H2a , H2b , H2c , and H2d . Further, suppose that an evaluation
of H2a shows a forced draw. Automatically, C2 is at best a draw and
possibly even a loss for the computer (because the human player is
assumed to play optimally). because we need to improve on C1 , we
do not have to evaluate any of H2b , H2c , and H2d ... (Weiss, 2002)
An implementation of alpha-beta pruning that uses negamax would look as
shown in Figure 9.
The value beta establishes an upper limit which, if exceeded, causes alphabeta to return a value early (which is why alpha-beta is faster than minimax).
Alpha serves as a reasonable score to beatif alpha-beta returns alpha, then
the position being evaluated was not deemed too good. Note also that alpha
changes value as it finds new positions that return better values.
This particular implementation of alpha beta has the condition that a returned value is always between alpha and beta. In this case, alpha and beta are
hard bounds and the implementation is said to be fail hard.
12

function minimax(depth)
if endOfGame() depth = 0 then
return estimation()
end if
max
for all moves do
makeTheMove()
score minimax(depth 1)
unmakeTheMove()
if score > max then
max score
end if
end for
return max
end function
Figure 8: The Negamax algorithm.
4.3.4

Quiescent Searching

One of the most dangerous aspects of limited-depth searching is when a strong

move the opponent can make is missed because the program did not search
far enough. For instance, a program examining a long sequence of consecutive
captures and re-captures might conclude that it wins an exchange just because
its done searching when in fact, if it had looked a move further, it would have
realized that it would in fact gain nothing (or lose material). A remarkable
instance of a top-class program losing due to this horizon effect of naive fixeddepth searching occurred in 2005 in a Man versus Machine triad of games.
Grandmaster Ruslan Ponomariov squared up against the program Fritz; the
computer made a remarkable error on move 39 (see Figure 10) (Levy, 2005).
Though the sub-optimal quality of this move is only apparent to those who
are already strong in chess, it becomes evident that Fritzs hunger for material
was myopic. The game continued with
39. . . Bc2 40 QXh4 gXh4 41 Rc1 RXb3 42 NXb3 BXb3 43 a5 Nc4 44
b5 Ba4 45 bXa6 Bc6 46 a7 Kg7 47 a6 Ba8 48 Rb1
Whereupon black resigned.
As it is clear here, it is important that computer programs should not simply
quit searching at some depth. The solution is to use quiescent searching. This
technique consists of searching deeper (to an indefinite depth, in fact) whenever
the computer searches through moves that are tactically potentially explosive
that is, positions where one side that can make a move that can drastically
change the evaluation of a position. Quiescent searching forces the program to
only evaluate quiet (quiescent) nodes, searching further if there exist moves
that have tactically strong moves.
An implementation of quiescent searching would replace alpha-betas call
to an evaluation function with a call to a quiescent-searching function, which
13

function alphabeta(, , depth)

if endOfGame() depth = 0 then
return estimation()
end if
for all moves do
makeTheMove()
score alphabeta(, , depth 1)
unmakeTheMove()
if score then
return
end if
if score > then
score
end if
end for
return
end function
Figure 9: The Alpha-Beta algorithm
Ponomariov vs. Fritz
Man vs. Machine, Bilbao21 Nov 2005

0Z0Z0ZkZ
Z0Z0ZpZ0
6
pm0o0m0Z
5
M0ZpZ0o0
4
PO0OpZ0l
3
ZBsbO0LP
2
0Z0Z0ZKZ
1
Z0Z0S0Z0
a
b
c
d
e
f
g h
8
7

Figure 10: Fritz (playing black) here plays ...Bc2?

would look as shown in Figure 11.7
7 The implementation of quiescent searching shown in Figure 11 uses an early call to an
estimation function (a stand pat score) in hopes of faster performance by failing hard or by

14

function qsearch(, )
standP at estimation()
if standP at then
return
end if
if standP at > then
standP at
end if
for all capturing moves do
makeTheMove()
score qsearch(, )
unmakeTheMove()
if score then
return
end if
if score > then
score
end if
end for
return
end function
Figure 11: The Quiescent Searching algorithm
However, this technique can still be improvedwe can limit ourselves to
only considering captures that are actually winning (this can be done using a
technique called Static Exchange Evaluation, which I do not explain here). We
can also use a clever (if perhaps a bit risky) technique called delta pruning, which
will skip quiescent-searching if no captures will allow the player to overcome
alpha.
4.3.5

Iterative Deepening, Principal Variation, and History Heuristic

Iterative deepening is a creative and powerful optimization for searching, and

opens many new doors for improvements to searching. The idea behind iterative
deepening is to begin ones search at a shallow depth and iteratively deepen the
search until we reach a full depth. Although this may seem pointless (after
all, it entails re-searching the same position multiple times), this is in fact very
powerful because as we progressively search, we also identify what moves have
been the best. We do this mainly through two methods: Principal Variation
Searching (PVS), and History Heuristic (Korf, 1985).
Before we discuss any optimizations to the alpha-beta routine, it is important
to note that most of these adaptations are Late Move Reductions (LMRs)
improving alpha.

15

because alpha-beta works fastest if the best moves are found first (if good moves
are found early on, more moves will be eliminated due to a narrower window
between alpha and beta), it is oftentimes worthwhile to spend a little extra
effort to identify moves that appear to have a lot of potential.
Principal Variation Searching (PVS) identifies the best move at the current
depth (the move that raises alpha) and stores it in order for it to be found again
at the next search depth. Oftentimes (in fact, most of the time), this best move
(the prinipal variation) remains the best move even as we increase our depthsearch, so after we find the principal variation at a low depth (which takes little
time), we quickly find the best move at a high depth because we begin our
search with the principal variation (Marsland and Campbell, 1982).
History heuristic is the technique of maintaining two 64x64 arrays (one for
each side) that represents from and to squares for moves that cause a value
to be returned (be it due to beta cutoff or alpha improvement). When we
progress to the next search depth, we will prioritize moves with high values
in the history heuristic arrays because these are more likely to cause a betacutoff or alpha improvement (which, either way, makes the process of searching
faster). History heuristic is a controversial methodthough simple to implement,
top-level programs avoid it because it ceases to be useful at very high search
depths (Schaeffer, 1989).
4.3.6

Null Move Pruning

Null move pruning is a creative method to quickly detect positions that are
almost certainly going to cause a beta-cutoff. The technique works based on
the assumption that passing ones turn (doing a null move) is detrimental to
ones position.8 If, even despite the handicap of a null move, a player is still
winning in a position (to be more specific, if the player is still causing a betacutoff), then it is reasonable to assume that the position is ridiculous and we
can move on to search more plausible moves (Adelson-Velsky et al., 1975).
There exist many aspects to null move pruning that vary from program to
program. This includes the value of R, the value representing by how much
we reduce our search depth after doing a tentative null-move pruning. Some
programs use the value 2, others 3, and yet others chose between these two
values depending on the current search depth.
A very important aspect of null-move pruning to keep in mind is the possibility of (relatively rare) positions where there doesnt exist any moves better
than the null move. These positions, which are known as zugzwang, occur
when any move a side can make will be to the detriment of his / her position.
Figure 12 shows an example of a zugzwang position; blacks only option is the
move Kb7, whereupon white will be guaranteed to be able to promote his pawn
and win.
To avoid using null-move pruning in zugzwang positions, one simple solution
is to require a certain minimum amount of non-pawn pieces on the board before
8 Null moves are illegal in chessnonetheless, chess programs can still use the assumption
that a null move is detrimental (this is called the null move observation) to their advantage.

16

0ZkZ0Z0Z
7
Z0O0Z0Z0
6
0Z0J0Z0Z
5
Z0Z0Z0Z0
4
0Z0Z0Z0Z
3
Z0Z0Z0Z0
2
0Z0Z0Z0Z
1
Z0Z0Z0Z0
a
b
c
d
e
f
g h
8

Figure 12: An example of zugzwangBlack to move, loses

we attempt a null move; zugzwang positions where there exists even a minor
piece are extraordinarily rare and so many programs simply assume that a
position with a piece on the board cannot have zugwzwang, though high-level
programs may spend more time identifying zugzwang positions.

4.4

Evaluation

Position evaluation is the third and final element to a chess engine. Search
optimizations can help a program go faster, but only a strong evaluation function
can make it stronger (in terms of its knowledge of chess). Deep Blue, the
famous IBM computer that defeated world champion Garry Kasparov in a 6game match in 1997, had an extremely complex position evaluator that had
been developed for years by multiple grandmasters.
All searching algorithms eventually reach rock bottom and stop searching
any further; instead of going to deeper search depths, they call an evaluator
that estimates how good a position is for whoevers turn it is to move. If
a position is advantageous for the side to move, the evaluator should return a
positive value; if the position is not good for the side to move, the result should
be negative. A dead draw should return 0.
Most chess players are familiar with the idea of certain pieces being worth
more than others. For example, it is relatively common knowledge that a rook
is more or less worth five pawns. However, some other elements to playing, such
as having pieces in good places, are rarely worth as much as a pawn is, even in
the most contrived of scenarios. So how do we represent things that are worth
less than a pawn? The key is to come up with an imaginary unit, the centipawn,
and use this value when evaluating. The advantage to using centipawns is that
we can easily handle things worth less than a pawn (for instance, something

17

worth a quarter of a pawn is worth 25 centipawns), and it allows us to work

only with integers, which are faster to work with than floating-point decimals
are.
A strong evaluation function can take many forms, but always works by
assigning a bonus for some element of a position that brings about an advantage
to the person whose turn it is to move, and assigning penalties if the opponent
has good elements to his/her position. Most evaluators take many factors into
consideration when evaluating a position.
4.4.1

Material

By far the most important aspect of position evaluation is materialhaving

more pieces on the board. However, specifically determining what we should
assign as values remains a topic of debate. A very popular essay on the matter
comes from GM Larry Kaufman, who assigns the values Pawn = 1, Knight =
312, Bishop = 312, Rook = 5, and Queen = 934. Kaufman also specifically
encourages an additional bonus of 12 for having both bishops (the bishop
pair) (Kaufman, 1999).
Some programmers may chose to assign variable values for piecesfor example, it may be desirable to make knights be worth more when a position is
closed (where there is little open space on the board) and make bishops more
valuable in open positions (where the center of the board is open).
4.4.2

Pawn Structure

In chess, a solid position oftentimes comes from having a very strong pawn
structure. Because of the particular way in which pawns can move, these little
pieces can simultaneously be remarkably strong or hopelessly useless. It is up to
the evaluator to detect strong or weak pawn structure. Most programs penalize
three types of weak pawn structure, which are labeled in Figure 13.
In the first diagram, the pawns on a5, b3, and e4 are isolated. In the second
diagram, the pawns on the b and f files are doubled. In the third diagram, the
pawns on d5 and g7 are backward.
0Z0Z0Z0Z
Z0Z0Z0Zp
0Z0o0ZpZ
o0o0Z0Z0
0Z0ZPZPZ
ZPZ0Z0ZP
0Z0Z0Z0Z
Z0Z0Z0Z0

0Z0Z0Z0Z
Z0Z0Z0Z0
0OPZ0Z0Z
Z0ZPZPZ0
0O0Z0O0Z
Z0Z0Z0Z0
0Z0Z0Z0Z
Z0Z0Z0Z0

0Z0Z0Z0Z
Z0o0Z0o0
0ZPZ0o0Z
Z0ZPZPZ0
0Z0ZPZ0Z
Z0Z0Z0Z0
0Z0Z0Z0Z
Z0Z0Z0Z0

Figure 13: Isolated, doubled, and backward pawns.

18

4.4.3

Piece-Square Tables

An easy way to encourage a chess program to put its pieces in good squares is
to use Piece-Square Tables. These tables are in fact arrays that give a given
bonus (or penalty) for a piece on a specific square. For example, a piece-square
table for white pawns would likely give bonuses for pawns in the center and
for those about to promote. A piece-square table for knights would probably
penalize having the knight along the edge of the board (a knight on the rim is
grim).
An example of a piece-square table for white pawns could look like the
array shown in Figure 14. This particular piece-square table encourages rapid
development of the center pawns and gives bonuses for pawns that have moved
forward, especially if they are closer to the central files. Such a piece-square
table will likely encourage good piece positioning.

0 0 0
0
0
0 0 0
5 10 15 20
20 15 10 5

4 8 12 16
16 12 8 4

3 6 9
12
12
9 6 3

2 4 6
8
8
6 4 2

1 2 3 10 10 3 2 1

0 0 0 40 40 0 0 0
0 0 0
0
0
0 0 0
Figure 14: A possible piece-square table for white pawns.

4.4.4

King Safety

King safety is another important aspect to many evaluators. It is generally

useful to maintain a strong defensive position for ones king during a game of
chess. King safety in a programs evaluator can encourage the program to have
a solid pawn shield in front of ones king and discourage the program from
allowing the enemy to place his/her pieces in places that are too close to the
king.
An easy way to implement king safety would be to give a bonus for adjacent
pawns in front of the king (using bitboards to represent places where a shielding
pawn could stand, and ANDing this bitboard with the bitboard for whites
pawns), and give penalties for opponent pieces that are near the king (using
an array and a method of finding distances between squaresperhaps with
Chebyshev distances9 ).
The world of computer chess is a well-developed one and top-of-the-line
programs take years to create. While my program will certainly not do as well
9 The Chebyshev distance bewteen two points represents the number of turns it would take
a king to move between the two points.

19

as the current reigning champions, it will certainly represent its own unique
take at the challenge. The decisions I make when developing my program will
determine what techniques will be useful to me further down the line. Each
chess program has its own defining characteristics in representation, searching,
and evaluation that distinguish it from others and perhaps adds a very human
aspect to a deterministic process.

20

5
5.1

Development
Version 0.1

My first version of my chess engine is finished by early November. This basic

program uses basic searching techniques: alpha-beta searching with bitboards,
as well as basic evaluation (based on Tomasz Michniewskis simplified evaluation
function). During this time I reached preliminary results and very high speeds
when searching (especially when compared to my very first attempt, using an
8x8 array with only minimax).
Due to the fact that I spent much of my time waiting for my program to
play when testing old versions, I decided to name my engine Godot (in reference
to Samuel Becketts play Waiting for Godot).
One particularly interesting test to assure that a move generation works
correctly is perft. This is simply a test case where the program is given a position
and is asked to generate all possible legal moves at progressively increasing
depths. For instance, if we begin from the starting position, the number of legal
moves we have is:
Depth
1
2
3
4
5
6

Moves
20
400
8902
197281
4865609
119060324

Which my programs reproduces correctly. What is perhaps most exciting is

the rate at which the program generates these moves: at a rate of just below
1.4 million nodes / second. However, that number will quickly go down when I
actually have to evaluate those positions, which will take most of my time.
I make my program use alpha-beta pruning and I now have my first presentable artificial intelligence, although it isnt terribly smart yet. I decide to
test my program with a basic chess puzzle, shown in Figure 15. I use this
position because the solution is relatively simple and completely empirically decisive. The winning moves are 1 QXd1+ KXd1 2 Nf1+ Kf2 3 NXh1, requiring a
depth search of 4 (though there are five moves in the sequence, implementations
do not count the first move as a search depth).
The preliminary results were slightly disappointing. The data I found is
shown in Figure 16. Considering a game of lightning chess (1 min. each side)
that takes 25 moves of actual thinking, we would need to take no more than 2.4
seconds of thought per move, thus leaving us with a depth of 2, which is not
enough for serious play. Given a 3-minute game of 30 thinking moves, wed need
6 seconds. For 40 moves in a 5-minute game, we would need 7.5 seconds. So
at my current implementation, I could play to depth 2 for anything except the
longest of games, where I could perhaps reach depth 3, which remains extremely
shallow. Much work remains.
21

rmblka0s
7
opo0Z0op
6
0Z0Z0o0Z
5
Z0Z0Z0Z0
4
0ZNZ0OnZ
3
Z0Z0Z0Z0
2
POPZ0ZPO
1
SNAQJBZR
a
b
c
d
e
f
g h
8

Figure 15: The test position for speed evaluation.

Depth
1
2
3
4

Time (s)
.163
.854
22.018
224.256

Nodes
1206
25605
793889
8307900

Rate (node/s)
7398.773
29983.606
36056.363
37046.500

Figure 16: Results with only alpha-beta pruning.

My next endeavor, then, was PV-searching (PVS). The particular implementation I used was based off of Stef Luijtens Winglet program, which uses a
triangular array where the PV at depth N is stored in the Nth row of the array.
Of course, with fixed-depth searching, that would mean that the array would
have M axDepth N 1 entries at Depth N. The results of PVS are shown in
Figure 17.
As with most speed-ups, three things can be noted with this optimization:
1) the program is faster (time dropped by 9.44%); 2) fewer nodes are examined
(a 16.96% decrease); 3) rate has slowed down (by about 12%). This is due to the
Depth
1
2
3
4

Time (s)
.167
.966
15.545
203.086

Nodes
1367
29355
506818
6898488

Rate (node/s)
8185.628
30388.199
32610.281
33968.309

Figure 17: Results after adding PV searching.

22

Depth
1
2
3
4
5
6

Time (s)
.042
.114
.146
.218
.764
7.319

Nodes
43
157
1198
3829
29777
340529

Rate (node/s)
1023.810
1377.193
8205.479
17564.220
38975.130
46526.711

Figure 18: Results after adding Iterative Deepening.

program working more effectively with respect to time, at the price of having
to do more work for each node. Despite the improvements, Godot still cannot
play even semi-decently. More work must be done.

5.2

Version 0.2

Godot becomes a serious program once Ive completed iterative deepening. It

turns out that most of the moves I make are a total waste of my timethankfully
with PV-searching and history heuristics, I now have a major speedup. The
results of the previous test case, now with much deeper searching are shown in
Figure 18.
As expected, the program is (much, much) faster (nearly a thousand times
faster, in fact), examines less nodes, and has a lower node/s efficiency. However,
we can see that rate slowly increases with the new implementation, indicating
that despite the fact that we are doing much more work each node, we are
getting much more payoff. By depth 6, we have a much higher rate than we did
with any other implementation. Iterative deepening marks the beginning of a
serious program.
At this point, I play my first game against the fledgling Godot, as shown in
Figure 19.

5.3

Version 0.3

What is immediately apparent from the first game (apart from the fact that I
am awful at chess, which is perhaps a little ironic at this point) is that Godot
needs quiescent searching. In this last game, Godot sacrifices a knight with the
move . . . NXd4 due to the fact that he doesnt see through the whole exchange,
only noticing he has the last move and naively concluding this means he wins
the exchange. The final result of this type of searching is the program playing
embarrassing blunders.
My next goal, then, was to implement quiescent searching. This required
that I implement SEE, or Static Exchange Evaluation. This can be implemented
using the SWAP algorithm, which avoids the ostensibly recursive nature of a
program that looks through all possible exchanges at a square. The final result
is a program that is quite a bit slower, but makes very few blunders.
23

Ulysse Carion vs. Godot

5 minute game
The game begins in a rather usual way, though Godots lack of an opening repertoire is obvious from move 1.
1 e4 Nc6 2 Nf3 Nf6 3 Nc3 e6 4 d4 Bb4 5 e5 Ng4 6 Bd2

rZblkZ0s
opopZpop
6
0ZnZpZ0Z
5
Z0Z0O0Z0
4
0a0O0ZnZ
3
Z0M0ZNZ0
2
POPA0OPO
1
S0ZQJBZR
8
7

At this point Godot makes a flat-out blunder with the startlingly dumb move
6. . . NXd4??
I happily accept the sacrifice.
7 NXd4 Qh4
Unfortunately for me I was even more short-sighted than Godot was here;
8 Bb5?? QXf2m

rZbZkZ0s
opopZpop
6
0Z0ZpZ0Z
5
ZBZ0O0Z0
4
0a0M0ZnZ
3
Z0M0Z0Z0
2
POPA0lPO
1
S0ZQJ0ZR
8
7

Godots first victory.

Figure 19: The machine versus his creator.

In order to prove to myself that Ive been productive in my efforts, I square
off Godot 0.2 against 0.3 to see if my improvements are sufficiently conclusive
for a victory.
24

Godot 0.2 vs. Godot 0.3

1 minute game

1 Nc3 d5 2 e3 Nf6 3 d4 Bf5 4 Bd3 e6 5 BXf5 eXf5 6 Qd3 Qd7 7 Qb5

QXb5 8 NXb5 Na6 9 Nf3 Bb4+ 10 c3

rZ0ZkZ0s
opo0Zpop
6
nZ0Z0m0Z
5
ZNZpZpZ0
4
0a0O0Z0Z
3
Z0O0ONZ0
2
PO0Z0OPO
1
S0A0J0ZR
8
7

Godot 0.3 here plays a clever . . . c6!, which forces Godot 0.2 to juggle too
many balls at once ...
10. . . c6! 11 cXb4 cXb5 12 O-O NXb4

rZ0ZkZ0s
opZ0Zpop
6
0Z0Z0m0Z
5
ZpZpZpZ0
4
0m0O0Z0Z
3
Z0Z0ONZ0
2
PO0Z0OPO
1
S0A0ZRJ0
8
7

... and Black is now up a pawn and has a bishop for a knight. The game then
drifts into an uncomfortable endgame for white.
13 Bd2 Nd3 14 a4 bXa4 15 Ne5 NXe5 16 dXe5 Ne4 17 Be1 Nc5 18
Rd1 O-O-O 19 Bb4 Nb3 20 Rd3 f6 21 Rc3+ Kb8 22 eXf6 gXf6 23 Be7
Rc8 24 BXf6 Rhe8 25 Rd1 Rc6 26 RXc6 bXc6 27 Kf1 Kc7 28 Bc3 Kd6
29 Ke2 f4 30 g3 f Xe3 31 f4 Kc5 32 Bf6 Nd2 33 Bc3 Nb3 34 Bf6 Nd2 35
Bc3 Nc4 36 Bd4+ Kd6

25

0Z0ZrZ0Z
o0Z0Z0Zp
6
0Zpj0Z0Z
5
Z0ZpZ0Z0
4
pZnA0O0Z
3
Z0Z0o0O0
2
0O0ZKZ0O
1
Z0ZRZ0Z0
8
7

In the style of Cronus with Uranus and Zeus with Cronus, Godot 0.3 defeats
its predecessor with great gusto.
37 b4 aXb3 38 Bc3 c5 39 Ra1 d4 40 Be1 b2 41 Rb1 Rb8 42 Ba5 Na3
43 Rd1 Kd5 44 Bc3 b1Q 45 RXb1 RXb1 46 BXd4 cXd4 47 Kf3 Rf1+ 48
Ke2 Rf2+ 49 Kd1 Nc2 50 f5 d3 51 Kc1 e2 52 Kb2 e1Q 53 g4 Qa1+ 54
Kb3 Qa3m

0Z0Z0Z0Z
o0Z0Z0Zp
6
0Z0Z0Z0Z
5
Z0ZkZPZ0
4
0Z0Z0ZPZ
3
lKZpZ0Z0
2
0ZnZ0s0O
1
Z0Z0Z0Z0
8
7

Godot 0.3 Victorious

At this point, I wanted to have an actual evaluation of how good my program

really is. This meant having it play online. Because I dont have the money
to pay for online membership-based services that would allow my program to
play on an online chess server (i.e. Chessbases PlayChess or ICC), I opted for
creating a bot that played games automatically on chess.coms free server. I
had Godot play 1-minute chess and to my surprise, it played at a remarkable
2110 Elo, defeating multiple FIDE-titled players in the process.
I include below some of the more interesting games, though I omit any
commentary because it would not be worthwhile given the blunder-prone nature
of lightning chess.
FM Julian Landaw (2396) v. Godot (First match against titled player)
26

1 e4 Nf6 2 e5 Nd5 3 d4 Nc6 4 c4 Nb6 5 d5 NXe5 6 b3 e6 7 Bb2 d6 8 dXe6

BXe6 9 f4 Ng6 10 g3 d5 11 c5 BXc5 12 Qc2 Bb4+ 13 Nd2 O-O 14 f5 BXd2+
15 KXd2 Qg5+ 16 Kd1 QXf5 17 Bd3 Qg4+ 18 Ne2 Qf3 19 Kd2 Rac8 20 Rhf1
Qh5 21 h4 Nd7 22 Nd4 Nge5 23 Be2 Qh6+ 24 Ke1 Qe3 25 Nf5 BXf5 26 QXf5
QXg3+ 27 Qf2 QXf2+ 28 RXf2 Rce8 29 Kf1 Re6 30 Rc1 Rc8 31 Kg1 Rg6+ 32
Kh1 Rd6 33 h5 d4 34 Rg2 d3 35 Bg4 d2 36 Rd1 NXg4 37 RXg4 f6 38 h6 g5
39 Rg2 Kf7 40 RdXd2 RXd2 41 RXd2 Ne5 42 Rf2 Ng4 43 Rg2 NXh6 44 Rf2
Ng4 45 Rf3 Ke6 46 Bc3 Ne5 47 Re3 Kd5 48 Re2 Re8 49 Be1 f5 50 Rd2+ Ke4
51 Bf2 a6 52 Re2+ Kd5 53 Rc2 Re7 54 Bg1 f4 55 Rd2+ Ke4 56 Re2+ Kd5 57
Rh2 g4 58 Rd2+ Ke4 59 Rh2 g3 60 Rh6 f3 61 Rh4+ Kf5 62 Rd4 f2

0Z0Z0Z0Z
Zpo0s0Zp
6
pZ0Z0Z0Z
5
Z0Z0mkZ0
4
0Z0S0Z0Z
3
ZPZ0Z0o0
2
PZ0Z0o0Z
1
Z0Z0Z0AK
8
7

Final position after Landaw loses on time.

NM Jared Defibaugh (2372) v. Godot (Victory against chess.coms 5thbest player.)

1 e3 Nc6 2 d4 Nf6 3 Nf3 d5 4 Be2 e6 5 O-O Bd6 6 h3 O-O 7 c4 Bb4 8 Nc3
BXc3 9 bXc3 Ne7 10 Qc2 Bd7 11 Ne5 Bc6 12 Ba3 Re8 13 BXe7 QXe7 14 NXc6
bXc6 15 c5 e5 16 Rab1 Rec8 17 Rb7 Rcb8 18 Rfb1 Rc8 19 a4 Qe6 20 a5 h6
21 Qd1 a6 22 Qf1 Ne4 23 BXa6 Nd2 24 Qe2 NXb1 25 RXb1 Rd8 26 Rc1 e4
27 Bb7 RXa5 28 Rb1 Rb8 29 Rb2 Ra7 30 BXc6 Ra1+ 31 Kh2 Rc8 32 Bb5 Rc1
33 c6 Qd6+ 34 g3 RXc3 35 Ba6 Rd8 36 Bb7 RXc6 37 BXc6 QXc6 38 Rc2 Qb6
39 h4 Ra8 40 Qd2 Rc8 41 Qc3 Qb1 42 Qc5 Qb3 43 Qc3 Qb1 44 Qc6 Qb3
45 Re2 h5 46 Qd7 Qb7 47 Qf5 g6 48 Qg5 Qc6 49 g4 hXg4 50 QXg4 Ra8 51
Qg3 Qc4 52 h5 QXe2 53 hXg6 Qh5+ 54 Kg2 QXg6 55 QXg6+ f Xg6 56 Kg3
Kf7 57 f3 Ra3 58 Kf4 g5+ 59 KXg5 eXf3 60 e4 dXe4 61 d5 f2 62 d6 cXd6

0Z0Z0Z0Z
Z0Z0ZkZ0
6
0Z0o0Z0Z
5
Z0Z0Z0J0
4
0Z0ZpZ0Z
3
s0Z0Z0Z0
2
0Z0Z0o0Z
1
Z0Z0Z0Z0
8
7

Final position after Defibaugh loses on time.

27

 Godot v. GM Evan Ju (2353) (Loss against chess.coms then-#1 player.)

1 Nc3 g6 2 Nf3 Bg7 3 d4 d6 4 e4 Nf6 5 Bf4 O-O 6 e5 Nfd7 7 Bc4 Nb6 8 Qe2
NXc4 9 QXc4 c6 10 eXd6 eXd6 11 Bg5 Re8+ 12 Kf1 Qb6 13 Na4 Qa5 14 Bd2
Qh5 15 Re1 RXe1+ 16 KXe1 b5 17 Qb4 bXa4 18 QXd6 Nd7 19 QXc6 Rb8 20
Kf1 Nf6 21 Kg1 Bg4 22 Qd6 RXb2 23 Qd8+ Bf8 24 QXf6 BXf3 25 gXf3 Qh3
26 Qf4 Rb1+ 27 Bc1 Bh6 28 QXh6 QXh6 29 Kg2 RXc1 30 RXc1 QXc1 31 a3
QXc2 32 d5 Qb3 33 f4 QXd5+ 34 Kg3 Qb3+ 35 Kg2 QXa3 36 h3 Qb3 37 h4
a3 38 f5 a2 39 f Xg6 a1Q 40 gXh7+ KXh7 41 h5 Qd5+ 42 f3 Qad4 43 h6 Qg5+
44 Kf1 Qd1+ 45 Kf2 Qdd2+ 46 Kf1 Qgg2m

0Z0Z0Z0Z
o0Z0ZpZk
6
0Z0Z0Z0O
5
Z0Z0Z0Z0
4
0Z0Z0Z0Z
3
Z0Z0ZPZ0
2
0Z0l0ZqZ
1
Z0Z0ZKZ0
8
7

Final position after ...Qgg2#

The results of online play indicated two thingsfirst, that Godot was definitely playing at an extremely high level (to the extent that I was no longer
capable of judging how well it plays purely by looking at its moves), and second,
that Godot could still be improved. 1-minute chess is highly tactical, and that
humans could defeat it meant that it was not searching deeply enough. I still
had many optimizations I could explore at this point. Also, it was becoming
quite evident that my evaluation was not very goodby analysing my games using a stronger program, it became evident that Godot was not putting enough
emphasis on things such as pawn structure or king safety.

5.4

Version 0.4

Godot 0.4 marked two large improvements over its predecessor: null move pruning and better evaluation.
Null move pruning causes a remarkable speed-up over previous implementations. In order to detect potential zugzwang, positions where null move pruning
wont work, Godot does not do null-move pruning if either side has no pieces
(pieces here meaning any chessman except pawns). The results, which are
considerably better than any previous test, are conclusively better and shown
in Figure 20.
Null-move pruning again adds a new level of achievable search depth, making
Godot even stronger. At 5-minute games, Godot can now reasonably play at
depth 6, and is incredibly fast at depth 5. For longer games, Godot can now
reach depth 7. However, likely just as important is the new evaluator, which
takes into consideration:
28

Depth
1
2
3
4
5
6
7

Time (s)
.138
.173
.249
.425
.52
3.928
13.785

Nodes
58
483
1336
6271
9424
103167
377588

Rate (node/s)
420.290
2791.908
32610.281
33968.309
5365.462
18123.077
27391.222

Figure 20: Results after adding Null-move pruning.

Piece Values Godot attributes values to pieces according to GM Larry Kaufmans values, which I described in Section 4.4.1.
Pawn Structure Godot penalizes 10 cp10 for doubled or isolated pawns, and
penalizes 8 cp for backward pawns.
Passed Pawns Godot offers a 20 cp bonus for a pawn that is passed (that is,
no pawn ahead of it is in an adjacent file).
Rooks Behind Passed Pawns Godot offers an additional 20 cp bonus for a
rook that is behind and on the same file as a passed pawn.
Pawn Shield Godot gives 9 cp for a pawn immediately ahead and adjacent to
the king, and also gives 4 cp for a pawn two ranks ahead of the king.
Nearby Threats Godot penalizes for having any opponents piece too close
to the king.
Piece Placement Godot also uses piece-square tables, but unlike before they
have a relatively small impact on evaluation.
This new evaluator does not cause any measurable slowdown in searching,
but certainly does cause the computer to play better.
I also implemented delta pruning, a technique that attempts to speed up
searching in quiescent searching by returning alpha if one side is so far above
alpha that there is no hope of reaching an equalizing position. To my surprise,
this optimization slightly slowed down my programthe extra work necessary
to test the potential value change in a position, as well as the extra logic
involved made the optimization not worthwhile in my program.
At this point, the new program plays considerably better than I do, making testing the program in specific scenarios very difficult. Thankfully, a very
strong chess player, Varun Krishnan (a USCF11 Life Master), volunteered to
play against my program. The game went as:
10 cp

= Centipawns (see Section 4.4)

States Chess Federation

11 United

29

1 e4 Nc6 2 d4 d5 3 e5 e6 4 Nf3 Bb4+ 5 c3 Ba5 6 Bd3 Nge7 7 O-O

O-O 8 BXh7+ KXh7 9 Ng5+ Kg8 10 Qh5 Re8 11 QXf7+ Kh8 12 f4
Nb8 13 Rf3 Nf5 14 Rh3+ Nh6 15 RXh6+ gXh6 16 Qh7m
Krishnan remarked that my program mostly lacked was an opening book
the moves 1 e4 Nc6 2 d4 d5 3 e5 e6 lead to a position that strongly favors white.
Shredders opening database, which has nearly 3,000 positions in the position
following 1 e4 e6 2 d4 d5 3 e5 (the French Defence, Advance Variation), only
finds 2 games where the move . . . Nc6 was made. It was apparent that it was
time to create an opening book.
Although many opening databases exist online and in other programs, I
decided to create my own opening database. To do this, I needed a large sample
size of high-quality games. I found a large database of games from the Dutch
Chess Championship, ranging 25 years from 1981 to 2006. The database had a
total of 104,020 games.
To parse the database, the first step was to convert the PGN-formatted
database into something my program could use. A PGN game takes the format
of:
[Event ""]
[Site ""]
[Date "1994.??.??"]
[Round "?"]
[White "Broll, Egon"]
[Black "Fischer, Max Dr(33)"]
[Result "1-0"]
[WhiteElo "1625"]
[ECO "A10"]
1.c4 b6 2.g3 Bb7 3.Nf3 e6 4.Bg2 d6 5.O-O g6 6.d4 Bg7 7.Nc3 Nf6
8.Bg5 O-O 9.Qd2 Qd7 10.Bh6 Re8 11.Bxg7 Kxg7 12.Rae1 c5 13.e4
cxd4 14.Qxd4 Nc6 15.Qd2 e5 16.Nb5 Red8 17.a3 a6 18.Nc3 Na5
19.Qd3 Rac8 20.Nd5 Nxc4 21.b3 Bxd5 22. exd5 Nxa3 23.Qxa6 Nc2
24.Rd1 b5 25.Ng5 Nb4 26.Qa5 Nc2 27.Bh3 Ng4 28.f3 Nce3 29.Bxg4
Nxg4 30.fxg4 Rf8 31.Qb4 h6 32.Nf3 Rce8 33.Rc1 e4 34.Nd4 e3
35.Qxb5 Qa7 36.Ne2 Rb8 37.Qd3 Rfe8 38.Rf4 Qa3 39.Rcf1 Re7 40.Qc3+
Re5 41.Rxf7+ Kg8 42.Qc7 1-0
Using a RegEx (Regular Expression) (a type of string that can find and replace character sequences), we can parse the entire database into a long sequence
of lines, each of them representing a game. I removed any character sequence
matching the RegEx:
[\\{.+?\\} | \\d+\\. | \\s\\s+]
Which removes all comments (which are enclosed between {. . .}), numbers
(which take the form of digits followed by a period), and extra whitespace.
I also completely ignore any line that begins with [. The aforementioned
PGN now becomes the line:
30

c4 b6 g3 Bb7 Nf3 e6 Bg2 d6 O-O g6 d4 Bg7 Nc3 Nf6 Bg5 O-O [...]
At this point, all we have is a long list of moves in what is called algebraic
notation 12 . My goal at this point was to create a large database of positions and
the most common move in that position. Though it may be tempting to simply
create a large table of lines of algebraic notation and replies in that position,
this would be inadequate. Such an implementation would not consider the move
sequences 1 e4 e5 2 Nc3 and 1 Nc3 e5 2 e4 to be equivalent, despite the fact
that they are13 .
For my program to work correctly with transpositions, it must enter the
moves into the actual chess-playing logic, and ask the chess program itself if two
lines are equivalent. This means I must convert SAN into computer-formatted
moves. Algebraic notation is not optimal for computers, who must try to convert
a move represented in legible format into a move usable by the program. This is
due to the fact that algebraic notation accounts for the ambiguity of a move.
Normally, a move representing a rook moving to f3 would be represented as Rf3
in algebraic notation, but if there are two rooks that can move there, then we
disambiguate by specifying the file or rank (preferably the former) of the piece
moving. This is demonstrated in Figure 21.
0Z0Z0Z0Z
Z0Z0Z0Z0
6 0Z0Z0Z0Z
5 Z0Z0Z0Z0
4 0Z0Z0Z0Z
3 ZrZ0Z0Z0
2 0Z0Z0Z0Z
1 Z0Z0Z0Z0

0Z0Z0Z0Z
Z0Z0Z0Z0
6 0Z0Z0s0Z
5 Z0Z0Z0Z0
4 0Z0Z0Z0Z
3 ZrZ0Z0Z0
2 0Z0Z0Z0Z
1 Z0Z0Z0Z0

Figure 21: With SAN, Rb3f3 is Rf3 in the first position, but Rff3 in the latter.
Once I created a simple utility to convert a SAN move into a computerusable format (using something very similar to Stockfishs method, implemented
in Stockfishs notation.cpp), I could then easily keep track of what positions had
what replies. However, even with a large table of positions and most common
replies, I still need a way to easily find the move Im looking for (assuming it is
even there).
The solution was to create a large Tree Map, a data structure that can link
keys with values. For each position, I used the positions Zobrist hash as its key,
and the move to reply with as its value. The advantage with using a Tree Map
is that its implementation is such that the time to find a move is proportional to
the logarithm of the size of the Map (in computer science terms, this is referred
to as running in O(log n)), meaning my opening database will not become
much slower even if I make my opening database larger.
12 Also
13 In

known as SAN, which is short for Standard Algebraic Notation.

chess terminology, two lines leading to the same position are known as transpositions.

31

My final implementation has a very large mapping of positions with moves,

giving Godot the capacity to respond to 252,360 different positions without ever
having to think. Effectively, this means that Godot will likely be able to play
without searching for the first 7 moves of the game.
Krishnan against volunteered to play against Godot, this time in the format
of a 1-minute game.

Varun Krishnan (2217) vs. Godot

1 minute game
Godots new opening book, though adding theoretically very little (to no)
skill the Godots actual play, has a strong psychological effect when a
human faces it. Godot accurately plays the first moves of Pirc Defense,
Classical Variation.
1 Nf3 g6 2 e4 Bg7 3 d4 d6 4 Nc3 Nf6 5 h3 O-O 6 Be2 c5 7 O-O
Nc6

rZbl0skZ
7
opZ0opap
6
0Zno0mpZ
5
Z0o0Z0Z0
4
0Z0OPZ0Z
3
Z0M0ZNZP
2
POPZBOPZ
1
S0AQZRJ0
a
b
c
d
e
f
g h
8

With Godot having consumed less than half a second of thought, the psychological effects of a relatively aggressive computer with time to spare
causes a blunder on whites part.
8 d5 Ne5 9 NXe5 dXe5 10 Be3 b6 11 Bb5 Rb8 12 a4 Qd6 13

32

Nb1??

0sbZ0skZ
o0Z0opap
6
0o0l0mpZ
5
ZBoPo0Z0
4
PZ0ZPZ0Z
3
Z0Z0A0ZP
2
0OPZ0OPZ
1
SNZQZRJ0
a
b
c
d
e
f
g h
8
7

Godot pushes on to capture another pawn...

13. . . NXe4 14 f3 Nf6 15 c4 e6 16 a5 eXd5 17 cXd5 QXd5

0sbZ0skZ
o0Z0Zpap
6
0o0Z0mpZ
5
OBoqo0Z0
4
0Z0Z0Z0Z
3
Z0Z0APZP
2
0O0Z0ZPZ
1
SNZQZRJ0
a
b
c
d
e
f
g h
8
7

With only a few seconds on the clock and Godot with still over two thirds
of his time remaining, white makes another final blunder.
18 Nc3 Qe6 19 Ba4 c4 20 aXb6 aXb6 21 Qe2 Nh5 22 Bb5??

33

Ng3!

0sbZ0skZ
Z0Z0Zpap
6
0o0ZqZpZ
5
ZBZ0o0Z0
4
0ZpZ0Z0Z
3
Z0M0APmP
2
0O0ZQZPZ
1
S0Z0ZRJ0
a
b
c
d
e
f
g h
8
7

White loses on time.

Other games demonstrate the same patternGodot wins most of its games
by playing relatively solid moves consistently, winning by taking advantage of
its opponents blunders. Against a very careful opponent, Godot struggles to
outperform its rivals, but in rapid chess, when perfect opening play and fast
thinking have a powerful psychological effect, the computer can incite mistakes
in the humans that face it.

5.5

Version 0.5

In order to make my program quite a bit faster, I decided to change my program from being a hybrid-representation program (containing both piece-centric
and square-centric data) to a completely bitboard-based program. My initial
program had a few dependencies that ran faster with square-centric implementations (namely evaluation), but Godot 0.4 could easily be implemented in a
completely piece-centric way. The only operation that would have to be slowed
down with the change is outputting the board, an operation that is almost never
executed.
With the new, completely bitboard-based program, Godot is quite a bit
faster. With perft, Godot can loop through 2.4 million nodes / second, making
the new change a 70% optimization on its predecessor.

5.6

GodotBot

GodotBot is the nickname gave to the new, final online version of Godot. Playing
on chess.com, GodotBot is how I evaluate exactly how good Godot really is by
putting it up against chess players online from around the world.

34

The main challenge with GodotBot is that it must communicate over the
internet. I chose to implement this by using Selenium, a tool for simulating
a web browser. Specifically, I used Selenium WebDriver with ChromeDriver,
which allows me to automate a Chrome browser in Java. The algorithm I used
is shown in Figure 22.

Set up

Wait for
game to
begin

Start new
game

Wait
for turn

Make move

yes

Game
over?

no

Figure 22: A flowchart of GodotBot.

A very tricky element to master in making the program is to configure how
long GodotBot waits for the website to update; it takes a (relatively small) while
for the website to be updated after Godot makes a move. Trying to refresh
slowly wastes time (which is problematic when playing 1-minute games), but
refreshing too quickly raises the chances of Selenium not getting a reply back
from the browser, which can cause an Unreachable Browser Exception, which
causes the program to crash.
Through experimentation, Ive found that waiting 400-500 milliseconds between each reply is the ideal time; GodotBot will still occasionally (perhaps one
in eight games) crash, but the update time is not prohibitively slow.

35

Results

The final result of the project is Godot, a chess program that is surprisingly
strong. In sifting through the many options available to me, I made Godot
into a bitboard-based program relying on a combination of null-move pruning,
iterative deepening, quiescent searching, static exchange evaluation, alpha-beta,
PVS, and history heuristics.
For the vast majority of chess players, Godot would be very challenging to
play against, especially in short time controls. However, using Godot to set up
a position and find the best move available takes only two lines of code. The
Godot source code is very user-friendly.
Though Godot is strong, it will not be able to defeat current world-class programs. Godot is not Deep Blue, and will almost certainly lose against Stockfish,
Rybka, Critter, or other top-level engines.
The program is
Fast Godot can generate in excess of 2.4 million nodes per second, and
can evaluate over 30 thousand positions per second.
Fine-Tuned Godots position evaluation takes into account material,
pawn structure, king safety, rook-pawn cooperation, and piece placement
to determine how good a position is.
Unique No single program is the basis for the projects result; Godot
is a combination of techniques inspired from world-class programs and is
original.
Maintainable Godot is written in clean code that is easy to maintain.

36

Recommendations

Though Godot is certainly a strong program, there exist countless optimizations

and improvements to explore. If I could extend my program, I would look into
re-writing Godot in a faster language than Javaa C++ version of my program
would likely run considerably faster. In addition, I would also like to look into
other popular optimizations, such as transposition tables, aspiration windows,
razoring, and others.

37

References
G. M. Adelson-Velskii, V. L. Arlazarov, A. R. Bitman, A. A. Zhivotovskii, and
A. V. Uskov. Programming a computer to play chess. Russian Mathematical
Surveys, 25(2):221, 1970.
Georgy Adelson-Velsky, Vladimir Arlazarov, and Mikhail Donskoy. Some methods of controlling the tree search in chess programs. Artificial Intelligence, 6
(4):361371, 1975.
D. J. Edwards and T. F. Hart. The alpha-beta heuristic, December 1961.
Frederic Friedel. A short history of computer chess. Chessbase, 2002.
Robert Hyatt. Chess program board representations, 2004.
Larry Kaufman. The evaluation of material imbalances. Chess Life, March
1999.
Richard E. Korf. Depth-first iterative-deepening: An optimal admissible tree
search. Artificial Intelligence, 27:97109, 1985.
Alan Kotok. A chess playing program. Technical report, MIT, December 1962.
David Levy. Bilbao: The humans strike back. Chessbase, November 2005.
T. A. Marsland and M. Campbell. Parallel search of strongly ordered game trees.
Technical report, Department of Computing Science, University of Alberta,
Edmonton, 1982.
Sren Riis. A gross miscarriage of justice in computer chess. Chessbase, February
2012.
Jonathan Schaeffer. The history heuristic and alpha-beta search enhancements
in practice. IEEE Transactions on Pattern Analysis and Machine Intelligence,
11:12031212, 1989.
Claude E. Shannon. Programming a computer for playing chess. Philosophical
Magazine, 41(314), March 1950.
John von Neumann. Zur theorie der gesellschaftsspiele. Mathematische Annalen,
100(1):295320, 1928.
Mark Allen Weiss. Data Structures & Problem Solving Using Java. Addison
Wesley, 2 edition, 2002.
Albert L. Zobrist. A new hashing method with application for game playing.
Technical Report 88, Computer Sciences Department, University of Wisconsin, April 1970.

38