Combinatorial Block Designs
Combinatorial Block Designs
Shawn Rana
12/04/2014
Page 1
Table of Contents
Variables in an Experimental Design.............................................................................................................3
Complete Block Design.................................................................................................................................5
Latin Square..................................................................................................................................................6
Number of Blocks Needed to Test All Varieties Equally................................................................................7
Review and Problem Set 1.9
Incomplete Block Designs(BIBDs)...............................................................................................................11
Necessary Conditions for a BIBD.................................................................................................................13
Sufficient Corollaries for the Existence of a BIBD........................................................................................15
Review and Problem Set 2..18
Complementary Designs.............................................................................................................................20
Symmetric BIBDs.........................................................................................................................................21
Necessary Conditions for a Symmetric BIBD..22
Latin Squares In-Depth................................................................................................................................25
Latin Squares Using Two Variables..............................................................................................................26
Orthogonal Latin Squares...........................................................................................................................29
Conditions for the Existence of Orthogonal Families..................................................................................31
Review and Problem Set 3..33
Finishing Notes35
Sources.36
Page 2
Page 3
consists of only the elements that make up the variety set. The blocks of the experimental design are
also going to be a subset of the varieties, and in this question, the blocks will be made up of the many
computers that make up a lab. One lab is considered one block.
The experimental design will thus look like this:
Experimental Design for Testing Usability of Operating Systems
Lab 1
Lab 2
Lab 3
Computer B
Computer C
Computer D
Computer A
Lab 4
The design above is called an experimental block design which is a type of block design. We are testing a
certain operating system on a specific computer in a specific lab and have organized our testing in a
block(design). Now that we have understood an experimental design and the specific variables, a block
design is simply a specific type of design that puts together the experimental units as blocks and assigns
each specific experimental unit a treatment from the set of V. Thus, our blocks; Lab 1, Lab 2, Lab 3, and
Lab 4 are all subsets of our variety set, V, {,,
in set notation where order does matter(in specific cases such as a Latin Square)and repetitions are
possible: Lab 1= {,,,}, Lab 2= {,
Lab 4=
Page 4
{,,,}.
Page 5
Latin Square
In order to get a range of results, each of the different branded computers need to be tested all of the
operating systems and as do all of the labs. The Latin Square will display the most varied results because
no row and column of a block design will consist of the same variety more than once. A Latin Square is a
complete block design that has each block containing all of the set V and each element in V in a unique
experimental unit. Denoting our computer problem, this means all of the operating systems in our set of
varieties are used up in our labs and each unique computer gets tested all of the varieties. When writing
the blocks in set notation, order does matter in this case.
Fact: A Latin Square Design can always be formed if the number of experimental units making up a
block is equal to the number of total blocks, which is also equal to the number of total varieties.
The above fact can be seen true because if the number of varieties, number of blocks, and number of
experimental units are equal to each other, then each variety will be tested once in each column and
once in each row. This will be better illustrated in the future section of Latin Squares.
Our Latin Square design for testing usability of operating systems is seen below:
Lab 1
Lab 2
Lab 3
Computer B
Computer C
Computer D
Computer A
Lab 4
Seen above, each operating system gets tested once and only once in each block, and each different
brand computer in each lab gets tested a unique operating system. This provides the most accurate
result because there is data being retrieved an equal number of times from each unique computer in
each lab. Also note, there is more than one way to create a Latin square. We could have the blocks of
varieties switched without actually changing the blocks.
Page 6
Page 7
Computer B
Computer C
Computer D
Computer A
Lab
1
Lab
2
Lab
3
Lab
4
Lab
5
Lab
6
}
Lab 3={,, , }
Lab 4={,,,}
Lab 5={, }
Lab 6={,, , }.
Lab 2= {,
The design above meets our goal of testing all six varieties an equal number of times, and without using
too many resources and time; meaning, we could also have completed this design by using more blocks
such as 9 blocks, 12 blocks, 15 blocksetc. The reason the number of blocks should be a multiple of 3
because in 3 blocks we can test all of the varieties an equal number of times (two times exact), and this
cannot be achieved with less than 3 blocks. However, most companies have a budget and time restraint
so spending more money and testing more resources would be unfavorable in a companys point of view.
Moreover, the design above is actually called an incomplete block design because not all of V is being
used in each block. According to our problem, this means that we are not using all six of the operating
systems in each lab, we are only using four. Unlike the complete block design where each block is all of
V, an incomplete block design uses part of the set. Both designs are geared towards testing each and
every variety equally, not one less and not one more than another. The next topic dives further into the
definition of the incomplete block design.
Page 8
P is the set of experimental units, specific positions of the blocks that will be tested.
V is the set of varieties that get tested.
Blocks are made up of experimental units. Blocks are certain subsets of V.
A Block Design is a design that puts together experimental units from P as blocks and assigns
each unit an element from the V set. It is designed so that the experimental units make each
vertical block and each block is a set of varieties.
Set Notation for a block design is displayed through a set or even a matrix (where repetition may
occur and order matters.) For example, Block A consists of: {a, b, c, d}. This can also be written as
a matrix: [a, b, c, d].
A Complete Block Design is a type of block design that has each block testing all of the available
varieties. Thus, if each block set contains all of the set V, then the block design is complete. Each
variety must be tested.
A Latin Square is a specific type of complete block design because each block in the design tests
all of the varieties. However, this design is different from other designs in the way that each
block contains all of the set V and each v V is in a unique experimental unit. So, each variety is
never tested more than once in a specific position.
An Incomplete Block Design is a block design that has blocks that do not contain all of the set V.
If there are more varieties than the number of experimental units making a block, then the block
design is an incomplete block design when constructed.
Problem Set
1.
Design a complete block design that tests comfortability of winter shoes on a dog. The varieties
of shoes are given as, V= {A, B, C, D}. HINT: Knowing a dog is made up of four feet, a block is a
certain dog, and the experimental units making the block are their certain feet position.
2.
Design an incomplete block design if there were two more brands of shoes added to the problem
above.
Page 9
3.
4.
Turn this block design below into an incomplete block design and all of the varieties (A, B, C, D, E)
get tested equally. (The various Bs 1-4 are blocks and Ks 1-4 make up each block.)
K1
K2
K3
K4
B1
B2
B3
B4
A
B
C
D
E
A
B
D
A
B
C
D
E
A
B
D
5.
Design a Latin Square with the V set being {1, 2, 3, 4, 5}. Display all the blocks in set notation.
6.
How many blocks would I need if I was on a resource constraint, had 7 varieties to test equally,
and knew 6 experimental units made each block?
Page 10
Each specific block holds k number of varieties, where k > 0 and k is the same for each block.
Each variety within a block is paired up with another variety (besides itself) and as such, each
pair of varieties appear simultaneously in blocks. Note that is uniform through the entire
design and > 0.
Thus, we have five variables that become significant in a block design: b, v, r, k, and . These five
parameters are not all independent; v, k, and determine b and r, and not all combinations of v, k, and
are possible. When v > k, as in when we have more varieties than the number of varieties a block can
hold, the balanced block design becomes a balanced incomplete block design. The block design is also
called a BIBD or a (b, v, r, k, )-design. However, this notation does not just apply to incomplete block
designs. It can apply to complete block designs and other designs also if all of the variables can be
determined from the design itself.
An example of a balanced incomplete block design would be the incomplete block design we constructed
with the computer labs and operating systems:
Computer B
Computer C
Computer D
Computer A
Page 11
Lab
1
Lab
2
Lab
3
Lab
4
Lab
5
Lab
6
This would be considered a (6, 6, 4, 4, 4)-design. We have 6 blocks(b): Lab 1, Lab 2, Lab 3, Lab 4, Lab 5,
and Lab 6. We have 6 varieties (v), {,,
blocks(r). Each block can hold up to 4 varieties (k). Notice how k < v; because there are more varieties
than the number of varieties each block can hold, this automatically becomes a BIBD. Also, each pair of
varieties appears 4 times in the entire design (). To clarify , let's pick a variety in Lab 1. The variety
can be paired with three other varieties in its block to form a pair {i, j}. Let's say pairs with to
form the pair That specific pair simultaneously shows up four times across all of the blocks
to form , which is 4. Now, this must be true for any and all pairs. One pair cannot show up 3 times, and
another pair show up 4 times. We will prove why this is important in the next section.
Page 12
Page 13
Page 14
(v 1)
k1
Q.E.D
The number r is the same for each particular I and r must be a positive integer for the design to be able
to exist as a balanced incomplete block design. The same is true for b as b must be an integer when
being solved for.
Corollary 1.3
If an incomplete block design satisfies theorem 1.1 (both conditions must be met for this to be true) then
it should also satisfy:
In relation to b being an integer in relation to v, k, and , this can trivially be done by dividing both sides
by
We can easily find out how this corollary is derived from the two theorems proved above:
From bk = vr, we get
From (v 1) = r(k 1), we get
by solving for r.
Page 15
and
.
By dividing by
Q.E.D
Corollary 1.4
This last corollary further tests the existence of a BIBD:
and
Recall from earlier I said that (43, 43, 7, 7, 1)-design could exist; it does not guarantee that the design
does exist. This design, when tested, actually passes all of the conditions and corollaries, except for this
one. Thus, a (43, 43, 7, 7, 1)-design does not exist. A BIBD must pass all of these corollaries from the
theorems (and the theorems itself) above to exist.
Example: Now not only are these conditions valuable in testing the existence of a BIBD but are evidently
significant in finding other valuable given certain information. For example, in a track meet of 16
sprinters, four sprinters can race in one heat, and there are are 20 heats. What other information is
needed to be able to construct a BIBD?
From this information, we are given:
b= 20 heats(blocks)
v= 16 sprinters(varieties)
k= 4 sprinters competing in one heat(size of block)
Thus, we don't know what r is, which represents the the number of heats any sprinter can be in, and we
don't know what is, which represents the number of times each pair of sprinters can meet at the same
time.
Page 16
Thus, we can find these missing parameters using our two theorems using b, v, and k.
Therefore, we are able to construct a (20, 16, 5, 4, 1)-design given our parameters and conditions. In
conclusion, the last corollary finds sufficient existence results for a BIBD, whilst the previous corollaries
were necessary but not sufficient.
Page 17
k represents the max number of varieties each block can hold, k > 0.
represents the number of times each pair of varieties in each block appears at the same time,
.> 0.
A balanced incomplete block design has more varieties than the the number of varieties a block
can hold, v > k and r > where the number of replications of a variety is greater than the number
of times each pair simultaneously appear.
A pair of varieties is a one variety i in a block paired with k-1 varieties in the block to create a pair
{i, j}.
There are two necessary conditions in order for a BIBD to exist: bk = vr and (v 1) = r(k 1).
Problem Set
1.
2.
3.
4.
Aviation engineers want to check engine wear on airplanes. If four engines are used in an
airplane, create a block design that tests five varieties of engines (A, B, C, D, E) an equal number
Page 18
of times (keeping in remembrance that the engineers want to test as little number of airplanes
as possible due to a budget constraint).
5.
6.
Write down all of the pairs for all of the varieties for question 4.
7.
What is the only way to turn a BIBD into a complete block design?
8.
Page 19
Complementary Designs
Let me introduce a new problem example to help better display this concept. A generic (7, 7, 3, 3, 1)design is shown below. There are seven blocks named B1 through B7; seven varieties: A, B, C, D, E, F, G,
and H; each variety is shown three times, or has three replications; each block can hold up to three
varieties; and no pair of varieties is simultaneously shown more than once.
B1
K1
K2
K3
B2
B3
B4
B5
B6
B7
A A A B B C C
B D F D E D E
C E G F G G F
The complement of this design is constructed by replacing each block with a block consisting of the
remaining varieties. Thus, this would look like:
K1
K2
K3
K4
B1
B2
B3
B4
B5
B6
B7
D
E
F
G
B
C
F
G
B
C
D
E
A
C
E
G
A
C
D
F
A
B
E
F
A
B
D
G
From a parameter approach this is a (7, 7, 4, 4, 2)-design. In relation to the original (b,v, r, k, )-design,
the parameters for this complementary design can be labeled as a (b, v, b r, v k, + b 2r)-design.
Thus the complement of a (20, 16, 5, 4, 1)-design is a (20, 16, 15, 12, 11)-design. If a complement of a
BIBD fulfills all of the conditions of a BIBD, then the complement is also a BIBD.
Page 20
Page 21
Page 22
The complement of a BIBD design is when each column of the design is replaced with varieties
that have not been used, thus creating a new, unused design.
What is the complement of this design (if the letters A through G are used as varieties)
K1
K2
K3
K4
B1
B2
B3
B4
B5
B6
B7
D
E
F
G
B
C
F
G
B
C
D
E
A
C
E
G
A
C
D
F
A
B
E
F
A
B
D
G
2.
3.
In your own words, explain how the parameters of a complement design are achieved.
4.
Four of the blocks of a (7, 3, 1)-design are {1, 2, 3}, {1, 5, 6}, {2, 5, 7}, and {1, 4, 7}. Find the
remaining blocks.
5.
Show that in a (v, k, )-design, any two blocks have exactly varieties in common.
6.
Page 23
b) A (31, 6, 1)-design
c) A (57, 12, 3)-design
d) A (21, 5, 1)-design
e) A (100, 10, 5)-design
7.
Page 24
A k x k Latin Square
1
...
k-1
...
...
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
k-1
...
k-3
k-2
...
k-2
k-1
The design above displays a Latin square for any variable k. Because the number of varieties, the
number of blocks, and the number of experimental units making each block are equal to each
other, it is assumed that they are equal to some positive integer k. Thus, the Latin square is
made up of k rows and k columns.
Let us analyze this k x k design. Specifically, let us examine the first column and row. All of the
varieties (from 1 through k) are being used in the first column and all of the varieties are also
being used from the first row. However, none of the varieties that are used in the first column
are being used in the same order in any other column and none of the varieties that are used in
the first row are being used in any other row. Thus, each variety is in a unique position in the
Latin square.
Before we get in-depth with the topic of Latin squares, we must first dive into understanding
how block designs can be formed with two variables instead of only one as we have been doing
thus far. Becoming adept at this will help understand families of Latin squares, which will be
explained later.
Page 25
Computer A
Computer B
Computer C
Computer D
Lab
1
Lab
2
Lab
3
Lab
4
Before we go further, let me introduce a simple notation to note on the entries in a block design so we
can better understand how a two variable block design comes together. The i, j entry of the block design
above signifies the variety used on computer i in lab j. Thus, for example, the variety 2 is used in entry
2,1, in entry 1,2, in entry, 4,3, and in entry 3,4. This will be more evident the further we delve into Latin
squares.
Back to the problem, we must also design another Latin square for testing usability for hard drives. Lets
say for the sake of this topic, it is different from the previous Latin square, Latin square(A), because
recall, there are more than one ways to design a Latin square given each variety is in another unique
position not previously used before. Thus, we have:
Page 26
Computer A
Computer B
Computer C
Computer D
Lab
1
Lab
2
Lab
3
Lab
4
This Latin square is completely different from a numerical point of view because the numbers that are
used here were not used in the same positions in Latin square (A). Now, we have two different Latin
squares but we must combine both of these into a single Latin square.
Thus, this can be accomplished by testing each operating system exactly once in combination with each
brand of hard drive. What this entails is that we must build a 4 x 4 array where the row signifies the
computer and the column signifies the lab, and we should place both an operating system and a hard
drive with the corresponding computer and lab.
From the previous entry notation I showed, we will say aij indicates operating system used in entry i, j
and say bij indicates hard drive used in i, j. We want each entry in our new single Latin square design to
look like this:
(aij , bij) which aij and bij are respectfully derived from each Latin square . From the looks of putting both
of these Latin squares together, we will have 4 x 4= 16 different possible ordered pairs (a, b).
The final product of our example is the combination of both Latin squares:
Computer A
Computer B
Computer C
Computer D
Lab
1
Lab
2
Lab
3
Lab
4
Computer A
Computer B
Computer C
Computer D
Lab
1
Lab
2
Lab
3
Lab
4
Both of these Latin squares when combined, turn into the one shown on the next page:
Page 27
Latin Square (C) for Testing the Combined Effects of Operating Systems and Hard Drives on Usability
Lab 1
Lab 2
Lab 3
Lab 4
Computer A
Computer B
Computer C
Computer D
Referring to our problem, this Latin square does not mean the same thing as it would if we would test
both variables one by one. This design signifies the combined effect of both variables on the computers.
Also, the i, j entry is an ordered pair consisting of a computer operating system and hard drive used in
the two Latin squares in computer position i in computer lab j.
Now that we understand the concept of two variables in a block design, I will introduce some
terminology that will further our knowledge of Latin squares.
Page 28
Latin Square D
As we can see from Latin square A, an entry is seen as aij where a is the variety used on row i, column j.
In Latin square D, an entry is seen as bij where b is the variety used on row i, column j. However,
according to the definition of orthogonality, these Latin squares are not orthogonal because there is
formed pair that appears more than once. The formed pair (2, 4) appears once in row 2, column 1 and
also in row 4, column 3. The same can also be said for pair (4, 3); this pair also appears more than once
in the design, and thus not distinct.
Now what if there were more ways to write a Latin square, than just two? We know two distinct Latin
squares form distinct pairs when combined are orthogonal. However, if we have A(1), A(2), A(3), , A(n)
being distinct k x k Latin squares, and every pair of them is orthogonal, then we have a orthogonal
family. An example is provided on the next page:
Page 29
Latin Square F
Latin Square G
Latin Square H
All of these Latin squares are orthogonal to each other and thus create an orthogonal family. However,
you must be thinking: Does there exist an orthogonal family of r Latin squares of order k?
To answer this question, we must prove a theorem in the next section that gives necessary, but not
sufficient conditions for the existence of an orthogonal family of r Latin squares of order k.
Page 30
Now that the first row is complete, we can arrange the second row starting with the 2, 1 entry.
Because we already have 1 in the first column, we cannot have 1 again in the 2, 1 entry for it
would violate the definition of a Latin square and would not be orthogonal. By orthogonality,
a21(x) a21(y)(for some Latin square y), because if they were equal to each other, then we would
have the same variety(v) in both the i, j spot of an entry. When paired up: (a21(x), a21(y)) = (v, v).
Thus for some v, (a21(x), a21(y)) = (a1v(x), a1v(y)) will infringe upon the definition of orthogonality
Page 31
because the pair (a21(x), a21(y)) is not distinct. This pair also appears as (a1v(x), a1v(y)). Therefore,
each 2, 1 entry in each Latin square through A(r) is distinct and different from 1. Because there is
already a 1 in the 1, 1 entry in each Latin square, in order for the block design to confine itself as
a Latin square, 1 cannot appear again in the same column.
Thus, in conclusion, because 1 cannot appear again, there are at most n 1 numbers that can
appear in the 2, 1 entry, and r k 1. This can also be understood by the pigeonhole concept
which states that if there are q objects and there are s places to put q objects, and q > s, then at
least one spot contains more than one object. We can apply this principle to the second row, first
column entry of each Latin square, and we will also arrive at r k 1.
Q.E.D
The condition above is necessary but not sufficient in finding if there exists an orthogonal family of r
Latin squares of order k. In order to find sufficiency, there remains one theorem.
Theorem 2.2: If k > 1 and k = pn, where p is a prime number and n is a positive integer, then there is a
complete orthogonal family of Latin squares of order k.
Together with both theorems, we may can conclude the existence of orthogonal families. For example,
to see if a family of orthogonal Latin squares of order 3 exists, we know that the number of orthogonal
Latin squares consisting in the family is less than or equal to the order, 3(by the first theorem). We also
know that 3= 31 by the second theorem, so thus, there must exist an orthogonal family of order 3.
Page 32
A Latin Square is a complete block design that has each block containing all of the set V and each
element in V in a unique experimental unit.
A Latin square is a k x k block design where k signifies the order of the Latin square.
The i, j entry signifies i meaning row, and j meaning column.
Two Latin squares can be combined where each pair is an ordered pair (a , b ). In the ordered
ij
ij
pair, aij and bij are respectfully derived from each Latin square.
If we have two distinct k x k Latin squares that create k ordered pairs where (a , b ) are all
2
ij
ij
If we have A
(1)
, A(2), A(3), , A(n) being distinct k x k Latin squares, and every pair of them is
orthogonal, then we have a orthogonal family.
2.
3.
Does there exist a pair of orthogonal Latin squares of order 12? Why?
4.
Supposed that two orthogonal 8 x 8 Latin squares both have 87654321 in the first row. Is it
possible for them to have the same 2, 4 entry?
5.
Determine if the pairs on the next page are orthogonal to each other.
Page 33
a)
b)
6.
Page 34
Finishing Notes
Throughout this paper, we taught ourselves the meaning of applying a combinatorial design to
everyday situations. For complete block designs, we can test all of the varieties for a single block,
but for incomplete block designs we cannot. We also learned how significant Latin squares truly
are in real world applications and mathematically speaking, they are truly unique. By going indepth with Latin squares, we read upon when there are different Latin squares when combined
to make distinct pairs, they are seen as orthogonal and may have an orthogonal family.
Nonetheless, theorems were proved, and excruciating block designs were created through hours
of simple mouse clicks. However, it is dually noted that I have only scratched the surface of this
topic. It has been a pleasure teaching the topic of block designs to whomever this may interest.
Shawn Rana
Page 35
Websites
1. www.stat.purdue.edu/~bacraig/notes1/topic13.pdf
2. www.math.ucdenver.edu/~wcherowi/courses/m6406/bibd1.pdf
3. www.math.cornell.edu/~web4520/CG10-0.pdf
4. www.en.wikipedia.org/wiki/Block_design
5. www.mmorris.public.iastate.edu/stat512/512.6.pdf
6. http://www.maths.qmul.ac.uk/~rab/DOEbook/doeweb11.pdf
7. www.math.ucdenver.edu/~wcherowi/courses/m6406/symbibd.pdf
8. http://mathworld.wolfram.com/BlockDesign.html
9. http://www.springer.com/cda/content/document/cda_downloaddocument/9780387954875
-c1.pdf?SGWID=0-0-45-101851-p9775353.
10. http://www.renyi.hu/~dezso/coa/bibdpaper.pdf
Page 36