Hillman
Hillman
HAYLEY HILLMAN
1
2 HAYLEY HILLMAN
Contents
1. Introduction to Matroids 3
1.1. Basic Graph Theory 3
1.2. Basic Linear Algebra 4
2. Bases 5
2.1. An Example in Linear Algebra 6
2.2. An Example in Graph Theory 6
3. Rank Function 8
3.1. The Rank Function in Graph Theory 9
3.2. The Rank Function in Linear Algebra 11
4. Independent Sets 14
4.1. Independent Sets in Graph Theory 14
4.2. Independent Sets in Linear Algebra 17
5. Cycles 21
5.1. Cycles in Graph Theory 22
5.2. Cycles in Linear Algebra 24
6. Vertex-Edge Incidence Matrix 25
References 27
MATROID THEORY 3
1. Introduction to Matroids
A matroid is a structure that generalizes the properties of indepen-
dence. Relevant applications are found in graph theory and linear
algebra. There are several ways to define a matroid, each relate to the
concept of independence. This paper will focus on the the definitions
of a matroid in terms of bases, the rank function, independent sets and
cycles.
Throughout this paper, we observe how both graphs and matrices
can be viewed as matroids. Then we translate graph theory to linear
algebra, and vice versa, using the language of matroids to facilitate our
discussion.
Many proofs for the properties of each definition of a matroid have
been omitted from this paper, but you may find complete proofs in
Oxley[2], Whitney[3], and Wilson[4].
The four definitions of a matroid introduced in this paper are equiv-
alent to each other. However, the proofs are also omitted from this
paper. The complete proofs can be found in Whitney[3].
The following subsections are a brief introduction to the basics of
graph theory and linear algebra.
Figure 1. Graph, G
1 2 3 4 5 6 7 8
0 1 1 1 0 0 0 0
0 1 1 0 1 1 0 0
A=
0 0 0 1 1 0 1 0
0 0 0 0 0 1 1 1
0 0 0 0 0 0 0 1
MATROID THEORY 5
Now that we have a basic foundation of linear algebra and graph the-
ory, we will begin our introduction of matroids by using the concept of
a base.
2. Bases
This section provides one definition of a matroid, as well as demon-
strates how our examples from linear algebra and graph theory fit this
definition. The following definition is from Hassler Whitney’s paper,
“On the Abstract Properties of Linear Independence,” which is the first
published paper that explored the theory of matroids.
Definition 2.1. A matroid M consists of a non-empty finite set E and
a non-empty collection B of subsets of E, called bases, satisfying the
following properties: [3]
B(i) no base properly contains another base;
B(ii) if B1 and B2 are bases and if {e} is any element of B1 , then
there is an element f of B2 such that (B1 − {e}) ∪ {f } is also
a base.
B(ii) is known as the exchange property.[4] This property states that
if an element is removed from B1 , then there exists an element in B2 ,
such that a new base, B3 , is formed when that element is added to B1 .
We can use the property B(ii) to show that every base in a matroid
has the same number of elements.
Theorem 2.1. Every base of a matroid has the same number of ele-
ments.
Proof. First assume that two bases of a matroid M , B1 and B2 , contain
different number of elements, such that |B1 | < |B2 |. Now suppose there
is some element, {e1 } ∈ M , such that e1 ∈ B1 , but e1 ∈ / B2 . If we
remove {e1 } from B1 , then by B(ii), we know there is some element,
e2 ∈ B2 , but e2 ∈
/ B1 such that B3 = B1 \ ({e1 } ∪ {e2 }), where B3 is a
base in M . Therefore, |B1 | = |B3 | but |B2 | 6= |B1 | = |B3 |.
If we continue the process of exchanging elements, defined by the
property B9ii), k number of times, then there will be no element ini-
tially in B1 that is not in the base Bk . Therefore, for all e ∈ Bk , the
element e is also in B2 , and thus Bk ⊆ B2 .
From B(i), we know that no base properly contains another base.
This is a contradiction. Therefore we know that every base has the
same number of elements.
6 HAYLEY HILLMAN
1 0 0 0
1 1 0 0
B2 = 0 ,
1 ,
1 ,
0 .
0 0 1 1
0 0 0 1
For this case, B(ii) is satisfied. We would find the same results if
we continued this process with all possible bases of A. It is well known
from Linear Algebra that no basis of A properly contains another basis.
Bases
{a, b, c, d}
{a, e, d, c}
{b, c, d, e}
{b, a, e, d}
{c, b, a, e}
{c, b, f, e}
{c, d, f, a}
{c, g, a, e}
{c, g, f, e}
Table 2.2, The Spanning Trees of G
By observing the set of bases listed above, we can see that B(i) is
satisfied, because no base properly contains another base. We can now
demonstrate B(ii) by using this property with two bases. If we choose,
B1 = {a, b, c, d} and B2 = {c, g, a, e}, then we can see the spanning
trees of B1 and B2 in Figures 2 and 3.
Notice that each spanning tree has 5 vertices and 4 edges. We can
demonstrate B(ii) by removing an element {a} from B1 , and then
there exists an element in B2 such that a new base is created, B3 =
(B1 \ {a}) ∪ {e}). Figure 4 shows the new base, B3 .
Figure 4. B3
3. Rank Function
In this section, we will continue the discussion of matroids by in-
troducing a new definition of a matroid in terms of its rank function.
The following definition of a matroid is from Robin Wilson’s book,
Introduction to Graph Theory
MATROID THEORY 9
Because there are four column vectors in this basis, and this is a
maximal linearly independent set, the rank of the matrix A is also
four.
An example of a loop in a matrix is the zero column vector,
0
0
0
0
0
because the space spanned by ~0 is 0 dimensional.
The following is a definition of parallel elements in linear algebra.
Definition 3.4. Two nonzero vectors, ~u and ~v , are parallel elements,
if ~u = λ~v , for some scalar λ.
An example of a set of parallel elements in a matrix is the set {e, f },
given by
MATROID THEORY 13
1
0
e=
1
0
0
2
0
f =
2 .
0
0
Because 2e = f , the rank of the set {e, f } is one. Therefore, We say
that the set {e, f } is a set of parallel elements.
Now we can demonstrate the properties of a matroid in terms of its
rank function by examining the matrix A. We can see the property,
R(i), by observing the set, C, of column vectors from the matrix A.
1 1 0 0 0
1 0 1 0 1
C= 0 , 1 , 0 , 0 , 1 .
0 0 1 1 0
0 0 0 1 0
In this example, the size of C is five, while the rank of C is four.
Therefore, R(i) is satisfied for C.
Now we will show an example of the property R(ii). If we continue
with this example, and take,
1 1 0
1 0 1
D = 0 , 1 , 0 ,
0 0 1
0
0 0
so that D ⊆ C ⊆ A, we can see that 3 = r(D) < r(C) = 4. Therefore,
property R(ii) is satisfied in this example.
From the definition of a matroid, the equation in R(iii) is satisfied
with the two subsets, C, D ⊂ E.
We can say that the independent sets of a graph are the edge sets of
the forests contained in the graph.[4] Figures 10 and 11 are examples
of forests contained in the graph G defined in Figure 1.
Forests of G
{a}, {b}, {c}, {d}, {e}
{f }, {g}, {a, b}, {b, c}
{c, d}, {d, e}, {e, f }, {f, g}
{g, a}, {a, f }, {e, f }, {d, f }
{b, f }, {b, g}, {c, g}, {d, g}
{a, b, c}, {a, b, g}, {a, e, d}
{a, f, d}, {a, g, c}, {a, g, d}
{b, c, d}, {b, g, d}, {b, f, d}
{b, f, e}, {c, d, e}, {c, g, d}
{c, d, f }, {e, f, e}, {a, f, g}
{a, b, c, d}, {a, e, d, c}, {b, c, d, e}
{b, a, e, d}, {c, b, a, e}, {c, b, f, e}
{c, d, f, a}, {c, g, a, e}, {c, g, f, e}
Table 4.1, The Forests of G
From observing the table of forests, we can see that the forests are
contained within the spanning trees, which are the bases listed in the
last three rows.
Now we will demonstrate why the exchange axiom for independent
sets requires that two independent sets, K and L, must satisfy the
inequality |K| > |L|. Suppose we let the two forests contained in
G be the sets K and L0 shown in Figures 12 and 13. Notice that
|K| = |L| = 3.
We find that there is no element, e contained in K but not L, such
that the set L ∪ {e} is independent.
However, if we let L1 = L0 \ {c}, so that 3 = |K| > |L1 | = 2, then
we necessarily have an element, in this case {d}, such that d ∈ K but
not in L1 . Therefore, we find the independent set L1 ∪ {d}.
MATROID THEORY 17
[1]
0 0
1
0
b1
0 + b2
1 = 0.
0 0
0 0
In these two examples, we find that b1 = b2 = 0 and c1 = c2 = c3 = 0
are the only solutions. Therefore, both subsets are linearly independent
by Definition 4.3.
To demonstrate I(i) and I(ii), we can take two independent sets of
the matrix A to be K and L,
1 0 0
0 1 0
K= 1 ,
0 ,
0 ,
0 1 1
0 0 1
1 0
1 0
L= 0 , 0 ,
0 1
0 1
so that |K| > |L|. From our previous discussion of linear indepen-
dence in a set of vectors, we can see that any subset of K or L are
linearly independent.
The inequality stated in I(ii) ensures that the dimension of the space
spanned by K is greater than the dimension of the space spanned by L,
which makes it impossible to add an element from K to L. For example,
given three vectors that span a space, we can extend a different set of
two vectors which span a plane to a set of three vectors which spans a
space.
Now we can demonstrate the exchange property by noticing that K
and L share a common element,
0
0
0 ;
1
1
MATROID THEORY 21
which means that we must choose one vector from the set
1 0
0 1
1 , 0 ,
0 1
0
0
to add to L, so that L is independent. We can see the linear indepen-
dence in the sets;
1 1 0
1 0 0
L1 = 0 ,
1 ,
0 and
0 0 1
0 0 1
0 1 0
1 0 0
L2 =
0 ,
1 ,
0 .
1 0 1
0 0 1
5. Cycles
In this section, we will continue our discussion of matroids by in-
troducing a new definition of a matroid in terms of cycles. We will
take a cycle of a matroid, M , to be a minimally dependent subset of
elements in M . The following theorem is from Robin Wilson’s book,
Introduction to Graph Theory
Definition 5.1. A matroid M consists of a non-empty finite set E,
and a collection C of non-empty subsets of E (called cycles) satisfying
the following properties:[4]
C(i) no cycle properly contains another cycle;
C(ii) if C1 and C2 are two distinct cycles each containing an element
e, then there exists a cycle in C1 ∪ C2 that does not contain {e}
Now we can connect a cycle to the concepts introduced in the pre-
vious sections. Let A be a cycle. A − {e} is in some base for all e ∈ A,
which implies that r(A) = |A| − 1, and r(B) = |B| for all B ⊂ A.
Therefore, A is minimally dependent, which means that if we take any
element from A, then the remaining set is linearly independent.
22 HAYLEY HILLMAN
We can see that the property C(i) holds by observing the table of
cycles in G.
MATROID THEORY 23
Using our examples of the cycles C1 and C2 , we can see that the
two cycles each contain the elements {a} and {e}. Figure 18 shows the
graph of C3 = C1 ∪ C2 . We can see there are three cycles in C3 , which
are {a, e, f }, {a, b, c, d, e}, and {b, c, d, f }.
The cycle {b, c, d, f } in Figure 19 is a cycle in C3 which contains
neither {a} nor {e}. Therefore, the property C(ii) holds in this case.
0 0 0 0
1
1
1
0
e1
1 + e2
0 + e3
1 + e4
1 = 0.
0 1 1 1
0 0 0 0
0
1
f =
1 .
0
0
1 1 0 0
1 0 1 0
L4 = 0 1 , 0 , 1
0 0 1 1
0 0 0 0
a b c d e f g
1 1 0 0 0 1 0 0
2
1 1 0 0 0 1 1
3
0 1 1 0 0 0 0
4 0 0 1 1 0 0 1
5 0 0 0 1 1 1 0
We can see the relationship between graphs and matrices in the
vertex-edge incidence matrix if we use the set {a, e, f } as our example.
We can see that the rank of the set {a, e, f } is 2, because any subset,
containing two elements, does not contain a cycle. In the graph in
Figure 20, we can see that the set {a, e, f } is a cycle. The sum of the
column vectors corresponding to the set of edges in our example is,
1 1 0 0
1
0
1
0
0 +
0 +
0 =
0 .
0 0 0 0
0 1 1 0
We can also see that this set of vectors is minimally dependent. If
you take any one vector from the set, the set become an independent
set.
The rank of the column vectors corresponding to the set {a, e, f } is
also two, because any subset of the set of column vectors, containing
two elements, does not contain a cycle.
One base of G is the set of edges {a, b, c, d}. The corresponding set
of column vectors are,
1 0 0 0
1 1 0 0
N=
0 ,
1 ,
1 ,
0 .
0 0 1 1
0 0 0 1
We can see that the set of vectors are a maximal independent set,
because |N | = r(N ) = 4. Therefore, the set of vectors, N , is also a
base.
Now we can see the link between graph theory and linear algebra,
by using the language of matroids to motivate our discussion and to
generalize the properties of independence.
28 HAYLEY HILLMAN
References
[1] David Lay. Linear Algebra and its Applications. University of Maryland-College
Park, 2006.
[2] James Oxley. Matroid Theory. Oxford University Press, New York, 1992.
[3] Hassler Whitney. ”On The Abstract Properties of Linear Independence”. Amer-
ican Journal of Mathematics. Vol 57. John Hopkins University Press, 1935.
[4] Robin Wilson. Introduction to Graph Theory. Harlow:Pearson Education Lim-
ited, 1996.