Constraint Satisfaction

Problems

Chapter 5
Section 1 – 3
Grand Challenge:
http://www.grandchallenge.org/

1
 Constraint satisfaction problems (CSPs)

 CSP:
 state is defined by variables Xi with values from domain Di
 goal test is a set of constraints specifying allowable combinations of
values for subsets of variables

 Allows useful general-purpose algorithms with more power

than standard search algorithms

2
 Example: Map-Coloring

 Variables WA, NT, Q, NSW, V, SA, T

 Domains Di = {red,green,blue}

 Constraints: adjacent regions must have different colors

 e.g., WA ≠ NT
3
 Example: Map-Coloring

 Solutions are complete and consistent assignments,

e.g., WA = red, NT = green,Q = red,NSW =
green,V = red,SA = blue,T = green

4
 Constraint graph
 Binary CSP: each constraint relates two variables
 Constraint graph: nodes are variables, arcs are constraints

5
 Varieties of CSPs
 Discrete variables
 finite domains:
 n variables, domain size d  O(d n) complete assignments
 e.g., 3-SAT (NP-complete)
 infinite domains:
 integers, strings, etc.
 e.g., job scheduling, variables are start/end days for each job
 need a constraint language, e.g., StartJob1 + 5 ≤ StartJob3

 Continuous variables
 e.g., start/end times for Hubble Space Telescope observations
 linear constraints solvable in polynomial time by linear programming

6
 Varieties of constraints
 Unary constraints involve a single variable,
 e.g., SA ≠ green

 Binary constraints involve pairs of variables,

 e.g., SA ≠ WA

 Higher-order constraints involve 3 or more

variables,
 e.g., SA ≠ WA ≠ NT

7
 Example: Cryptarithmetic

 Variables: F T U W R O X1 X2 X3
 Domains: {0,1,2,3,4,5,6,7,8,9} {0,1}
 Constraints: Alldiff (F,T,U,W,R,O)
 O + O = R + 10 · X1
 X1 + W + W = U + 10 · X2
 X2 + T + T = O + 10 · X3
 X3 = F, T ≠ 0, F ≠ 0
8
 Real-world CSPs
 Assignment problems
 e.g., who teaches what class
 Timetabling problems
 e.g., which class is offered when and where?
 Transportation scheduling
 Factory scheduling

 Notice that many real-world problems involve real-

valued variables

9
 Standard search formulation

Let’s try the standard search formulation.

We need:
• Initial state: none of the variables has a value (color)
• Successor state: one of the variables without a value will get some value.
• Goal: all variables have a value and none of the constraints is violated.

NxD
N layers
WA WA WA NT T
[NxD]x[(N-1)xD]
WA WA WA NT
NT NT NT WA

Equal! N! x D^N
10
There are N! x D^N nodes in the tree but only D^N distinct states??
 Backtracking (Depth-First) search
• Special property of CSPs: They are commutative: NT = WA
This means: the order in which we assign variables WA NT
does not matter.
• Better search tree: First order variables, then assign them values one-by-one.

D
WA WA WA
WA
NT D^2
WA WA
NT NT

D^N
11
Backtracking example

12
Backtracking example

13
Backtracking example

14
Backtracking example

15
 Improving backtracking efficiency

 General-purpose methods can give huge

gains in speed:
 Which variable should be assigned next?
 In what order should its values be tried?
 Can we detect inevitable failure early?

16
 Most constrained variable
 Most constrained variable:
choose the variable with the fewest legal values

 a.k.a. minimum remaining values (MRV)

heuristic
 Picks a variable which will cause failure as
soon as possible, allowing the tree to be
pruned.
17
 Most constraining variable
 Tie-breaker among most constrained
variables

 Most constraining variable:

 choose the variable with the most constraints on
remaining variables (most edges in graph)

18
 Least constraining value
 Given a variable, choose the least
constraining value:
 the one that rules out the fewest values in the
remaining variables

 Leaves maximal flexibility for a solution.

 Combining these heuristics makes 1000
queens feasible 19
 Forward checking
 Idea:
 Keep track of remaining legal values for unassigned variables
 Terminate search when any variable has no legal values

20
 Forward checking
 Idea:
 Keep track of remaining legal values for unassigned variables
 Terminate search when any variable has no legal values

21
 Forward checking
 Idea:
 Keep track of remaining legal values for unassigned variables
 Terminate search when any variable has no legal values

22
 Forward checking
 Idea:
 Keep track of remaining legal values for unassigned variables
 Terminate search when any variable has no legal values

23
 Constraint propagation
 Forward checking propagates information from assigned to
unassigned variables, but doesn't provide early detection for
all failures:

 NT and SA cannot both be blue!

 Constraint propagation repeatedly enforces constraints
locally
24
 Arc consistency
 Simplest form of propagation makes each arc consistent
 X Y is consistent iff
for every value x of X there is some allowed y

constraint propagation propagates arc consistency on the graph.

25
 Arc consistency
 Simplest form of propagation makes each arc consistent
 X Y is consistent iff
for every value x of X there is some allowed y

26
 Arc consistency
 Simplest form of propagation makes each arc consistent
 X Y is consistent iff
for every value x of X there is some allowed y

 If X loses a value, neighbors of X need to be rechecked

27
 Arc consistency
 Simplest form of propagation makes each arc consistent
 X Y is consistent iff
for every value x of X there is some allowed y

 If X loses a value, neighbors of X need to be rechecked

 Arc consistency detects failure earlier than forward checking
 Can be run as a preprocessor or after each assignment
 Time complexity: O(n2d3) 28
29
 B G R R G B

B a priori
B B G
R R B constrained
G R
G G
nodes

Note: After the backward pass, there is guaranteed

to be a legal choice for a child note for any of its
leftover values.
This removes any inconsistent values from Parent(Xj),
it applies arc-consistency moving backwards.

30
31
Junction Tree Decompositions

32
 Local search for CSPs
 Note: The path to the solution is unimportant, so we can
apply local search!

 To apply to CSPs:
 allow states with unsatisfied constraints
 operators reassign variable values

 Variable selection: randomly select any conflicted variable

 Value selection by min-conflicts heuristic:

 choose value that violates the fewest constraints
 i.e., hill-climb with h(n) = total number of violated constraints

33
 Example: 4-Queens
 States: 4 queens in 4 columns (44 = 256 states)
 Actions: move queen in column
 Goal test: no attacks
 Evaluation: h(n) = number of attacks

34
35
 Summary
 CSPs are a special kind of problem:
 states defined by values of a fixed set of variables
 goal test defined by constraints on variable values

 Backtracking = depth-first search with one variable assigned per node

 Variable ordering and value selection heuristics help significantly

 Forward checking prevents assignments that guarantee later failure

 Constraint propagation (e.g., arc consistency) does additional work to

constrain values and detect inconsistencies

 Iterative min-conflicts is usually effective in practice

36