Artificial Intelligence Logic - Programming.and - Prolog
Artificial Intelligence Logic - Programming.and - Prolog
PROLOG (2ED)
Ulf Nilsson and Jan Maluszy
nski
c
Copyright
2000,
Ulf Nilsson and Jan Maluszy
nski. The book may be downloaded
and printed for personal use only provided that the text (1) is not altered in any way,
and (2) is accompanied by this copyright notice. The book may also be copied and
distributed in paper-form for non-profit use only. No other form of distribution or
storage is permitted. In particular, it is not allowed to store and distribute the book
electronically.
This book was previously published by John Wiley & Sons Ltd. The book was originally published in 1990 with the second edition published in 1995. The copyright was
reverted back to the authors in November 2000.
For further information about updates and supplementary material please check out
the book web-site at
http://www.ida.liu.se/~ulfni/lpp
or contact the authors at [email protected] and [email protected].
Contents
Preface
ix
Foundations
1 Preliminaries
1.1 Logic Formulas . . . . . . . . . .
1.2 Semantics of Formulas . . . . . .
1.3 Models and Logical Consequence
1.4 Logical Inference . . . . . . . . .
1.5 Substitutions . . . . . . . . . . .
Exercises . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
3
3
7
10
13
14
16
. . . . .
. . . . .
. . . . .
Models
. . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
19
19
21
24
29
31
3 SLD-Resolution
3.1 Informal Introduction . . . . .
3.2 Unification . . . . . . . . . . .
3.3 SLD-Resolution . . . . . . . . .
3.4 Soundness of SLD-resolution .
3.5 Completeness of SLD-resolution
3.6 Proof Trees . . . . . . . . . . .
Exercises . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
33
33
37
43
48
51
53
57
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
vi
Contents
.
.
.
.
.
.
.
.
59
59
61
65
67
70
75
77
84
87
87
93
97
II
99
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
Programming in Logic
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
101
101
103
104
107
109
114
116
Structures
. . . . . . .
. . . . . . .
. . . . . . .
. . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
119
119
119
129
131
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
135
135
136
141
143
144
146
146
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
149
149
153
154
155
161
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
Contents
vii
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
163
163
166
169
171
175
176
11 Searching in a State-space
11.1 State-spaces and State-transitions . . . .
11.2 Loop Detection . . . . . . . . . . . . . .
11.3 Water-jug Problem (Extended Example)
11.4 Blocks World (Extended Example) . . .
11.5 Alternative Search Strategies . . . . . .
Exercises . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
179
179
181
182
183
185
186
III
.
.
.
.
.
.
.
.
.
.
.
.
189
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
191
191
193
194
196
196
202
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
203
204
205
207
212
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
213
214
215
216
222
227
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
229
230
232
233
236
239
.
.
.
.
.
.
.
.
.
.
viii
Contents
A Bibliographical Notes
241
A.1 Foundations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
A.2 Programming in Logic . . . . . . . . . . . . . . . . . . . . . . . . . . . 244
A.3 Alternative Logic Programming Schemes . . . . . . . . . . . . . . . . . 247
B Basic Set Theory
251
B.1 Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
B.2 Relations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
B.3 Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
C Answers to Selected Exercises
253
Bibliography
263
Index
277
Preface
Since the first edition of this book the field of logic programming has developed and
matured in many respects. This has been reflected by the large number of textbooks
that appeared in that period. These books usually fall into one of the following three
categories:
books which provide a theoretical basis for logic programming;
books which describe how to write programs in Prolog (sometimes even in particular Prolog systems);
books which describe alternative logic programming languages like constraint
logic programming, deductive databases or concurrent logic programming.
Objectives
The main objective of both editions of this textbook is to provide a uniform account
of both the foundations of logic programming and simple programming techniques in
the programming language Prolog. The discussion of the foundations also facilitates
a systematic survey of variants of the logic programming scheme, like constraint logic
programming, deductive databases or concurrent logic programming. This book is
not primarily intended to be a theoretical handbook on logic programming. Nor is
it intended to be a book on advanced Prolog programming or on constraint logic
programming. For each of these topics there are more suitable books around. Because
of the diversity of the field there is of course a risk that nothing substantial is said
about anything. We have tried to compensate for this risk by limiting our attention to
(what we think are) the most important areas of logic programming and by providing
the interested reader with pointers containing suggestions for further reading. As a
consequence of this:
ix
Preface
the theoretical presentation is limited to well-established results and many of the
most elaborate theorems are stated only with hints or pointers to their proofs;
most of the program examples are small programs whose prime aim is to illustrate
the principal use of logic programming and to inspire the reader to apply similar
techniques when writing real logic programs.
The objectives of the book have not changed since the first edition, but its content
has been revised and updated to reflect the development of the field.
Prerequisites
Like many other textbooks, this book emerged out of lecture notes which finally stabilized after several years of teaching. It has been used as introductory reading in
the logic programming course for third year undergraduate students mainly from the
computer science curriculum at Link
oping University. To take full benefit from the
book, introductory courses in logic and discrete mathematics are recommended. Some
basic knowledge in automata theory may be helpful but is not strictly necessary.
Organization
The book is divided into three parts:
Foundations;
Programming in Logic;
Alternative Logic Programming Schemes.
The first part deals with the logical aspects of logic programming and tries to provide
a logical understanding of the programming language Prolog. Logic programs consist
of logical formulas and computation is the process of deduction or proof construction.
This makes logic programming fundamentally different from most other programming
languages, largely a consequence of the fact that logic is considerably much older than
electronic computers and not restricted to the view of computation associated with
the Von Neumann machine. The main difference between logic programming and
conventional programming languages is the declarative nature of logic. A program
written in, for instance, Fortran can, in general, not be understood without taking
operational considerations into account. That is, a Fortran program cannot be understood without knowing how it is going to be executed. In contrast to that, logic has
no inherent concept of execution and logic formulas can be understood without any
notion of evaluation or execution in mind. One of the most important aims of this
book is to emphasize this distinction between logic programs and programs written in
traditional programming languages.
Chapter 1 contains a recapitulation of notions basic to logic in general. Readers
who are already well acquainted with predicate logic can without problem omit this
chapter. The chapter discusses concepts related both to model- and proof-theory of
Preface
xi
predicate logic including notions like language, interpretation, model, logical consequence, logical inference, soundness and completeness. The final section introduces
the concept of substitution which is needed in subsequent chapters.
Chapter 2 introduces the restricted language of definite programs and discusses the
model-theoretic consequences of restricting the language. By considering only definite
programs it suffices to limit attention to so-called Herbrand interpretations making
the model-theoretic treatment of the language much simpler than for the case of full
predicate logic.
The operational semantics of definite programs is described in Chapter 3. The
starting point is the notion of unification. A unification algorithm is provided and
proved correct. Some of its properties are discussed. The unification algorithm is the
basis for SLD-resolution which is the only inference rule needed for definite programs.
Soundness and completeness of this rule are discussed.
The use of negation in logic programming is discussed in Chapter 4. It introduces
the negation-as-finite-failure rule used to implement negation in most Prolog systems
and also provides a logical justification of the rule by extending the users program with
additional axioms. Thereafter definite programs are generalized to general programs.
The resulting proof-technique of this language is called SLDNF-resolution and is a
result of combining SLD-resolution with the negation-as-finite-failure rule. Results
concerning soundness of both the negation-as-finite-failure rule and SLDNF-resolution
are discussed. Finally some alternative approaches based on three-valued logics are
described to explain alternative views of negation in logic programming.
The final chapter of Part I introduces two notions available in existing Prolog
systems. Cut is introduced as a mechanism for reducing the overhead of Prolog computations. The main objective of this section is to illustrate the effect of cut and to
point out cases when its use is motivated, and cases of misuse of cut. The conclusion
is that cut should be used with great care and can often be avoided. For example,
cut is not used in subsequent chapters, where many example programs are presented.
The second section of Chapter 5 discusses the use of predefined arithmetic predicates
in Prolog and provides a logical explanation for them.
The second part of the book is devoted to some simple, but yet powerful, programming techniques in Prolog. The goal is not to study implementation-specific details of
different Prolog systems nor is it our aim to develop real-size or highly optimized programs. The intention is rather to emphasize two basic principles which are important
to appreciate before one starts considering writing real programs:
logic programs are used to describe relations, and
logic programs have both a declarative and an operational meaning. In order to
write good programs it is important to keep both aspects in mind.
Part II of the book is divided into several chapters which relate logic programming to
different fields of computer science while trying to emphasize these two points.
Chapter 6 describes logic programming from a database point of view. It is shown
how logic programs can be used, in a coherent way, as a framework for representing
relational databases and for retrieving information out of them. The chapter also
contains some extensions to traditional databases. For instance, the ability to define
infinite relations and the use of structured data.
xii
Preface
Chapter 7 demonstrates techniques for defining relations on recursive data-structures, in particular on lists. The objective is to study how recursive data-structures give
rise to recursive programs which can be defined in a uniform way by means of inductive
definitions. The second part of the chapter presents an alternative representation of
lists and discusses advantages and disadvantages of this new representation.
Chapter 8 introduces the notion of meta- and object-language and illustrates how to
use logic programs for describing SLD-resolution. The ability to do this in a simple way
facilitates some very powerful programming techniques. The chapter also introduces
some (controversial) built-in predicates available in most Prolog implementations.
Chapter 9 is a continuation of Chapter 8. It demonstrates how to extend an
interpreter from Chapter 8 into a simple expert-system shell. The resulting program
can be used as a starting point for developing a full-scale expert system.
Historically one of the main objectives for implementing Prolog was its application
for natural language processing. Chapter 10 shows how to describe grammars in
Prolog, starting from context-free grammars. Thereafter larger classes of languages are
considered. The last two sections introduce the notion of Definite Clause Grammars
(DCGs) commonly used for describing both natural and artificial languages in Prolog.
The last chapter of Part II elaborates on results from Chapter 6. The chapter
demonstrates simple techniques for solving search-problems in state-transition graphs
and raises some of the difficulties which are inherently associated with such problems.
The final part of the book gives a brief introduction to some extensions of the logic
programming paradigm, which are still subject of active research.
Chapter 12 describes a class of languages commonly called concurrent logic programming languages. The underlying execution model of these languages is based on
concurrent execution. It allows therefore for applications of logic programming for description of concurrent processes. The presentation concentrates on the characteristic
principles of this class of languages, in particular on the mechanisms used to enforce
synchronization between parallel processes and the notion of dont care nondeterminism.
Chapter 13 discusses an approach to integration of logic programming with functional programming based on the use of equations. The notion of E-unification (unification modulo a set E of equations) is introduced and properties of E-unification
algorithms are discussed. Finally it is shown how to generalize the notion of SLDresolution to incorporate E-unification instead of ordinary unification.
Chapter 14 concerns the use of constraints in logic programming. The constraint
logic programming scheme has attracted a great many people because of its generality,
elegance and expressive power. A rigorous semantical framework is briefly described.
The main ideas are illustrated using examples from several constraint domains.
The final chapter of Part III concerns the optimization of queries to deductive
databases. The chapter provides an alternative to SLD-resolution as the inference
mechanism in a query-answering system and discusses the principal idea of several
optimizations described in the literature.
In addition the book contains three appendices. The first of them provides bibliographical remarks to most of the chapters of the book including suggestions for further
reading. The second appendix contains a brief account of set theoretic notions used
throughout the book and the final appendix contains solutions and hints for some of
the exercises which are available in the main text.
Preface
xiii
Acknowledgements
The authors would like to thank a number of persons for their involvement in the
course of writing the first and second edition of this book. In particular, Roland Bol,
Staffan Bonnier, Lars Degerstedt, Wlodzimierz Drabent and all other members of the
Logic Programming Laboratory. We are also indebted to students, who lived through
draft versions of the book and provided invaluable feedback. Thanks are also due to
Gu Xinli, Jalal Maleki, Mirka Milkowska, Simin Nadjm-Tehrani, Torbjorn N
aslund
and Linda Smith who devoted much of their time reading parts of the manuscript.
Needless to say, the remaining flaws are to be attributed to the authors.
Our deepest gratitude also to Roslyn Meredith and Rosemary Altoft at John Wiley, and the anonymous referees whose comments influenced the final structure and
contents of both editions of the book.
Finally we should mention that the material presented in this book is closely related
to our research interests. We gratefully acknowledge the financial support of our
research projects by the Swedish Research Council for Engineering Sciences (TFR)
and by Link
oping University.
Linkoping, Sweden
June 1995
Ulf Nilsson
ski
Jan Maluszyn
xiv
Preface
PART I
FOUNDATIONS
Chapter 1
Preliminaries
1.1
Logic Formulas
When describing some state of affairs in the real world we often use declarative1 sentences like:
(i ) Every mother loves her children
(ii ) Mary is a mother and Tom is Marys child
By applying some general rules of reasoning such descriptions can be used to draw
new conclusions. For example, knowing (i ) and (ii ) it is possible to conclude that:
(iii ) Mary loves Tom
A closer inspection reveals that (i ) and (ii ) describe some universe of persons and
some relations between these individuals like . . . is a mother, . . . is a child
of . . . or the relation . . . loves . . . which may or may not hold between the
persons.2 This example reflects the principal idea of logic programming to describe
possibly infinite relations on objects and to apply the programming system in order
to draw conclusions like (iii ).
For a computer to deal with sentences like (i )(iii ) the syntax of the sentences must be
precisely defined. What is even more important, the rules of reasoning like the one
1 The notion of declarative sentence has its roots in linguistics. A declarative sentence is a complete expression of natural language which is either true or false, as opposed to e.g. imperative or
interrogative sentences (commands and questions). Only declarative sentences can be expressed in
predicate logic.
2 Some people would probably argue that being a mother is not a relation but rather a property.
However, for the sake of uniformity properties will be called relations and so will statements which
relate more than two objects (like . . . is the sum of . . . and . . . ).
Chapter 1: Preliminaries
which permits inferring (iii ) from (i ) and (ii ) must be carefully formalized. Such
problems have been studied in the field of mathematical logic. This chapter surveys
basic logical concepts that are used later on in the book to relate logic programming
and logic. (For basic set theoretic notions see Appendix B.)
The first concept considered is that of logic formulas which provide a formalized syntax for writing sentences like (i )(iii ). Such sentences refer to individuals in some
world and to relations between those individuals. Therefore the starting point is an
assumption about the alphabet of the language. It must include:
symbols for denoting individuals (e.g. the symbol tom may be used to denote
the person Tom of our example). Such symbols will be called constants;
symbols for denoting relations (loves , mother , child of ). Such symbols are called
predicate symbols.
Every predicate symbol has an associated natural number, called its arity. The relation
named by an n-ary predicate symbol is a set of n-tuples of individuals; in the example
above the predicate symbol loves denotes a set of pairs of persons, including the pair
Mary and Tom, denoted by the constants mary and tom.
With the alphabet of constants, predicate symbols and some auxiliary characters,
sentences of natural language like Mary loves Tom can be formalized as formulas
like loves(mary, tom).
The formal language should also provide the possibility of expressing sentences like
(i ) which refers to all elements of the described world. This sentence says that for
all individuals X and Y, if X is a mother and Y is a child of X then X loves Y. For
this purpose, the language of logic introduces the symbol of universal quantifier
( to be read for every or for all) and the alphabet of variables. A variable is a
symbol that refers to an unspecified individual, like X and Y above. Now the sentences
(i )(iii ) can be formalized accordingly:
X ( Y ((mother (X) child of (Y, X)) loves(X, Y )))
mother (mary) child of (tom, mary)
loves(mary, tom)
(1)
(2)
(3)
The symbols and are examples of logical connectives which are used to combine logic formulas reads and and is called conjunction whereas is called
implication and corresponds to the if-then construction above. Parentheses are used
to disambiguate the language.
Another connective which will be used frequently is that for expressing negation.
It is denoted by (with reading not). For example the sentence Tom does not
love Mary can be formalized as the formula:
loves(tom, mary)
In what follows the symbol is also sometimes used. It is called the existential quantifier and reads there exists. The existential quantifier makes it possible to express
the fact that, in the world under consideration, there exists at least one individual
which is in a certain relation with some other individuals. For example the sentence
Mary has a child can be formalized as the formula:
X child of (X, mary)
On occasion the logical connectives and are used. They formalize the connectives or and if and only if (iff).
So far individuals have been represented only by constants. However it is often
the case that in the world under consideration, some individuals are composed
objects. For instance, in some world it may be necessary to discuss relations between
families as well as relations between persons. In this case it would be desirable to
refer to a given family by a construction composed of the constants identifying the
members of the family (actually what is needed is a function that constructs a family
from its members). The language of logic offers means of solving this problem. It is
assumed that its alphabet contains symbols called functors that represent functions
over object domains. Every functor has assigned a natural number called its arity,
which determines the number of arguments of the function. The constants can be
seen as 0-ary functors. Assume now that there is a ternary 3 functor family, a binary
functor child and a constant none. The family consisting of the parents Bill and Mary
and children Tom and Alice can now be represented by the construction:
family(bill , mary, child (tom, child (alice, none)))
Such a construction is called a compound term.
The above informal discussion based on examples of simple declarative sentences gives
motivation for introducing basic constructs of the language of symbolic logic. The kind
of logic used here is called predicate logic. Next a formal definition of this language
is given. For the moment we specify only the form of allowed sentences, while the
meaning of the language will be discussed separately. Thus the definition covers only
the syntax of the language separated from its semantics.
From the syntactic point of view logic formulas are finite sequences of symbols such
as variables, functors and predicate symbols. There are infinitely many of them and
therefore the symbols are usually represented by finite strings of primitive characters.
The representation employed in this book usually conforms to that specified in the
ISO standard of the programming language Prolog (1995). Thus, the alphabet of the
language of predicate logic consists of the following classes of symbols:
variables which will be written as alphanumeric identifiers beginning with capital
letters (sometimes subscriped). Examples of variables are X, Xs, Y, X7, . . .;
constants which are numerals or alphanumeric identifiers beginning with lowercase letters. Examples of constants are x, alf , none, 17, . . .;
functors which are alphanumeric identifiers beginning with lower-case letters
and with an associated arity > 0. To emphasize the arity n of a functor f it is
sometimes written in the form f /n;
3 Usually the terms nullary, unary, binary and ternary are used instead of 0-ary, 1-ary, 2-ary and
3-ary.
Chapter 1: Preliminaries
predicate symbols which are usually alphanumeric identifiers starting with lowercase letters and with an associated arity 0. The notation p/n is used also for
predicate symbols;
logical connectives which are (conjunction), (negation), (logical equivalence), (implication) and (disjunction);
quantifiers (universal) and (existential);
auxiliary symbols like parentheses and commas.
have a binding-order where , and bind stronger than , which in turn binds
stronger than followed by (i.e. ) and finally . Thus (a ((b) c)) will
be simplified into a b c. Sometimes binary functors and predicate symbols are
written in infix notation (e.g. 2 3).
Let F be a formula. An occurrence of the variable X in F is said to be bound
either if the occurrence follows directly after a quantifier or if it appears inside the
subformula which follows directly after X or X. Otherwise the occurrence is
said to be free. A formula with no free occurrences of variables is said to be closed. A
formula/term which contains no variables is called ground.
Let X1 , . . . , Xn be all variables that occur free in a formula F . The closed formula
of the form X1 (. . . ( Xn F ) . . .) is called the universal closure of F and is denoted
F . Similarly, F is called the existential closure of F and denotes the formula F
closed under existential quantification.
1.2
Semantics of Formulas
The interpretation of constants, functors and predicate symbols provides a basis for
assigning truth values to formulas of the language. The meaning of a formula will be
Chapter 1: Preliminaries
Mary
Tom
John
defined as a function on meanings of its components. First the meaning of terms will
be defined since they are components of formulas. Since terms may contain variables
the auxiliary notion of valuation is needed. A valuation is a mapping from variables
of the alphabet to the domain of an interpretation. Thus, it is a function which assigns
objects of an interpretation to variables of the language. By the notation [X 7 t]
we denote the valuation which is identical to except that [X 7 t] maps X to t.
Definition 1.4 (Semantics of terms) Let = be an interpretation, a valuation
and t a term. Then the meaning = (t) of t is an element in |=| defined as follows:
if t is a constant c then = (t) := c= ;
if t is a variable X then = (t) := (X);
if t is of the form f (t1 , . . . , tn ), then = (t) := f= (= (t1 ), . . . , = (tn )).
Notice that the meaning of a compound term is obtained by applying the function
denoted by its main functor to the meanings of its principal subterms, which are
obtained by recursive application of this definition.
Example 1.5 Consider a language which includes the constant zero, the unary functor s and the binary functor plus. Assume that the domain of = is the set of the
natural numbers (N ) and that:
zero=
:= 0
9
s= (x) := 1 + x
plus= (x, y) := x + y
That is, zero denotes the natural number 0, s denotes the successor function and plus
denotes the addition function. For the interpretation = and a valuation such that
(X) := 0 the meaning of the term plus(s(zero), X) is obtained as follows:
= (plus(s(zero), X)) =
=
=
=
= (s(zero)) + = (X)
(1 + = (zero)) + (X)
(1 + 0) + 0
1
The meaning of a formula is a truth value. The meaning depends on the components of
the formula which are either (sub-) formulas or terms. As a consequence the meanings
of formulas also rely on valuations. In the following definition the notation = |= Q
is used as a shorthand for the statement Q is true with respect to = and and
= 6|= Q is to be read Q is false w.r.t. = and .
Definition 1.6 (Semantics of wff s) Let = be an interpretation, a valuation and
Q a formula. The meaning of Q w.r.t. = and is defined as follows:
= |= p(t1 , . . . , tn ) iff h= (t1 ), . . . , = (tn )i p= ;
= |= (F ) iff = 6|= F ;
= |= (F G) iff = |= F and = |= G;
= |= (F G) iff = |= F or = |= G (or both);
= |= (F G) iff = |= G whenever = |= F ;
= |= (F G) iff = |= (F G) and = |= (G F );
= |= (XF ) iff = |=[X7t] F for every t |=|;
= |= (XF ) iff = |=[X7t] F for some t |=|.
The semantics of formulas as defined above relies on the auxiliary concept of valuation
that associates variables of the formula with elements of the domain of the interpretation. It is easy to see that the truth value of a closed formula depends only on
the interpretation. It is therefore common practice in logic programming to consider
all formulas as being implicitly universally quantified. That is, whenever there are
free occurrences of variables in a formula its universal closure is considered instead.
Since the valuation is of no importance for closed formulas it will be omitted when
considering the meaning of such formulas.
10
Chapter 1: Preliminaries
Example 1.7 Consider Example 1.5 again. Assume that the language contains also
a unary predicate symbol p and that:
p= := {h1i, h3i, h5i, h7i, . . .}
Then the meaning of the formula p(zero) p(s(zero)) in the interpretation = is determined as follows:
= |= p(zero) p(s(zero)) iff
iff
iff
iff
1.3
The motivation for introducing the language of formulas was to give a tool for describing worlds that is, algebraic structures. Given a set of closed formulas P and an
interpretation = it is natural to ask whether the formulas of P give a proper account
of this world. This is the case if all formulas of P are true in =.
Definition 1.9 (Model) An interpretation = is said to be a model of P iff every
formula of P is true in =.
Clearly P has infinitely many interpretations. However, it may happen that none of
them is a model of P . A trivial example is any P that includes the formula (F F )
where F is an arbitrary (closed) formula. Such sets of formulas are called unsatisfiable.
When using formulas for describing worlds it is necessary to make sure that every
description produced is satisfiable (that is, has at least one model), and in particular
that the world being described is a model of P .
Generally, a satisfiable set of formulas has (infinitely) many models. This means
that the formulas which properly describe a particular world of interest at the same
time describe many other worlds.
11
C
B
A
Example 1.10 Figure 1.2 shows another structure which can be used as a model
of the formulas (1) and (2) of Section 1.1 which were originally used to describe the
world of Figure 1.1. In order for the structure to be a model the constants tom, john
and mary are interpreted as the boxes A, B and C respectively the predicate
symbols loves, child of and mother are interpreted as the relations . . . is above . . . ,
. . . is below . . . and . . . is on top.
Our intention is to use the description of the world of interest to obtain more information about this world. This new information is to be represented by new formulas
not explicitly included in the original description. An example is the formula (3) of
Section 1.1 which is obtained from (1) and (2). In other words, for a given set P of
formulas other formulas (say F ) which are also true in the world described by P are
searched for. Unfortunately, P itself has many models and does not uniquely identify
the intended model which was described by P . Therefore it must be required that
F is true in every model of P to guarantee that it is also true in the particular world
of interest. This leads to the fundamental concept of logical consequence.
Definition 1.11 (Logical consequence) Let P be a set of closed formulas. A closed
formula F is called a logical consequence of P (denoted P |= F ) iff F is true in every
model of P .
Example 1.12 To illustrate this notion by an example it is shown that (3) is a logical
consequence of (1) and (2). Let = be an arbitrary interpretation. If = is a model of
(1) and (2) then:
= |= X( Y ((mother (X) child of (Y, X)) loves(X, Y )))
= |= mother (mary) child of (tom, mary)
(4)
(5)
(6)
for any valuation specifically for (X) = mary = and (Y ) = tom = . However,
since these individuals are denoted by the constants mary and tom it must also hold
that:
= |= mother (mary) child of (tom, mary) loves(mary, tom)
(7)
Finally, for this to hold it follows that loves(mary, tom) must be true in = (by Definition 1.6 and since (5) holds by assumption). Hence, any model of (1) and (2) is also
a model of (3).
12
Chapter 1: Preliminaries
This example shows that it may be rather difficult to prove that a formula is a logical
consequence of a set of formulas. The reason is that one has to use the semantics of
the language of formulas and to deal with all models of the formulas.
One possible way to prove P |= F is to show that F is false in every model of P ,
or put alternatively, that the set of formulas P {F } is unsatisfiable (has no model).
The proof of the following proposition is left as an exercise.
Proposition 1.13 (Unsatisfiability) Let P be a set of closed formulas and F a
closed formula. Then P |= F iff P {F } is unsatisfiable.
It is often straightforward to show that a formula F is not a logical consequence of the
set P of formulas. For this, it suffices to give a model of P which is not a model of F .
Example 1.14 Let P be the formulas:
X(r(X) (p(X) q(X)))
(8)
r(a) r(b)
(9)
To prove that p(a) is not a logical consequence of P it suffices to consider an interpretation = where |=| is the set consisting of the two persons Adam and Eve and
where:
a= := Adam
b= := Eve
p= := {hEvei}
q= := {hAdami}
r= := {hAdami, hEvei}
Clearly, (8) is true in = since any person is either female or male. Similarly (9) is
true since both Adam and Eve are persons. However, p(a) is false in = since Adam
is not a female.
Another important concept based on the semantics of formulas is the notion of logical
equivalence.
Definition 1.15 (Logical equivalence) Two formulas F and G are said to be logically equivalent (denoted F G) iff F and G have the same truth value for all
interpretations = and valuations .
Next a number of well-known facts concerning equivalences of formulas are given. Let
F and G be arbitrary formulas and H(X) a formula with zero or more free occurrences
of X. Then:
F
F G
F G
F G
(F G)
(F G)
XH(X)
XH(X)
F
F G
G F
(F G) (G F )
F G
F G
XH(X)
XH(X)
DeMorgans
DeMorgans
DeMorgans
DeMorgans
law
law
law
law
13
1.4
Logical Inference
In Section 1.1 the sentence (iii ) was obtained by reasoning about the sentences (i )
and (ii ). The language was then formalized and the sentences were expressed as the
logical formulas (1), (2) and (3). With this formalization, reasoning can be seen as a
process of manipulation of formulas, which from a given set of formulas, like (1) and
(2), called the premises, produces a new formula called the conclusion, for instance
(3). One of the objectives of the symbolic logic is to formalize reasoning principles
as formal re-write rules that can be used to generate new formulas from given ones.
These rules are called inference rules. It is required that the inference rules correspond
to correct ways of reasoning whenever the premises are true in any world under
consideration, any conclusion obtained by application of an inference rule should also
be true in this world. In other words it is required that the inference rules produce
only logical consequences of the premises to which they can be applied. An inference
rule satisfying this requirement is said to be sound.
Among well-known inference rules of predicate logic the following are frequently
used:
Modus ponens or elimination rule for implication: This rule says that whenever
formulas of the form F and (F G) belong to or are concluded from a set of
premises, G can be inferred. This rule is often presented as follows:
F
F G
G
( E)
Elimination rule for universal quantifier: This rule says that whenever a formula
of the form (XF ) belongs to or is concluded from the premises a new formula
can be concluded by replacing all free occurrences of X in F by some term t
which is free for X (that is, all variables in t remain free when X is replaced by
t: for details see e.g. van Dalen (1983) page 68). This rule is often presented as
follows:
XF (X)
( E)
F (t)
Introduction rule for conjunction: This rule states that if formulas F and G
belong to or are concluded from the premises then the conclusion F G can be
inferred. This is often stated as follows:
F G
F G
(I)
Soundness of these rules can be proved directly from the definition of the semantics of
the language of formulas.
14
Chapter 1: Preliminaries
Their use can be illustrated by considering the example above. The premises are:
X ( Y (mother (X) child of (Y, X) loves(X, Y )))
mother (mary) child of (tom, mary)
(10)
(11)
(12)
(13)
(14)
Thus the conclusion (14) has been produced in a formal way by application of the
inference rules. The example illustrates the concept of derivability. As observed, (14)
is obtained from (10) and (11) not directly, but in a number of inference steps, each
of them adding a new formula to the initial set of premises. Any formula F that
can be obtained in that way from a given set P of premises is said to be derivable
from P . This is denoted by P ` F . If the inference rules are sound it follows that
whenever P ` F , then P |= F . That is, whatever can be derived from P is also a
logical consequence of P . An important question related to the use of inference rules is
the problem of whether all logical consequences of an arbitrary set of premises P can
also be derived from P . In this case the set of inference rules is said to be complete.
Definition 1.16 (Soundness and Completeness) A set of inference rules are
said to be sound if, for every set of closed formulas P and every closed formula F ,
whenever P ` F it holds that P |= F . The inference rules are complete if P ` F
whenever P |= F .
A set of premises is said to be inconsistent if any formula can be derived from the
set. Inconsistency is the proof-theoretic counterpart of unsatisfiability, and when the
inference system is both sound and complete the two are frequently used as synonyms.
1.5
Substitutions
The chapter is concluded with a brief discussion on substitutions a concept fundamental to forthcoming chapters. Formally a substitution is a mapping from variables
of a given alphabet to terms in this alphabet. The following syntactic definition is
often used instead:
Definition 1.17 (Substitutions) A substitution is a finite set of pairs of terms
{X1 /t1 , . . . , Xn /tn } where each ti is a term and each Xi a variable such that Xi 6= ti
and Xi 6= Xj if i 6= j. The empty substitution is denoted .
1.5 Substitutions
15
16
Chapter 1: Preliminaries
Exercises
1.1 Formalize the following sentences of natural language as formulas of predicate
logic:
a)
b)
c)
d)
e)
f)
1.2 Formalize the following sentences of natural language into predicate logic:
a)
b)
c)
(F G)
(F G)
1.6 Let F and G be closed formulas. Show that F G iff {F } |= G and {G} |= F .
1.7 Show that P is unsatisfiable iff there is some closed formula F such that P |= F
and P |= F .
Exercises
17
1.8 Show that the following three formulas are satisfiable only if the interpretation
has an infinite domain
Xp(X, X)
XY Z(p(X, Y ) p(Y, Z) p(X, Z))
XY p(X, Y )
1.9 Let F be a formula and a substitution. Show that F |= (F ).
1.10 Let P1 , P2 and P3 be sets of closed formulas. Redefine |= in such a way that
P1 |= P2 iff every formula in P2 is a logical consequence of P1 . Then show that
|= is transitive that is, if P1 |= P2 and P2 |= P3 then P1 |= P3 .
1.11 Let P1 and P2 be sets of closed formulas. Show that if P1 P2 and P1 |= F
then P2 |= F .
1.12 Prove Proposition 1.23.
1.13 Let and be substitutions. Show that the composition is equivalent to
function composition of the mappings denoted by and .
1.14 Show that a substitution is idempotent iff Dom() Range() = ?.
1.15 Which of the following statements are true?
if = then =
if = then =
if = then =
18
Chapter 1: Preliminaries
Chapter 2
Definite Logic Programs
2.1
Definite Clauses
The idea of logic programming is to use a computer for drawing conclusions from
declarative descriptions. Such descriptions called logic programs consist of finite
sets of logic formulas. Thus, the idea has its roots in the research on automatic theorem
proving. However, the transition from experimental theorem proving to applied logic
programming requires improved efficiency of the system. This is achieved by introducing restrictions on the language of formulas restrictions that make it possible to use
the relatively simple and powerful inference rule called the SLD-resolution principle.
This chapter introduces a restricted language of definite logic programs and in the
next chapter their computational principles are discussed. In subsequent chapters a
more unrestrictive language of so-called general programs is introduced. In this way
the foundations of the programming language Prolog are presented.
To start with, attention will be restricted to a special type of declarative sentences
of natural language that describe positive facts and rules. A sentence of this type
either states that a relation holds between individuals (in case of a fact), or that a
relation holds between individuals provided that some other relations hold (in case of
a rule). For example, consider the sentences:
(i ) Tom is Johns child
(ii ) Ann is Toms child
(iii ) John is Marks child
(iv ) Alice is Johns child
(v ) The grandchild of a person is a child of a child of this person
19
20
These sentences may be formalized in two steps. First atomic formulas describing
facts are introduced:
child(tom, john)
child(ann, tom)
child(john, mark)
child(alice, john)
(1)
(2)
(3)
(4)
(5)
This can be further formalized using quantifiers and the logical connectives and
, but to preserve the natural order of expression the implication is reversed and
written :
X Y (grandchild(X, Y ) Z (child(X, Z) child(Z, Y )))
(6)
This formula can be transformed into the following equivalent forms using the equivalences given in connection with Definition 1.15:
X Y
X Y
X Y
X Y
We now focus attention on the language of formulas exemplified by the example above.
It consists of formulas of the form:
A0 A1 An
(where n 0)
or equivalently:
A0 A1 An
where A0 , . . . , An are atomic formulas and all variables occurring in a formula are
(implicitly) universally quantified over the whole formula. The formulas of this form
are called definite clauses. Facts are definite clauses where n = 0. (Facts are sometimes
called unit-clauses.) The atomic formula A0 is called the head of the clause whereas
A1 An is called its body.
The initial example shows that definite clauses use a restricted form of existential
quantification the variables that occur only in body literals are existentially quantified over the body (though formally this is equivalent to universal quantification on
the level of clauses).
2.2
21
The logic formulas derived above are special cases of a more general form, called clausal
form.
Definition 2.1 (Clause) A clause is a formula (L1 Ln ) where each Li is an
atomic formula (a positive literal) or the negation of an atomic formula (a negative
literal).
As seen above, a definite clause is a clause that contains exactly one positive literal.
That is, a formula of the form:
(A0 A1 An )
The notational convention is to write such a definite clause thus:
A0 A1 , . . . , An
(n 0)
If the body is empty (i.e. if n = 0) the implication arrow is usually omitted. Alternatively the empty body can be seen as a nullary connective which is true in every
interpretation. (Symmetrically there is also a nullary connective 2 which is false in
every interpretation.) The first kind of logic program to be discussed are programs
consisting of a finite number of definite clauses:
Definition 2.2 (Definite programs) A definite program is a finite set of definite
clauses.
To explain the use of logic formulas as programs, a general view of logic programming
is presented in Figure 2.1. The programmer attempts to describe the intended model
by means of declarative sentences (i.e. when writing a program he has in mind an
algebraic structure, usually infinite, whose relations are to interpret the predicate
symbols of the program). These sentences are definite clauses facts and rules. The
program is a set of logic formulas and it may have many models, including the intended
model (Figure 2.1(a)). The concept of intended model makes it possible to discuss
correctness of logic programs a program P is incorrect iff the intended model is not
a model of P . (Notice that in order to prove programs to be correct or to test programs
it is necessary to have an alternative description of the intended model, independent
of P .)
The program will be used by the computer to draw conclusions about the intended
model (Figure 2.1(b)). However, the only information available to the computer about
the intended model is the program itself. So the conclusions drawn must be true in any
model of the program to guarantee that they are true in the intended model (Figure
2.1(c)). In other words the soundness of the system is a necessary condition. This
will be discussed in Chapter 3. Before that, attention will be focused on the practical
question of how a logic program is to be used.
The set of logical consequences of a program is infinite. Therefore the user is
expected to query the program selectively for various aspects of the intended model.
There is an analogy with relational databases facts explicitly describe elements
of the relations while rules give intensional characterization of some other elements.
22
model
intended
model
model
(a)
P `F
(b)
model
intended
model
model
(c)
Figure 2.1: General view of logic programming
23
Since the rules may be recursive, the relation described may be infinite in contrast
to the traditional relational databases. Another difference is the use of variables and
compound terms. This chapter considers only queries of the form:
((A1 Am ))
Such formulas are called definite goals and are usually written as:
A1 , . . . , Am
where Ai s are atomic formulas called subgoals. The goal where m = 0 is denoted 21
and called the empty goal. The logical meaning of a goal can be explained by referring
to the equivalent universally quantified formula:
X1 Xn (A1 Am )
where X1 , . . . , Xn are all variables that occur in the goal. This is equivalent to:
X1 Xn (A1 Am )
This, in turn, can be seen as an existential question and the system attempts to deny
it by constructing a counter-example. That is, it attempts to find terms t1 , . . . , tn such
that the formula obtained from A1 Am when replacing the variable Xi by ti
(1 i n), is true in any model of the program, i.e. to construct a logical consequence
of the program which is an instance of a conjunction of all subgoals in the goal.
By giving a definite goal the user selects the set of conclusions to be constructed.
This set may be finite or infinite. The problem of how the machine constructs it will
be discussed in Chapter 3. The section is concluded with some examples of queries
and the answers obtained to the corresponding goals in a typical Prolog system.
Example 2.3 Referring to the family-example in Section 2.1 the user may ask the
following queries (with the corresponding goal):
Query
Is Ann a child of Tom?
Who is a grandchild of Ann?
Whose grandchild is Tom?
Who is a grandchild of whom?
Goal
child(ann, tom)
grandchild(X, ann)
grandchild(tom, X)
grandchild(X, Y )
24
Y = mark
Y = mark
Y = john
It is also possible to ask more complicated queries, for example Is there a person
whose grandchildren are Tom and Alice?, expressed formally as:
grandchild(tom, X), grandchild(alice, X)
whose (expected) answer is X = mark.
2.3
Definite programs can only express positive knowledge both facts and rules say
which elements of a structure are in a relation, but they do not say when the relations
do not hold. Therefore, using the language of definite programs, it is not possible to
construct contradictory descriptions, i.e. unsatisfiable sets of formulas. In other words,
every definite program has a model. This section discusses this matter in more detail.
It shows also that every definite program has a well defined least model. Intuitively
this model reflects all information expressed by the program and nothing more.
We first focus attention on models of a special kind, called Herbrand models. The
idea is to abstract from the actual meanings of the functors (here, constants are treated
as 0-ary functors) of the language. More precisely, attention is restricted to the interpretations where the domain is the set of variable-free terms and the meaning of every
ground term is the term itself. After all, it is a common practice in databases the
constants tom and ann may represent persons but the database describes relations
between the persons by handling relations between the terms (symbols) no matter
whom they represent.
The formal definition of such domains follows and is illustrated by two simple
examples.
Definition 2.4 (Herbrand universe, Herbrand base) Let A be an alphabet
containing at least one constant symbol. The set UA of all ground terms constructed
from functors and constants in A is called the Herbrand universe of A. The set BA of
all ground, atomic formulas over A is called the Herbrand base of A.
The Herbrand universe and Herbrand base are often defined for a given program. In
this case it is assumed that the alphabet of the program consists of exactly those
symbols which appear in the program. It is also assumed that the program contains
at least one constant (since otherwise, the domain would be empty).
Example 2.5 Consider the following definite program P :
25
odd(s(0)).
odd(s(s(X))) odd(X).
The program contains one constant (0) and one unary functor (s). Consequently the
Herbrand universe looks as follows:
UP = {0, s(0), s(s(0)), s(s(s(0))), . . .}
Since the program contains only one (unary) predicate symbol (odd) it has the following Herbrand base:
BP = {odd(0), odd(s(0)), odd(s(s(0))), . . .}
26
Example 2.8 One possible interpretation of the program P in Example 2.5 is odd= =
{hs(0)i, hs(s(s(0)))i}. A Herbrand interpretation can be specified by giving a family
of such relations (one for every predicate symbol).
Since the domain of a Herbrand interpretation is the Herbrand universe the relations
are sets of tuples of ground terms. One can define all of them at once by specifying
a set of labelled tuples, where the labels are predicate symbols. In other words: A
Herbrand interpretation = can be seen as a subset of the Herbrand base (or a possibly
infinite relational database), namely {A BP | = |= A}.
Example 2.9 Consider some alternative Herbrand interpretations for P of Example
2.5.
=1
=2
=3
=4
=5
:=
:=
:=
:=
=
:=
?
{odd(s(0))}
{odd(s(0)), odd(s(s(0)))}
{odd(sn (0)) | n {1, 3, 5, 7, . . .}}
{odd(s(0)), odd(s(s(s(0)))), . . .}
BP
27
(m 0)
generally the result of Theorem 2.12 would hold for any set of clauses.
28
(m 0)
which is not true in =. This implies that = contains A1 , . . . , Am but not A0 . Then
A1 , . . . , Am are elements of every interpretation of the family M . Moreover there must
be at least one model =i M such that A0 6 =i . Thus A0 A1 , . . . , Am is not true
in this =i . Hence =i is not a model of the program, which contradicts the assumption.
This concludes the proof that the intersection of any set of Herbrand models of a
program is also a Herbrand model.
Thus by taking the intersection of all Herbrand models (it is known that every definite
program P has at least one Herbrand model namely BP ) the least Herbrand model
of the definite program is obtained.
Example 2.15 Let P be the definite program {male(adam), female(eve)} with obvious intended interpretation. P has the following four Herbrand models:
{male(adam), female(eve)}
{male(adam), male(eve), female(eve)}
{male(adam), female(eve), female(adam)}
{male(adam), male(eve), female(eve), female(adam)}
It is not very hard to see that any intersection of these yields a Herbrand model.
However, all but the first model contain atoms incompatible with the intended one.
Notice also that the intersection of all four models yields a model which corresponds
to the intended model.
This example indicates a connection between the least Herbrand model and the intended model of a definite program. The intended model is an abstraction of the world
to be described by the program. The world may be richer than the least Herbrand
model. For instance, there may be more female individuals than just Eve. However,
the information not included explicitly (via facts) or implicitly (via rules) in the program cannot be obtained as an answer to a goal. The answers correspond to logical
consequences of the program. Ideally, a ground atomic formula p(t1 , . . . , tn ) is a logical consequence of the program iff, in the intended interpretation =, ti denotes the
individual xi and hx1 , . . . , xn i p= . The set of all such ground atoms can be seen as
a coded version of the intended model. The following theorem relates this set to the
least Herbrand model.
Theorem 2.16 The least Herbrand model MP of a definite program P is the set of
all ground atomic logical consequences of the program. That is, MP = {A BP |
P |= A}.
29
Proof : Show first MP {A BP | P |= A}: It is easy to see that every ground atom
A which is a logical consequence of P is an element of MP . Indeed, by the definition
of logical consequence A must be true in MP . On the other hand, the definition of
Herbrand interpretation states that A is true in MP iff A is an element of MP .
Then show that MP {A BP | P |= A}: Assume that A is in MP . Hence it is
true in every Herbrand model of P . Assume that it is not true in some non-Herbrand
model =0 of P . But we know (see Theorem 2.12) that the set = of all ground atomic
formulas which are true in =0 is a Herbrand model of P . Hence A cannot be an element
of =. This contradicts the assumption that there exists a model of P where A is false.
Hence A is true in every model of P , that is P |= A, which concludes the proof.
The model intersection property expressed by Theorem 2.14 does not hold for arbitrary
formulas as illustrated by the following example.
Example 2.17 Consider the formula p(a) q(b). Clearly, both {p(a)} and {q(b)} are
Herbrand models of the formula. However, the intersection {p(a)} {q(b)} = ? is
not a model. The two models are examples of minimal models that is, one cannot
remove any element from the model and still have a model. However, there is no least
model that is, a unique minimal model.
2.4
The question arises how the least Herbrand model can be constructed, or approximated
by successive enumeration of its elements. The answer to this question is given by a
fixed point approach to the semantics of definite programs. (A fixpoint of a function
f : D D is an element x D such that f (x) = x.) This section gives only a sketch
of the construction. The discussion of the relevant theory is outside of the scope of
this book. However, the intuition behind the construction is the following:
A definite program consists of facts and rules. Clearly, all ground instances of the
facts must be included in every Herbrand model. If a Herbrand interpretation = does
not include a ground instance of a fact A of the program then A is not true in = and
= is not a model.
Next, consider a rule A0 A1 , . . . , Am where (m > 0). This rule states that
whenever A1 , . . . , Am are true then so is A0 . In other words, take any ground instance
(A0 A1 , . . . , Am ) of the rule. If = includes A1 , . . . , Am it must also include A0
in order to be a model.
Consider the set =1 of all ground instances of facts in the program. It is now
possible to use every instance of each rule to augment =1 with new elements which
necessarily must belong to every model. In that way a new set =2 is obtained which
can be used again to generate more elements which must belong to the model. This
process is repeated as long as new elements are generated. The new elements added
to =i+1 are those which must follow immediately from =i .
The construction outlined above can be formally defined as an iteration of a transformation TP on Herbrand interpretations of the program P . The operation is called
the immediate consequence operator and is defined as follows:
Definition 2.18 (Immediate consequence operator) Let ground(P ) be the set
of all ground instances of clauses in P . TP is a function on Herbrand interpretations
30
of P defined as follows:
TP (I) := {A0 | A0 A1 , . . . , Am ground(P ) {A1 , . . . , Am } I}
For definite programs it can be shown that there exists a least interpretation = such
that TP (=) = = and that = is identical with the least Herbrand model MP . Moreover,
MP is the limit of the increasing, possibly infinite sequence of iterations:
[
TP :=
TP i
i=0
As already mentioned above it has been established that the set constructed in this
way is identical to the least Herbrand model.
Theorem 2.20 Let P be a definite program and MP its least Herbrand model. Then:
MP is the least Herbrand interpretation such that TP (MP ) = MP (i.e. it is the
least fixpoint of TP ).
MP = TP .
For additional details and proofs see for example Apt (1990), Lloyd (1987) or van Emden and Kowalski (1976).
Exercises
31
Exercises
2.1 Rewrite the following formulas in the form A0 A1 , . . . , Am :
X(p(X) q(X))
X(p(X) Y (q(X, Y ) r(X)))
X(p(X) (q(X) r(X)))
X(r(X) (q(X) p(X)))
2.2 Formalize the following scenario as a definite program:
Basil owns Fawlty Towers. Basil and Sybil are married. Polly and
Manuel are employees at Fawlty Towers. Smith and Jones are guests
at Fawlty Towers. All hotel-owners and their spouses serve all guests
at the hotel. All employees at a hotel serve all guests at the hotel. All
employees dislike the owner of the workplace. Basil dislikes Manuel.
Then ask the queries Who serves who? and Who dislikes who?.
2.3 Give the Herbrand universe and Herbrand base of the following definite program:
p(f (X)) q(X, g(X)).
q(a, g(b)).
q(b, g(b)).
2.4 Give the Herbrand universe and Herbrand base of the following definite program:
p(s(X), Y, s(Z)) p(X, Y, Z).
p(0, X, X).
2.5 Consider the Herbrand universe consisting of the constants a, b, c and d. Let
= be the Herbrand interpretation:
{p(a), p(b), q(a), q(b), q(c), q(d)}
Which of the following formulas are true in =?
(1)
(2)
(3)
(4)
(5)
Xp(X)
Xq(X)
X(q(X) p(X))
X(q(X) p(X))
X(p(X) q(X))
2.6 Give the least Herbrand model of the program in exercise 2.3.
2.7 Give the least Herbrand model of the program in exercise 2.4. Hint: the model
is infinite, but a certain pattern can be spotted when using the TP -operator.
32
Chapter 3
SLD-Resolution
This chapter introduces the inference mechanism which is the basis of most logic
programming systems. The idea is a special case of the inference rule called the
resolution principle an idea that was first introduced by J. A. Robinson in the
mid-sixties for a richer language than definite programs. As a consequence, only a
specialization of this rule, that applies to definite programs, is presented here. For
reasons to be explained later, it will be called the SLD-resolution principle.
In the previous chapter the model-theoretic semantics of definite programs was
discussed. The SLD-resolution principle makes it possible to draw correct conclusions
from the program, thus providing a foundation for a logically sound operational semantics of definite programs. This chapter first defines the notion of SLD-resolution
and then shows its correctness with respect to the model-theoretic semantics. Finally
SLD-resolution is shown to be an instance of a more general notion involving the
construction of proof trees.
3.1
Informal Introduction
Every inference rule of a logical system formalizes some natural way of reasoning.
The presentation of the SLD-resolution principle is therefore preceded by an informal
discussion about the underlying reasoning techniques.
The sentences of logic programs have a general structure of logical implication:
A0 A1 , . . . , An
(n 0)
where A0 , . . . , An are atomic formulas and where A0 may be absent (in which case it
is a goal clause). Consider the following definite program that describes a world where
parents of newborn children are proud, Adam is the father of Mary and Mary is
newborn:
33
34
Chapter 3: SLD-Resolution
proud (X) parent(X, Y ), newborn(Y ).
parent(X, Y ) father (X, Y ).
parent(X, Y ) mother (X, Y ).
father (adam, mary).
newborn(mary).
Notice that this program describes only positive knowledge it does not state who
is not proud. Nor does it convey what it means for someone not to be a parent. The
problem of expressing negative knowledge will be investigated in detail in Chapter 4
when extending definite programs with negation.
Say now that we want to ask the question Who is proud?. The question concerns
the world described by the program P , that is, the intended model of P . We would
of course like to see the answer Adam to this question. However, as discussed in
the previous chapters predicate logic does not provide the means for expressing this
type of interrogative sentences; only declarative ones. Therefore the question may be
formalized as the goal clause:
proud (Z)
(G0 )
(C0 )
(G1 )
35
Thus, one step of reasoning amounts to replacing a goal G0 by another goal G1 which
is true in any model of P {G0 }. It now remains to be shown that P {G1 } is
unsatisfiable. Note that G1 is equivalent to:
Z Y (parent (Z, Y ) newborn(Y ))
Thus G1 can be shown to be unsatisfiable with P if in every model of P there is some
individual who is a parent of a newborn child. Thus, check first whether there are any
parents at all. The program contains a clause:
parent (X, Y ) father (X, Y ).
(C1 )
(G2 )
The new goal G2 can be shown to be unsatisfiable with P if in every model of P there
is some individual who is a father of a newborn child. The program states that Adam
is the father of Mary:
father (adam, mary).
(C2 )
Thus it remains to be shown that Mary is not newborn is unsatisfiable together with
P:
newborn(mary).
(G3 )
(C3 )
(G4 )
The way of reasoning used in this example is as follows: to show existence of something,
assume the contrary and use modus ponens and elimination of the universal quantifier
to find a counter-example for the assumption. This is a general idea to be used in
computations of logic programs. As illustrated above, a single computation (reasoning)
step transforms a set of atomic formulas that is, a definite goal into a new set of
atoms. (See Figure 3.1.) It uses a selected atomic formula p(s1 , . . . , sn ) of the goal and
a selected program clause of the form p(t1 , . . . , tn ) A1 , . . . , Am (where m 0 and
A1 , . . . , Am are atoms) to find a common instance of p(s1 , . . . , sn ) and p(t1 , . . . , tn ). In
other words a substitution is constructed such that p(s1 , . . . , sn ) and p(t1 , . . . , tn )
are identical. Such a substitution is called a unifier and the problem of finding unifiers
will be discussed in the next section. The new goal is constructed from the old one by
replacing the selected atom by the set of body atoms of the clause and applying to all
36
Chapter 3: SLD-Resolution
proud (Z).
atoms obtained in that way. This basic computation step can be seen as an inference
rule since it transforms logic formulas. It will be called the resolution principle for
definite programs or SLD-resolution principle. As illustrated above it combines in a
special way modus ponens with the elimination rule for the universal quantifier.
At the last step of reasoning the empty goal, corresponding to falsity, is obtained.
The final conclusion then is the negation of the initial goal. Since this goal is of the
form (A1 Am ), the conclusion is equivalent (by DeMorgans laws) to the
formula (A1 Am ). The final conclusion can be obtained by the inference rule
known as reductio ad absurdum. Every step of reasoning produces a substitution.
Unsatisfiability of the original goal A1 , . . . , Am with P is demonstrated in k steps
by showing that its instance:
(A1 , . . . , Am )1 k
is unsatisfiable, or equivalently that:
P |= (A1 Am )1 k
In the example discussed, the goal Nobody is proud is unsatisfiable with P since
its instance Adam is not proud is unsatisfiable with P . In other words in every
model of P the sentence Adam is proud is true.
It is worth noticing that the unifiers may leave some variables unbound. In this
case the universal closure of (A1 Am )1 k is a logical consequence of P .
Examples of such answers will appear below.
Notice also that generally the computation steps are not deterministic any atom
of a goal may be selected and there may be several clauses matching the selected atom.
Another potential source of non-determinism concerns the existence of alternative
unifiers for two atoms. These remarks suggest that it may be possible to construct
(sometimes infinitely) many solutions, i.e. counter-examples for the initial goal. On
the other hand it may also happen that the selected atom has no matching clause.
3.2 Unification
37
If so, it means that, using this method, it is not possible to construct any counterexample for the initial goal. The computation may also loop without producing any
solution.
3.2
Unification
As demonstrated in the previous section, one of the main ingredients in the inference
mechanism is the process of making two atomic formulas syntactically equivalent. Before defining the notion of SLD-resolution we focus on this process, called unification,
and give an algorithmic solution a procedure that takes two atomic formulas as
input, and either shows how they can be instantiated to identical atoms or, reports a
failure.
Before considering the problem of unifying atoms (and terms), consider an ordinary
equation over the natural numbers (N ) such as:
.
2x + 3 = 4y + 7
(5)
The equation has a set of solutions; that is, valuations : {x, y} N such that = (2x+
3) = = (4y + 7) where = is the standard interpretation of the arithmetic symbols. In
this particular example there are infinitely many solutions ({x 7 2, y 7 0} and
{x 7 4, y 7 1} etc.) but by a sequence of syntactic transformations that preserve
the set of all solutions the equation may be transformed into an new equation that
compactly represents all solutions to the original equation:
.
x = 2(y + 1)
(6)
(7)
Clearly it is no longer possible to apply all the transformations that were applied above
since the interpretation of f /2, g/1 is no longer fixed. However, any solution of the
equations:
.
.
{X = a, g(Y ) = g(X)}
(8)
(9)
(10)
38
Chapter 3: SLD-Resolution
symbols f /2, g/1 and a are interpreted. For example, if f /2 denotes integer addition,
g/1 the successor function and a the integer zero, then (10) represents only one solution
to equation (7). However, equation (7) has infinitely many integer solutions any
such that (Y ) = 0 is a solution.
On the other hand, consider a Herbrand interpretation =; Solving of an equation
.
s = t amounts to finding a valuation such that = (s) = = (t). Now a valuation in
the Herbrand domain is a mapping from variables of the equations to ground terms
(that is, a substitution) and the interpretation of a ground term is the term itself.
Thus, a solution in the Herbrand domain is a grounding substitution such that
s and t are identical ground terms. This brings us to the fundamental concept of
unification and unifiers:
Definition 3.1 (Unifier) Let s and t be terms. A substitution such that s and
t are identical (denoted s = t) is called a unifier of s and t.
The search for a unifier of two terms, s and t, will be viewed as the process of solving
.
.
.
the equation s = t. Therefore, more generally, if {s1 = t1 , . . . , sn = tn } is a set of
equations, then is called a unifier of the set if si = ti for all 1 i n. For instance,
the substitution {X/a, Y /a} is a unifier of equation (7). It is also a unifier of (8)(10).
In fact, it is the only unifier as long as irrelevant variables are not introduced. (For
instance, {X/a, Y /a, Z/a} is also a unifier.) The transformations informally used in
steps (7)(10) preserve the set of all solutions in the Herbrand domain. (The full set
of transformations will soon be presented.) Note that a solution to a set of equations
is a (grounding) unifier. Thus, if a set of equations has a unifier then the set also has
a solution.
However, not all sets of equations have a solution/unifier. For instance, the set
.
{sum(1, 1) = 2} is not unifiable. Intuitively sum may be thought of as integer addition,
but bear in mind that the symbols have no predefined interpretation in a logic program.
(In Chapters 1314 more powerful notions of unification are discussed.)
It is often the case that a set of equations have more than one unifier. For in.
stance, both {X/g(Z), Y /Z} and {X/g(a), Y /a, Z/a} are unifiers of the set {f (X, Y ) =
f (g(Z), Z)}. Under the first unifier the terms instantiate to f (g(Z), Z) and under the
second unifier the terms instantiate to f (g(a), a). The second unifier is in a sense
more restrictive than the first, as it makes the two terms ground whereas the first
still provides room for some alternatives in that is does not specify how Z should be
bound. We say that {X/g(Z), Y /Z} is more general than {X/g(a), Y /a, Z/a}. More
formally this can be expressed as follows:
Definition 3.2 (Generality of substitutions) A substitution is said to be more
general than a substitution (denoted ) iff there exists a substitution such
that = .
Definition 3.3 (Most general unifier) A unifier is said to be a most general
unifier (mgu) of two terms iff is more general than any other unifier of the terms.
.
.
Definition 3.4 (Solved form) A set of equations {X1 = t1 , . . . , Xn = tn } is said
to be in solved form iff X1 , . . . , Xn are distinct variables none of which appear in
t1 , . . . , tn .
3.2 Unification
39
There is a close correspondence between a set of equations in solved form and the most
general unifier(s) of that set as shown by the following theorem:
.
.
Proposition 3.5 Let {X1 = t1 , . . . , Xn = tn } be a set of equations in solved form.
Then {X1 /t1 , . . . , Xn /tn } is an (idempotent) mgu of the solved form.
Proof : First define:
.
.
E := {X1 = t1 , . . . , Xn = tn }
:= {X1 /t1 , . . . , Xn /tn }
Clearly is an idempotent unifier of E. It remains to be shown that is more general
than any other unifier of E.
Thus, assume that is a unifier of E. Then Xi = ti for 1 i n. It must
follow that Xi /ti for 1 i n. In addition may contain some additonal pairs
Y1 /s1 , . . . , Ym /sm such that {X1 , . . . , Xn } {Y1 , . . . , Ym } = ?. Thus, is of the form:
{X1 /t1 , . . . , Xn /tn , Y1 /s1 , . . . , Ym /sm }
Now = . Thus, there exists a substitution (viz. ) such that = . Therefore,
is an idempotent mgu.
Definition 3.6 (Equivalence of sets of equations) Two sets of equations E1 and
E2 are said to be equivalent if they have the same set of unifiers.
Note that two equivalent sets of equations must have the same set of solutions in any
Herbrand interpretation.
The definition can be used as follows: to compute a most general unifier mgu(s, t)
.
of two terms s and t, first try to transform the equation {s = t} into an equivalent
solved form. If this fails then mgu(s, t) = failure. However, if there is a solved form
.
.
{X1 = t1 , . . . , Xn = tn } then mgu(s, t) = {X1 /t1 , . . . , Xn /tn }.
Figure 3.2 presents a (non-deterministic) algorithm which takes as input a set of
equations E and terminates returning either a solved form equivalent to E or failure
if no such solved form exists. Note that constants are viewed as function symbols of
.
arity 0. Thus, if an equation c = c gets selected, the equation is simply removed by
case 1. Before proving the correctness of the algorithm some examples are used to
illustrate the idea:
.
Example 3.7 The set {f (X, g(Y )) = f (g(Z), Z)} has a solved form since:
.
.
.
{f (X, g(Y )) = f (g(Z), Z)} {X = g(Z), g(Y ) = Z}
.
.
{X = g(Z), Z = g(Y )}
.
.
{X = g(g(Y )), Z = g(Y )}
.
The set {f (X, g(X), b) = f (a, g(Z), Z)}, on the other hand, does not have a solved
form since:
.
.
.
.
{f (X, g(X), b) = f (a, g(Z), Z)} {X = a, g(X) = g(Z), b = Z}
.
.
.
{X = a, g(a) = g(Z), b = Z}
40
Chapter 3: SLD-Resolution
1
2
3
4
5a
5b
.
.
.
{X = a, a = Z, b = Z}
.
.
.
{X = a, Z = a, b = Z}
.
.
.
{X = a, Z = a, b = a}
failure
.
The algorithm fails since case 2 applies to b = a. Finally consider:
.
{f (X, g(X)) = f (Z, Z)}
.
.
{X = Z, g(X) = Z}
.
.
{X = Z, g(Z) = Z}
.
.
{X = Z, Z = g(Z)}
failure
The set does not have a solved form since Z is a proper subterm of g(Z).
Theorem 3.8 The solved form algorithm in Figure 3.2 terminates and returns an
equivalent solved form or failure if no such solved form exists.
Proof : First consider termination: Note that case 5b is the only case that may increase
the number of symbol occurrences in the set of equations. However, case 5b can be
applied at most once for each variable X. Thus, case 5b can be applied only a finite
3.2 Unification
41
number of times and may introduce only a finite number of new symbol occurrences.
Case 2 and case 5a terminate immediately and case 1 and 3 strictly decrease the
number of symbol occurrences in the set. Since case 4 cannot be applied indefinitely,
but has to be intertwined with the other cases it follows that the algorithm always
terminates.
It should be evident that the algorithm either returns failure or a set of equations
in solved form. Thus, it remains to be shown that each iteration of the algorithm
preserves equivalence between successive sets of equations. It is easy to see that if
case 2 or 5a apply to some equation in:
.
.
{s1 = t1 , . . . , sn = tn }
(E1 )
then the set cannot possibly have a unifier. It is also easy to see that if any of case 1, 3
or 4 apply, then the new set of equations has the same set of unifiers. Finally assume
.
that case 5b applies to some equation si = ti . Then the new set is of the form:
.
.
.
.
.
{s1 = t1 , . . . , si1 = ti1 , si = ti , si+1 = ti+1 , . . . sn = tn }
(E2 )
where := {si /ti }. First assume that is a unifier of E1 that is, sj = tj for
every 1 j n. In particular, it must hold that si = ti . Since si is a variable
which is not a subterm of ti it must follow that si /ti . Moreover, = and it
therefore follows that is a unifier also of E2 .
Next, assume that is a unifier of E2 . Thus, si /ti and = which must
then be a unifier also of E1 .
The algorithm presented in Figure 3.2 may be very inefficient. One of the reasons is
case 5a; That is, checking if a variable X occurs inside another term t. This is often
referred to as the occur-check. Assume that the time of occur-check is linear with
respect to the size |t| of t.1 Consider application of the solved form algorithm to the
equation:
.
g(X1 , . . . , Xn ) = g(f (X0 , X0 ), f (X1 , X1 ), . . . , f (Xn1 , Xn1 ))
where X0 , . . . , Xn are distinct. By case 1 this reduces to:
.
.
.
{X1 = f (X0 , X0 ), X2 = f (X1 , X1 ), . . . , Xn = f (Xn1 , Xn1 )}
Assume that the equation selected in step i is of the form Xi = f (. . . , . . .). Then in the
.
k-th iteration the selected equation is of the form Xk = Tk where Ti+1 := f (Ti , Ti ) and
T0 := X0 . Hence, |Ti+1 | = 2|Ti | + 1. That is, |Tn | > 2n . This shows the exponential
dependency of the unification time on the length of the structures. In this example
the growth of the argument lengths is caused by duplication of subterms. As a matter
of fact, the same check is repeated many times. Something that could be avoided by
sharing various instances of the same structure. In the literature one can find linear
algorithms but they are sometimes quite elaborate. On the other hand, Prolog systems
usually solve the problem simply by omitting the occur-check during unification.
Roughly speaking such an approach corresponds to a solved form algorithm where
case 5ab is replaced by:
1 The
size of a term is the total number of constant, variable and functor occurrences in t.
42
Chapter 3: SLD-Resolution
.
X = t where X 6= t and X has more than one occurrence in E
replace all other occurrences of X by t;
% case 5
A pragmatic justification for this solution is the fact that rule 5a (occur check) never is
used during the computation of many Prolog programs. There are sufficient conditions
which guarantee this, but in general this property is undecidable. The ISO Prolog
standard (1995) states that the result of unification is undefined if case 5b can be
applied to the set of equations. Strictly speaking, removing case 5a causes looping
of the algorithm on equations where case 5a would otherwise apply. For example, an
.
attempt to solve X = f (X) by the modified algorithm will produce a new equation
.
.
X = f (f (X)). However, case 5 is once again applicable yielding X = f (f (f (f (X))))
and so forth. In practice many Prolog systems do not loop, but simply bind X to
the infinite structure f (f (f (. . .))). (The notation X/f () will be used to denote this
binding.) Clearly, {X/f ()} is an infinite unifier of X and f (X). It can easily
be represented in the computer by a finite cyclic data structure. But this amounts
to generalization of the concepts of term, substitution and unifier for the infinite case
not treated in classical logic. Implementation of unification without occur-check may
result in unsoundness as will be illustrated in Example 3.21.
Before concluding the discussion about unification we study the notion of most general
unifier in more detail. It turns out that the notion of mgu is a subtle one; For instance,
there is generally not a unique most general unifier of two terms s and t. A trivial
.
example is the equation f (X) = f (Y ) which has at least two mgus; namely {X/Y }
and {Y /X}. Part of the confusion stems from the fact that (being more general
than) is not an ordering relation. It is reflexive: That is, any substitution is more
general than itself since = . As might be expected it is also transitive: If 1 = 2 1
and 2 = 3 2 then obviously 1 = 3 2 1 . However, is not anti-symmetric. For
instance, consider the substitution := {X/Y, Y /X} and the identity substitution .
The latter is obviously more general than since = . But is also more general
than , since = . It may seem odd that two distinct substitutions are more general
than one another. Still there is a rational explanation. First consider the following
definition:
Definition 3.9 (Renaming) A substitution {X1 /Y1 , . . . , Xn /Yn } is called a renaming substitution iff Y1 , . . . , Yn is a permutation of X1 , . . . , Xn .
A renaming substitution represents a bijective mapping between variables (or more
generally terms). Such a substitution always preserves the structure of a term; if
is a renaming and t a term, then t and t are equivalent but for the names of the
variables. Now, the fact that a renaming represents a bijection implies that there
must be an inverse mapping. Indeed, if {X1 /Y1 , . . . , Xn /Yn } is a renaming then
{Y1 /X1 , . . . , Yn /Xn } is its inverse. We denote the inverse of by 1 and observe
that 1 = 1 = .
Proposition 3.10 Let be an mgu of s and t and assume that is a renaming.
Then is an mgu of s and t.
The proof of the proposition is left as an exercise. So is the proof of the following
proposition:
3.3 SLD-Resolution
43
3.3
SLD-Resolution
44
Chapter 3: SLD-Resolution
Next the use of the SLD-resolution principle is discussed for a given definite program P . The starting point, as exemplified in Section 3.1, is a definite goal clause G0
of the form:
A1 , . . . , Am
(m 0)
From this goal a subgoal Ai is selected (if possible) by the computation rule. A new
goal clause G1 is constructed by selecting (if possible) some renamed program clause
B0 B1 , . . . , Bn (n 0) whose head unifies with Ai (resulting in an mgu 1 ). If so,
G1 will be of the form:
(A1 , . . . , Ai1 , B1 , . . . , Bn , Ai+1 , . . . , Am )1
(According to the requirement above, the variables of the program clause are being
renamed so that they are different from those of G0 .) Now it is possible to apply
the resolution principle to G1 thus obtaining G2 , etc. This process may or may not
terminate. There are two cases when it is not possible to obtain Gi+1 from Gi :
the first is when the selected subgoal cannot be resolved (i.e. is not unifiable)
with the head of any program clause;
the other case appears when Gi = 2 (i.e. the empty goal).
The process described above results in a finite or infinite sequence of goals starting
with the initial goal. At every step a program clause (with renamed variables) is used
to resolve the subgoal selected by the computation rule < and an mgu is created.
Thus, the full record of a reasoning step would be a pair hGi , Ci i, i 0, where Gi is a
goal and Ci a program clause with renamed variables. Clearly, the computation rule
< together with Gi and Ci determines (up to renaming of variables) the mgu (to be
denoted i+1 ) produced at the (i + 1)-th step of the process. A goal Gi+1 is said to be
derived (directly) from Gi and Ci via < (or alternatively, Gi and Ci resolve into Gi+1 ).
Definition 3.12 (SLD-derivation) Let G0 be a definite goal, P a definite program
and < a computation rule. An SLD-derivation of G0 (using P and <) is a finite or
infinite sequence of goals:
G0
C0
G1 Gn1
Cn1
Gn . . .
where each Gi+1 is derived directly from Gi and a renamed program clause Ci via
<.
Note that since there are usually infinitely many ways of renaming a clause there are
formally infinitely many derivations. However, some of the derivations differ only in
the names of the variables used. To avoid some technical problems and to make the
renaming of variables in a derivation consistent, the variables in the clause Ci of a
derivation are renamed by adding the subscript i to every variable in the clause. In
what follows we consider only derivations where this renaming strategy is used.
Each finite SLD-derivation of the form:
G0
C0
G1 Gn1
Cn1
Gn
3.3 SLD-Resolution
45
: proud (Z).
: proud (X0 ) parent (X0 , Y0 ), newborn(Y0 ).
Unification of proud (Z) and proud (X0 ) yields e.g. the mgu 1 = {X0 /Z}. Assume that
a computation rule which always selects the leftmost subgoal is used (if nothing else is
said, this computation rule is used also in what follows). Such a computation rule will
occasionally be referred to as Prologs computation rule since this is the computation
rule used by most Prolog systems. The first derivation step yields:
G1
C1
In the second resolution step the mgu 2 = {X1 /Z, Y1 /Y0 } is obtained. The derivation
then proceeds as follows:
G2
C2
G3
C3
: newborn(mary).
: newborn(mary).
G4
A derivation like the one above is often represented graphically as in Figure 3.1.
Example 3.14 Consider the following definite program:
1:
2:
3:
4:
5:
46
Chapter 3: SLD-Resolution
parent (X , Y ) mother (X , Y ).
mother (b, X).
2
Figure 3.3 depicts a finite SLD-derivation of the goal grandfather (a, X) (again using
Prologs computation rule).
SLD-derivations that end in the empty goal (and the bindings of variables in the initial
goal of such derivations) are of special importance since they correspond to refutations
of (and provide answers to) the initial goal:
Definition 3.15 (SLD-refutation) A (finite) SLD-derivation:
G0
C0
G1 Gn
Cn
Gn+1
C0
G1 Gn
Cn
be a refutation. It turns out that if the computation rule is changed there still exists
another refutation:
G0
C00
G01 G0n
0
Cn
3.3 SLD-Resolution
47
parent (X , Y ) father (X , Y ).
father (b, X).
2
of G0 which has the same computed answer substitution (up to renaming of variables)
and where the sequence C00 , . . . , Cn0 of clauses used is a permutation of the sequence
C0 , . . . , Cn . This property will be called independence of the computation rule and it
will be discussed further in Section 3.6.
Not all SLD-derivations lead to refutations. As already pointed out, if the selected
subgoal cannot be unified with any clause, it is not possible to extend the derivation
any further:
Definition 3.17 (Failed derivation) A derivation of a goal clause G0 whose last
element is not empty and cannot be resolved with any clause of the program is called
a failed derivation.
Figure 3.4 depicts a failed derivation of the program and goal in Example 3.14. Since
the selected literal (the leftmost one) does not unify with the head of any clause in
the program, the derivation is failed. Note that a derivation is failed even if there is
some other subgoal but the selected one which unifies with a clause head.
By a complete derivation we mean a refutation, a failed derivation or an infinite
derivation. As shown above, a given initial goal clause G0 may have many complete
derivations via a given computation rule <. This happens if the selected subgoal of
some goal can be resolved with more than one program clause. All such derivations
may be represented by a possibly infinite tree called the SLD-tree of G0 (using P and
<).
Definition 3.18 (SLD-tree) Let P be a definite program, G0 a definite goal and
< a computation rule. The SLD-tree of G0 (using P and <) is a (possibly infinite)
labelled tree satisfying the following conditions:
the root of the tree is labelled by G0 ;
if the tree contains a node labelled by Gi and there is a renamed clause Ci P
such that Gi+1 is derived from Gi and Ci via < then the node labelled by Gi
has a child labelled by Gi+1 . The edge connecting them is labelled by Ci .
48
Chapter 3: SLD-Resolution
grandfather (a, X).
,@
@@
father (b, X).
mother (b, X).
,
,
2
Figure 3.5: SLD-tree of grandfather (a, X)
The nodes of an SLD-tree are thus labelled by goals of a derivation. The edges are
labelled by the clauses of the program. There is in fact a one-to-one correspondence
between the paths of the SLD-tree and the complete derivations of G0 under a fixed
computation rule <. The sequence:
G0
C0
G1 Gk
Ck
is a complete derivation of G0 via < iff there exists a path of the SLD-tree of the form
G0 , G1 , . . . , Gk , . . . such that for every i, the edge hGi , Gi+1 i is labelled by Ci . Usually
this label is abbreviated (e.g. by numbering the clauses of the program) or omitted
when drawing the tree. Additional labelling with the mgu i+1 or some part of it may
also be included.
Example 3.19 Consider again the program of Example 3.14. The SLD-tree of the
goal grandfather (a, X) is depicted in Figure 3.5.
The SLD-trees of a goal clause G0 are often distinct for different computation rules. It
may even happen that the SLD-tree for G0 under one computation rule is finite whereas
the SLD-tree of the same goal under another computation rule is infinite. However,
the independence of computation rules means that for every refutation path in one
SLD-tree there exists a refutation path in the other SLD-tree with the same length
and with the same computed answer substitution (up to renaming). The sequences of
clauses labelling both paths are permutations of one another.
3.4
Soundness of SLD-resolution
The method of reasoning presented informally in Section 3.1 was formalized as the
SLD-resolution principle in the previous section. As a matter of fact one more inference
49
C0
G1 Gn1
Cn1
50
Chapter 3: SLD-Resolution
(11)
(12)
(13)
(14)
(15)
is also a logical consequence of the program. But since 1 is a most general unifier of
B0 and Aj , B0 can be replaced by Aj in (15). Now let be 1 n restricted to the
variables in A1 , . . . , Am then:
(A1 . . . Am )
is a logical consequence of P , which concludes the proof.
It should be noticed that the theorem does not hold if the unifier is computed by a
unification algorithm without occur-check. For illustration consider the following
example.
Example 3.21 A term is said to be f-constructed with a term T if it is of the form
f (T, Y ) for any term Y . A term X is said to be bizarre if it is f -constructed with
itself. (As discussed in Section 3.2 there are no bizarre terms since no term can
include itself as a proper subterm.) Finally a term X is said to be crazy if it is the
second direct substructure of a bizarre term. These statements can be formalized as
the following definite program:
f constructed(f (T, Y ), T ).
bizarre(X) f constructed(X, X).
crazy(X) bizarre(f (Y, X)).
51
Now consider the goal crazy(X) representing the query Are there any crazy
terms?. There is only one complete SLD-derivation (up to renaming). Namely:
G0
C0
: crazy(X)
: crazy(X0 ) bizarre(f (Y0 , X0 ))
G1
C1
G2
The only subgoal in G2 does not unify with the first program clause because of the
occur-check. This corresponds to our expectations: Since, in the intended model, there
are no bizarre terms, there cannot be any crazy terms. Since SLD-resolution is sound,
if there were any answers to G0 they would be correct also in the intended model.
Assume now that a unification algorithm without occur-check is used. Then the
derivation can be extended as follows:
G2
C2
G3
3.5
Completeness of SLD-resolution
Another important problem is whether all correct answers for a given goal (i.e. all
logical consequences) can be obtained by SLD-resolution. The answer is given by the
following theorem, called the completeness theorem for SLD-resolution (due to Clark
(1979)).
Theorem 3.22 (Completeness of SLD-resolution) Let P be a definite program,
A1 , . . . , An a definite goal and < a computation rule. If P |= (A1 An ),
there exists a refutation of A1 , . . . , An via < with the computed answer substitution
such that (A1 An ) is an instance of (A1 An ).
The proof of the theorem is not very difficult but is rather long and requires some
auxiliary notions and lemmas. It is therefore omitted. The interested reader is referred
to e.g. Apt (1990), Lloyd (1987), Stark (1990) or Doets (1994).
Theorem 3.22 shows that even if all correct answers cannot be computed using
SLD-resolution, every correct answer is an instance of some computed answer. This is
52
Chapter 3: SLD-Resolution
due to the fact that only most general unifiers not arbitrary unifiers are computed
in derivations. However every particular correct answer is a special instance of some
computed answer since all unifiers can always be obtained by further instantiation of
a most general unifier.
Example 3.23 Consider the goal clause p(X) and the following program:
p(f (Y )).
q(a).
Clearly, {X/f (a)} is a correct answer to the goal that is:
{p(f (Y )), q(a)} |= p(f (a))
However, the only computed answer substitution (up to renaming) is {X/f (Y0 )}.
Clearly, this is a more general answer than {X/f (a)}.
The completeness theorem confirms existence of a refutation which produces a more
general answer than any given correct answer. However the problem of how to find this
refutation is still open. The refutation corresponds to a complete path in the SLD-tree
of the given goal and computation rule. Thus the problem reduces to a systematic
search of the SLD-tree. Existing Prolog systems often exploit some ordering on the
program clauses, e.g. the textual ordering in the source program. This imposes the
ordering on the edges descending from a node of the SLD-tree. The tree is then
traversed in a depth-first manner following this ordering. For a finite SLD-tree this
strategy is complete. Whenever a leaf node of the SLD-tree is reached the traversal
continues by backtracking to the last preceding node of the path with unexplored
branches (see Figure 3.6). If it is the empty goal the answer substitution of the
completed refutation is reported before backtracking. However, as discussed in Section
3.3 the SLD-tree may be infinite. In this case the traversal of the tree will never
53
terminate and some existing answers may never be computed. This can be avoided by a
different strategy of tree traversal, like for example the breadth-first strategy illustrated
in Figure 3.7. However this creates technical difficulties in implementation due to very
complicated memory management being needed in the general case. Because of this,
the majority of Prolog systems use the depth-first strategy for traversal of the SLDtree.
3.6
Proof Trees
The notion of SLD-derivation resembles the notion of derivation used in formal grammars (see Chapter 10). By analogy to grammars a derivation can be mapped into
a graph called a derivation tree. Such a tree is constructed by combining together
elementary trees representing renamed program clauses. A definite clause of the form:
A0 A1 , . . . , An
(n 0)
,@@
,
A A
q
if n > 0
if n = 0
Elementary trees from a definite program P may be combined into derivation trees by
combining the root of a (renamed) elementary tree labelled by p(s1 , . . . , sn ) with the
leaf of another (renamed) elementary tree labelled by p(t1 , . . . , tn ). The joint node is
.
labelled by an equation p(t1 , . . . , tn ) = p(s1 , . . . , sn ).2 A derivation tree is said to be
complete if it is a tree and all of its leaves are labelled by . Complete derivation trees
are also called proof trees. Figure 3.8 depicts a proof tree built out of the following
elementary trees from the program in Example 3.14:
.
speaking equations may involve terms only. Thus, the notation p(t1 , . . . , tn ) =
.
.
p(s1 , . . . , sn ) should be viewed as a shorthand for t1 = s1 , . . . , tn = sn .
2 Strictly
54
Chapter 3: SLD-Resolution
H
HHH
father (X , Y ) parent (Y , Z )
grandfather (X0 , Z0 )
. 0 0
=
father (a, b)
. 0 0
=
parent(X1 , Y1 )
mother (X
. 1 , Y1 )
=
mother (b, c)
grandfather
(X0 , Z0 )
q
,@@
,
father (X , Y ) parent (Y , Z )
q
parent (X
(b, c)
1 , Y1 ) fatherq (a, b) mother
q
q
q
mother (X1 , Y1 )
55
H
HHH
father (X , Y ) parent (Y , Z )
grandfather (X0 , Z0 )
. 0 0
=
father (a, b)
. 0 0
=
parent(X1 , Y1 )
father (X
. 1 , Y1 )
=
father (a, b)
of the equations associated with proof tree (a) in Figure 3.10 provides an answer
substitution {X/a, Y /c} to the initial goal.
The solved form of the equations in a consistent derivation tree can be used to
simplify the derivation tree by instantiating the labels of the tree. For instance, applying the substitution {X/a, Y /c, X0/a, Y0 /b, Z0 /c, X1 /b, Y1 /c} (corresponding to the
solved form above) to the nodes in the proof tree yields a new proof tree (depicted in
.
Figure 3.11). However, nodes labelled by equations of the form A = A will usually
be abbreviated A so that the tree in Figure 3.11 is instead written as the tree (d) in
Figure 3.10. The equations of the simplified tree are clearly consistent.
Thus the search for a consistent proof tree can be seen as two interleaving processes:
The process of combining elementary trees and the simplification process working on
the equations of the already constructed part of the derivation tree. Note in particular
that it is not necessary to simplify the whole tree at once the tree (a) has the
following associated equations:
.
.
.
.
.
.
.
.
{X = X0 , Y = Z0 , X0 = a, Y0 = b, Y0 = X1 , Z0 = Y1 , X1 = b, Y1 = c}
Instead of solving all equations only the underlined equations may be solved, resulting
in an mgu 1 = {Y0 /X1 , Z0 /Y1 }. This may be applied to the tree (a) yielding the tree
(b). The associated equations of the new tree can be obtained by applying 1 to the
previous set of equations after having removed the previously solved equations:
.
.
.
.
.
.
{X = X0 , Y = Y1 , X0 = a, X1 = b, X1 = b, Y1 = c}
Solving of the new underlined equations yields a mgu 2 = {X1 /b, Y1 /c} resulting in
the tree (c) and a new set of equations:
.
.
.
.
{X = X0 , Y = c, X0 = a, b = b}
Solving all of the remaining equations yields 3 = {X/a, Y /c, X0/a} and the final tree
(d) which is trivially consistent.
Notice that we have not mentioned how proof trees are to be constructed or in
which order the equations are to be solved or checked for consistency. In fact, a whole
spectrum of strategies is possibile. One extreme is to first build a complete proof
56
Chapter 3: SLD-Resolution
grandfather
. (X, Y )
=
grandfather (X0 , Z0 )
HH
HH
father (X , Y ) parent (Y , Z )
. 0 0
=
father (a, b)
. 0 0
=
parent (X1 , Y1 )
grandfather
. (X, Y )
=
grandfather (X0 , Y1 )
HH
HH
father (X , X ) parent(X , Y )
. 0 1
=
father (a, b)
mother (X
. 1 , Y1 )
=
mother (b, c)
mother (X
. 1 , Y1 )
=
mother (b, c)
(a)
(b)
grandfather
. (X, Y )
=
grandfather (X0 , c)
HHH
H
father (X , b)
parent (b, c)
HHH
H
father (a, b)
parent(b, c)
mother (b, c)
mother (b, c)
. 0
=
father (a, b)
(c)
grandfather (a, c)
(d)
tree and then check if the equations are consistent. At the other end of the spectrum
equations may be checked for consistency while building the tree. In this case there
are two possibilities either the whole set of equations is checked every time a new
equation is added or the tree is simplified by trying to solve equations as soon as they
are generated. The latter is the approach used in Prolog the tree is built in a
depth-first manner from left to right and each time a new equation is generated the
tree is simplified.
From the discussion above it should be clear that many derivations may map
into the same proof tree. This is in fact closely related to the intuition behind the
independence of the computation rule take copies of the clauses to be combined
together. Rename each copy so that it shares no variables with the other copies. The
clauses are then combined into a proof tree. A computation rule determines the order
in which the equations are to be solved but the solution obtained is independent of
this order (up to renaming of variables).
Exercises
57
grandfather
. (a, c)
=
grandfather (a, c)
H
HHH
father (a, b)
parent(b, c)
.
=
father (a, b)
.
=
parent(b, c)
mother
. (b, c)
=
mother (b, c)
Exercises
3.1 What are the mgus of the following pairs of atoms:
p(X, f (X))
p(f (X), Y, g(Y ))
p(X, Y, X)
p(a, X)
p(Y, f (a))
p(Y, f (a), g(a))
p(f (Y ), a, f (Z))
p(X, f (X))
58
Chapter 3: SLD-Resolution
3.7 How many consistent proof trees does the goal p(a, X) have given the
program:
p(X, Y ) q(X, Y ).
p(X, Y ) q(X, Z), p(Z, Y ).
q(a, b).
q(b, a).
3.8 Let be a renaming substitution. Show that there is only one substitution
such that = = .
3.9 Show that if A BP and A has a refutation of length n then A TP n.
Chapter 4
Negation in Logic Programming
4.1
Negative Knowledge
Definite programs express positive knowledge; the facts and the rules describe that
certain objects are in certain relations with one another. The relations are made
explicit in the least Herbrand model the set of all ground atomic consequences of
the program. For instance, consider the following program:
above(X, Y ) on(X, Y ).
above(X, Y ) on(X, Z), above(Z, Y ).
on(c, b).
on(b, a).
The program describes the situation depicted in Figure 1.2: The object C is on top
of B which is on top of A and an object is above a second object if it is either on top
of it or on top of a third object which is above the second object. The least Herbrand
model of the program looks as follows:
{on(b, a), on(c, b), above(b, a), above(c, b), above(c, a)}
Note that neither the program nor its least Herbrand model include negative information, such as A is not on top of any box or B is not above C. Also in real
life the negative information is seldom stated explicitly. Swedish Rail in its timetable
explicitly states that there is a daily train from Linkoping to Stockholm scheduled to
depart at 9:22, but it does not explicitly state that there is no train departing at 9:56
or 10:24.
Thus, in many real-life situations the lack of information is taken as evidence to
the contrary since the timetable does not indicate a departure from Linkoping
to Stockholm at 10:24 one does not plan to take such a train. This is because we
59
60
HHHH
above(b, c).
on(b, c).
HHH
H
on(a, c). on(a, Z ), above(Z , c).
above(a, c).
(cwa)
(naf )
This is called the negation as (finite) failure rule (naf ). It should be contrasted with
the cwa which may also be called the negation as infinite failure rule. To illustrate
the difference between the two approaches the program above is extended with the
following (obviously true) clause:
above(X, Y ) above(X, Y ).
1 To
be more precise, this would not really qualify as an inference rule in the traditional sense since
61
The SLD-tree of the goal above(b, c) still contains no refutations but the tree is now
infinite. Thus, it cannot be concluded that above(b, c) using naf . However, it still
follows from the cwa.
A second, and more serious problem with the cwa (and the naf ) is that it is unsound
above(b, c) is not a logical consequence of the program(s) above. In fact, any proof
system that permits inferring a negative literal from a definite program is unsound!
The reason is that the Herbrand base BP (in which all ground atomic formulas are
true) is always a model of P . There are two principal approaches to repair this problem.
One is to view the program as a shorthand for another, larger, program from which
the negative literal follows. The second approach is to redefine the notion of logical
consequence so that only some of the models of program (e.g. the least Herbrand
model) are considered. The effect in both cases is to discard some uninteresting
models of the program. The first part of this chapter gives a logical justification of
the naf -rule using the completion comp(P ) of a definite program P .
Once able to draw negative conclusions it is natural to extend the language of
definite programs to permit the use of negative literals in the body of a clause. The
final part of this chapter therefore introduces the language of general (logic) programs
and introduces the notion of SLDNF-resolution that combines the SLD inference rule
with the negation as finite failure rule. The two final sections of the chapter survey
two alternative approaches to justify inference of negative conclusions from general
programs. The first idea attempts to repair some problems with trying to justify
negation as finite failure in terms of the program completion. The second approach,
called the well-founded semantics, generalizes the closed world assumption (and thus,
negation as infinite failure) from definite to general programs. Both approaches are
based on an extension of classical logic from two into three truth-values.
4.2
As pointed out above, any proof system that allows negative literals to be derived
from a definite program is unsound. The objective of this section therefore is to give a
logical justification of the naf -rule. The idea presented below is due to K. Clark (1978)
and relies on the claim that when writing a definite program P the programmer really
means something more than just a set of definite clauses. The intended program
can be formalized and is called the completion of P . Consider the following definition:
above(X, Y ) on(X, Y ).
above(X, Y ) on(X, Z), above(Z, Y ).
The rules state that an object is above a second object if the first object is (1) on top
of the second object or (2) on top of a third object which is above the second object.
This could also be written thus:
above(X, Y ) on(X, Y ) (on(X, Z), above(Z, Y ))
Now what if the if-statement is instead replaced by an if-and-only-if-statement?
above(X, Y ) on(X, Y ) (on(X, Z), above(Z, Y ))
62
This formula states that X is above Y if and only if at least one of the conditions are
true. That is, if none of the conditions hold it follows that X is not above Y ! This is
the intuition used to explain the negation as failure.
Unfortunately combining definite clauses as illustrated above is only possible if the
clauses have identical heads. Thus, consider the following clauses:
on(c, b).
on(b, a).
By simple transformation the program can be rewritten as follows:
.
.
on(X1 , X2 ) X1 = c, X2 = b.
.
.
on(X1 , X2 ) X1 = b, X2 = a.
These clauses can be combined into one formula, where implication is replaced by the
equivalence connective. In that way two if-statements have been combined into one
if-and-only-if-statement:
.
.
.
.
on(X1 , X2 ) (X1 = c, X2 = b) (X1 = b, X2 = a)
The logical reading of this is that X1 is on top of X2 if and only if either X1 = c and
X2 = b or X1 = b and X2 = a.
The idea outline above will now be formalized as a special transformation of a
definite program P . The resulting set of formulas is called the completion of P :
Definition 4.1 (Completed program) Let P be a definite program. The completion comp(P ) of P is the formulas obtained from the following three transformation
steps:
(i ) For every predicate symbol p replace each clause C of the form:
p(t1 , . . . , tm ) L1 , . . . , Ln
(n 0)
by the formula:
.
.
p(X1 , . . . , Xm ) Y1 , . . . , Yi (X1 = t1 , . . . , Xm = tm , L1 , . . . , Ln )
where Y1 , . . . , Yi are all the variables in C and X1 , . . . , Xm are distinct variables
which do not appear in C.
Remark: Note that the first step does not really change the logical under.
standing of the clauses provided that the appropriate definition of = is added
(this is discussed in the third step).
(ii ) For each predicate symbol p replace all formulas:
p(X1 , . . . , Xm ) B1
..
.
p(X1 , . . . , Xm ) Bj
63
by the formula:
X1 , . . . , Xm (p(X1 , . . . , Xm ) B1 Bj )
X1 , . . . , Xm (p(X1 , . . . , Xm ))
if j > 0
if j = 0
(iii ) Finally the program is extended with the following free equality axioms defining
the equalities introduced in step (i) (To be more precise some of the axioms are
axiom schemata making the resulting set of axioms infinite):
.
= X)
.
.
= Y Y = X)
.
.
.
= Y Y = Z X = Z)
.
.
.
(X1 = Y1 Xn = Yn f (X1 , . . . , Xn ) = f (Y1 , . . . , Yn ))
.
.
(X1 = Y1 Xn = Yn (p(X1 , . . . , Xn ) p(Y1 , . . . , Yn )))
.
.
.
(f (X1 , . . . , Xn ) = f (Y1 , . . . , Yn ) X1 = Y1 Xn = Yn )
.
(f (X1 , . . . , Xm ) = g(Y1 , . . . , Yn ))
(if f /m 6= g/n)
.
(X = t)
(if X is a proper subterm of t)
(X
(X
(X
(E1 )
(E2 )
(E3 )
(E4 )
(E5 )
(E6 )
(E7 )
(E8 )
.
The free equality axioms enforce = to be interpreted as the identity relation in all
.
Herbrand interpretations. Axioms E1 E3 must be satisfied in order for = to be an
.
equivalence relation. Axioms E4 E5 enforcing = to be a congruence relation. Axioms
.
E1 E5 are sometimes dropped and replaced by the essential constraint that = always
denotes the identity relation. Therefore the most interesting axioms are E6 E8 which
formalize the notion of unification. They are in fact similar to cases 1, 2 and 5a in
the solved form algorithm. Axiom E6 states that if two compound terms with the
same functor are equal, then the arguments must be pairwise equal. Axiom E7 states
that two terms with distinct functors/constants are not equal and axiom E8 essentially
states that no nesting of functions can return one of its arguments as its result.
Example 4.2 We now construct the completion of the above/2-program again. The
first step yields:
.
.
above(X1 , X2 ) X, Y (X1 = X, X2 = Y, on(X, Y ))
.
.
above(X1 , X2 ) X, Y, Z(X1 = X, X2 = Y, on(X, Z), above(Z, Y ))
.
.
on(X1 , X2 ) (X1 = c, X2 = b)
.
.
on(X1 , X2 ) (X1 = b, X2 = a)
Step two yields:
X1 , X2 (above(X1 , X2 ) X, Y (. . .) X, Y, Z(. . .))
.
.
.
.
X1 , X2 (on(X1 , X2 ) (X1 = c, X2 = b) (X1 = b, X2 = a))
Finally the program is extended with the free equality axioms described above.
Example 4.3 Consider the following program that describes a world containing
two parents only, Mary and Kate, both of which are female:
64
65
rule. An SLD-tree is said to be fair if all its derivations are fair. Jaffar, Lassez and
Lloyd showed that the completeness result above holds for any fair SLD-tree. Clearly,
derivations in Prolog are not fair so negation as failure as implemented in Prolog is not
complete. Fair SLD-derivations can be implemented by always selecting the leftmost
subgoal and appending new subgoals to the end of the goal. However, very few logic
programming systems support fair derivations for efficiency reasons.
4.3
L1 , . . . , Ln .
where each Li is a positive or negative literal.
Ci
C0
G1 Gn1
Cn1
Gn
Gi+1 if either:
66
HHHH
zz
on(Z, c).
zz
A derivation is said to be (finitely) failed if (1) the selected literal is positive and
does not unify with the head of any clause or (2) the selected literal is negative
and finitely failed;
A derivation is said to be stuck if the selected subgoal is of the form A and
A is infinitely failed;
Example 4.8 Consider the following program describing a world where the block C
is piled on top of B which is on top of A:
on(c, b).
on(b, a).
As shown in Figure 4.2 the goal on(X, Y ), on(Z, X) has an SLDNF-refutation
with the computed answer substitution {X/c, Y /b}. (In the figure failed derivations
are terminated with the marker zz.)
As might be expected SLDNF-resolution is sound. After all, both SLD-resolution and
negation as finite failure are sound:
Theorem 4.9 (Soundness of SLDNF-resolution) Let P be a definite program
and L1 , . . . , Ln a general goal. If L1 , . . . , Ln has an SLDNF-refutation with the
computed answer substitution , then comp(P ) |= (L1 Ln ).
However, contrary to what might be expected, SLDNF-resolution is not complete even
though both SLD-resolution and negation as finite failure are complete. A simple
counter-example is the goal on(X, Y ) which intuitively corresponds to the query:
Are there any blocks, X and Y , such that X is not on top of Y ?
()
One expects several answers to this query. For instance, A is not on top of any block.
However, the only SLDNF-derivation of on(X, Y ) fails since the goal on(X, Y )
succeeds. The root of the problem is that our notion of failed SLDNF-derivation is
too conservative. The success of on(X, Y ) does not necessarily mean that there is
no block which is not on top of another block only that there exists at least one
block which is on top of another block. Of course, if on(X, Y ) succeeds with the
empty computed answer substitution then we can conclude that every block is on top
of every block in which case () should be answered negatively.
67
The problem stems from the fact that negation as finite failure, in contrast to
SLD-resolution, is only a test. Remember that according to the definition of SLDNFresolution and soundness and completeness of negation as finite failure it holds that:
on(X, Y ) succeeds
iff
iff
Hence the goal on(X, Y ) should not be read as an existential query but rather as
a universal test:
For all blocks, X and Y , is X not on top of Y ?
This query has a negative answer in the intended model, since e.g. B is on top of
A. The problem above is due to the quantification of the variables in the negative
literal. If the query above is rephrased as on(a, b) then SLDNF-resolution yields a
refutation since on(a, b) finitely fails. It is sometimes assumed that the computation
rule is only allowed to select a negative literal A if A is ground or if A has an
empty computed answer substitution. Such computation rules are said to be safe. We
will return to this issue when extending SLDNF-resolution to programs containing
negative literals.
4.4
Once able to infer both negative and positive literals it is natural to extend the language of definite programs to include clauses that contain both positive and negative
literals in bodies. Such formulas are called general clauses: 2
Definition 4.10 (General clause) A general clause is a formula:
A0 L1 , . . . , Ln
where A0 is an atomic formula and L1 , . . . , Ln are literals (n 0).
Thus, by analogy to definite clauses and definite programs:
Definition 4.11 (General program) A general (logic) program is a finite set of
general clauses.
By means of general clauses it is possible to extend the blocks world with the
following relations:
founding (X) on(Y, X), on ground(X).
on ground (X) off ground (X).
off ground (X) on(X, Y ).
on(c, b).
on(b, a).
2 General
programs are sometimes also called normal logic programs in the literature.
68
The first clause states that a founding block is one which is on the ground and has
another block on top of it. The second clause states that a block which is not off
ground is on the ground and the third clause says that a block which is on top of
another block is off ground.
The new language of general programs introduces a number of subtleties in addition
to those already touched upon earlier in this chapter. For instance, it is not obviously
clear how to understand a general program logically. Moreover, given a particular
logical understanding, what kind of proof system should be used?
There is no single answer to these questions and only some of them will be addressed here. The remaining part of this chapter will mainly be devoted to the idea
initiated above that of program completion and SLDNF-resolution. However, some
alternative approaches will also be discussed.
Although the language of programs has now been enriched it is still not possible for
a negative literal to be a logical consequence of a general program P . The reason
is the same as for definite programs the Herbrand base is a model of P in which
all negative literals are false. By analogy to definite programs question arises how
to interpret general programs in order to allow for sound negative inferences to be
made. Fortunately, the notion of program completion can be applied also to general
programs. For instance, the completion of:
win(X) move(X, Y ), win(Y ).
contains the formula:
.
X1 (win(X1 ) X, Y (X1 = X, move(X, Y ), win(Y )))
However, the completion of general programs sometimes leads to paradoxical situations. Consider the following general clause:
p p.
Then the completed program contains the formula p p. The inconsistency of the
completed program is due to p/0 being defined in terms of its own complement. Such
situations can be avoided by employing a special discipline when writing programs.
The idea is to build the program in layers (called strata), thereby enforcing the
programmer not to refer to the negation of a relation until the relation is fully defined
(in a lower stratum). The following is a formal definition of the class of stratified
programs (let the subset of all clauses in P with p in the head be denoted P p ):
Definition 4.12 (Stratified program) A general program P is said to be stratified
iff there exists a partitioning P1 Pn of P such that:3
if p(. . .) . . . , q(. . .), . . . Pi then P q P1 Pi ;
if p(. . .) . . . , q(. . .), . . . Pi then P q P1 Pi1 .
For instance, the following program is stratified:
3 Note
that there are often many partitionings of a program that satisfy the requirements.
69
:= {A0 | A0 L1 , . . . , Ln ground(P ) I |= L1 , . . . , Ln }
Mn
:= TP1 (?)
:= TP2 (M1 )
..
.
:= TPn (Mn1 )
Apt, Blair and Walker (1988) showed that MP := Mn is a minimal Herbrand model
called the standard model of P . It was also shown that the model does not
depend on how the program is partitioned (as long as it is stratified). For instance,
the standard model of the program P1 P2 above may be constructed thus:
M1
M2
The model conforms with our intuition of the intended model. However, in contrast
to definite programs MP is not necessarily the only minimal Herbrand model. For
instance, the program:
loops halts
70
has two minimal Herbrand models the standard model {loops} and a non-standard
model {halts}. This is obviously a consequence of the fact that the clause is logically
equivalent to loops halts (and halts loops). However, by writing this as an
implication with loops/0 in the consequent it is often argued that unless there is
evidence for halts/0 from the rest of the program we should prefer to conclude loops/0.
For instance, the following is an alternative (counter-intuitive) minimal model of the
program P1 P2 above:
{on(b, a), on(c, b), off ground (a), off ground (b), off ground (c)}
We return to the issue of canonical models of general programs when introducing the
well-founded semantics in Section 4.7.
4.5
In Section 4.3 the notion of SLDNF-resolution for definite programs and general goals
was introduced. Informally speaking SLDNF-resolution combines the SLD-resolution
principle with the following principles:
A succeeds iff A has a finitely failed SLD-tree
A finitely fails iff A has an SLD-refutation
When moving from definite to general programs the situation gets more complicated
in order to prove A there must be a finitely failed tree for A. But that tree
may contain new negative literals which may either succeed or finitely fail. This
complicates the definition of SLDNF-resolution for general programs quite a bit. For
instance, paradoxical situations may occur when predicates are defined in terms of
their own complement. Consider the non-stratified program:
p p
Given an initial goal p a derivation p
p can be constructed. The question
is, whether the derivation can be completed. It can be extended into a refutation if
p finitely fails. Alternatively, if p has a refutation then the derivation fails. Both
cases are clearly impossible since p cannot have a refutation and be finitely failed
at the same time!
We now introduce the notions of SLDNF-derivation and SLDNF-tree, similar to the
notions of SLD-derivation and SLD-tree used for SLD-resolution. Thus, an SLDNFderivation is a sequence of general goals and an SLDNF-tree the combination of all
possible SLDNF-derivations of a given initial goal under a fixed computation rule. It
is difficult to introduce the notions separately since SLDNF-derivations have to be
defined in terms of SLDNF-trees and vice versa. Instead both notions are introduced
in parallel by the following notion of an SLDNF-forest. To simplify the definition the
following technical definitions are first given: A forest is a set of trees whose nodes are
labelled by general goals. A subforest of F is any forest obtained by removing some of
the nodes (and all their children) in F . Two forests F1 and F2 are considered to be
equivalent if they contain trees equal up to renaming of variables. Moreover, F1 is said
to be smaller than F2 if F1 is equivalent to a subforest of F2 . Now the SLDNF-forest
of a goal is defined as follows:
71
if the tree with root A has a leaf 2 with the empty computed answer
substitution, then G has a single child labelled zz;
if the tree with the root labelled A is finite and all leaves are labelled
zz, then G has a single child labelled L1, . . . , Li1 , Li+1 , . . . , Li+j (the
associated substitution is );
Note that a selected negative literal A fails only if A has a refutation with the
empty computed answer substitution. As will be shown below, this condition, which
was not needed when defining SLDNF-resolution for definite programs, is absolutely
vital for the soundness of SLDNF-resolution of general programs.
The trees of the SLDNF-forest are called (complete) SLDNF-trees and the sequence
of all goals in a branch of an SLDNF-tree with root G is called a complete SLDNFderivation of G (under P and <). The tree labelled by G0 is called the main tree. A
tree with root A is called subsidiary if A is a selected literal in the forest. (As
shown below the main tree may also be a subsidiary tree.)
Example 4.14 Consider the following stratified program P :
founding (X) on(Y, X), on ground(X).
on ground (X) off ground (X).
off ground (X) on(X, Y ).
above(X, Y ) on(X, Y ).
above(X, Y ) on(X, Z), above(Z, Y ).
on(c, b).
on(b, a).
The SLDNF-forest of founding(X) is depicted in Figure 4.3. The main tree contains
one failed derivation and one refutation with the computed answer substitution {X/a}.
The branches of an SLDNF-tree in the SLDNF-forest represent all complete SLDNFderivations of its root under the computation rule <. There are four kinds of complete
SLDNF-derivations:
infinite derivations;
72
founding(X).
on(a, Y0 ).
HHH
H
on ground (b).
on ground(a).
on(Y0 , X), on ground (X).
zz
zz
off ground(b).
on(b, Y0 ).
loops(X).
halts(X).
loops(X).
loops(X).
zz);
2);
73
paradox (X).
ok (X).
ok (X).
paradox (X).
on top(X).
blocked (X).
blocked (X).
on(Y, X).
Y =a,X=b
2
Figure 4.6: SLDNF-forest of on top(X)
Figure 4.5 depicts the SLDNF-forest of the goal paradox (X). (The figure also
illustrates an example where the main tree is also a subsidiary tree.) This forest
contains two stuck derivations because the program contains a loop through negation
in order for paradox (X) to be successful (resp. finitely failed) the derivation of
ok (X) must be finitely failed (resp. successful). However, in order for ok (X) to
be finitely failed (resp. successful) the derivation of paradox (X) must be successful
(resp. finitely failed).
Note that Definition 4.13 enforce the SLDNF-forest to be the least forest satisfying
conditions (i)(iii). If minimality of the forest is dropped, it is possible to get out
of the looping situation above for instance, it would be consistent with (i)(iii)
to extend ok (X) into a refutation if paradox (X) at the same time was finitely
failed (or vice versa).
The last cause of a stuck derivation is demonstrated by the following example:
on top(X) blocked (X).
blocked (X) on(Y, X).
on(a, b).
Clearly on top(a) should be derived from the program. However, the SLDNF-tree of
the goal on top(X) in Figure 4.6 contains no refutation. Note that the derivation
of on top(X) is stuck even though blocked (X) has a refutation. The reason
why the goal on top(X) is not finitely failed is that blocked (X) does not have
an empty computed answer substitution. Note also that it would be very counterintuitive if on top(X) had been finitely failed since it would have implied that no
element was on top. This last case, when a subsidiary SLDNF-tree has at least one
refutation, but none with the empty computed answer substitution is usually referred
to as floundering. Floundering can sometimes be avoided by making sure that negative
literals are selected by the computation rule only when they become ground. However,
74
75
HHH
H
incompatible(rabbit , rabbit )
likes(rabbit , rabbit ) likes(rabbit , rabbit)
zz
zz
HHHH
likes(rabbit , rabbit )
harmless(rabbit ) eats(rabbit , rabbit)
zz
4.6
Three-valued Completion
76
In classical logic, formulas take on two truth-values a formula is either true or false.
In a three-valued (or partial) logic, formulas are also allowed to be undefined. The
intuition behind the extra truth-value is to model diverging computations. Thus, in
terms of SLDNF-resolution, true means successful, false means finitely failed and
undefined means diverging. It is convenient to encode the truth-values as 0 (false),
1
2 (undefined) and 1 (true) in which case the truth-value of compound formulas can
then be defined as follows:
= (F )
= (F G)
= (F G)
= (F G)
= (F G)
= (XF )
= (XF )
:=
:=
:=
:=
:=
:=
:=
1 = (F )
min{= (F ), = (G)}
max{= (F ), = (G)}
if = (F ) < = (G) then 0 else 1
if = (F ) = = (G) then 1 else 0
min{=[X7t] (F ) | t |=|}
max{=[X7t] (F ) | t |=|}
Most concepts from classical logic have natural counterparts in this three-valued logic:
Let F be a closed formula. An interpretation = is called a model of F iff =(F ) = 1.
By analogy to classical logic this is written = |=3 F . Similarly, if P is a set of closed
formulas, then F is a logical consequence of a P (denoted P |=3 F ) iff every model of
P is a model of F .
Also by analogy to two-valued Herbrand interpretations, a three-valued or, as it
will be called, partial Herbrand interpretation = will be written as a set of literals with
the restriction that not both A and A may be members of =. Hence, a literal L is
true in = iff L =. A ground atomic formula A is undefined in = if neither A = nor
A =. Thus, = uniquely determines the truth-value of ground literals. A partial
Herbrand interpretation such that either A = or A = for each ground atom A is
said to be total (or two-valued).
It can be shown that SLDNF-resolution is sound with respect to the three-valued
completion:
Theorem 4.17 (Soundness of SLDNF-resolution revisited) Let P be a general
program and L1 , . . . , Ln a general goal.
If L1 , . . . , Ln has a computed answer substitution then:
comp(P ) |=3 (L1 Ln )
If L1 , . . . , Ln has a finitely failed SLDNF-tree then:
comp(P ) |=3 ((L1 Ln ))
No general completeness result for SLDNF-resolution is available with respect to the
three-valued completion. However, the situation is not as bad as in the case of twovalued completion. With a slightly modified notion of SLDNF-resolution it was shown
by Drabent (1995a) that the only sources of incompleteness are floundering and unfair
selection of literals in SLDNF-derivations. As already discussed floundering is an undecidable property but sufficient conditions may be imposed to guarantee the absence
77
of floundering. One simple (and rather weak) sufficient condition is that every variable
in a clause or in the goal occurs in a positive body literal. A general program P and
a goal G are said to be allowed if all clauses of P and G satisfy this condition. Kunen
(1989) showed the following completeness result for allowed programs:
Theorem 4.18 (Completeness of SLDNF-resolution) If P is an allowed program
and L1 , . . . , Ln an allowed goal then:
If comp(P ) |=3 ((L1 Ln )) then L1 , . . . , Ln has a computed answer
substitution .
If comp(P ) |=3 ((L1 Ln )) then L1 , . . . , Ln has a finitely failed
SLDNF-tree.
4.7
Well-founded Semantics
Program completion attempts to capture the intuition behind negation as finite failure
an imperfect alternative to the closed world assumption or negation as infinite
failure. To illustrate the difference between the two, consider the following programs:
P1 : halts(a).
P2 : halts(a).
halts(b) halts(b).
78
Logically, both programs are equivalent. However, comp(P1 ) and comp(P2 ) are not
equivalent. In particular:
comp(P1 ) |= halts(b) whereas comp(P2 ) 6|= halts(b)
On the other hand, under the closed world assumption defined as follows:
cwa(P )
(9)
(10)
{A | A BP and I |= A} {A | A BP and I |= A}
79
Definition 4.21 (Supported interpretation) Let P be a general program. A Herbrand interpretation I of P is said to be supported iff for each I |= A there exists some
A L1 , . . . , Ln ground (P ) such that I |= L1 , . . . , Ln .
Theorem 4.22 Let P be a general program and I a Herbrand interpretation. Then
I is supported iff I TP (I).
Thus, a canonical model should be a fixed point of the TP -operator. However, the
program:
loops(a) loops(a).
has two supported models: {loops(a)} and ?. We therefore require that the canonical
model is also minimal. This means that I is canonical if I is a minimal fixed point of
TP . Clearly this is satisfied by the least Herbrand model of a definite program.
Unfortunately there are general programs which have more than one minimal supported Herbrand model (see exercise 4.13) and, perhaps more seriously, there are
programs which have no such model. For instance the general program p p has
only one Herbrand model, {p}, which it is not supported and therefore not a fixed point
of the TP -operator. The crux is that p/0 is defined in terms of its own complement.
The problems just illustrated can be rectified by resorting to partial (or threevalued) Herbrand interpretations instead of two-valued ones. (Recall that a partial
Herbrand interpretation I is a set of ground literals where not both A I and A I.)
For instance, the partial interpretation ? is a model of the program above. In this
interpretation p/0 is undefined. To deal with partial Herbrand interpretations we
make the following modifications to our definitions:
TP (I) := {H | H L1 , . . . , Ln ground (P ) I |=3 L1 , . . . , Ln }
A partial Herbrand interpretation I of P is said to be supported iff for each I |=3 A
there exists some A L1 , . . . , Ln ground (P ) such that I |=3 L1 , . . . , Ln .
Now consider a partial interpretation I. In order for I to be a model of P it is
necessary that if A TP (I) then A I. Similarly, in order for I to be supported it is
required that if A I then A TP (I). Thus, in order for I to be a canonical partial
model of P we require that:
A I iff A TP (I)
(C1 )
As concerns false atoms the situation is more complicated and we have to introduce
the auxiliary notion of an unfounded set to characterize atoms that must be false.
Assume that a partial interpretation I is given describing literals which are known to
be true. Informally, an atom A is false (i.e. is contained in an unfounded set) if each
grounded clause A L1 , . . . , Ln either (1) contains a literal which is false in I or (2)
contains a positive literal which is in an unfounded set. (As a special case A is false if
there is no grounded clause with A as its head.)
Definition 4.23 (Unfounded set) Let I be a partial Herbrand interpretation. A
subset U of the Herbrand base is called an unfounded set of P with respect to I if for
each A U at least one of the following holds for every A L1 , . . . , Ln ground(P ):
80
For a given program P and partial interpretation I there is a unique greatest unfounded
set which should be thought of as the set of all ground atomic formulas which are false
provided that all literals in I are true. The greatest unfounded set of P w.r.t. I will
be denoted FP (I).
Example 4.24 If P is a definite program then FP (?) is always equivalent to the
complement of the least Herbrand model. That is, without any knowledge about the
truth and falsity of body literals, the unfounded set is the set of all atoms which are
false in the least Herbrand model. For instance, let P be:
odd (s(0)).
odd (s(s(X))) odd (X).
Then FP (?) = {odd (s2n (0)}. Next let P be a general program:
odd (s(s(X))) odd (X).
even(X) odd (X).
odd (s(0)).
Then FP (?) = {odd (s2n (0))}. Thus, every atom odd (s2n (0)) is false. Moreover,
FP ({odd (s(0))}) = {odd (s2n (0)), even(s(0))}. Hence, if odd (s(0)) is known to be
true, then both odd (s2n (0)) and even(s(0)) must be false.
We now require that a canonical model I satisfies:
A I iff A FP (I)
(C2 )
That is, A is false in the canonical model iff A is in the greatest unfounded set of P
w.r.t. the canonical model itself. Partial Herbrand interpretations are partially ordered
under set inclusion just like ordinary Herbrand interpretations, but the intuition is
quite different. A minimal partial interpretation is maximally undefined whereas a
minimal two-valued interpretation is maximally false. It was shown by Van Gelder,
Ross and Schlipf (1991) that all general programs have a unique minimal partial model
satisfying C1 and C2 . The model is called the well-founded model of P :
Definition 4.25 (Well-founded model) Let P be a general program. The wellfounded model of P is the least partial Herbrand interpretation I such that:
if A TP (I) then A I;
if A FP (I) then A I.
Example 4.26 The definite program:
odd (s(0)).
odd (s(s(X))) odd (X).
81
BP
BP
T
WP
BP
T
WP
U
F
has the well-founded model {odd (s2n+1 (0)) | n 0} {odd (s2n (0)) | n 0}. The
program:
loops(a) halts(a).
loops(b) halts(b).
halts(a) halts(a).
halts(b).
has the well-founded model {halts(b), loops (a), halts(a), loops(b)}. Finally:
p p.
q q.
r.
has the well-founded model {r, q}.
More formally the well-founded model of P can be characterized as the least fixed
point of the operator:
WP (I) = TP (I) FP (I)
where FP (I) denotes the set {A | A FP (I)}.
By known results from the theory of fixed points the least fixed point of WP is a
limit of a (possibly transfinite) iterative process. If the Herbrand universe is finite it is
always possible to compute the well-founded model of P as the limit of the sequence:
82
Then assume a particular instance in this class of games that has only three states,
{a, b, c}, and the following moves:
a
After which w(b) is known to be true, since I1 |= m(b, c), w(c). The third iteration
yields:
I3 = TP (I2 ) FP (I2 ) where
TP (I2 ) = {m(a, b), m(b, a), m(b, c), w(b)}
FP (I2 ) = {m(a, a), m(a, c), m(b, b), m(c, a), m(c, b), m(c, c), w(c), w(a)}
After which the unfounded set is extended by w(a) (since all ground instances of
w(a) m(a, Y ), w(Y ) either contain a positive body literal which is in the unfounded
set or a negative literal (w(b)) which is false in I2 ).
Now WP (I3 ) = I3 . Thus, in the well-founded model there are two losing and one
winning state. Obviously, c is a losing state since no moves are possible. Consequently
b is a winning state because the opponent can be put in a losing state. Finally a is
a losing state since the only possible move leaves the opponent in a winning state.
Incidentally, the well-founded model is total.
Next consider the following game:
a
83
= TP (I2 ) FP (I2 ) = I2
This time the well-founded model is partial. The state d is a losing and c is a winning
state. However, nothing is known about a and b. This may appear startling. However,
a player can clearly not win from state b by moving to c. Moreover he does not have to
lose, since there is always the option of moving to state a. (From which the opponent
can always move back to b.) Hence a and b are drawing states.
The well-founded model coincides with the other canonical models discussed earlier in
this chapter. For instance, the least Herbrand model in the case of definite programs:
Theorem 4.28 If P is a definite program then the well-founded model is total and
coincides with the least Herbrand model.
It is also coincides with the standard model of stratified programs:
Theorem 4.29 If P is stratified then the well-founded model is total and coincides
with the standard model.
Several other connections between the well-founded semantics and other semantics
have also been established.
Several attempts have been made to define variants of SLDNF-resolutions which compute answers to goals using the well-founded semantics as the underlying declarative
semantics. In general, no complete resolution mechanism can be found, but for restricted classes of general programs such resolution mechanisms exist. Most notably
the notion of SLS-resolution of Przymusinski (1989).
84
Exercises
4.1 Consider the following definite program:
p(X) q(Y, X), r(Y ).
q(s(X), Y ) q(X, Y ).
r(0).
Show that there is one computation rule such that p(0) has a finitely failed
SLD-tree and another computation rule such that p(0) has an infinite SLDtree.
4.2 Construct the completion of the program in the previous exercise. Show that
p(0) is a logic consequence of comp(P ).
4.3 Construct the completion of the program:
p(a) q(X).
p(b) r(X).
r(a).
r(b).
Show that p(a) is a logical consequence of comp(P ).
4.4 Let P be a definite program. Show that comp(P ) |= P .
4.5 Consider a general program:
p(b).
p(a) q(X).
q(a).
Construct comp(P ) and show that p(a) is a logical consequence of comp(P ).
4.6 Construct a fair SLD-tree for the program:
p(s(X)) p(X).
q(X, Y ) p(Y ), r(X, 0).
r(X, X).
and the goal p(X), q(X, Y ).
4.7 Which of the following four programs are stratified?
P1
P2
P3
P4
Exercises
85
86
Chapter 5
Towards Prolog: Cut and
Arithmetic
5.1
An SLD-tree of a goal may have many failed branches and very few, or just one,
success branch. Therefore the programmer may want to prevent the interpreter from
constructing failed branches by adding control information to the program. However,
such information relies on the operational semantics of the program. To give the
required control information, the programmer has to know how the SLD-tree is constructed and traversed. However, for practical reasons this information has to be taken
into account anyway for the depth-first search employed in Prolog-interpreters, existence of an infinite branch in the SLD-tree may prevent the interpreter from finding
an existing correct answer. To control the search the concept of cut is introduced in
Prolog. Syntactically the cut is denoted by the nullary predicate symbol ! and it
may be placed in the body of a clause or a goal as one of its atoms. Its meaning can be
best explained as a shortcut in the traversal of the SLD-tree. Thus, the presence of
cut in a clause may avoid construction of some subtrees of the SLD-tree. For a more
precise explanation some auxiliary notions are needed.
Every node n of an SLD-tree corresponds to a goal of an SLD-derivation and has
87
88
QQQ (3)
QQ
(2)
male(ben).
male(mary).
(6)
2
Figure 5.1: SLD-tree
a selected atom A. Assume that A is not an instance of a subgoal in the initial goal.
Then A is an instance of a body atom Bi of a clause B0 B1 , . . . , Bi , . . . , Bn whose
head unifies with the selected subgoal in some node n0 between the root and n. Denote
by origin(A) the node n0 .
Prolog interpreters traverse the nodes of the SLD-tree in a depth-first manner as
depicted in Figure 3.6. The ordering of branches corresponds to the textual ordering
of the clauses in the program. When a leaf of the tree is reached, backtracking takes
place. The process terminates when no more backtracking is possible (that is, when
all subtrees of the root are traversed). The atom ! is handled as an ordinary atom
in the body of a clause. However, when a cut is selected for resolution it succeeds
immediately (with the empty substitution). The node where ! is selected will be
called the cut-node. A cut-node may be reached again during backtracking. In this case
the normal order of tree-traversal illustrated in Figure 3.6 is altered by definition of
cut the backtracking continues above the node origin(!) (if cut occurs in the initial goal
the execution simply terminates). This is illustrated by the following simple example.
Example 5.1 The father of a person is its male parent. Assume that the following
world is given:
(1)
(2)
(3)
(4)
(5)
(6)
(7)
The SLD-tree of the goal father (X, tom) under Prologs computation rule is shown
in Figure 5.1. After first finding the solution X = ben, an attempt to find another
solution will fail since Mary is not male. By the formulation of the problem it is clear
that there may be at most one solution for this type of goal (that is, when the second
89
(6)
!.
2
Figure 5.2: Pruning failing branches
argument is fully instantiated). When a solution is found the search can be stopped
since no person has more than one father. To enforce this, cut may be inserted at the
end of (1). The modified SLD-tree is shown in Figure 5.2 (The dashed line designates
the branch cut off by !). The origin of the cut-node is the root of the tree so the
search is completed after backtracking to the cut-node. Hence, the other branch of
the tree is not traversed.
Notice that the modified version of (1) cannot be used for computing more than
one element of the relation . . . is the father of . . . . The cut will stop the search after
finding the first answer to the goal father (X, Y ) (consider the SLD-tree in Figure
5.3).
It follows by the definition that the cut has the following effects:
It divides the body into two parts where backtracking is carried out separately
after success of ! no backtracking to the literals in the left-hand part is
possible. However, in the right-hand part execution proceeds as usual;
It cuts off unexplored branches directly below origin (!). In other words, there
will be no further attempts to match the selected subgoal of origin(!) with the
remaining clauses of the program.
Cut is, to put it mildly, a controversial construct. The intention of introducing cut is
to control the execution of a program without changing its logical meaning. Therefore
the logical reading of cut is true. Operationally, if it removes only the failed branches
of the SLD-tree it does not influence the meaning of the program. However, it may
also cut off some success branches, thus destroying completeness of definite programs
and soundness of general programs. To illustrate the latter, consider the following
example:
90
parent(X, Y. ), male(X), !.
. .. .
... ....... . . . . . . .
.
...
...
.
.
... . . . . . . . . . .
..
.
.....
.
.
.
...
....
...
.
male(ben), !. male(mary), !. male(sam), !. male(alice), !.
...
...
...
...
.
!.
!.
...
...
...
...
.
Example 5.2 It is a well known fact that fathers of newborn children are proud. This
proposition is reflected by the following definite clause:
(1) proud (X) father (X, Y ), newborn(Y ).
Take additionally the clauses:
(2)
(3)
(4)
(5)
(6)
The answer to the initial goal proud (john) is yes since, as described, John is the
father of Chris who is newborn.
Now, replace (2) by the version with cut used in Example 5.1:
(20 )
This time the answer to the goal proud (john) is no. It is so because the first
listed child of John is Mary the sister of Chris. After having found this answer
there will be no more attempts to find any more children of John because of the cut.
This makes the program incomplete some correct answer substitutions cannot be
found. More seriously, this incompleteness may result in incorrect answers if negation
is involved. For example, the goal proud (john) will succeed implying that John
is not proud.
So far two principal uses of cut have been distinguished to cut off failing branches
of the SLD-tree and to prune succeeding branches. Cutting off failing branches is
91
generally considered harmless since it does not alter the answers produced during
the execution. Such cuts are sometimes referred to as green cuts. However, this
restricted use of cut is usually tied to some particular use of the program. Thus,
as illustrated in Figures 5.2 and 5.3, for some goals only failing branches are cut off
whereas for other goals succeeding branches are also pruned.
In general, cutting succeeding branches is considered harmful. (Consequently such
cuts are referred to as red cuts.) However, there are some cases when it is motivated.
This section is concluded with two examples in the first example the use of cut is
sometimes (rightfully) advocated. The second example demonstrates a very harmful
(albeit common) use of cut.
Consider the following (partial) program:
proud (X) father (X, Y ), newborn(Y ).
..
.
father (john, sue).
father (john, mary).
..
.
newborn(sue).
newborn(mary).
The SLD-tree of the goal proud (X) has two success-leaves since John has two
children both of which are newborn. However, both answers give the same binding
for X namely X = john. In general the user is not interested in getting the same
answer twice or more. To avoid this, a cut may be inserted at the very end of the first
clause (or possibly as the rightmost subgoal in the goal).
proud (X) father (X, Y ), newborn(Y ), !.
Next consider the following example1 which describes the relation between two integers
and their minimum:
min(X, Y, X) X < Y, !.
min(X, Y, Y ).
At first glance this program may look correct. People used to imperative programming
languages often reason as follows If X is less than Y then the minimum of X and Y
is X, else it is Y. Actually the program returns the expected answer both to the goal
min(2, 3, X) and min(3, 2, X) in both cases the answer X = 2 is obtained.
However, the program is not correct. Consider the goal min(2, 3, 3). This goal
succeeds implying that 3 is the minimum of 2 and 3! The program above is an
1 Here < is a binary predicate symbol written in infix notation designating the less-than relation
over e.g. the integers. Intuitively it may be thought of as an infinite collection of facts:
.
..
1 < 0.
1 < 1.
..
.
0 < 1.
0 < 2.
..
.
1 < 2.
1 < 3.
..
.
2 < 3.
2 < 4.
..
.
..
.
In Prolog < is implemented as a so-called built-in predicate which will be discussed in the next
section.
92
example of an incorrect program where (some of) the false answers are discarded by
means of the cut. The intended model is simply not a model of the program since the
second clause says that For any two integers, X and Y, Y is their minimum. This
use of cut is harmful. It may not only produce incorrect answers, but it also makes
the program hard to read and understand. If cut is to be used it should be added to a
program which is true in the intended model. Thus, the recommended version of the
minimum program (with cut) would look as follows:
min(X, Y, X) X < Y, !.
min(X, Y, Y ) X Y.
This program is true in the intended model and the goal min(2, 3, 3) does not
succeed any longer.
As a final remark, cut may be used to implement negation in Prolog. Consider the
following clauses (where fail is a Prolog predicate which lacks a definition and cannot
be defined by the user):
not(student(X)) student(X), !, fail .
not(student(X)).
This definition relies entirely on the operational semantics of Prolog. That is, subgoals
must be solved from left to right and clauses are searched in the textual order. If we
want to know whether John is not a student the goal not(student(john)) may be
given. Then there are two cases to consider if the subgoal student(john) succeeds
(i.e. if John is a student), ! will cut off the second clause and the negated goal will
fail. That is, Prolog produces the answer no. However, if the subgoal student(john)
finitely fails, the second clause will be tried (on backtracking) and the negated goal
immediately succeeds.
To avoid having to write a separate definition for every predicate that the user may
want to negate it is possible to use a predefined meta-predicate named call/1 which
is available in standard Prolog. The argument of call/1 must not be a variable when
the subgoal is selected and a call to the predicate succeeds iff the argument succeeds.
In other words the goal call(G) succeeds iff the goal G succeeds. Using this
predicate not/1 may be defined for arbitrary goals:2
not(X) call(X), !, fail .
not(X).
Notice that the success of call(t) may produce bindings for variables in t. Hence the
implementation is not logically correct, as discussed in Chapter 4. However, it works
as intended when the argument of not/1 is a ground atom.
In general it is possible to avoid using cut in most cases by sticking to negation
instead. This is in fact advocated since unrestricted use of cut often leads to incorrect
programs. It is not unusual that people on their first contacts with Prolog and faced
with a program that produces incorrect answers clutter the program with cuts at
random places instead of writing a logically correct program in the first place. In the
following chapters the use of cut is avoided to make this point quite clear. However,
this does not mean that cut should be abandoned altogether correctly used, it can
improve the efficiency of programs considerably.
2 Standard
5.2
93
Built-in Arithmetic
It has been proved that definite programs can describe any computable relation. That
is, any Turing machine can be coded as a logic program. This means that from a
theoretical point of view logic programming is not less expressive than other programming paradigms. In other words, resolution and exhaustive search provide a universal
tool for computation. But from a practical point of view it is not desirable to compute everything in that way. Take for example the arithmetic operations on natural
numbers. They are efficiently implemented in the hardware of computers. Therefore,
from a practical point of view, it is desirable to allow logic programs to access machine
arithmetic. A similar argument concerns any other operation or procedure whose efficient implementation in hardware or software is available. The problem is whether
it is possible to do that without destroying the declarative nature of logic programs
that use these external features. This section discusses the problem for the example
of arithmetic operations and shows the solution adopted in Prolog.
Notice first that arithmetic operations like plus or times can be easily described by
a definite logic program. The natural numbers can be represented by ground terms.
A standard way for that is to use the constant 0 for representing zero and the unary
functor s/1 for representing the successor of a number. Thus, the consecutive natural
numbers are represented by the following terms:
0, s(0), s(s(0)), . . .
The operations of addition and multiplication are binary functions on natural numbers.
Logic programs provide only a formalism for expressing relations. However, a binary
function can be seen as a ternary relation consisting of all triples hx, y, zi such that z
is the result of applying the function to the arguments x and y. It is well known that
the operations of addition and multiplication on natural numbers can be characterized
by the following Peano axioms:
.
0+X = X
.
s(X) + Y = s(X + Y )
.
0X = 0
.
s(X) Y = (X Y ) + Y
These axioms relate arguments and results of the operations. In the relational notation
of definite programs they can be reformulated as follows:
plus(0, X, X).
plus(s(X), Y, s(Z)) plus(X, Y, Z).
times(0, X, 0).
times(s(X), Y, Z) times(X, Y, W ), plus(W, Y, Z).
This program can be used to add and multiply natural numbers represented by ground
terms.
For example, to add 2 and 3 the goal plus(s(s(0)), s(s(s(0))), X) can be given.
The computed answer is X = s(s(s(s(s(0))))). An SLD-refutation is used to construct
it.
94
On the other hand, the program can be used also for subtraction and (a limited form
of) division. For example, in order to subtract 2 from 5 the goal plus(X, s(s(0)),
s(s(s(s(s(0)))))) can be used. The program can also perform certain symbolic computations. For example, one can add 2 to an unspecified natural number using the goal
plus(s(s(0)), X, Y ). The computed answer is Y = s(s(X)). Thus, for any ground
term t the result is obtained by adding two instances of the symbols s in front of t.
When comparing this with the usual practice in programming languages, the following observations can be made:
the representation of numbers by compound terms is inconvenient for humans;
the computations of the example program do not make use of arithmetic operations available in the hardware therefore they are much slower. For instance,
adding numbers N and M requires N + 1 procedure-calls;
arithmetic expressions cannot be constructed, since the predicate symbols plus/3
and times/3 represent relations. For example, to compute 2 + (3 4) one has to
introduce new temporary variables representing the values of subexpressions:
times(s(s(s(0))), s(s(s(s(0)))), X), plus(X, s(s(0)), Y ).
The first problem can easily be solved by introducing some syntactic sugar, like
the convention that the decimal numeral for the natural number n represents the
term sn (0) for instance, 3 represents the term s(s(s(0))). Techniques for compiling
arithmetic expressions into machine code are also well known. Thus the main problem
is how to incorporate arithmetic expressions into logic programs without destroying
the declarative meaning of the programs.
Syntactically arithmetic expressions are terms built from numerals, variables and
specific arithmetic functors, like +, , etc. usually written in infix notation. The
intended meaning of a ground arithmetic expression is a number. It is thus essential
that distinct expressions may denote the same number, take for example 2 + 2, 2
1 + 4 2 and 4. Thus, there is a binary relation on ground arithmetic expressions
which holds between arbitrary expressions E1 and E2 iff E1 and E2 denote the same
number. Clearly this relation is an equivalence relation. Every equivalence class
includes one numeral which is the simplest representation of all terms in the class.
The machine operations give a possibility of efficient reduction of a given ground
arithmetic expression to this numeral.
Assume that arithmetic expressions may appear as terms in definite logic programs. The answers of such programs should take into account equivalence between
the arithmetic expressions. For example, consider the following rule for computing tax
if the annual income is greater than 150, 000 then the tax is 50%, otherwise 25%
of the income reduced by 30, 000:
tax(Income, 0.5 Income) greater(Income, 150000).
tax(Income, 0.25 (Income 30000)) greater(Income, 150000).
A tax-payer received a decision from the tax department to pay 25, 000 in tax from
his income of 130, 000. To check whether the decision is correct (s)he may want to
use the rules above by giving the goal tax(130000, 25000). But the rules cannot be
95
used to find a refutation of the goal since none of the heads of the clauses unify with
the subgoal in the goal. The reason is that standard unification is too weak to realize
that the intended interpretations of the terms 25000 and 0.25 (130000 30000) are
the same. Thus, the equivalence must somehow be described by equality axioms for
arithmetic. But they are not included in the program above.
This discussion shows the need for an extension of the concept of logic programs.
For our example the program should consist of two parts a set of definite clauses
P and a set of equality axioms E describing the equivalences of terms. This type of
program has been studied in the literature. The most important result is a concept
of generalized unification associated with a given equality theory E and called Eunification. A brief introduction follows below. A more extensive account is provided
in Chapter 13 and 14.
A definite clause equality theory is a (possibly infinite) set of definite clauses, where
.
every atom is of the form s = t and s and t are terms. Sometimes the form of the
clauses is restricted to facts.
A definite program with equality is a pair P, E where P is a definite program which
.
contains no occurrences of the predicate symbol = /2 and E is a definite clause equality
theory.
Let E be a definite clause equality theory. A substitution is an E-unifier of the
.
terms s and t iff s = t is a logical consequence of E.
Example 5.3 Let E be an equality theory describing the usual equivalence of arithmetic expressions. Consider the expressions:
t1 := (2 X) + 1 and t2 := Y + 2
For instance, the substitution := {Y /(2 X 1)} is an E-unifier of t1 and t2 . To
check this, notice that t1 = t1 and that t2 = (2 X 1) + 2 which is equivalent to
t1 .
Now, for a given program P, E and goal A1 , . . . , Am the refutation of the goal can
be constructed in the same way as for definite programs, with the only difference that
E-unification is used in place of unification as presented in Chapter 3.
Finding E-unifiers can be seen as solving of equations in an algebra defined by
the equality axioms. It is known that the problem of E-unification is in general
undecidable. Even if it is decidable for some theory E there may be many different
solutions of a given equation. The situation when there exists one most general unifier
is rather unusual. This means that even if it is possible to construct all E-unifiers, a
new dimension of nondeterminism is introduced.
Assume now that an equality theory E describes all external functions, including
arithmetic operations, used in a logic program. This means that for any ground terms
.
s and t whose main functors denote external functions, the formula s = t is a logical
consequence of E iff the invocation of s returns the same result as the invocation of t.
In other words, in the special case of ground terms their E-unifiability can be decided
they either E-unify with the identity substitution, if both reduce to the same result,
or they are not E-unifiable, if their results are different. This can be exploited in the
following way whenever a call of an external function is encountered as a term to
be E-unified, it is invoked and its reduced form is being unified instead by the usual
96
unification algorithm. However, the external procedures can be invoked only with
ground arguments. If some variables of the call are not instantiated, the computation
cannot proceed and no E-unifier can be found. In this case a run time error may be
reported.
This idea is incorporated in Prolog in a restricted form for arithmetic operations.
Before explaining how, some syntactic issues should be mentioned.
The integers are represented in Prolog as integer numerals, for example 0, 1, 1989
and 17 etc. Prolog also supports a limited form of arithmetic over the reals using
floating point numbers usually written as e.g. 3.14, 7.0, 0.3333 etc. Logically the
numerals are constants. In addition, a number of predefined arithmetic functors for
use in the infix notation is available. They denote standard arithmetic functions on
integers and floats and refer to the operations of the computer. The most important
operations are:
Functor
+
/
//
mod
Operation
Addition
Subtraction
Multiplication
(Floating point) division
(Integer) division
Remainder after division
Additionally unary minus is used to represent negative numbers. (For a full list see
the ISO Prolog standard (1995).)
A ground term t constructed from the arithmetic functors and the numerals represents an integer or a floating point number, which can also be represented by a
numeral n, possibly prefixed by . The machine operations of the computer make
it possible to construct this term t0 in an efficient way. The arithmetic operations can
.
be axiomatized as an equational theory E such that t = t0 is its logical consequence.
Two predefined predicates of Prolog handle two specific cases of E-unification. They
are is/2 and = : = /2 both of which are used in the infix notation.
The binary predicate = : = /2 checks if two ground arithmetic expressions are Eunifiable. For example the goal:
2 + 3 = : = 1 + 4.
succeeds with the answer yes (corresponding to the empty substitution). If the
arguments are not ground arithmetic expressions, the execution aborts with an error
message in most Prolog implementations.
The binary predicate is/2 unifies its first argument with the reduced form of a
term constructed from the arithmetic functors and numerals. For example the goal:
X is 2 + 2.
succeeds with the substitution {X/4}.
The first argument of this predicate need not be variable. Operationally the reduced form of the second argument, which is either a numeral or a numeral preceded
by , is being unified with the first argument. If the latter is an arithmetic expression in the reduced form then this is a special case of E-unification handled also by
Exercises
97
= : = /2.
Otherwise the answer is no. But an E-unifier may still exist. For example
the goal:
X + 1 is 2 + 3.
will fail, although the terms X + 1 and 2 + 3 have an E-unifier namely {X/4}.
Another standard predicate =\= /2 (also in infix notation) checks whether two
ground terms are not E-unifiable. Prolog also provides predefined predicates for comparing the number represented by ground arithmetic expressions. These are the binary
infix predicates <, >, and .
Exercises
5.1 Consider the following definite program:
top(X, Y ) p(X, Y ).
top(X, X) s(X).
p(X, Y ) true(1), q(X), true(2), r(Y ).
p(X, Y ) s(X), r(Y ).
q(a).
q(b).
r(c).
r(d).
s(e).
true(X).
Draw the SLD-tree of the goal top(X, Y ). Then show what branches are
cut off:
when true(1) is replaced by cut;
when true(2) is replaced by cut.
5.2 Consider the following program:
p(Y ) q(X, Y ), r(Y ).
p(X) q(X, X).
q(a, a).
q(a, b).
r(b).
Add cut at different places in the program above and determine the answers
in response to the goal p(Z).
5.3 Consider the definition of not/1 given on page 92. From a logical point of view,
p(X) and not not p(X) are equivalent formulas. However, they behave
differently when given to the program that consists of a single clause p(a)
in what way?
98
PART II
PROGRAMMING IN LOGIC
99
Chapter 6
Logic and Databases
This chapter discusses the relationship between logic programs and relational databases. It is demonstrated how logic can be used to represent on a conceptual level
not only explicit data, but also implicit data (corresponding to views in relational
database theory) and how it can be used as a query language for retrieval of information
in a database. We do not concern ourselves with implementation issues but only
remark that SLD-resolution does not necessarily provide the best inference mechanism
for full logical databases. (An alternative approach is discussed in Chapter 15.) On the
other hand, logic not only provides a uniform language for representation of databases
its additional expressive power also enables description, in a concise and intuitive
way, of more complicated relations for instance, relations which exhibit certain
common properties (like transitivity) and relations involving structured data objects.
6.1
Relational Databases
As indicated by the name, the mathematical notion of relation is a fundamental concept in the field of relational databases. Let D1 , D2 , . . . , Dn be collections of symbols
called domains. In the context of database theory the domains are usually assumed
to be finite although, for practical reasons, they normally include an infinite domain
of numerals. In addition, the members of the domains are normally assumed to be
atomic or indivisible that is, it is not possible to access a proper part of a member.
A database relation R over the domains D1 , . . . , Dn is a subset of D1 Dn . R
is in this case said to be n-ary. A relational database is a finite number of such (finite)
relations. Database relations and domains will be denoted by identifiers in capital
letters.
Example 6.1 Let MALE := {adam, bill}, FEMALE := {anne, beth} and finally
PERSON := MALE FEMALE . Then:
101
102
hadam, adami
hadam, billi
MALE PERSON =
hadam, annei
hadam, bethi
hbill, adami
hbill, billi
hbill, annei
hbill, bethi
Now, let FATHER, MOTHER and PARENT be relations over the domains MALE
PERSON , FEMALE PERSON and PERSON PERSON defined as follows:
FATHER
MOTHER
PARENT
It is of course possible to imagine alternative syntactic representations of these relations. For instance in the form of tables:
FATHER:
C1
adam
adam
MOTHER:
C2
bill
beth
C1
anne
anne
C2
bill
beth
PARENT :
C1
adam
adam
anne
anne
C2
bill
beth
bill
beth
103
whereas in a relational database this is usually not possible since anne 6 MALE . To
avoid such problems a notion of type is needed.
Despite this difference it should be clear that any relational database can be represented as a logic program (where each domain of the database is extended to the set
of all terms) consisting solely of ground facts. Such a set of facts is commonly called
the extensional database (EDB).
6.2
Deductive Databases
After having established the relationship between relational databases and a (very
simple) class of logic programs, different extensions to the relational database-model
are studied. We first consider the use of variables and a simple form of rules. By such
extensions it is possible to describe in a more succinct and intuitive manner
many database relations. For instance, using rules and variables the database above
can be represented by the program:
parent(X, Y ) father (X, Y ).
parent(X, Y ) mother(X, Y ).
father (adam, bill).
father (adam, beth).
mother(anne, bill).
mother(anne, beth).
The part of a logic program which consists of rules and nonground facts is called the
intensional database (IDB). Since logic programs facilitate definition of new atomic
formulas which are ultimately deduced from explicit facts, logic programs are often
referred to as deductive databases. The logic programs above are also examples of a
class of logic programs called datalog programs. They are characterized by the absence
of functors. In other words, the set of terms used in the program solely consists of
constant symbols and variables. For the representation of relational databases this is
sufficient since the domains of the relations are assumed to be finite and it is therefore
always possible to represent the individuals with a finite set of constant terms. In the
last section of this chapter logic programs which make also use of compound terms are
considered, but until then our attention will be restricted to datalog programs.
Example 6.2 Below is given a deductive family-database whose extensional part consists of definitions of male/1, female/1, father /2 and mother/2 and whose intensional
part consists of parent/2 and grandparent/2:
grandparent(X, Z) parent(X, Y ), parent(Y, Z).
parent(X, Y ) father (X, Y ).
parent(X, Y ) mother(X, Y ).
father (adam, bill).
father (adam, beth).
father (bill, cathy).
father (donald, eric).
mother(anne, bill).
mother(anne, beth).
mother(cathy, donald).
mother(diana, eric).
104
male(adam).
male(bill).
male(donald).
male(eric).
In most cases it is possible to organize the database in many alternative ways. Which
organization to choose is of course highly dependent on what information one needs
to retrieve. Moreover, it often determines the size of the database. Finally, in the
case of updates to the database, the organization is very important to avoid inconsistencies in the database for instance, how should the removal of the labelled tuple
parent(adam, bill) from the database in Example 6.2 be handled? Although updates
are essential in a database system they will not be discussed in this book.
Another thing worth noticing about Example 6.2 is that the unary definitions
male/1 and female/1 can be seen as type declarations. It is easy to add another such
type declaration for the domain of persons:
person(X) male(X).
person(X) female(X).
It is now possible to type e.g. the database on page 103 by adding to the body of
every clause the type of each argument in the head of the clause:
parent(X, Y ) person(X), person(Y ), father (X, Y ).
parent(X, Y ) person(X), person(Y ), mother(X, Y ).
father (adam, bill) male(adam), person(bill).
father (adam, beth) male(adam), person(beth).
..
.
person(X) male(X).
person(X) female(X).
..
.
In this manner, type-errors like father (anne, adam) may be avoided.
6.3
In database textbooks one often encounters the concept of views. A view can be
thought of as a relation which is not explicitly stored in the database, but which
is created by means of operations on existing database relations and other views.
Such implicit relations are described by means of some query-language which is often
compiled into relational algebra for the purpose of computing the views. Below it
will be shown that all standard operations of relational algebra can be mimicked in
logic programming (with negation) in a natural way. The objective of this section is
twofold first it shows that logic programs have at least the computational power
of relational algebra. Second, it also provides an alternative to SLD-resolution as the
operational semantics of a class of logic programs.
105
The primitive operations of relational algebra are union, set difference, cartesian
product, projection and selection.
Given two n-ary relations over the same domains, the union of the two relations,
R1 and R2 (denoted R1 R2 ), is the set:
{hx1 , . . . , xn i | hx1 , . . . , xn i R1 hx1 , . . . , xn i R2 }
Using definite programs the union of two relations represented by the predicate
symbols r1 /n and r2 /n can be specified by the two rules:
r(X1 , . . . , Xn ) r1 (X1 , . . . , Xn ).
r(X1 , . . . , Xn ) r2 (X1 , . . . , Xn ).
For instance, if the EDB includes the definitions father /2 and mother/2, then parent/2
can be defined as the union of the relations father /2 and mother/2:1
parent(X, Y ) father (X, Y ).
parent(X, Y ) mother(X, Y ).
The difference R1 \ R2 of two relations R1 and R2 over the same domains yields the
new relation:
{hx1 , . . . , xn i R1 | hx1 , . . . , xn i 6 R2 }
In logic programming it is not possible to define such relations without the use of
negation; however, using negation it may be defined thus:
r(X1 , . . . , Xn ) r1 (X1 , . . . , Xn ), not r2 (X1 , . . . , Xn ).
For example, let parent/2 and mother/2 belong to the EDB. Now, father /2 can be
defined as the difference of the relations parent/2 and mother/2:
father (X, Y ) parent(X, Y ), not mother(X, Y ).
The cartesian product of two relations R1 and R2 (denoted R1 R2 ) yields the new
relation:
{hx1 , . . . , xm , y1 , . . . , yn i | hx1 , . . . , xm i R1 hy1 , . . . , yn i R2 }
Notice that R1 and R2 may have both different domains and different arities. Moreover, if R1 and R2 contain disjoint sets of attributes they are carried over to the
resulting relation. However, if the original relations contain some joint attribute the
attribute of the two columns in the new relation must be renamed into distinct ones.
This can be done e.g. by prefixing the joint attributes in the new relation by the
relation where they came from. For instance, in the relation R(A, B) S(B, C) the
attributes are, from left to right, A, R.B, S.B and C. Obviously, it is possible to
achieve the same effect in other ways.
In logic programming the cartesian product is mimicked by the rule:
r(X1 , . . . , Xm , Y1 , . . . , Yn ) r1 (X1 , . . . , Xm ), r2 (Y1 , . . . , Yn ).
1 In what follows we will sometimes, by abuse of language, write the relation p/n. Needless to
say, p/n is not a relation but a predicate symbol which denotes a relation.
106
For instance, let male/1 and female/1 belong to the EDB. Then the set of all malefemale couples can be defined by the rule:
couple(X, Y ) male(X), female(Y ).
Projection can be seen as the deletion and/or rearrangement of one or more columns
of a relation. For instance, by projecting the F - and C-attributes of the relation
FATHER(F, C) on the F -attribute (denoted F (FATHER(F, C))) the new relation:
{hx1 i | hx1 , x2 i FATHER}
is obtained. The same can be achieved in Prolog by means of the rule:
father (X) father (X, Y ).
The selection of a relation R is denoted F (R) (where F is a formula) and is the set
of all tuples hx1 , . . . , xn i R such that F is true for hx1 , . . . , xn i. How to translate
such an operation to a logic program depends on the appearance of the constraining
formula F . In general F is only allowed to contain atomic objects, attributes, , ,
and some simple comparisons (e.g. = and <). For instance, the database relation
defined by Y 1,000,000 INCOME (X, Y ) may be defined as follows in Prolog:
millionaire(X, Y ) income(X, Y ), Y 1000000.
Some other operations (like intersection and composition) are sometimes encountered
in relational algebra but they are usually all defined in terms of the mentioned, primitive ones and are therefore not discussed here. However, one of them deserves special
attention namely the natural join.
The natural join of two relations R and S can be computed only when the columns
are named by attributes. Thus, assume that T1 , . . . , Tk are the attributes which appear
both in R and in S. Then the natural join of R and S is defined thus:
R 1 S := A R.T1 =S.T1 R.Tk =S.Tk (R S)
where A is the list of all attributes of RS with exception of S.T1 , . . . , S.Tk . Thus, the
natural join is obtained by (1) taking the cartesian product of the two relations, (2) selecting those tuples which have identical values in the columns with the same attribute
and (3) filtering out the superfluous columns. Notice that if R and S have disjoint
sets of attributes, then the natural join reduces to an ordinary cartesian product.
To illustrate the operation, consider the relation defined by F (X, Y ) 1 P (Y, Z)
where F (X, Y ) and P (Y, Z) are defined according to Figure 6.1(a) and 6.1(b) and
denote the relation between fathers/parents and their children.
Now F (X, Y ) 1 P (Y, Z) is defined as X,F.Y,Z F.Y =P.Y (F (X, Y ) P (Y, Z)).
Hence the first step consists in computing the cartesian product F (X, Y ) P (Y, Z)
(cf. Figure 6.1(c)). Next the tuples with equal values in the columns named by F.Y
and P.Y are selected (Figure 6.1(d)). Finally this is projected on the X, F.Y and Z
attributes yielding the relation in Figure 6.1(e).
If we assume that father /2 and parent/2 are used to represent the database relations F and P then the same relation may be defined with a single definite clause as
follows:
X
adam
bill
Y
adam
bill
cathy
Y
bill
cathy
(a)
X
adam
bill
107
Z
bill
cathy
dave
X
adam
adam
adam
bill
bill
bill
F.Y
bill
bill
bill
cathy
cathy
cathy
(b)
F.Y
bill
cathy
P.Y
bill
cathy
P.Y
adam
bill
cathy
adam
bill
cathy
Z
bill
cathy
dave
bill
cathy
dave
(c)
Z
cathy
dave
X
adam
bill
(d)
F.Y
bill
cathy
Z
cathy
dave
(e)
6.4
Logic as a Query-language
In the previous sections it was observed that logic provides a uniform language for
representing both explicit data and implicit data (so-called views). However, deductive
databases are of little or no interest if it is not possible to retrieve information from
the database. In traditional databases this is achieved by so-called query-languages.
Examples of existing query-languages for relational databases are e.g. ISBL, SQL,
QUEL and Query-by-Example.
By now it should come as no surprise to the reader that logic programming can be
used as a query-language in the same way it was used to define views. For instance,
to retrieve the children of Adam from the database in Example 6.2 one only has to
give the goal clause:
parent(adam, X).
108
To this Prolog-systems would respond with the answers X = bill and X = beth, or put
alternatively the unary relation {hbilli, hbethi}. Likewise, in response to the goal:
mother(X, Y ).
Prolog produces four answers:
X
X
X
X
= anne,
= anne,
= cathy,
= diana,
Y
Y
Y
Y
= bill
= beth
= donald
= eric
6.5
109
Special Relations
The main objective of this section is to show how to define relations that possess
certain properties occurring frequently both in real life and in mathematics. This
includes properties like reflexivity, symmetry and transitivity.
Let R be a binary relation over some domain D. Then:
R is said to be reflexive iff for all x D, it holds that hx, xi R;
R is symmetric iff hx, yi R implies that hy, xi R;
R is anti-symmetric iff hx, yi R and hy, xi R implies that x = y;
R is transitive iff hx, yi R and hy, zi R implies that hx, zi R;
R is asymmetric iff hx, yi R implies that hy, xi
/ R.
To define an EDB which possesses one of these properties is usually a rather cumbersome task if the domain is large. For instance, to define a reflexive relation over a
domain with n elements requires n tuples, or n facts in the case of a logic program.
Fortunately, in logic programming, relations can be defined to be reflexive with a single
clause of the form:
r(X, X).
However, in many cases one thinks of the Herbrand universe as the coded union of
several domains. For instance, the Herbrand universe consisting of the constants bill,
kate and love may be thought of as the coded union of persons and abstract notions.
If as in this example the intended domain of r/2 (encoded as terms) ranges over
proper subsets of the Herbrand universe and if the type predicate t/1 characterize this
subset, a reflexive relation can be written as follows:
r(X, X) t(X).
For instance, in order to say that every person looks like himself we may write the
following program:
looks like(X, X) person(X).
person(bill).
person(kate).
abstract(love).
In order to define a symmetric relation R it suffices to specify only one of the pairs
hx, yi and hy, xi if hx, yi R. Then the program is extended with the rule:
r(X, Y ) r(Y, X).
However, as shown below such programs suffer from operational problems.
Example 6.3 Consider the domain:
{sarah, diane, pamela, simon, david , peter }
110
The relation . . . is positioned over . . . clearly is transitive and may be defined either
through a purely extensional database:
over(a, b).
over(a, d).
over(b, d).
over(a, c).
over(b, c).
over(c, d).
111
The definitions above are declaratively correct, but they suffer from operational problems when executed by Prolog systems. Consider the goal married(diane, david )
together with the deductive database of Example 6.3. Clearly married(diane, david )
is a logical consequence of the program but any Prolog interpreter would go into an
infinite loop first by trying to prove:
married(diane, david ).
Via unification with the rule a new goal clause is obtained:
married(david , diane).
When trying to satisfy married(david , diane) the subgoal is once again unified with
the rule yielding a new goal, identical to the initial one. This process will obviously
go on forever. The misbehaviour can, to some extent, be avoided by moving the rule
textually after the facts. By doing so it may be possible to find some (or all) refutations
before going into an infinite loop. However, no matter how the clauses are ordered,
goals like married(diane, diane) always lead to loops.
A better way of avoiding such problems is to use an auxiliary anti-symmetric
relation instead and to take the symmetric closure of this relation. This can be done
by renaming the predicate symbol of the EDB with the auxiliary predicate symbol
and then introducing two rules which define the symmetric relation in terms of the
auxiliary one.
Example 6.5 The approach is illustrated by defining married/2 in terms of the auxiliary definition wife/2 which is anti-symmetric:
married(X, Y ) wife(X, Y ).
married(X, Y ) wife(Y, X).
wife(sarah, simon).
wife(diane, david ).
wife(pamela, peter ).
This program has the nice property that it never loops simply because it is not
recursive.
A similar approach can be applied when defining transitive relations. A new auxiliary
predicate symbol is introduced and used to rename the EDB. Then the transitive
closure of this relation is defined by means of the following two rules (where p/2
denotes the transitive relation and q/2 the auxiliary one):
p(X, Y ) q(X, Y )
p(X, Y ) q(X, Z), p(Z, Y ).
Example 6.6 The relation over/2 may be defined in terms of the predicate symbol
on/2:
over(X, Y ) on(X, Y ).
over(X, Z) on(X, Y ), over(Y, Z).
112
Notice that recursion is not completely eliminated. It may therefore happen that the
program loops. As shown below this depends on properties of the auxiliary relation.
The transitive closure may be combined with the reflexive closure of a relation. Given
an auxiliary relation denoted by q/2, its reflexive and transitive closure is obtained
through the additional clauses:
p(X, X).
p(X, Y ) q(X, Y ).
p(X, Z) q(X, Y ), p(Y, Z).
Actually, the second clause is superfluous since it follows logically from the first and
third clause: any goal, p(a, b), which is refuted through unification with the second
clause can be refuted through unification with the third clause where the recursive
subgoal is unified with the first clause.
Next we consider two frequently encountered types of relations namely partial
orders and equivalence relations.
A binary relation is called a partial order if it is reflexive, anti-symmetric and
transitive whereas a relation which is reflexive, symmetric and transitive is called an
equivalence relation.
Example 6.7 Consider a directed, acyclic graph:
b
It is easy to see that the relation there is a path from . . . to . . . is a partial order
given the graph above. To formally define this relation we start with an auxiliary,
asymmetric relation (denoted by edge/2) which describes the edges of the graph:
edge(a, b).
edge(a, c).
edge(b, d).
edge(b, e).
edge(c, e).
edge(d, f ).
edge(e, f ).
edge(e, g).
Then the reflexive and transitive closure of this relation is described through the two
clauses:
path(X, X).
path(X, Z) edge(X, Y ), path(Y, Z).
113
path(a, f ).
edge(a, Y0 ), path(Y0 , f ).
path(b, f ).
edge(b, Y2 ), path(Y2 , f ).
path(a,
f ).
...
..
This program does not suffer from infinite loops. In fact, no partial order defined in
this way will loop as long as the domain is finite. However, if the graph contains a
loop it may happen that the program starts looping consider the addition of a cycle
in the above graph. For instance, an additional edge from b to a:
edge(b, a).
Part of the SLD-tree of the goal path(a, f ) is depicted in Figure 6.2. The SLD-tree
clearly contains an infinite branch and hence it may happen that the program starts
looping without returning any answers. In Chapter 11 this problem will be discussed
and a solution will be suggested.
Example 6.8 Next consider some points on a map and bi-directed edges between the
points:
a
114
Next the other half of each edge is described by means of the symmetric closure of the
relation denoted by edge/2:
bi edge(X, Y ) edge(X, Y ).
bi edge(X, Y ) edge(Y, X).
Finally, path/2 is defined by taking the reflexive and transitive closure of this relation:
path(X, X).
path(X, Z) bi edge(X, Y ), path(Y, Z).
Prolog programs defining equivalence relations usually suffer from termination problems unless specific measures are taken (cf. Chapter 11).
6.6
In relational databases it is usually required that the domains consist of atomic objects, something which simplifies the mathematical treatment of relational databases.
Naturally, when using logic programming, nothing prevents us from using structured
data when writing deductive databases. This allows for data abstraction and in most
cases results in greater expressive power and improves readability of the program.
Example 6.9 Consider a database which contains members of families and the addresses of the families. Imagine that a family is represented by a ternary term family/3
where the first argument is the name of the husband, the second the name of the wife
and the last a structure which contains the names of the children. The absence of
children is represented by the constant none whereas the presence of children is represented by the binary term of the form c(x, y) whose first argument is the name of
one child and whose second argument recursively contains the names of the remaining children (intuitively none can be thought of as the empty set and c(x, y) can be
thought of as a function which constructs a set by adding x to the set represented by
y). An excerpt from such a database might look as follows:
address(family (john, mary, c(tom, c(jim, none))), main street(3)).
address(family (bill, sue, none), main street(4)).
parent(X, Y )
address(family (X, Z, Children), Street),
among(Y, Children).
parent(X, Y )
address(family (Z, X, Children), Street),
among(Y, Children).
115
husband(X)
address(family (X, Y, Children), Street).
wife(Y )
address(family (X, Y, Children), Street).
married(X, Y )
address(family (X, Y, Children), Street).
married(Y, X)
address(family (X, Y, Children), Street).
among(X, c(X, Y )).
among(X, c(Y, Z))
among(X, Z).
The database above can be represented in the form of a traditional database by introducing a unique key for each family. For example as follows:
husband(f 1, john).
husband(f 2, bill).
wife(f 1, mary).
wife(f 2, sue).
child(f 1, tom).
child(f 1, jim).
address(f 1, main street, 3).
address(f 2, main street, 4).
parent(X, Y ) husband(Key, X), child(Key, Y ).
..
.
However, the latter representation is less readable and it may also require some extra
book-keeping to make sure that each family has a unique key.
To conclude the issues discussed in this chapter were raised to demonstrate the
advantages of using logic as a uniform language for representing databases. Facts, rules
and queries can be written in a single language. Moreover, logic supports definition of
relations via recursive rules, something which is not allowed in traditional databases.
Finally, the use of structured data facilitates definition of relations which cannot be
made in traditional relational databases. From this stand-point logic programming
provides a very attractive conceptual framework for describing relational databases.
On the other hand we have not raised important issues like how to implement such
databases let alone how to handle updates to deductive databases.
116
Exercises
6.1 Reorganize the database in Example 6.2 so that father /2 and mother/2 become part of the intensional database.
6.2 Extend Example 6.2 with some more persons. Then define the following predicate symbols (with obvious intended interpretations):
grandchild/2
sister/2
brother/2
cousins/2
uncle/2
aunt/2
6.3 Consider an arbitrary planar map of countries. Write a program which colours
the map using only four colours so that no two adjacent countries have the same
colour. NOTE: Two countries which meet only pointwise are not considered
to be adjacent.
6.4 Define the input-output behaviour of AND- and inverter-gates. Then describe
the relation between input and output of the following nets:
x
y
v
z
w
y
x
6.5 Translate the following relational algebra expressions into definite clauses.
X,Y (HUSBAND(Key, X) 1 WIFE (Key, Y ))
X (PARENT (X, Y ) X Y 20,000 INCOME (X, Y ))
6.6 The following clauses define a binary relation denoted by p/2 in terms of the
relations q/2 and r/2. How would you define the same relation using relational
algebra?
p(X, Y ) q(Y, X).
p(X, Y ) q(X, Z), r(Z, Y ).
Exercises
117
118
Chapter 7
Programming with Recursive Data
Structures
7.1
In the previous chapter we studied a class of programs that manipulate simple data
objects mostly constants. However, the last section of the chapter introduced the
use of compound terms for representation of more complex worlds like families
and their members. Such data objects are typically used when there is a need to
represent some collection of individuals where the size is not fixed or when the set of
individuals is infinite. In the example a family may have indefinitely many children.
Such objects are usually represented by means of so called recursive data structures. A
recursive data structure is so called because its data objects may contain, recursively
as substructures, objects of the same type. In the previous chapter the functor c/2
was used to represent the children of a family the first argument contained the name
of one child and the second, recursively, a representation of the remaining children.
This chapter discusses some recursive data structures used commonly in logic programs and programming techniques for dealing with such structures.
7.2
Lists
Some well-known programming languages for instance Lisp use lists as the primary representation of data (and programs). Although logic programming only allows
terms as representations of individuals, it is not very hard to represent lists as terms.
Most Prolog systems even support the use of lists by means of special syntax. We will
first introduce a precise concept of list.
Let D be some domain of objects. The set of all lists (over D) is defined inductively
as the smallest set satisfying the following conditions:
119
120
. .
. .
. .
[s1 , . . . , sm |[t1 , . . . , tn |X]] is usually written [s1 , . . . , sm , t1 , . . . , tn |X] (m, n > 0);
[s1 , . . . , sm |[t1 , . . . , tn ]] is usually written [s1 , . . . , sm , t1 , . . . , tn ] (m > 0, n 0).
Hence, instead of writing [a|[b|[c|[ ]]]] the notation [a, b, c] is used (note that [c|[ ]] is
written as [c], [b|[c]] is written as [b, c] and [a|[b, c]] is written as [a, b, c]). Similarly
[a, b|[c|X]] is written as [a, b, c|X].
It is easy to write procedures which relate a list to its head and tail (cf. the functions
CAR and CDR in Lisp):
car(Head , [Head |Tail ]).
cdr(Tail , [Head |Tail ]).
Presented with the goal cdr(X, [a, b, c]) Prolog answers X = [b, c].
Now consider the definition of lists again. Looking more closely at the two statements defining what a list is, it is not very hard to see that both statements can be
formulated as definite clauses the first statement as a fact and the second as a
recursive rule.
Example 7.1 Formally the definition of lists can be expressed as follows:
list([ ]).
list([Head |Tail ]) list(Tail ).
This type-declaration has two different uses it can (1) be used to test whether a
term is a list or (2) to enumerate/generate all possible lists. In reply to the definite goal
list(X) Is there some X such that X is a list? Prolog starts enumerating
7.2 Lists
121
all possible lists starting with [ ] and followed by [X1 ], [X1 , X2 ], etc. Remember that
answers containing variables are understood to be universally quantified that is,
the second answer is interpreted as For any X1 , [X1 ] is a list. (Of course the names
of the variables may differ but are not important anyway.)
The next program considered is actually a version of the among/2 program from
the previous chapter. Here it is called member/2 and it is used to describe membership
in a list. An informal definition looks as follows:
X is a member of any list whose head is X;
if X is a member of Tail then X is a member of any list whose tail is Tail .
Again observe that the definition is directly expressible as a definite program!
Example 7.2
member(X, [X|Tail ]).
member(X, [Y |Tail ]) member(X, Tail ).
As a matter of fact, the first clause does not quite express what we intended. For
instance, the goal member(a, [a | b]) has a refutation even though [a | b] is not a list
according to our definition. Such unwanted inferences could be avoided by strengthening the first clause into:
member(X, [X|Tail ]) list(Tail ).
Unfortunately the extra condition makes the program less efficient. Resolving a goal
of the form:
member(tm , [t1 , . . . , tm , . . . , tm+n ]).
requires n + 1 extra resolution steps. Moreover, it is not necessary to have the extra
condition if the program is used as expected, that is for examination of list membership
only.
Just as list/1 has more than one use depending on how the arguments of the goal
are instantiated, member/2 can be used either to test or to generate answers. For instance, the goal member(b, [a, b, c]) has a refutation whereas member(d, [a, b, c])
fails. By leaving the first argument uninstantiated the member/2-program will enumerate the elements of the list in the second argument. For instance, the goal
member(X, [a, b, c]) has three refutations with three different answers under
Prologs depth-first search strategy the first answer is X = a, followed by X = b and
finally X = c. The SLD-tree of the goal is shown in Figure 7.1.
Note that the program computes all the expected answers. Consider instead the
goal member(a, X) which reads Is there some list which contains a?. The SLDtree of the goal is depicted in Figure 7.2.
The first answer produced is X = [a | Tail 0 ] which is interpreted as For any
Tail 0 , [a | Tail 0 ] has a as a member or less strictly Any list starting with a contains
a. The second success branch first binds X to [Y0 |Tail 0 ] and then binds Tail 0 to
[a | Tail 1 ]. Hence the complete binding obtained for X is [Y0 | [a | Tail 1 ] ] which is
122
,@@
,
,
@
2 member(X, [b, c]).
X/a
,@
,
, @@
2 member(X, [c]).
X/b
,@
,
, @@
2
member(X, [ ]).
X/c
member(a, X).
Tail 1 /[a|Tail 2 ]
7.2 Lists
123
equivalent to [Y0 , a | Tail 1 ] and is interpreted as Any list with a as the second element
contains a. Similarly the third answer is interpreted as Any list with a as the third
element contains a. It is not hard to see that there are infinitely many answers of
this kind and the SLD-tree obviously contains infinitely many success branches. This
brings us to an important question discussed briefly in Chapter 3 what impact has
the textual ordering of clauses in Prolog?
What happens if the clauses in the member/2-program are swapped? Referring
to Figure 7.1 one can see that instead of first traversing the leftmost branch in the
SLD-tree the rightmost branch is traversed first. This branch will eventually fail, so
the computation backtracks until the first answer (which is X = c) is found. Then
the computation backtracks again and the answer X = b is found followed by the final
answer, X = a. Thus, nothing much happens the SLD-tree is simply traversed
in an alternative fashion which means that the answers show up in a different order.
This may, of course, have serious impacts if the tree contains some infinite branch
consider the rightmost branch of the tree in Figure 7.2. Clearly no clause ordering
will affect the size of the tree and it is therefore not possible to traverse the whole
tree (that is, find all answers). However if the rightmost branch in the tree is always
selected before the leftmost one the computation will loop for ever without reporting
any answers (although there are answers to the goal).
The halting problem is of course undecidable (i.e. it is in general not possible to
determine whether a program will loop or not), but it is good practice to put facts
before recursive clauses when writing a recursive program. In doing so it is often
possible to find all, or at least some, of the answers to a goal before going into an
infinite loop. There is also another good reason for doing this which has to do with
the implementation of modern Prolog compilers. If the rightmost subgoal in the last
clause of a definition is a recursive call, the Prolog compiler is sometimes able to
produce more efficient machine code.
The next program considered is that of putting two lists together. The name
commonly used for the program is append/3 although a more appropriate name would
be concatenate/3. As an example, appending a list [c, d] to another list [a, b] yields
the new list [a, b, c, d]. More formally the relation can be defined as follows:
appending any list X to the empty list yields the list X;
if appending Z to Y yields W , then appending Z to [X|Y ] yields [X|W ].
Again there is a direct translation of the definition into a definite program:
Example 7.3
append([ ], X, X).
append([X|Y ], Z, [X|W ]) append(Y, Z, W ).
Just like the previous programs, the append/3-program can be used in many different
ways. Obviously, we can use it to test if the concatenation of two lists equals a third
list by giving the goal:
append([a, b], [c, d], [a, b, c, d])
124
,@
,,
@@Y /[a|Y ]
2 append(Y , Z, [b, c, d]).
Y /[ ]
,@@ Y /[b|Y ]
Z/[a, b, c, d]
,
,
@
2 append(Y , Z, [c, d]).
Y /[ ]
,@@ Y /[c|Y ]
Z/[b, c, d]
,
,
@
2 append(Y , Z, [d]).
Y /[ ]
,@@ Y /[d|Y ]
Z/[c, d]
,
,
@
0
append(Y3 , Z, [ ]).
Y2 /[ ]
Z/[d]
2
Y3 /[ ], Z/[ ]
It can also be used as a function to concatenate two lists into a third list:
append([a, b], [c, d], X)
in which case the computation succeeds with the answer X = [a, b, c, d]. However, it
is also possible to give the goal:
append(Y, Z, [a, b, c, d])
which reads Are there two lists, Y and Z, such that Z appended to Y yields
[a, b, c, d]?. Clearly there are two such lists there are in fact five different possibilities:
Y
Y
Y
Y
Y
= []
= [a]
= [a, b]
= [a, b, c]
= [a, b, c, d]
Z
Z
Z
Z
Z
= [a, b, c, d]
= [b, c, d]
= [c, d]
= [d]
= []
By now it should come as no surprise that all of these answers are reported by Prolog.
The SLD-tree of the goal is depicted in Figure 7.3.
7.2 Lists
125
The program can actually be used for even more sophisticated tasks. For instance,
the rule:
unordered(List) append(F ront, [X, Y |End], List), X > Y.
describes the property of being an unordered list of integers. The clause expresses the
fact that a list is unordered if there are two consecutive elements where the first is
greater than the second.
Another example of the use of append/3 is shown in the following clause, which
defines the property of being a list with multiple occurrences of some element:
multiple(List) append(L1, [X|L2], List), append(L3, [X|L4], L2).
The following is an alternative (and perhaps more obvious) definition of the same
property:
multiple([Head|Tail ]) member(Head , Tail ).
multiple([Head|Tail ]) multiple(Tail).
The append/3-program can also be used to define the membership-relation and the
relation between lists and their last elements. (These are left as exercises.) One may
be willing to compare a definition of the last element of the list based on append/3
with the following direct definition:
X is the last element in the list [X];
if X is the last element in the list Tail then it is also the last element in the list
[Head |Tail ].
This can be formalized as follows:
Example 7.4
last(X, [X]).
last(X, [Head |Tail ]) last(X, Tail ).
All of the programs written so far have a similar structure the first clause in each
of them is a fact and the second clause is a recursive rule. In Examples 7.1 and 7.3
the resemblance is even closer: The program of Example 7.1 can be obtained from
that of Example 7.3 by removing the second and third arguments of each atom in the
program. This is no coincidence since (almost) every program that operates on lists
has a uniform structure. Some programs differ slightly from the general pattern, like
examples 7.2 and 7.4 on the other hand, when removing the first argument from
the atoms in these programs, they also closely resemble the list/1-program.
Almost all programs in this chapter (also those which follow) are defined by means
of a technique which looks like that of inductive definitions of sets.
Remember that relations are sets of tuples. The propositions of an inductive definition describe which tuples are in, and outside of this set. The first proposition (usually
called the basic clause) in the definition is normally unconditional or uses only already
fully defined relation(s). It introduces some (one or more) initial tuples in the set.
126
The second proposition (called the inductive clause) states that if some tuples are in
the set (and possibly satisfy some other, already defined relations) then some other
tuples are also in the set. The inductive clause is used to repeatedly pump up the
set as much as possible. That is, the basic clause gives a set S0 . The inductive clause
then induces a new set S1 from S0 . But since S1 may contain tuples which do not
appear in S0 , the inductive clause is used on S1 to obtain the set S2 and so on. The
basic and inductive clause are sometimes called direct clauses.
The direct clauses specify that some tuples are in the set (the relation). But that
does not exclude the set from also containing other tuples. For instance, saying that
1 is an integer does not exclude Tom and 17 from being integers. Hence, an inductive
definition contains also a third clause (called the extremal clause) which states that
no other tuples are in the set than those which belong to it as a result of the direct
clauses. In the definitions above this last statement is omitted. A justification for
this is that definite programs describe only positive information and it is not possible
to express the extremal clause as a definite clause. However, taking into account the
negation-as-failure rule, the extremal clause becomes explicit when considering the
completion of the program. For instance the completion of Example 7.1 contains the
formula:
X(list(X) X = [ ] Head , Tail (X = [Head |Tail ] list(Tail )))
The if-part of this formula corresponds to the direct clauses whereas the only ifpart is the extremal clause which says that an individual is a list only if it is the empty
list or a pair where the tail is a list.
The definition of list/1 is in some sense prototypical for inductive definitions of
relations between lists and other objects. The basic clause states that something holds
for the empty list and the inductive clause says that something holds for lists of length
n given that something holds for lists of length m, n > m. This should be contrasted
with the following programs:
list([ ]).
list(Tail ) list([Head|Tail ]).
and:
list([ ]).
list(X) list(X).
Declaratively, there is nothing wrong with them. All statements are true in the intended model. However, as inductive definitions they are incomplete. Both of them
define the empty list to be the only list. They are not very useful as programs either
since the goal list([a]) yields an infinite loop.
Next some other, more complicated, relations between lists are considered. The
first relation is that between a list and its permutations. Informally speaking, a permutation of a list is a reordering of its elements. Consider a list with n elements.
What possible reorderings are there? Clearly the first element can be put in n different positions. Consequently there are n 1 positions where the second element may
be put. More generally there are n m + 1 positions where the m-th element may be
put. From this it is easy to see that there are n! different permutations of a list with
n elements.
The relation between a list and its permutations is defined inductively as follows:
7.2 Lists
127
= [a, b, c]
= [b, a, c]
= [b, c, a]
= [a, c, b]
= [c, a, b]
= [c, b, a]
128
orderings of literals. Needless to say, some programs loop no matter how the body
literals are ordered.
The permutation/2-program can be used to sort, for instance, lists of natural
numbers. The classical specification of the relation between a list and its sorted version
says that Y is a sorted version of X if Y is a sorted permutation of X. Together
with the property sorted/1 (which holds if a list of integers is sorted in ascending
order) the relation may be defined thus (nsort/2 stands for naive sort):
Example 7.6
nsort(X, Y ) permutation(X, Y ), sorted(Y ).
sorted([ ]).
sorted([X]).
sorted([X, Y |Z]) X Y, sorted([Y |Z]).
The predicate symbol /2 which is used to compare integers is normally predefined
as a so called built-in predicate in most Prolog systems. Needless to say, this program
is incredibly inefficient. For more efficient sorting programs the reader is advised to
solve exercises 7.10 7.12. However, the program illustrates quite clearly why the
order among the atoms in the body of a clause is important. Consider the goal:
nsort([2, 1, 3], X).
This reduces to the new goal:
permutation([2, 1, 3], X), sorted(X).
With the standard computation rule this amounts to finding a permutation of [2, 1, 3]
and then checking if this is a sorted list. Not a very efficient way of sorting lists but
it is immensely better than first finding a sorted list and then checking if this is a
permutation of the list [2, 1, 3] which would be the effect of switching the order among
the subgoals. Clearly there are only six permutations of a three-element list but there
are infinitely many sorted lists.
The definition of sorted/1 differs slightly from what was said above there are
two basic clauses, one for the empty list and one for the list with a single element. It
may also happen that there are two or more inductive clauses (cf. exercise 7.12).
The last example considered here is that of reversing a list. Formally the relation
between a list and its reversal is defined as follows:
Example 7.7
reverse([ ], [ ]).
reverse([X|Y ], Z) reverse(Y, W ), append(W, [X], Z).
Or more informally:
the empty list is the reversal of itself;
129
last1
last2
list1
list2
7.3
Difference Lists
The computational cost of appending two lists in Prolog is typically proportional to the
length of the first list. In general a linear algorithm is acceptable but other languages
often facilitate concatenation of lists in constant time. The principal idea to achieve
constant time concatenation is to maintain a pointer to the end of the list as shown
in Figure 7.4. In order to append the two lists the following Pascal-like commands are
needed:
..
.
last1^.pointer := list2;
last1 := last2;
..
.
In Prolog the same technique can be adopted by using variables as pointers. Assume
that, in the world of lists, there is a (partial) function which given two lists where the
second is a suffix of the first, returns the list obtained by removing the suffix from the
first (that is, the result is a prefix of the first list). Now let the functor denote
this function, then the term:
[t1 , . . . , tm , tm+1 , . . . , tm+n ] [tm+1 , . . . , tm+n ]
denotes the same list as does [t1 , . . . , tm ]. More generally, [a, b, c|L] L denotes the list
[a, b, c] for any list assigned to L. As a special case the term LL designates the empty
list for any list assigned to L. It is now possible to use this to define concatenation of
difference lists:
130
Declaratively this stands for Appending the difference of Y and Z to the difference
of X and Y yields the difference of X and Z. The correctness of the statement is
easier to see when written as follows:
t1 . . . ti ti+1 . . . tj tj+1 . . . tk
| {z }
Z
|
{z
}
Y
|
{z
}
X
Exercises
131
empty(L L).
Clearly, [a|Y ] Y is not an empty list (since it denotes the list [a]). However, the goal
empty([a|Y ] Y ) succeeds with Y bound to an infinite term.
Yet another problem with difference lists stems from the fact that designates
a partial function. Thus far nothing has been said about the meaning of terms such
as [a, b, c] [d]. For instance the goal:
append([a, b] [c], [c] [b], L)
succeeds with the answer L = [a, b] [b]. Again such problems can be solved with
additional computational efforts. The append/3 program may for instance be written
as follows:
append(X Y, Y Z, X Z) suffix (Y, X), suffix (Z, Y ).
But this means that concatenation of lists becomes linear again.
Exercises
7.1 Write the following lists as terms with (dot) as functor and [ ] representing
the empty list:
[a, b]
[a | b]
[a, [b, c], d]
[a, b | X]
[a | [b, c]]
[a, b | [ ]]
[[ ] | [ ]]
[a | [b, c | [ ]]]
7.2 Define a binary relation last/2 between lists and their last elements using only
the predicate append/3.
7.3 Define the membership-relation by means of the append/3-program.
7.4 Define a binary relation length/2 between lists and their lengths (i.e. the number of elements in them).
7.5 Define a binary relation lshift /2 between lists and the result of shifting them
(circularly) one step to the left. For example, so that the goal:
lshift ([a, b, c], X)
succeeds with the answer X = [b, c, a].
7.6 Define a binary relation rshift/2 between lists and the result of shifting them
(circularly) one step to the right. For example, so that the goal:
rshift([a, b, c], X)
succeeds with the answer X = [c, a, b].
7.7 Define a binary relation prefix /2 between lists and all its prefixes. Hint: [ ], [a]
and [a, b] are prefixes of the list [a, b].
132
7.8 Define a binary relation suffix /2 between lists and all its suffixes. Hint: [ ], [b]
and [a, b] are suffixes of the list [a, b].
7.9 Define a binary relation sublist/2 between lists and their sublists.
7.10 Implement the insert-sort algorithm for integers in Prolog informally it can
be formulated as follows:
Given a list, remove its first element, sort the rest, and insert the
first element in its appropriate place in the sorted list.
7.11 Implement the quick-sort algorithm for integers in Prolog informally it can
be formulated as follows:
Given a list, split the list into two one part containing elements
less than a given element (e.g. the first element in the list) and one
part containing elements greater than or equal to this element. Then
sort the two lists and append the results.
7.12 Implement the merge-sort algorithm for integers in Prolog informally it can
be formulated as follows:
Given a list, divide the list into two halves. Sort the halves and
merge the two sorted lists.
7.13 A nondeterministic finite automaton (NFA) is a tuple hS , , T, s0 , F i where:
S is a finite set of states;
is a finite input alphabet;
T S S is a transition relation;
s0 S is an initial state;
F S is a set of final states.
A string x1 x2 . . . xn n is accepted by an NFA if there is a sequence:
hs0 , s1 , x1 i, hs1 , s2 , x2 i, , hsn1 , sn , xn i T
such that sn F . An NFA is often depicted as a transition diagram whose
nodes are states and where the transition relation is denoted by labelled edges
between nodes. The final states are indicated by double circles. Define the
NFA depicted in Figure 7.5 as a logic program (let 1 be the initial state).
Use the program to check if strings (represented by lists of as and bs) are
accepted.
7.14 Informally speaking, a Turing machine consists of an infinite tape divided into
slots which may be read from/written into by a tape-head. In each slot there
is exactly one of two symbols called blank (denoted by 0) and nonblank
(denoted by 1). Initially the tape is almost blank the number of slots from
the leftmost to the rightmost nonblank of the tape is finite. This sequence
(string) will be referred to as the content of the tape. The machine is always
Exercises
133
a
start
b
2
3
a
in one of a finite number of states, some of which are called final and one of
which is called initial.
The tape-head is situated at exactly one of the slots of the tape. Depending
on the contents of this slot and the current state, the machine makes one of a
number of possible moves:
It writes 0 or 1 in the slot just read from, and
changes state, and
moves the tape-head one slot to the right or to the left.
This can be described through a function, which maps the current state and
the symbol in the current slot of the tape into a triple which consists of a new
state, the symbol written in the current slot and the direction of the move.
To start with the machine is in the initial state and the tape-head is situated
at the leftmost nonblank of the tape. A string is said to be accepted by a
Turing machine iff it is the initial contents of the tape and there is a finite
sequence of moves that take the machine to one of its final states.
Write a Turing machine which accepts a string of n (n > 0) consecutive 1s
and halts pointing to the leftmost nonblank in a sequence of 2 n 1s. This
illustrates another view of Turing machines, not only as language acceptors,
but as a function which takes as input a natural number n represented by n
consecutive 1s and produces some output represented by the consecutive 1s
starting in the slot pointed to when the machine halts.
7.15 Write a program for multiplying matrices of integers. Obviously the program
should succeed only if the number of columns of the first matrix equals the
number of rows in the second. Then write a specialized program for multiplying
matrices of fixed size.
7.16 Find some suitable representation of sets. Then define some standard operations on sets, like union, intersection, membership, set-difference.
7.17 Represent strings by difference lists. Define the property of being a palindrome.
7.18 Use the concept of difference list to implement the quick-sort algorithm in
exercise 7.11.
7.19 Use difference lists to define queues. That is, a first-in-first-out stack. Write relations that describe the effects of adding new objects to and removing objects
from queues.
134
7.20 Define the property of being a binary tree. Then define what it means for an
element to be a member of a binary tree.
7.21 A binary tree is said to be sorted if for every node N in the tree, the nodes
in the left subtree are all less than N and all nodes in the right subtree are
greater than N . Define this by means of a definite program and then define
relations for adding and deleting nodes in a sorted binary tree (so that it stays
sorted).
7.22 Write a program for finding a minimal spanning tree in a weighted loop-free
undirected connected graph.
Chapter 8
Amalgamating Object- and
Meta-language
8.1
What is a Meta-language?
136
8.2
Ground Representation
137
subset of the constants and functors of the meta-language. The meta-language may of
course also contain other symbols in particular some predicate symbols. However,
leaving them aside for the moment, the domain of the intended interpretation = of
the meta-language consists of terms and formulas of the object-language. Now the
meaning of the constants and functors introduced above are given by the bijection ,
or rather by its inverse (1 ) as follows:
The meaning c= of a constant c of the meta-language is the constant or variable
1 (c) of the object-language.
The meaning f= of an n-ary functor f of the meta-language is an n-ary function
which maps:
(i ) the terms t1 , . . . , tn to the term 1 (f )(t1 , . . . , tn ) if 1 (f ) is a functor of
the object-language;
(ii ) the terms t1 , . . . , tn to the atom 1 (f )(t1 , . . . , tn ) if 1 (f ) is a predicate
letter of the object-language;
(iii ) the formulas f1 , . . . , fn to the formula 1 (f )(f1 , . . . , fn ) if 1 (f ) is a
connective of the object-language.
Example 8.1 Take as object-language a language with an alphabet consisting of the
constants a and b, the predicate letters p/1 and q/2, the connectives and and an
infinite but enumerable set of variables including X.
Now assume that the meta-language contains the constants a, b and x and the
functors p/1, q/2, and/2 and if /2 with the obvious intended interpretation. Then the
meaning of the meta-language term:
if (p(x), and(q(x, a), p(b)))
is the object-language formula:
p(X) q(X, a) p(b)
It should be noted that the discussion above avoids some important considerations. In
particular, the interpretation of meta-language functors consists of partial, not total,
functions. For instance, nothing said about the meaning of ill-formed terms such
as:
if (p(and(a, b)), q(if (a, b)))
Predicate logic requires that functors are interpreted as total functions and formally
such terms must also have some kind of meaning. There are different methods to deal
with the problem. However, they are not discussed here.
The coding of object-language expressions given above is of course only one possibility. In fact, in what follows we will not commit ourselves to any particular representation of the object-language. Instead A will be used to denote some particular
representation of the object-language construction A. This makes it possible to present
the idea without discussing technical details of a particular representation.
pq
138
It is now possible to describe relations between terms and formulas of the objectlanguage in the meta-language. In particular, our intention is to describe SLDresolution and SLD-derivations. The first relation considered is that between consecutive goals, Gi and Gi+1 (i 0), in an SLD-derivation:
G0
C0
G1 Gi
Ci
Gi+1
The relationship between two such goals can be expressed through the following inference rule discussed in Chapter 3:
A1 , . . . , Ai1 , Ai , Ai+1 , . . . , An
B0 B1 , . . . , Bm
(A1 , . . . , Ai1 , B1 , . . . , Bm , Ai+1 , . . . , An )
where is the mgu of the two atoms Ai and B0 and where B0 B1 , . . . , Bm is a
renamed clause from the program. The relation between the two goals in the rule can
be formulated as the following definite clause:
Example 8.2
step(Goal, NewGoal )
select(Goal, Left, Selected , Right),
clause(C),
rename(C, Goal, Head , Body),
unify(Head , Selected, Mgu),
combine(Left, Body, Right, T mpGoal),
apply(Mgu, T mpGoal, NewGoal).
139
Some alternative approaches for representing the object-level program have been suggested in the literature. The most general approach is to explicitly carry the program
around using an extra argument. Here a more pragmatic approach is employed where
each clause C of the object-program is stored as a fact, clause( C ), of the metalanguage. For instance, clause/1 may consist of the following four facts:
pq
Example 8.3
clause(
clause(
clause(
clause(
The task of completing select/4 and the other undefined relations in Example 8.2 is
left as an exercise for the reader.
The relation derivation /2 between two goals G0 and Gi of an SLD-derivation (i.e. if
there is a derivation whose initial goal is G0 and final goal is Gi ) can be described as the
reflexive and transitive closure of the inference rule above. Thus, an SLD-derivation
can be described by means of the following two clauses:
Example 8.4
derivation(G, G).
derivation(G0, G2)
step(G0, G1),
derivation(G1, G2).
If all undefined relations were properly defined it would be possible to give the goal
clause:
q p2q).
derivation( grandparent(adam, X) ,
pq
(where 2 denotes the coding of the empty goal). This corresponds to the query
Is there a derivation from the object-language goal grandparent(adam, X) to the
empty goal?. The meta-language goal is reduced to:
p2q).
The leftmost subgoal is then satisfied with G bound to the representation of the
object-language goal parent(adam, Y ), parent(Y, X) yielding:
q p2q).
p2q, p2q).
derivation(
p2q).
140
is obtained. This unifies with the fact of derivation/2 and Prolog produces the answer
yes. Note that the answer obtained to the initial goal is only yes since the goal
contains no variables (only object-language variables which are represented as ground
terms in the meta-language). The modified version of the program which also returns
a substitution may look as follows:
Example 8.5
pq
derivation(G, G, ).
derivation(G0, G2, S0)
step(G0, G1, Mgu),
derivation(G1, G2, S1),
compose(Mgu, S1, S0).
step(Goal, NewGoal , Mgu)
select(Goal, Left, Selected , Right),
clause(C),
rename(C, Goal, Head , Body),
unify(Head , Selected, Mgu),
combine(Left, Body, Right, T mpGoal),
apply(Mgu, T mpGoal, NewGoal).
Now what is the point in having self-interpreters? Surely it must be better to let an
interpreter run the object-language directly, instead of letting the interpreter run a
self-interpreter which runs the object-program? The answer is that self-interpreters
provide great flexibility for modifying the behaviour of the logical machinery. With a
self-interpreter it is possible to write:
interpreters which employ alternative search strategies for instance, to avoid
using Prologs depth-first search, an interpreter which uses a breadth-first strategy may be written in Prolog and run on the underlying machine which uses
depth-first search;
debugging facilities for instance, interpreters which emit traces or collect runtime statistics while running the program;
interpreters which allow execution of a program which changes during its own
execution desirable in many A.I. applications or in the case of database updates;
interpreters which collect the actual proof of a satisfied goal something which
is of utmost importance in expert-systems applications (see the next chapter);
interpreters for nonstandard logics or logic-like languages this includes
fuzzy logic, nonmonotonic logic, modal logic, context-free grammars and Definite Clause Grammars (see Chapter 10).
Applications like compilers and language specific editors have already been mentioned.
Furthermore, meta-circular interpreters play a very important role in the area of program transformation, verification and synthesis topics which are outside the scope
of this book.
8.3
141
Nonground Representation
Although the interpreters in the previous section are relatively clear and concise, they
suffer severely from efficiency problems. The inefficiency is mainly due to the representation of object-language variables by constants in the meta-language. As a
consequence, rather complicated definitions of renaming, unification and application
of substitutions to terms/formulas are needed. In this section a less logical and more
pragmatic approach is employed resulting in an extremely short interpreter. The idea
is to represent object-language variables by meta-language variables the whole approach seems straightforward at first sight, but it has severe semantical consequences
some of which are raised below.
In addition to representing variables of the object-language by variables of the
meta-language, an object-language clause of the form:
A0 A1 , . . . , An
will be represented in the meta-language by the term:2
A0 if A1 and . . . and An
A0 if true
when n 1
when n = 0
142
The subgoal obviously unifies only with the head of the third clause in Example 8.7.
The goal thus reduces to the new goal:
clause(parent(adam, bill) if Y0 ), solve(Y0 ).
Now the leftmost subgoal unifies with the second clause of Example 8.6, resulting in
the new goal:
solve(father (adam, bill)).
This means that the unification of the object-language atom parent(adam, bill) and
the head of the object-language clause parent(X, Y ) father (X, Y ) is performed automatically on the meta-level. There is no need to provide a definition of unification
of object-language formulas as was needed in Example 8.2.
The same effect is achieved when dealing with renaming of variables in objectlanguage clauses. Consider the goal:
solve(parent(X, bill)).
This reduces to the new goal:
clause(parent(X, bill) if Y0 ), solve(Y0 ).
Note that the goal and the second clause of Example 8.6 both contain the variable
X. However, the variables of the rule are automatically renamed on the meta-level so
that the next goal becomes:
solve(father (X, bill)).
Finally, application of a substitution to a goal is considered. The goal:
clause(father(adam, X) and father (X, Y )).
which represents the object-language goal father (adam, X), father (X, Y ) is resolved
with the second clause of Example 8.7 and the goal:
solve(father (adam, X)), solve(father (X, Y ))
is obtained. This goal is resolved with the third clause of Example 8.7 yielding:
clause(father (adam, X) if Y1 ), solve(Y1 ), solve(father (X, Y )).
Now the leftmost subgoal unifies with the clause:
clause(father (adam, bill) if true).
and the mgu {X/bill, Y1/true} is obtained. This substitution is used to construct the
new goal:
solve(true), solve(father (bill, Y )).
143
Note that the mgu obtained in this step contains the object-language substitution
{X/bill} and that there is no need to apply it explicitly to the subgoal father (X, Y )
as was the case in the previous section.
Hence, by using the interpreter in Example 8.7 instead of that in the previous
section, three of the most laborious operations (unification, renaming and application)
are no longer explicitly needed. They are of course still performed but they now take
place on the meta-level.
Yet another advantage of the interpreter in Example 8.7 is that there is no need
to explicitly handle substitutions of the object program. By giving the goal:
solve(grandparent(adam, X)).
Prolog gives the answer X = cathy since the object-language variable X is now represented as a meta-language variable. In the previous section object-language variables
were represented by ground terms and to produce a computed answer substitution it
was necessary to explicitly represent such substitutions.
Although the program in Example 8.7 works quite nicely, its declarative reading is
far from clear. Its simplicity is due to the representation of object-language variables as
meta-language variables. But this also introduces problems as pointed out by Hill and
Lloyd (1988a). Namely, the variables in solve/1 and in clause/1 range over different
domains the variables in solve/1 range over formulas of the object-language whereas
the variables in clause/1 range over individuals of the intended interpretation of the
object-language program (intuitively the persons Adam, Bill and Cathy and possibly
some others). The problem can, to some extent, be solved by using a typed language
instead of standard predicate logic. However, this discussion is outside the scope of
this book.
The interpreter in Example 8.7 can be used for, what is sometimes called, pure
Prolog. This means that the object-program and goal are not allowed to contain
constructs like negation. However, the interpreter may easily be extended to also take
proper care of negation by including the rule:
solve(not X) not solve(X).
Similar rules can be added for most built-in predicates of Prolog. One exception is
cut (!), which is difficult to incorporate into the self-interpreter above. However, with
some effort it can be done (see e.g. OKeefe (1990)).
8.4
pq
pq
144
following inference rule (assuming that Prologs computation rule is used and that
t1 and t2 are terms):
clause(t1 , t2 ), A2 , . . . , Am
B0 B1 , . . . , Bn
(A2 , . . . , Am )
where B0 B1 , . . . , Bn is a (renamed) program clause and is an mgu of clause(t1 , t2 )
and clause(B0 , (B1 , . . . , Bn )). Here comma is treated as a binary functor which is
right-associative. That is, the expression (a, b, c) is the same term as ,(a, ,(b, c)).
For uniformity, a fact A, is treated as a rule of the form A true.
Note that there may be more than one clause which unifies with the arguments of
clause(t1 , t2 ). Hence, there may be several possible derivations. For instance, consider
the program:
father (X, Y ) parent(X, Y ), male(X).
father (adam, bill).
In case of the goal clause(father(X, Y ), Z) Prolog replies with two answers. The
first answer binds X to X0 , Y to Y0 and Z bound to (parent(X0 , Y0 ), male(X0 )). The
second answer binds X to adam, Y to bill and Z to true.
By using clause/2 it is possible to re-write Examples 8.6 and 8.7 as follows:
solve(true).
solve((X, Y )) solve(X), solve(Y ).
solve(X) clause(X, Y ), solve(Y ).
grandparent(X, Z) parent(X, Y ), parent(Y, Z).
..
.
Note that it is no longer possible to distinguish the meta-language from the the object
language.
The use of clause/2 is normally restricted in that the first argument of clause/2
must not be a variable at the time when the subgoal is selected. This is, for instance,
stipulated in the ISO Prolog standard. Thus, the goal solve(X) results in a run-time
error in most Prolog systems.
8.5
The Prolog standard also provides some built-in predicates that are used to modify the
program during execution of a goal. For instance, the built-in predicates asserta/1
and assertz /1 are used to dynamically add new clauses to the program. The only
difference between the two is that asserta/1 adds its argument textually first in the
definition of a predicate whereas assertz /1 adds it argument textually at the end.
We use assert/1 to stand for either of the two. From a proof-theoretic point of view
the logical meaning of assert/1 can be described as follows (assuming that t is not a
variable and that Prologs computation rule is used):
assert(t), A2 , . . . , An
A2 , . . . , An
145
In other words, assert/1 can be interpreted as something which is always true when
selected. However, the main effect of assert/1 is the addition of t to the database of
clauses. Of course, t should be a well-formed clause not to cause a run-time error.3
Consider the trivial program:
parent(adam, bill).
Presented with the goal:
assertz (parent(adam, beth)), parent(adam, X).
Prolog replies with two answers X = bill and X = beth. Prolog first adds the
clause parent(adam, beth) to the program database and then tries to satisfy the second
subgoal which now has two solutions. Changes made to Prologs database by assert/1
are permanent. That is, they are not undone on backtracking. Moreover, it is possible
to assert the same clause several times.
Unfortunately, the effect of using assert /1 is not always very clear. For instance,
if the order among the subgoals in the previous goal is changed into:
parent(adam, X), assertz (parent(adam, beth)).
some Prolog systems would return the single answer X = bill, since when the call to
parent/2 is made, Prolog records that its definition contains only one clause. Thus,
when backtracking takes place the new clause added to the definition of parent/2
remains invisible to the call. This is in accordance with the ISO Prolog standard
(1995). However, some (old) Prolog systems would return infinitely many answers.
First X = bill, and thereafter an infinite repetition of the answer X = beth. This
happens if the implementation does not freeze the definition of a predicate when a
call is made to the predicate. Every time a solution is found to the leftmost subgoal
a new copy of the clause parent(adam, beth) is added to the definition of parent/2.
Hence, there will always be one more clause for the leftmost subgoal to backtrack to.
A similar problem occurs in connection with the clause:
void assertz (void), fail .
In some Prolog implementations the goal void would succeed, whereas in others it
would fail. However, in both cases the resulting program is:
void assertz (void), fail .
void.
This suggests that assert/1 should be used with great care. Just like cut, assert/1 is
often abused in misguided attempts to improve the efficiency of programs. However,
there are cases when usage of assert/1 can be motivated. For instance, if a subgoal
is solved, the result can be stored in the database as a lemma. Afterwards the same
subgoal can be solved in a single derivation step. This kind of usage does not cause
any declarative problems since the lemma does not add to, or delete information from
the program.
3 The reason for quoting the word clause is that the argument of assert /1 formally is a term.
However, in most Prolog systems clauses are handled just as if they were terms. That is, the logical
connectives and , are allowed to be used also as functors.
146
8.6
The built-in predicate retract/1 is used to delete clauses dynamically from Prologs
database during the execution of a goal. The logical meaning of retract/1 is similar
to that of clause/2. It can be described by the inference rule:
retract((s t)), A2 , . . . , Am
B0 B1 , . . . , Bn
(A2 , . . . , Am )
where B0 B1 , . . . , Bn is a renamed program clause such that s t and B0
B1 , . . . , Bn have an mgu . Like the case with clause/2 there may be more than
one clause which unifies with (s t). Hence, several derivations are possible. For
uniformity, and by analogy to clause/2, a fact may be treated as a rule whose body
consists of the literal true.
As a side-effect retract/1 removes the clause B0 B1 , . . . , Bn from Prologs internal database. The effect is permanent that is, the clause is not restored when
backtracking takes place. For instance, consider the Prolog program:
parent(adam, bill).
parent(adam, beth).
parent(bill, cathy).
In reply to the goal:
retract(parent(adam, X) true).
Prolog replies with two answers X = bill and X = beth. Then execution terminates
and all that is left of the program is the clause:
parent(bill, cathy).
In most Prolog implementations (and according to the ISO standard) it is required
that the argument of retract/1 is not a variable and if it is of the form s t that s
is not a variable.
Like assert/1, usage of retract/1 is controversial and the effect of using it may
diverge in different implementations. In general there are both cleaner and more
efficient methods for solving problems than resorting to these two. For example,
naive users of Prolog often use assert/1 and retract/1 to implement a form of global
variables. This usually has two effects the program becomes harder to understand
and it runs slower since asserting new clauses to the program involve considerable
amount of work and book-keeping. This often comes as a big surprise to people who
are used to programming in imperative programming languages.
Exercises
8.1 Complete the self-interpreter described in Examples 8.2 8.4. Either by using the suggested representation of the object-language or invent your own
representation.
8.2 Extend Example 8.7 so that execution is aborted when the number of resolutionsteps for solving a subgoal becomes too large.
Exercises
147
x
=1
x
xn
= n xn1
x
(f + g)
f
g
=
+
x
x x
(f g)
f
g
=g
+f
x
x
x
::=
::=
::=
::=
::=
x | y | z | ...
0 | 1 | 2 | ...
true | false | E > E | . . .
I | N | E + E | E E | E E | ...
skip | assign(I, E) | if (B, C, C) | while(B, C) | seq(C, C)
148
Chapter 9
Logic and Expert Systems
9.1
Expert Systems
Roughly speaking, an expert system is a program that guides the user in the solution
of some problem which normally requires intervention of a human expert in the field.
Tasks which typically call for expert level knowledge include, for instance, diagnosis,
control and planning. Diagnosis means trying to find the cause of some malfunction,
e.g. the cause of an illness. In control-applications the aim is to prevent a system,
such as an industrial process, from entering abnormal states. Planning, finally, means
trying to find a sequence of state transitions ending in a specified final state via a
sequence of intermediate states given an initial one. A typical problem consists in
finding a plan which assembles a collection of parts into a final product. This chapter
illustrates the applicability of logic programming for expert systems and meta-level
reasoning by a diagnosis example.
Usually an expert system exhibits a number of characteristics:
It is divided into an inference engine and a knowledge-base. The knowledge-base
contains rules which describe general knowledge about some problem domain.
The inference engine is used to infer knowledge from the knowledge-base. Usually, the inference machine is generic in the sense that one can easily plug in a
new knowledge-base without any major changes to the inference machine.
It may contain rules which are subject to some uncertainty.
The system often runs on modern workstations and much effort is put into the
user interface and the dialogue with the user.
It has the capability not only to infer new knowledge from existing knowledge,
but also to explain how/why some conclusion was reached.
It has support for incremental knowledge acquisition.
149
150
It is easy to see that the first point above coincides with the objectives of logic programming namely to separate the logic component (what the problem is) from the
control (how the problem should be solved). This can be expressed by the equation:
Algorithm = Logic + Control
That is, Kowalskis well-known paraphrase of Wirths doctrine Program = Algorithm
+ Data Structure. In the spirit of Kowalski we could write:
Expert System = Knowledge-base + Control + User Interface
The last two terms are commonly called an expert-system shell.
The knowledge-base of an expert system typically consists of a set of so called
production rules (or simply rules). Like definite clauses, they have a set of premises
and a conclusion. Such rules say that whenever all the premises hold the conclusion
also holds. A typical rule found in one of the earliest expert systems called MYCIN
may look as follows:
IF
AND
AND
THEN
the
the
the
the
It is not very hard to express approximately the same knowledge in the form of a
definite clause:
identity of organism(staphylococcus)
stain of organism(gram positive),
morphology of organism(coccus),
growth conformation of organism(clumps).
The figure (0.7) given in the conclusion of the MYCIN-rule above is an example of
uncertainty of the rule. It says that if the premises hold then the conclusion holds
with probability 0.7. In the following we do not consider these figures of uncertainty
but assume that they are always 1.0.
We consider an application which involves diagnosing starting problems of cars.
The following two propositions seem to express general knowledge describing the cause
of malfunctioning devices:
if Y is a necessary component for X and Y is malfunctioning then X is also
malfunctioning;
if X exhibits a fault-symptom Z then either X is malfunctioning or there exists
another malfunctioning component which is necessary for X.
In predicate logic this may be expressed as follows:
X(Y (needs(X, Y ) malfunctions(Y )) malfunctions(X))
X, Z(symptom(Z, X) (malfunctions(X) Y (needs(X, Y ) malfunctions(Y ))))
The first of these readily transforms into the definite clause:
151
car
fuel
system
fuel
pump
fuel
ignition
system
starting
motor
electric
system
sparking
plugs
fuse
battery
152
Finally the predicate symptom/2 which describes the symptoms of a car (or rather
parts of the car) should be defined. However, the symptoms exhibited by a specific
car depend on the particular car in a specific moment of time. The description of the
symptoms of the car should therefore be added to the database when diagnosing the
cause of malfunction of that particular car. How to cope with this is described below.
As shown above, the knowledge-base of an expert system can be described as a set of
definite or general clauses. What about the inference engine?
The inference engine is used to infer new knowledge from existing knowledge. This
can be done by using two different strategies (1) either start from what is already
known and infer new knowledge from this, or (2) start from the conclusion to be
proved and reason backwards until the conclusion depends on what is already known.
These methods are called forward- and backward-chaining respectively. Clearly, SLDresolution is an example of a backward-chaining proof procedure. There are expert
systems which rely on forward-chaining or a mixture of the two, but there are also
expert systems which use backward-chaining only. MYCIN is an example of such an
expert system.
We have established the close relationship between, on the one hand, the knowledgebase of an expert system and the set of clauses in logic programming and, on the other
hand, the inference engines used in some expert systems and SLD-resolution. So what
is the main difference between expert systems and logic programming?
Apart from the probabilities of rules and the user interface, an expert system differs
from a logic program in the sense that its knowledge-base is usually incomplete. As
explained above, the knowledge-base only contains general knowledge concerning different faults and symptoms. It does not contain information about the specific symptoms of a particular individual. This information has to be added to its knowledge-base
whilst diagnosing the individual. That is, while inferring what fault the individual is
suffering from, the inference engine asks questions which have to be filled in, in order
to complete the knowledge-base. Thus, given a general description P of the world and
a symptom or an observation F one can say that the aim of the expert system is to
find a cause such that P ` F . This problem is commonly known under the
name abduction.
Another major distinction between logic programming and expert systems is that
expert systems have the capability to explain their conclusions. If an expert system
draws a conclusion concerning the health of a patient it is likely that the doctor (or
153
the patient) wants to know how the system came to that conclusion. Most Prolog
systems are not automatically equipped with such a mechanism.
So clearly the knowledge-base may be described as a Prolog program but the
Prolog inference engine does not satisfy the requirement needed in an expert system.
In order to remedy this we are going to build a new inference engine based on the
self-interpreter in Example 8.7 to provide these missing features.
9.2
Collecting Proofs
The first refinement made to the program in Example 8.7 is to add the capability of
collecting the proof representing the refutation of a goal. As described in Section 3.3
a refutation may be represented as a proof- or derivation-tree. Referring to Example
8.7 we see that there are three types of goals:
the empty goal (represented by the constant true);
compound goals of the form X and Y ;
goals consisting of a single literal.
Now in the case of the goal true we can simply return the term void which represents an empty proof. Furthermore, under the assumption that X has a proof P x
and that Y has a proof P y, the term P x & P y will represent a proof of the goal
represented by X and Y . Finally, the single literal X has a proof represented by the
term proof (X, P y) if there is a clause instance X if Y and Y has a proof represented
by P y. It is straightforward to convert this into the following definite program:
Example 9.1
solve(true, void).
solve((X and Y ), (P x & P y)) solve(X, P x), solve(Y, P y).
solve(X, proof (X, P y)) clause(X if Y ), solve(Y, P y).
Given the goal solve(grandparent(X, Y ), Z) and the database:
clause(grandparent(X, Y ) if parent(X, Z) and parent(Z, Y )).
clause(parent(X, Y ) if f ather(X, Y )).
clause(f ather(adam, bill) if true).
clause(f ather(bill, carl) if true).
Prolog not only finds a refutation and produces the answer X = adam, Y = carl but
also returns the term:
Z = proof (grandparent(adam, carl),
proof (parent(adam, bill),
proof (father (adam, bill), void))
&
proof (parent(bill, carl),
proof (f ather(bill, carl), void))
)
154
9.3
Query-the-user
and subsequent examples require the use of input and output. The Prolog standard provides
several built-in predicates. Thus, write/1 outputs a term on the current output stream. Similarly
read/1 inputs a term from the current input stream (a call succeeds if the term unifies with the
argument of the call). nl/0 outputs a newline character and tab/1 a specified number of blanks on
the current output stream. Strings of characters enclosed by single quotes are taken to be constants.
155
9.4
156
157
confirm(X, Y )
known(X, Y, true).
confirm(X, Y )
not known(X, Y, Z), nl, ask(X, Y ),
read(A), remember(X, Y, A), A = yes.
remember(X, Y, yes)
assertz(known(X, Y, true)).
remember(X, Y, no)
assertz(known(X, Y, f alse)).
Note that the second clause is an example of unsafe use of negation. Given a selected
subgoal confirm(a, b), the first clause is used (and the subgoal is solved) if the question
triggered by a and b was previously confirmed by the user (that is, if confirm(a, b, true)
is solved); the second clause is used if the question triggered by a and b was never
posed before. This will be the effect since the selected subgoal in the next goal will
be the negative literal not known(a, b, Z) which succeeds if there is no Z such that
known(a, b, Z). If neither of these two clauses apply (that is, if the question triggered
by a and b has been posed but denied) the call to confirm/2 fails.
When calling the program with the goal:
solve(malfunctions(car), X).
the system first prints the query:
Is the battery voltage less than 11 volts ?
If the user answers no the system asks:
Is the starting motor silent?
Under the assumption that the user replies no, the next question posed by the
system is:
Do any of the sparking plugs fail to produce a spark?
If the reply to this question is yes the computation stops with the (rather awkward)
answer:
X = proof (malfunctions(car),
proof (needs(car, ignition system), void)
&
proof (malfunctions(ignition system),
proof (needs(ignition system, sparking plugs), void)
&
proof (malfunctions(sparking plugs),
proof (symptom(worn out, sparking plugs), void)
&
proof (not indirect(sparking plugs), void)
)
)
)
158
Needless to say the answer is rather difficult to overview and there is need for routines
that display the proof in a readable form. Some alternative approaches are possible,
for instance, by printing the proof as a tree. However such a program would require
rather complicated graphics routines. Instead a rather crude approach is employed
where the rule-instances that the proof consists of are printed. The top-loop of the
printing routine looks as follows:
expert
abolish(known/3),
solve(malfunctions(car), X),
print proof (X).
where abolish/1 is a built-in predicate which removes all clauses whose heads have the
same predicate symbol and arity as the argument. When faced with the goal expert
the following dialogue may appear (with user input in bold-face):
159
In conclusion, the complete listing of this tiny expert-system shell and the particular
knowledge-base for diagnosing starting problems of cars is depicted below. (Lines
preceded by the symbol % are comments.)
160
% Queries
ask(worn out, sparking plugs)
write(Do any of the sparking plugs fail to produce a spark?).
ask(out of, fuel )
write(Does the fuel gauge indicate an empty tank?).
ask(broken, fuel pump)
write(Does the fuel pump fail to feed any fuel?).
ask(broken, fuse)
write(Is fuse number 13 broken?).
ask(discharged, battery)
write(Is the battery voltage less than 11 volts?).
ask(broken, starting motor)
write(Is the starting motor silent?).
% Knowledge-base
malfunctions(X) if needs(X, Y ) and malfunctions(Y ).
malfunctions(X) if symptom(Y, X) and not indirect(X).
indirect(X) if needs(X, Y ) and malfunctions(Y ).
needs(car, ignition system) if true.
needs(car, fuel system) if true.
needs(car, electric system) if true.
needs(ignition system, starting motor) if true.
needs(ignition system, sparking plugs) if true.
needs(electric system, fuse) if true.
needs(electric system, battery) if true.
needs(fuel system, fuel pump) if true.
needs(sparking plugs, battery) if true.
needs(starting motor, battery) if true.
needs(fuel pump, fuel) if true.
Exercises
161
% Explanations
print proof (void).
print proof (X & Y )
print proof (X), nl, print proof (Y ).
print proof (proof (X, void))
write(X), nl.
print proof (proof (X, Y ))
Y 6= void, write(X), write( BECAUSE), nl,
print children(Y ), nl, print proof (Y ).
print children(proof (X, Y ) & Z)
tab(8), write(X), write( AND), nl, print children(Z).
print children(proof (X, Y ))
tab(8), write(X), nl.
Exercises
9.1 Improve the printing of the proof. For instance, instead of printing the whole
proof at once the system may print the top of the proof and then let the
user decide which branch to explain further. Another possibility is the use of
natural language. Thus a possible interaction may look as follows:
The car malfunctions BECAUSE
(1) the car needs the ignition-system AND
(2) the ignition-system malfunctions
Explore? 2.
The ignition-system malfunctions BECAUSE
(1) the ignition-system needs the sparking-plugs AND
(2) the sparking-plugs malfunction
Explore?
9.2 Write an inference engine which exploits probabilities of rules so that it becomes possible to draw conclusions together with some measurement of their
belief. (See Shapiro (1983b).)
9.3 Extend the shell so that the user may give the query why? in reply to the
systems questions. In such cases the system should explain the conclusions
possible if the user gives a particular answer to the query.
162
Chapter 10
Logic and Grammars
10.1
Context-free Grammars
This rule states that a string is a statement if it begins with the symbol if followed
in turn by; a string which is a condition, the symbol then and finally a string which
163
164
is a statement. A CFG may contain several production rules with the same left-hand
side.
Now let , and be arbitrary strings from the set (N T ) . We say that the
string is directly derivable from A iff A P . The relation is denoted by
A .
Let be the reflexive and transitive closure of the relation and let ,
hnoun-phrasei hverb-phrasei
the hnouni
runs
engine
rabbit
For instance, hsentencei derives the string the rabbit runs since:
hsentencei
hnoun-phrasei hverb-phrasei
the hnouni hverb-phrasei
the rabbit hverb-phrasei
the rabbit runs
165
hsentencei
,@
,
, @@
hnoun phrasei hverb phrasei
,@
,
, @@
the
hnouni
runs
rabbit
Figure 10.1: Derivation tree for CFG
By describing the two relations and it is possible to construct an interpreter for context-free grammars, which behaves as a parser that recognizes strings
defined by the grammar. To do this, terminals and nonterminals will be represented
by constants, strings will be represented by lists and each production rule will be
represented by the clause:
prod rule(X, Y ).
where X and Y represent the left- and right-sides of the rule.
Example 10.3 The CFG in Example 10.1 may be represented by the definite program:
prod
prod
prod
prod
prod
166
Presented with the goal derives([sentence], X) Prolog succeeds with all possible
(non-)terminal strings which may be derived from hsentencei including the two terminal strings X = [the, rabbit, runs] and X = [the, engine, runs].
As shown in the next section there are more efficient ways of describing context-free
languages than the program in Example 10.3. However, the program works as long as
the grammar is not left-recursive and it has the following interesting properties:
The program is quite general to describe another context-free language it
suffices to rewrite the definition of prod rule/1. The rest of the program may
be used for any context-free grammar.
When comparing Example 10.3 and Examples 8.2 8.4 one realizes that the
programs are very similar. Both definitions of step/2 describe a relation between
two expressions where the second is obtained by rewriting the first expression
using some kind of rule. The relations derives/2 and derivation/2 are the
reflexive and transitive closures of the step-relations. Finally, prod rule/1
and clause/1 are used to represent rules of the formalisms.
The program operates either as a top-down or a bottom-up parser depending on
how the subgoals in the clauses are ordered. As presented in Example 10.3 it
behaves as a traditional recursive descent parser under Prologs computation
rule, but if the subgoals in derives/2 and step/2 are swapped the program
behaves as a (quite inefficient) bottom-up parser.
10.2
Logic Grammars
167
append([ ], X, X).
append([X|Y ], Z, [X|W ]) append(Y, Z, W ).
The program is able to refute goals like:
sentence([the, rabbit, runs]).
sentence([the, X, runs])
In reply to the second goal Prolog would give the answers X = rabbit and X = engine.
It is even possible to give the goal:
sentence(X).
In this case Prolog returns all (i.e. both) sentences of the language before going into
an infinite loop (incidentally, this loop can be avoided by moving the call to append/3
to the very end of the first clause).
Unfortunately the program in Example 10.4 is also rather inefficient. The append/3
procedure will blindly generate all partitions of the list and it may take some time to
find the correct splitting (at least in the case when the list is very long). To remedy
this problem the concept of difference lists may be used.
Using difference lists the first clause of Example 10.4 can be written as:
sentence(X0 X2 ) noun phrase(X0 X1 ), verb phrase(X1 X2 ).
Declaratively it reads The difference between X0 and X2 is a sentence if the
difference between X0 and X1 is a noun-phrase and the difference between X1 and X2
is a verb-phrase. The statement is evidently true consider the string:
x1 . . . xi xi+1 . . . xj xj+1 . . . xk
| {z }
|
|
{z
{z
X1
X2
}
}
X0
If the difference between X1 and X2 (that is, the string xi+1 . . . xj ) is a verb-phrase
and the difference between X0 and X1 (the string x1 . . . xi ) is a noun-phrase then the
string x1 . . . xi xi+1 . . . xj (that is the difference between X0 and X2 ) is a sentence.
Using this approach, Example 10.4 can be reformulated as follows:
Example 10.5
sentence(X0 X2 ) noun phrase(X0 X1 ), verb phrase(X1 X2 ).
noun phrase(X0 X2 ) connects(X0 , the, X1 ), noun(X1 X2 ).
verb phrase(X0 X1 ) connects(X0 , runs, X1 ).
noun(X0 X1 ) connects(X0 , engine, X1).
noun(X0 X1 ) connects(X0 , rabbits, X1 ).
connects([X|Y ], X, Y ).
168
A0 A1 , . . . , Ai1 , Ai , Ai+1 , . . . , An
and let:
B0 B1 , . . . , Bm
be a clause whose head unifies with Ai (with the mgu ). Then C may be replaced by the new clause:
(A0 A1 , . . . , Ai1 , B1 , . . . , Bm , Ai+1 , . . . , An )
It is easy to prove that this transformation does not add to the set of formulas which follow logically
from the program. That is, the transformation is sound. Under certain restrictions one can also
prove that the technique is complete in the sense that the set of all logical consequences of the old
program is exactly the same as the set of logical consequences of the new program.
169
10.3
Context-dependent Languages
Although context-free grammars are often used to specify the syntax of programming
languages they have many limitations. It is well-known that the class of context-free
languages is restricted. Even a simple language such as an bn cn where n {0, 1, 2, . . .}
(i.e. all strings which are built from equal number of as, bs and cs) cannot be defined
by a context-free grammar. Consider the grammar:
habci
hai
hai
hbi
hbi
hci
hci
The language of habci certainly contains the language an bn cn but also other strings
like a b b c c c. To describe languages like an bn cn more powerful formalisms are
needed. For instance, the property of being a string in the language an bn cn is described by the following definite program:
Example 10.7
abc(X0 X3 ) a(N, X0 X1 ), b(N, X1 X2 ), c(N, X2 X3 ).
a(0, X0 X0 ).
a(s(N ), [a|X1 ] X2 ) a(N, X1 X2 ).
b(0, X0 X0 ).
b(s(N ), [b|X1 ] X2 ) b(N, X1 X2 ).
c(0, X0 X0 ).
c(s(N ), [c|X1 ] X2 ) c(N, X1 X2 ).
Here the first clause reads The string X0 X3 is a member of an bn cn if X0 X1 is
a string of N as and X1 X2 is a string of N bs and X2 X3 is a string of N cs.
The restriction to equal number of as, bs and cs is thus obtained through the extra
argument of the predicate symbols a/2, b/2 and c/2.
170
hnoun-phraseihverbi
hpronouni
the hnouni
rabbit
rabbits
it
they
runs
run
Unfortunately the language of hsentencei includes strings such as the rabbit run,
they runs and it run strings which should not be part of the language. Again,
this can be repaired reasonably easy by defining the language by means of a logic
program and by adding extra arguments to the predicate symbols corresponding to
nonterminals:
Example 10.8 Consider the following logic program:
sentence(X0 X2 ) noun phrase(Y, X0 X1 ), verb(Y, X1 X2 ).
noun phrase(Y, X0 X1 ) pronoun(Y, X0 X1 ).
noun phrase(Y, X0 X2 ) connects(X0 , the, X1 ), noun(Y, X1 X2 ).
noun(singular(3), X0 X1 ) connects(X0 , rabbit, X1 ).
noun(plural(3), X0 X1 ) connects(X0 , rabbits, X1 ).
pronoun(singular(3), X0 X1 ) connects(X0 , it, X1 ).
pronoun(plural(3), X0 X1 ) connects(X0 , they, X1 ).
verb(plural(Y ), X0 X1 ) connects(X0 , run, X1 ).
verb(singular(3), X0 X1 ) connects(X0 , runs, X1 ).
A goal clause of the form:
sentence([the, rabbits, runs] [ ]).
may be reduced to the compound goal:
noun phrase(Y, [the, rabbits, runs] X1 ), verb(Y, X1 [ ]).
The leftmost goal eventually succeeds with the bindings Y = plural(3) and X1 =
[runs] but the remaining subgoal fails:
verb(plural(3), [runs] [ ]).
Thus, the string is not a member in the language defined by the program.
The extra arguments added to some predicate symbols serve essentially two purposes
as demonstrated above, they can be used to propagate constraints between subgoals
corresponding to nonterminals of the grammar and they may also be used to construct
some alternative (structured) representation of the string being analysed. For instance,
as a parse-tree or some other form of intermediate code.
10.4
171
Many Prolog systems employ special syntax for language specifications. When such a
description is encountered, the system automatically compiles it into a Prolog program.
Such specifications are called Definite Clause Grammars (DCGs). There are two
possible views of such grammars either they are viewed as a syntactic sugar for
Prolog. That is, the grammar is seen as a convenient shorthand for a Prolog program.
Alternatively the notion of DCG is viewed as an independent formalism on its own.
This book adopts the latter view.
Assume that an alphabet similar to that in Chapter 1 is given. Then a DCG is a
triple hN , T , P i where:
N is a possibly infinite set of atoms;
T is a possibly infinite set of terms;
P N (N T ) is a finite set of (production) rules.
By analogy to CFGs N and T are assumed to be disjoint and are called nonterminals
and terminals respectively.
DCGs are generalizations of CFGs and it is therefore possible to generalize the
concept of direct derivability. Let , 0 , (N T ) and let p(t1 , . . . , tn ) P
(where variables are renamed so that no name clashes occur with variables in ). Then
0 is directly derivable from iff:
is of the form 1 p(s1 , . . . , sn )2 ;
p(t1 , . . . , tn ) and p(s1 , . . . , sn ) unify with mgu ;
0 is of the form (1 2 ).
Also the concept of derivation is a generalization of the CFG-counterpart. The
derivability-relation for DCGs is the reflexive and transitive closure of the directderivability-relation. A string of terminals T is in the language of A N iff
hA, i is in the derivability-relation.
Example 10.9 Consider the following DCG:
sentence(s(X, Y ))
np(john, singular(3))
np(they, plural(3))
vp(run, plural(X))
vp(runs, singular(3))
np(X, N ) vp(Y, N )
john
they
run
runs
172
sentence(X)
HH
np(X0 , N0 ) vp(Y0 , N0 )
john runs
HH
HH
they run
derivation in the first step X is bound to the term s(X0 , Y0 ). In the second step
X0 is bound to john and finally Y0 is bound to runs. Composition of the mgus yields
the answer X/s(john, runs) to the initial nonterminal.
However, the derivation in the example is not the only one that starts with the nonterminal sentence(X). For instance, in derivation step two, the second nonterminal
may be selected instead, and in the same step the third production rule may be used
instead of the second. It turns out that the choice of nonterminal is of no importance, but that the choice of production rule is. This is yet another similarity between
DCGs and logic programs. The choice of nonterminal corresponds to the selection of
subgoal. In fact, the collection of all derivations starting with a nonterminal under
a fixed computation rule can be depicted as an SLD-tree. For instance, all possible derivations originating from the nonterminal sentence(X) (where the leftmost
nonterminal is always selected) is depicted in Figure 10.2.
As discussed above many Prolog systems support usage of DCGs by automatically
translating them into Prolog programs. In order to discuss combining DCGs and
Prolog we need to settle some notational conventions for writing DCGs:
since Prolog systems cannot distinguish terms from atoms, terminals are enclosed
by list-brackets;
nonterminals are written as ordinary compound terms or constants except that
they are not allowed to use certain reserved symbols (e.g. /2) as principal functors;
the functor ,/2 (comma) separates terminals and nonterminals in the right-hand
side of rules;
the functor -->/2 separates the left- and right-hand sides of a production rule;
173
-->
-->
-->
-->
-->
-->
-->
-->
-->
In this example the occurrence of even(N ) in the first rule always derives the empty
string. In this respect it can be removed from the rule. However, the primary function
of this nonterminal is to constrain bindings of N to terms representing even numbers.
That is, it not only defines the language consisting solely of the empty string but
also defines a relation (in this case the property of being an even natural number).
To distinguish such nonterminals from those which derive nonempty strings they are
written within curly brackets, and the definition of the relation is written directly in
Prolog. Thus, in Prolog it is possible to write the rule:
abc --> a(N ), b(N ), c(N ), {even(N )}.
together with the definite program:
even(0).
even(s(s(N ))) even(N ).
replacing the first and the two final production rules of the previous DCG.
Now since calls to Prolog may be inserted into a DCG it is also possible to utilize
the built-in predicates of Prolog in a DCG.
Example 10.10 This idea is illustrated by the following example, which is a grammar
that recognizes arithmetic expressions but, more than that, also computes the value
of the expression:
174
-->
-->
-->
-->
-->
-->
-->
For instance, the last rule states that any string which consists of a single terminal
which is an integer is a factor with the same value as the terminal. Similarly, the
first rule states that any string which starts with a term of value Y followed by +
followed by an expression of value Z is an expression of value Y + Z.
As already discussed, when a DCG is loaded into a Prolog system it is usually compiled
into a Prolog program similar in style to those in Section 10.2. This transformation is
quite simple and it is discussed in the next section. Some implementations of Prolog
do not include this feature. Fortunately, it is not very hard to write an interpreter for
DCGs similar to the Prolog-interpreter in Example 8.7.
For this purpose, view a DCG-rule as a binary fact with predicate symbol -->/2
where the first and second arguments consist of the left- and right-side of the production rule. The relationship between strings of terminals/nonterminals and the
derivable terminal strings can then be defined as follows:
derives([ ], S S).
derives([X], [X|S] S).
derives({X}, S S)
call(X).
derives((X, Y ), S0 S2 )
derives(X, S0 S1 ), derives(Y, S1 S2 ).
derives(X, S0 S1 )
(X --> Y ), derives(Y, S0 S1 ).
The interpreter is surprisingly simple. Declaratively the clauses state the following:
the empty string derives itself. That is, the difference between S and S for any
S;
the second clause says that the terminal string [X] derives itself. That is, the
difference between [X|S] and S for any S;
a nonterminal X in curly brackets derives the empty string if the goal X has
a refutation;
if the string X derives the terminal string S0 S1 and the string Y derives the
terminal string S1 S2 then the string (X, Y ) (that is, Y appended to X) derives
the terminal string S0 S2 ;
if there is a rule (X --> Y ) such that Y derives the terminal string S0 S1 then
the nonterminal X derives the same terminal string.
175
For instance, in the presence of the DCG of Example 10.9 the goal:
derives(sentence(X), [john, runs] [ ]).
succeeds with answer X = s(john, runs). Similarly the grammar in Example 10.10
and the goal:
derives(expr(X), [2, +, 3, , 4] [ ]).
result in the answer X = 14.
10.5
The standard treatment of DCGs in most Prolog systems is to compile them directly
into Prolog clauses. Since each production rule translates into one clause, the transformation is relatively simple. The clause obtained as a result of the transformations
described below may differ slightly from what is obtained in some Prolog systems but
the principle is the same.
The general idea is the following consider a production rule of the form:
p(t1 , . . . , tn ) --> T1 , . . . , Tm
Assume that X0 , . . . , Xm are distinct variables which do not appear in the rule. Then
the production rule translates into the definite clause:
p(t1 , . . . , tn , X0 , Xm ) A1 , . . . , Am
where:
if Ti is of the form q(s1 , . . . , sj ), then Ai is q(s1 , . . . , sj , Xi1 , Xi );
if Ti is of the form [T ], then Ai is connects(Xi1 , T, Xi );2
.
if Ti is of the form {T }, then Ai is T, Xi1 = Xi ;
.
if Ti is of the form [ ], then Ai is Xi1 = Xi .
For instance, the first rule of Example 10.10 is transformed as follows:
expr(X) -->
expr(X, X0 , X4 )
term(Y ),
term(Y, X0 , X1 ),
[+],
connects(X1 , +, X2 ),
expr(Z),
expr(Z, X2 , X3 ),
.
{X is Y + Z}.
X is Y + Z, X3 = X4 .
Some simplifications can be made to the final result in particular, subgoals of the
.
form X = Y may be omitted if all occurrences of Y are replaced by the variable X.
This means that the result obtained above can be simplified into:
2 Many Prolog systems use instead a built-in predicate C(A, B, C) with the same semantics as
connects(A, B, C).
176
When all rules are translated in this way and the program is extended by the definition connects([X|Y ], X, Y ), the resulting program can be used to refute goals like
expr(X, [2, +, 3, , 4], [ ]), with the expected answer X = 14.
A CFG (which is a special case of a DCG) like the one in Example 10.1 translates
into the program of Example 10.5 except that arguments of the form X Y are split
into two arguments and that the names of the variables may differ.
Example 10.11 As a final example the translation of Example 10.9 results in the
following program:
sentence(s(X, Y ), X0 , X2 )
np(X, N, X0 , X1 ), vp(Y, N, X1 , X2 ).
np(john, singular(3), X0, X1 )
connects(X0 , john, X1 ).
np(they, plural(3), X0, X1 )
connects(X0 , they, X1 ).
vp(run, plural(X), X0 , X1 )
connects(X0 , run, X1 ).
vp(runs, singular(3), X0 , X1 )
connects(X0 , runs, X1 ).
connects([X|Y ], X, Y ).
Given the goal sentence(X, [john, runs], [ ]) Prolog replies with the answer X =
s(john, runs).
Exercises
10.1 Write a DCG which describes the language of strings of octal numbers. Extend
the grammar so that the decimal value of the string is returned. For instance,
the goal octal(X, [4, 6], [ ]) should succeed with X = 38.
10.2 Write a DCG which accepts strings in the language am bn cm dn , (n, m 0).
10.3 Consider the following CFG:
hbleati b haaai
haaai a
haaai a haaai
Describe the same language using DCG notation. Then compile the specification into a Prolog program and write an SLD-refutation which proves that
the string b a a is in the language of hbleati.
Exercises
177
|
hexpr i
|
|
hvar i
hnati
hopi
skip
hvar i := hexpr i
if hbool i then hcmnd i else hcmnd i fi
while hbool i do hcmnd i od
hcmnd i ; hcmnd i
hexpr i > hexpr i
...
hvar i
hnati
hexpr i hopi hexpr i
x | y | z | ...
0 | 1 | 2 | ...
+ | | | ...
Hint: Most Prolog systems permit using the syntax prolog as an alternative
for the list of ASCII-characters [112, 114, 111, 108, 111, 103].
178
Chapter 11
Searching in a State-space
11.1
s1 , s1
s2 , s2
s3 , sn1
sn
such that sn G (i.e. to determine if hs0 , sn i is in the transitive and reflexive closure,
, of ). More informally the states can be seen as nodes in a graph whose edges
represent the pairs in the transition-relation. Then the problem reduces to that of
finding a path from the start-state to one of the goal-states.
Example 6.7 embodies an instance of such a problem the state-space consisted
of a finite set of states named by a, b, c, d, e, f and g. The predicate symbol edge/2
was used to describe the transition relation and path/2 described the transitive and
reflexive closure of the transition relation. Hence, the existence of a path from, for
instance, the state a to e is checked by giving the goal path(a, e). Now this is by
no means the only example of such a problem. The following ones are all examples of
similar problems:
Planning amounts to finding a sequence of worlds where the initial world is
transformed into some desired final world. For instance, the initial world may
consist of a robot and some parts. The objective is to find a world where the
parts are assembled in some desirable way. Here the description of the world is
a state and the transformations which transform one world to another can be
seen as a transition relation.
The derivation of a string of terminals from a nonterminal A can also be viewed
179
180
Also SLD-derivations may be formulated in this way the states are goals and
the transition relation consists of the SLD-resolution principle which produces
a goal Gi+1 out of another goal Gi and some program clause Ci . In most cases
the start-state is the initial goal and the goal-state is the empty goal.
Consider the following two clauses of Example 6.7 again:
path(X, X).
path(X, Z) edge(X, Y ), path(Y, Z).
Operationally the second clause reads as follows provided that Prologs computation
rule is employed To find a path from X to Z, first find an edge from X to Y
and then find a path from Y to Z. That is, first try to find a node adjacent to the
start-state, and then try to find a path from the new node to the goal-state. In other
words, the search proceeds in a forward direction from the start-state to the goalstate. However, it is easy to modify the program to search in the opposite direction
assuming that Prologs computation rule is used simply rewrite the second clause
as:
path(X, Z) edge(Y, Z), path(X, Y ).
The decision whether to search in a forward or backward direction depends on what
the search space looks like. Such considerations will not be discussed here, but the
reader is referred to the AI-literature
The path/2-program above does not work without modifications if there is more
than one goal-state. For instance, if both f and g are goal-states one has to give two
goals. An alternative solution is to extend the program with the property of being a
goal-state:
goal state(f ).
goal state(g).
Now the problem of finding a path from a to one of the goal-states reduces to finding
a refutation of the goal:
path(a, X), goal state(X).
The program above can be simplified if the goal-state is known in advance. In this
case it is not necessary to use the second argument of path/2. Instead the program
may be simplified into:
p q
p q
path( goal ).
path(X) edge(X, Y ), path(Y ).
where goal is a term representing the goal-state (if there are several goal-states there
will be one such fact for each state).
11.2
181
Loop Detection
One problem mentioned in connection with Example 6.7, appears when the graph
defined by the transition relation is cyclic.
Example 11.1 Consider the program:
path(X, X).
path(X, Z) edge(X, Y ), path(Y, Z).
edge(a, b). edge(b, a). edge(a, c).
edge(b, d). edge(b, e). edge(c, e).
edge(d, f ). edge(e, f ). edge(e, g).
As pointed out in Chapter 6 the program may go into an infinite loop for certain goals
from state a it is possible to go to state b and from this state it is possible to go
back to state a via the cycle in the transition relation. One simple solution to such
problems is to keep a log of all states already visited. Before moving to a new state it
should be checked that the new state has not already been visited.
Example 11.2 The following program extends Example 11.1 with a log:
path(X, Y )
path(X, Y, [X]).
path(X, X, Visited).
path(X, Z, Visited )
edge(X, Y ),
not member(Y, Visited ),
path(Y, Z, [Y |Visited ]).
member(X, [X|Y ]).
member(X, [Y |Z])
member(X, Z).
Declaratively the recursive clause of path/3 says that there is a path from X to Z
if there is an edge from X to Y and a path from Y to Z such that Y has not already
been visited.
At first glance the solution may look a bit inelegant and there certainly are more
sophisticated solutions around. However, carrying the log around is not such a bad
idea after all in many problems similar to the one above, it is not sufficient just to
answer yes or no to the question of whether there is a path between two states.
Often it is necessary that the actual path is returned as an answer to the goal. As an
example, it is not much use to know that there is a plan which assembles some pieces
of material into a gadget; in general one wants to see the actual plan.
Example 11.3 This extension can be implemented through the following modification of Example 11.2:
182
With these modifications the goal path(a, d, X) succeeds with the answer X =
[d, b, a] which says that the path from a to d goes via the intermediate state b. Intuitively, path(A, B, C, D) can be interpreted as follows The difference between D
and C constitutes a path from A to B.
11.3
The discussion above will be illustrated with the well-known water-jug problem often
encountered in the AI-literature. The problem is formulated as follows:
Two water jugs are given, a 4-gallon and a 3-gallon jug. Neither of them
has any type of marking on it. There is an infinite supply of water (a tap?)
nearby. How can you get exactly 2 gallons of water into the 4-gallon jug?
Initially both jugs are empty.
The problem can obviously be described as a state-space traversal a state is described by a pair hx, yi where x represents the amount of water in the 4-gallon jug
and y represents the amount of water in the 3-gallon jug. The start-state then is h0, 0i
and the goal-state is any pair where the first component equals 2. First of all some
transformations between states must be formulated. The following is by no means a
complete set of transformations but it turns out that there is no need for additional
ones:
empty the 4-gallon jug if it is not already empty;
empty the 3-gallon jug if it is not already empty;
fill up the 4-gallon jug if it is not already full;
fill up the 3-gallon jug if it is not already full;
if there is enough water in the 3-gallon jug, use it to fill up the 4-gallon jug until
it is full;
if there is enough water in the 4-gallon jug, use it to fill up the 3-gallon jug until
it is full;
if there is room in the 4-gallon jug, pour all water from the 3-gallon jug into it;
if there is room in the 3-gallon jug, pour all water from the 4-gallon jug into it.
183
It is now possible to express these actions as a binary relation between two states.
The binary functor :/2 (written in infix notation) is used to represent a pair:
action(X
action(X
action(X
action(X
action(X
action(X
action(X
action(X
: Y, 0 : Y ) X > 0.
: Y, X : 0) Y > 0.
: Y, 4 : Y ) X < 4.
: Y, X : 3) Y < 3.
: Y, 4 : Z) X < 4, Z is Y (4 X), Z 0.
: Y, Z : 3) Y < 3, Z is X (3 Y ), Z 0.
: Y, Z : 0) Y > 0, Z is X + Y, Z 4.
: Y, 0 : Z) X > 0, Z is X + Y, Z 3.
The definition of a path is based on the program in Example 11.3. However, since the
goal-state is known to be h2, Xi for any value of X (or at least 0 X 3) there is
no need for the second argument of path/4. With some minor additional changes the
final version looks as follows:
path(X)
path(0 : 0, [0 : 0], X).
path(2 : X, Visited , Visited ).
path(State, Visited, Path)
action(State, NewState),
not member(NewState, Visited ),
path(NewState, [NewState|Visited ], Path).
member(X, [X|Y ]).
member(X, [Y |Z])
member(X, Z).
Given this program and the goal path(X) several answers are obtained some of
which are rather naive. One answer is X = [2 : 0, 0 : 2, 4 : 2, 3 : 3, 3 : 0, 0 : 3, 0 : 0].
That is, first fill the 3-gallon jug and pour this water into the 4-gallon jug. Then the 3gallon jug is filled again, and the 4-gallon jug is filled with water from the 3-gallon jug.
The last actions are to empty the 4-gallon jug and then pour the content of the 3-gallon
jug into it. Another answer is X = [2 : 0, 0 : 2, 4 : 2, 3 : 3, 3 : 0, 0 : 3, 4 : 3, 4 : 0, 0 : 0].
In all 27 answers are produced.
11.4
A similar problem is the so-called blocks world. Consider a table with three distinct
positions. On the table are a number of blocks which may be stacked on top of each
other. The aim is to move the blocks from a given start-state to a goal-state. Only
blocks which are free (that is, with no other block on top of them) can be moved.
The first step is to determine how to represent the state. A reasonable solution is to
use a ternary functor state/3 to represent the three positions of the table. Furthermore,
use the constant table to denote the table. Finally represent by on(X, Y ) the fact
that X is positioned on top of Y . That is, state(on(c, on(b, on(a, table))), table, table)
represents the state:
184
c
b
a
1
The following are all possible actions that transform the state:
if the first position is nonempty the topmost block can be moved to either the
second or the third position;
if the second position is nonempty the topmost block can be moved to either the
first or the third position;
if the third position is nonempty the topmost block can be moved to either the
first or the second position.
The first action may be formalized as follows:
move(state(on(X, New X), OldY, Z), state(NewX, on(X, OldY ), Z)).
move(state(on(X, New X), Y, OldZ), state(NewX, Y, on(X, OldZ))).
The remaining two actions may be formalized in a similar way. Finally the program is
completed by adding the path-program from Example 11.3 (where edge/2 is renamed
into move/2). It is now possible to find the path from the start-state above to the
following goal-state:
c
a
b
1
11.5
185
,,@@
b
c
,,@@
,,@@
To look for a path in a tree (or a graph) using a breadth-first strategy means first
looking at all paths of length 1 from the start-state (or to the goal-state). Then all
paths of length 2 are investigated. The process is repeated until a complete path from
the start- to a goal-state is found.
The tree above will be represented using a binary predicate symbol children/2
where the first argument is the name of a node of the tree and the second argument is
the names of the children of that node. Hence the tree above is represented as follows:
children(a, [b, c]).
children(b, [d, e]).
children(c, [f ]).
children(e, [g, h]).
In order to realize the breadth-first strategy paths will be represented by reversed
lists of nodes. For instance, [d, b, a] represents the path which starts at the root of the
tree and proceeds to d via the intermediate node b. Given all paths of length n from
a start-state the problem of finding a path to a goal-state reduces to finding a path
from the end of one of these paths to the goal-state. Initially this amounts to finding
a path from the empty branch [X] (where X is the start-state) to a goal-state. That
is:
186
Exercises
11.1 A chessboard of size N N is given the problem is to move a knight across
the board in such a way that every square on the board is visited exactly once.
The knight may move only in accordance with the standard chess rules.
11.2 A farmer, a wolf and a goat are standing on the same river-bank accompanied
by a cabbage-head (a huge one!). A boat is available for transportation. Unfortunately, it has room for only two individuals including the cabbage-head.
To complicate things even more (1) the boat can be operated only by the
farmer and (2) if the goat is left alone with the wolf it will be eaten. Similarly
if the cabbage-head is left alone with the goat. Is there some way for them to
cross the river without anyone being eaten?
11.3 Three missionaries and three cannibals are standing on the same side of a
river. A boat with room for two persons is available. If the missionaries on
Exercises
187
either side of the river are outnumbered by cannibals they will be done away
with. Is there some way for all missionaries and cannibals to cross the river
without anyone being eaten?
First solve the problem using a depth-first search strategy. (In which case a
log must be used to prune infinite paths.) Then solve the same problem using
a breadth-first strategy similar to that on page 186.
11.4 (Towers of Hanoi) Three pins are available together with N disks of different
sizes. Initially all disks are stacked (smaller on top of bigger) on the leftmost
pin. The task is to move all disks to the rightmost pin. However, at no time
may a disk be on top of a smaller one. Hint: there is a very simple and efficient
algorithmic solution to this puzzle. However, it may also be solved with the
techniques described above.
11.5 How can the program in Example 11.4 be modified to avoid the use of negation?
188
PART III
ALTERNATIVE LOGIC
PROGRAMMING SCHEMES
189
Chapter 12
Logic Programming and
Concurrency
12.1
The construction of a computer program can be divided into two phases which are
usually intertwined the formulation of the actual problem (what the problem is)
and the description of how to solve the problem. Together they constitue an algorithm. This idea is the heart of logic programming the logic provides a description
of the problem and SLD-resolution provides the means for executing the description.
However, the logic has a meaning in itself its declarative semantics which is
independent of any particular execution strategy. This means that, as long as the
inference mechanism is sound, the behaviour of the algorithm may be altered by selecting an alternative inference mechanism. We do not have to go as far as abandoning
SLD-resolution the behaviour of the execution can be altered simply by choosing
different computation rules as illustrated by the following example:
Example 12.1 The following execution trace illustrates the impact of a more versatile
computation rule than the one used in Prolog. First consider the program:
(1) append([ ], X, X).
(2) append([X|Y ], Z, [X|W ]) append(Y, Z, W ).
(3) succlist([ ], [ ]).
(4) succlist([X|Y ], [Z|W ]) succlist(Y, W ), Z is X + 1.
Then consider the following SLD-derivation whose initial goal consists of two components (subgoals). Each of the subsequent goals in the derivation can be divided into
two halves originating from the components of the initial goal as visualized by the
191
192
frames:
append([4, 5], [3], X) succlist(X, Res)
(G0 )
Resolving append([4, 5], [3], X) using (2) yields the binding [4|W0 ] for X and the new
goal:
append([5], [3], W0 )
succlist([4|W0], Res)
(G1 )
Resolving succlist([4|W0 ], Res) using (4) yields the binding [Z1 |W1 ] for Res and the
goal:
append([5], [3], W0 )
succlist(W0 , W1 ), Z1 is 4 + 1
(G2 )
Resolving append([5], [3], W0 ) using (2) yields the binding [5|W2 ] for W0 :
append([ ], [3], W2 )
succlist([5|W2], W1 ), Z1 is 4 + 1
(G3 )
succlist([5|W2], W1 )
(G4 )
Resolving succlist([5|W2 ], W1 ) using (4) yields the binding [Z4 |W4 ] for W1 :
append([ ], [3], W2 )
succlist(W2 , W4 ), Z4 is 5 + 1
(G5 )
succlist([3], W4), Z4 is 5 + 1
(G6 )
succlist([3], W4)
(G7 )
succlist([ ], W7 ), Z7 is 3 + 1
(G8 )
Z7 is 3 + 1
(G9 )
Finally Z7 is bound to 4 yielding a refutation where the binding for Res is the list
[5, 6, 4].
Thus, 10 SLD-steps are needed to refute the initial goal. Notice that it is not possible
to improve on this by choosing an alternative computation rule no matter what
rule is used, the refutation will have the length 10.
12.2 And-parallelism
[3]
-
193
[4, 5]
append
[4, 5, 3]
[5, 6, 4]
succlist
With this versatile computation rule the two subgoals in G0 may be viewed as
two processes which communicate with each other using the (shared) variable X. The
frames in the derivation capture the internal behaviour of the processes and the shared
variable acts as a communication channel where a stream of data flows namely
the elements of the list to which the shared variable X is (incrementally) bound to
(first 4 then 5 and finally 3). See Figure 12.1.
Notice that there is no real parallelism in this example. The executions of the two
processes are only interleaved with each other. The control is merely shifted between
them and there is no real gain in performance. This type of control is commonly
known as coroutining.
The possibility of viewing subgoals as processes and goals as nets of communicating
processes connected by means of shared variables implies yet another interpretation
of logic programs in addition to its operational and declarative meaning. This new
view of logic programming extends the possible application areas of logic programming
to include also process programming (like operating systems, simulators or industrial
process control systems).
12.2
And-parallelism
194
12.3
One point worth noticing about Example 12.1 is that the execution is completely determinate no selected subgoal unifies with more than one clause-head. However,
this is not necessarily the case if some other computation rule is employed. For instance, the rightmost subgoal in G0 unifies with two different clauses. To reduce the
search space it is desirable to have a computation rule which is as determinate as
possible. Unfortunately it is rather difficult (if at all possible) to implement a computation rule which always selects a determinate subgoal. However, the programmer
often has some idea how the program should be executed to obtain good efficiency
(although not always optimal). Hence the programmer may be allowed to provide
additional information describing how the program should be executed.
The subgoal append([4, 5], [3], X) in G0 may be viewed as a process which consumes
input from two streams ([4, 5] and [3]) and acts as a producer of bindings for the variable
X. Similarly succlist(X, Res) may be viewed as a process which consumes bindings for
the variable X and produces a stream of output for the variable Res. Since, in general,
it is not obvious which subgoals are intended to act as consumers and producers
of shared variable-occurrences the user normally has to provide a declaration. For
instance, that the first two arguments of append/3 act as consumers and the third as
producer. There are several ways to provide such information. In what follows we
will use a notion of read-only variable which very closely resembles that employed in
languages such as Concurrent Prolog (one of the first and most influential languages
based on a concurrent execution model).
Roughly speaking, each clause (including the goal) may contain several occurrences
of a variable. On the other hand, variables can be bound at most once in an SLDderivation. This implies that at most one of the atoms in a clause acts as a producer
of a binding for that variable whereas all remaining atoms containing some occurrence
of the variable act as consumers. The idea employed in Concurrent Prolog is that
the user annotates variable-occurrences appearing in consumer atoms by putting a
question mark immediately after each occurrence. For instance, G0 may be written as
follows:
append([4, 5], [3], X), succlist(X?, Res).
This means that the call to append/3 acts as a producer of values for X and that
succlist/2 acts as a consumer of values for X and a producer of values for Res.
Variables annotated by ? are called read-only variables. Variables which are not
annotated are said to be write-enabled.
Now what is the meaning of a read-only variable? From a declarative point of view
they are not different from write-enabled occurrences of the same variable. Consequently, the question-mark can be ignored in which case X and X? denote the same
195
196
and that a new job arrives from outside while the first is being printed:
producer(Y1 ), print(job 1 ), consumer([job 2 |Y1 ]).
The producer/1-process can now be reduced to:
get(X2 ), producer(Y2 ), print(job 1 ), consumer([job 2 , X2 |Y2 ]).
The whole goal suspends again until either (1) a new job arrives (in which case the
new job is enqueued after the second job) or (2) printing of the first job ends (in
which case the second job can be printed). As pointed out above the program does
not terminate.
Notice that it may happen that all subgoals in a goal become suspended forever. A
trivial example is the goal consumer(X?). This situation is called deadlock.
12.4
12.5
The concepts discussed above provide a basis for a class of programming languages
based on logic programming. They are commonly called Concurrent Logic Programming languages or Committed Choice Languages. For the rest of this chapter the
197
principles of these languages are discussed. To illustrate the principles we use a language similar to Shapiros Concurrent Prolog (1983a).
By analogy to definite programs, the programs considered here are finite sets of
guarded clauses. The general scheme of a guarded clause is as follows:
H G1 , . . . , Gm | B1 , . . . , Bn
(m 0, n 0)
where H, G1 , . . . , Gm , B1 , . . . , Bn are atoms (possibly containing read-only annotations). H is called the head of the clause. G1 , . . . , Gm and B1 , . . . , Bn are called the
guard and the body of the clause. The symbol | which divides the clause into a guardand body-part is called the commit operator. If the guard is empty the commit operator is not written out. To simplify the operational semantics of the language, guards
are only allowed to contain certain predefined test-predicates typically arithmetic
comparisons. Such guards are usually called flat and the restriction of Concurrent
Prolog which allows only flat guards is called Flat Concurrent Prolog (FCP).
Like definite programs, FCP-programs are used to produce bindings for variables
in goals given by the user. The initial goal is not allowed to contain any guard.
Example 12.3 The following are two examples of FCP-programs for merging lists
and deleting elements from lists:
merge([ ], [ ], [ ]).
merge([X|Y ], Z, [X|W ]) merge(Y ?, Z, W ).
merge(X, [Y |Z], [Y |W ]) merge(X, Z?, W ).
delete(X, [ ], [ ]).
delete(X, [X|Y ], Z) delete(X, Y ?, Z).
delete(X, [Y |Z], [Y |W ]) X 6= Y | delete(X, Z?, W ).
Like definite clauses, guarded clauses have a logical reading:
all variables in a guarded clause are implicitly universally quantified the readonly annotations have no logical meaning;
denotes logical implication;
| and , denote logical conjunctions.
Each clause of the program must contain exactly one commit operator (although
usually not explicitly written when the guard-part is empty). Operationally it divides
the right-hand side of a clause into two parts which are solved strictly in sequence.
Before starting solving the body the whole guard must be solved. Literals in the guard
and body are separated by commas. Operationally this means that the literals may
be solved in parallel.
The notion of derivation basically carries over from definite programs. However,
the read-only annotations and commit operators impose certain restrictions on the
selection of a subgoal in a derivation step. This is because some subgoals may be
temporarily suspended. There are three reasons for this either because (1) unification of a subgoal with a clause head cannot be performed without binding read-only
198
variables or (2) the subgoal appears in the body of a guarded clause whose guard is
not yet satisfied or (3) the subgoal is a non-ground test-predicate.
To describe the basic derivation-step taking these restrictions into account the goal
will be partitioned into groups of guards and bodies. To emphasize this the goal will
be written as follows:
G1 | B1 , . . . , Gi | Bi , . . . , Gn | Bn .
where both Gj and Bj , (1 j n), are possibly empty conjunctions of atoms (in case
of Gj containing only test-predicates). A single reduction of the goal then amounts to
selecting some subgoal A such that either:
(i ) A is a test-predicate in Gi or Bi (if Gi is empty) which is both ground and true.
The new goal is obtained by removing A from the goal.
(ii ) Gi is empty, A appears in Bi and is a user-defined predicate and there is a
(renamed) guarded clause of the form:
H Gm | Bm .
such that A and H unify (with mgu ) without binding any read-only variables.
The new goal obtained is:
( G1 | B1 , . . . , Bi \ A , Gm | Bm , . . . , Gn | Bn ).
where Bi \ A denotes the result of removing A from Bi .
A successful derivation is one where the final goal is empty.
Like SLD-resolution this scheme contains several nondeterministic choices many
subgoals may be selected and if the subgoal selected is user-defined there may be
several guarded clauses which unify with it. In the latter case the commit operator
has an effect similar to that of cut. In order to solve a subgoal several clauses are
tried in parallel. However, as soon as the subgoal unifies with one of the clauses and
succeeds in solving its guard, all other attempts to solve the subgoal are immediately
surrendered. Thus, the commit operator behaves as a kind of symmetric cut. For
instance, take Example 12.3 and the goal:
merge([a, b], [c, d], X).
This goal has many solutions in Prolog. In FCP there is only one solution to the goal.
The result depends on what clauses the refutation commits to.
Since each clause is required to contain exactly one commit operator no goal can
have more than one solution. Thus, it is not possible to use append/3 to generate
splittings of a list. At most one solution will be found. This is one of the main
disadvantages of this class of languages. However, this is the price that has to be paid
in order to be able to implement these languages efficiently. Note that it is vital to test
for inequality in the guard of the last clause of the delete/3-program for this reason.
If the test is moved to the body it may happen that goals fail because of committing
to the third clause instead of the second.
199
user
dbms
user
The execution model given above is somewhat simplified since at each step only
one subgoal is selected. As already mentioned, languages like FCP support ANDparallelism which means that several subgoals may be selected simultaneously. However, incorporating this extra dimension into the execution model above makes it
rather complicated and we will therefore stick to the sequential version which simulates parallelism through coroutining.
The chapter is concluded with an example of a CLP program that implements a
simple database system with a fixed number of clients.
Example 12.4 Consider an application involving a database transaction system. Such
a system consists of some processes where customers (users) input transactions and
a database management system (DBMS) performs the transactions using a database
and outputs the results to the user. See Figure 12.2.
To start up such a system of processes the following goal may be given (if we
restrict ourselves to two users of the database system):
user(tty1 , X), user(tty2 , Y ), merge(X?, Y ?, Z), dbms(Z?, [ ]).
A formal definition of the user/2-process will not be provided. Informally the process
user(ttyn , X) is assumed to behave as follows:
(i ) It suspends until the arrival of a message from the terminal named ttyn ;
(ii ) When a message M arrives it binds X to the pair [M |Msgs] where Msgs is a
new variable. (For a description of all possible messages see Figure 12.3.);
(iii ) Then the process suspends until M becomes ground;
(iv ) When M becomes ground it prints a message on ttyn ;
(v ) Finally it calls itself with user(ttyn , Msgs).
Thus, the two user/2-processes generate two (infinite) streams of transactions which
are merged nondeterministically by the merge/3-process and the resulting stream is
processed (and grounded) by the dbms/2-system.
For the sake of simplicity, assume that the database consists of a list of pairs of the
form item(key, value) where key is a unique identifier and value is the data associated
with the key. Three different transactions are to be considered a pair may be (1)
added to the database, (2) deleted from the database, and (3) retrieved from the
database. On the top level the database management system may be organized as
follows (the first clause is not needed in this version of the program but is added as a
hint to exercise 12.3):
200
Transactions
add(key, value, Reply)
del(key, Reply)
in(key, Reply)
Description
This message represents an external request to add
a new item of the form item(key, value) to the
database. The first two arguments are ground and
Reply a variable which eventually is grounded by the
DBMS.
This message represents an external request to delete
an item of the form item(key, ) from the database.
The first argument is ground and Reply a variable
which eventually is grounded by the DBMS.
This message represents an external request to retrieve the value stored in the item of the form
item(key, ) from the database. The first argument
is ground and Reply a variable which eventually is
grounded by the DBMS.
201
202
Thereafter dbms/2 is resumed and unified with the second clause yielding the goal:
. . . , merge(. . .), retrieve(k10 , [item(k10 , john)], R), dbms(W3 ?, . . .).
The call to retrieve/3 succeeds with R bound to john. The answer is echoed on tty2
and the goal is reduced to:
. . . , merge(X0 ?, Y2 ?, W3 ), dbms(W3 ?, [item(k10 , john)]).
At this point the whole system is suspended until one of the users supplies another
transaction.
The example above illustrates one fundamental difference between sequential SLDresolution for definite programs and concurrent execution. In the former case computations are normally finite and the program computes relations. However, in the latter
case, computations may be infinite and the meaning of the program is not so easily
defined in terms of relations. For instance, when giving a goal:
A1 , . . . , An
we normally want this goal to succeed with some answer substitution. However, the
goal in Example 12.4 does not terminate, yet the execution results in some useful
output via side-effects (supplying transactions to the terminal and obtaining answers
echoed on the screen). This fundamental difference makes more complicated to give a
declarative semantics to concurrent logic programming languages like FCP.
Exercises
12.1 Write a concurrent logic program for checking if two binary trees have the
same set of labels associated with the nodes of the tree. Note that the labels
associated with corresponding nodes do not have to be the same.
12.2 Write a concurrent program for multiplying N N -matrices of integers (for
arbitrary N s).
12.3 Suggest a way of including a kill-process in Example 12.4. Such a process
is initially suspended but should, when it is activated, terminate all other
processes in the transaction system in a controlled way.
12.4 Write a concurrent program which takes as input a stream of letters (represented by constants) and replaces all occurrences of the sequence aa by a
and all occurrences of by the empty string. All other letters should appear
as they stand in the input.
12.5 Give a solution to the producer-consumer problem with a bounded buffer.
Chapter 13
Logic Programs with Equality
204
13.1
.
In what follows an equation will be a formula of the form s = t where s and t are
terms from a given alphabet. This kind of unconditional equation may be extended
to conditional ones. That is, formulas of the form:
.
F (s = t)
where s and t are terms and F is some formula possibly containing other predicate
.
symbols than =. In this chapter attention is restricted to unconditional equations.
At a first glance the restriction to unconditional equations may seem to be a serious
limitation, but from a theoretical point of view unconditional equations are sufficient
to define any computable function (e.g. Rogers (1967)). Hence, the restriction is solely
syntactic.
.
The intuition behind introducing the new predicate symbol =, is to identify
terms which denote the same individual in the domain of discourse, regardless of the
.
values of their variables. Hence, for two terms s and t, the formula s = t is true in an
interpretation = and valuation iff s and t have identical interpretations in = and
.
(that is, if = (s) = = (t)). An interpretation = is said to be a model of (s = t) if
.
s = t is true in = under any valuation . This extends to sets E of equations: = is a
model of a set E of equations iff = is a model of each equation in E.
The concept of logical consequence carries over from Chapter 1 with the modifi.
cation that the only interpretations that are considered are those that associate =
.
with the identity relation. Hence, given a set of equations E, s = t is said to be a
.
.
logical consequence of E (denoted E |= s = t) iff s = t is true in any model of E.
One of the main objectives of any logic is to permit inference of new formulas from
old ones using a system of rewrite rules. The inference rules in Figure 13.1 defines
the relation between a set of equational hypohesis E and new derived equations. (The
.
.
notation E ` s = t should be read s = t is derived from E.) The derivability
relation induces an equivalence relation, E , on the set of all terms, defined by s E t
.
iff E ` s = t. The relation is called an equality theory. The inference rules just
introduced were shown to be both sound and complete by Birkhoff (1935):
Theorem 13.1 (Soundness and Completeness)
.
.
E |= s = t iff E ` s = t iff s E t
The notion of E-unification is defined relative to the equality theory, E , induced by
E and `.
205
Hypothesis:
.
.
E ` s = t (if s = t E)
Reflexivity:
.
E`s=s
Symmetry:
.
E`s=t
.
E`t=s
Transitivity:
.
.
E`r=s E`s=t
.
E`r=t
Stability:
.
E`s=t
.
E ` s = t
Congruence:
.
.
E ` s1 = t1 E ` sn = tn
.
E ` f (s1 , . . . , sn ) = f (t1 , . . . , tn )
Figure 13.1: Inference rules for equality
Definition 13.2 (E-unifier) Two terms, s and t, are said to be E-unifiable if there
exists some substitution such that s E t. The substitution is called an E-unifier
of s and t.
Example 13.3 Let E be the following equalities defining addition of natural numbers:
.
sum(0, X) = X.
.
sum(s(X), Y ) = s(sum(X, Y )).
Consider the problem of finding an E-unifier of the two terms sum(s(X), Y ) and
s(s(0)). As formally shown in Figure 13.2, the two terms have at least one E-unifier
namely {X/0, Y /s(0)}.
Note that in the case of the empty equality theory, ? relates every term only to itself.
This implies that two terms, s and t, are ?-unifiable iff there is some substitution such
that s is identical to t. Hence, the notion of E-unification encompasses standard
unification as a special case.
13.2
More on E-unification
206
.
E ` sum(0, X) = X
.
.
E ` sum(s(X), Y ) = s(sum(X, Y ))
E ` sum(0, s(0)) = s(0)
.
.
E ` sum(s(0), s(0)) = s(sum(0, s(0))) E ` s(sum(0, s(0))) = s(s(0))
.
E ` sum(s(0), s(0)) = s(s(0))
.
Figure 13.2: Proof of E ` sum(s(0), s(0)) = s(s(0))
207
left as an exercise). It can be shown that neither E [{X, Y }] nor E [{X, Y }].
It can also be shown that any other E-unifier of the two terms is subsumed by one of
these two substitutions. Thus, the set {, } constitutes a complete set of E-unifiers
of the two terms.
An E-unification algorithm is said to be sound if, for arbitrary terms s and t, its
output is a set of E-unifiers of s and t. The algorithm is complete if the set in addition
is a complete set of E-unifiers. Needless to say, it is desirable to have an E-unification
algorithm which is at least sound and preferably complete. However, as already pointed
out, there are sets of equations and pairs of terms which do not have finite sets of Eunifiers. For such cases we cannot find a complete E-unification algorithm. Thus, one
must weaken the notion of completeness by saying that an algorithm is complete if
it enumerates a complete set of E-unifiers (for arbitrary pairs of terms). Under this
definition there are both sound and complete E-unification algorithms for arbitrary
sets E of equations. Unfortunately they are of little practical interest because of their
tendency to loop.
Thus, instead of studying general-purpose algorithms, research has concentrated
on trying to find algorithms for restricted classes of equations, much like research on
logic programming started with the restricted form of definite programs. Standard
unification is a trivial example where no equations whatsoever are allowed.
The most well-known approach based on restricted forms of equations is called
narrowing which, in many ways, resembles SLD-resolution. It has been shown to be
both sound and complete for a nontrivial class of equational theories. Characterizing
this class more exactly is outside the scope of this book.
Unfortunately narrowing also suffers from termination problems. The reason is
that the algorithm does not know when it has found a complete set of unifiers. It may
of course happen that this set is infinite in which case there is no hope for termination
whatsoever. But even if the set is finite, the algorithm often loops since it is not
possible to say whether the set found so far is a complete set of E-unifiers. Hence,
in practice one has to impose some sort of restrictions not only on the form of the
equations but also on the terms to be E-unified. One simple case occurs when both
terms are ground. In this case either ? or the singleton {} is a complete set of
E-unifiers of the terms.
13.3
In this section we review the integration of definite programs and equations. It turns
out that the proof-theoretic and model-theoretic semantics of this language are natural
extensions of the corresponding concepts for definite programs alone. But before
describing the nature of these extensions the syntax of definite programs with equations
is given. Thereafter weaknesses of definite programs alone are discussed to motivate
the extensions.
A definite program with equality is a pair P, E where:
.
P is a finite set of definite clauses not containing the predicate symbol =;
E is a possibly infinite set of equations.
208
One sometimes sees different extensions of this idea where E may contain e.g. con.
ditional equations or where = may appear in the bodies of clauses in P . What is
described below can also be generalized to such programs with some additional effort.
Now, consider the following definite program P where the symbols have their natural intended interpretations:
odd(1).
odd(X + 2) odd(X).
Although odd(2 + 1) is true in the intended model it is not a logical consequence of the
program because the program has at least one model (for instance the least Herbrand
model MP ) where odd(2 + 1) is false. It may thus be argued that the least Herbrand
model is incompatible with the intended interpretation since the two terms 1 + 2
and 2 + 1 have distinct interpretations in MP recall that any ground term denotes
itself in any Herbrand interpretation.
As pointed out above equations may be used to focus attention on certain models
namely those where some terms denote the same object. For instance, by adding
to P the equation E:
.
2+1=1+2
.
(or more generally X + Y = Y + X) it is possible to exclude certain unwanted interpretations from being models of P and E. In particular, MP is no longer a model of
both P and E. (In fact, no Herbrand interpretation of P is a model of P and E since
the terms 1 + 2 and 2 + 1 denote distinct objects.)
We recall that the model-theoretic semantics of definite programs without equality
enjoys some attractive properties: To characterize the meaning of a program (i.e. its
set of ground, atomic logical consequences) it is sufficient to consider the set of all
Herbrand models. In fact, attention may be focused on a single least Herbrand model.
Evidently, this is not applicable to definite programs with equality. However, there
is a natural extension of these ideas: Instead of considering interpretations where the
domain consists of ground terms one may consider interpretations where the domain
consists of sets of equivalent ground terms. More precisely one may consider the
quotient set of UP with respect to a congruence relation. Such a set will be called an
E-universe. In what follows, it will be clear from the context what congruence relation
is intended, and we will just write s to denote the equivalence class which contains s.
By analogy to definite programs the E-base will be the set:
{p(t1 , . . . , tn ) | t1 , . . . , tn E-universe and p/n is a predicate symbol}
and an E-interpretation will be a subset of the E-base. The intuition behind an Einterpretation is as follows: (1) the meaning of a ground term t is the equivalence class
.
t and (2) if s and t are ground terms, then s = t is true in the interpretation iff s and
t are members in the same equivalence class of the domain (i.e. if s = t).
To characterize the set of all ground, atomic logical consequences of a program P, E
we first define a set of E-interpretations which are models of E. Then we consider
E-interpretations which are also models of P . The following theorem shows that it is
reasonable to restrict attention to E-interpretations whose domain is UP /E (the set
of all equivalence-classes of UP w.r.t. the relation E ), since they characterize the set
of all ground equations which are logical consequences of E:
209
Theorem 13.5 Let E be a set of equations, s and t ground terms and = an Einterpretation whose domain is UP /E . Then:
.
= |= s = t iff
iff
iff
s=t
s E t
.
E |= s = t
Such E-interpretations are called canonical. Notice that if E = ? then s = {s} for any
ground term s, and = reduces to a Herbrand interpretation (except that the domain
consists of singleton sets of ground terms).
Example 13.6 Consider the following set E of equations:
.
father (sally) = robert.
.
father (bruce) = adam.
.
father (simon) = robert.
Then UP /E contains elements such as:
robert
adam
sally
bruce
=
=
=
=
Most of the results from Chapter 2 can be carried over to canonical E-interpretations.
For instance (see Jaffar, Lassez and Maher (1986) or (1984) for details):
if P, E has a model then it also has a canonical E-model;
the intersection of all canonical E-models of P, E is a canonical E-model;
there is a least canonical E-model (denoted by MP,E ).
Moreover, MP,E characterizes the set of all ground, atomic logical consequences of
P, E. In what follows let p(t1 , . . . , tn ) be an abbreviation of p(t1 , . . . , tn ). If t1 , . . . , tn
are ground terms, then:
P, E |= p(t1 , . . . , tn ) iff
p(t1 , . . . , tn ) MP,E
210
(j 0)
and that Am and B0 have a nonempty, complete set of E-unifiers . Then G and C
resolve into the new goal:
(A1 , . . . , Am1 , B1 , . . . , Bj , Am+1 , . . . , An )
if .
To avoid confusing this with ordinary SLD-resolution it will be called the SLDEresolution principle. The notion of SLDE-derivation, refutation etc. are carried over
from Chapter 3. SLDE-resolution introduces one extra level of nondeterminism
since two atoms may have several E-unifiers none of which subsume the others, it
may happen that a given computation rule, a goal and a clause with a head that
E-unifies with the selected subgoal, result in several new goals. This was not the case
for SLD-resolution since the existence of a unique mgu allowed only one new goal to
be derived.
Example 13.8 Consider again the following definite program and equations:
211
proud(robert).
,@@
,
,
@
newborn(sally). newborn(simon).
2
Figure 13.3: SLDE-tree for the goal proud(robert)
212
Exercises
13.1 Consider the equations in Example 13.3. Prove that {X/s(0), Y /0} is an Eunifier of sum(s(X), Y ) and s(s(0)).
13.2 Show that the inference rules in Figure 13.1 are sound. Try to prove that they
are complete!
13.3 Consider the following equations:
.
append (nil , X) = X
.
append (cons(X, Y ), Z) = cons(X, append (Y, Z))
Prove that append (X, cons(b, nil)) and cons(a, cons(b, nil )) are E-unifiable.
13.4 Prove that two terms, s and t, are ?-unifiable iff there is some substitution
such that s and t are syntactically identical.
Chapter 14
Constraint Logic Programming
The following program (which describes the property of being a list whose elements
are sorted in ascending order) is intended to illustrate some shortcomings of SLDresolution as previously presented:
sorted ([ ]).
sorted ([X]).
sorted ([X, Y |Xs]) X Y, sorted([Y |Xs]).
Consider the query Are there integers X, Y and Z, such that the list [X, Y, Z] is
sorted?. The query may be formalized as a goal:
sorted ([X, Y, Z]).
(G0 )
(G1 )
In a Prolog implementation this would lead to a run-time error since arithmetic tests
can be made only if the arguments are instantiated. This could easily be repaired by
imagining an infinite set of facts of the form 0 0, 0 1, . . . Unfortunately this would
lead to an infinite number of answers to the original query. Assume instead that the
interpreter is clever enough to realize that X Y has at least one solution. Then the
second subgoal of G1 may be selected instead, in which case G1 is reduced to:
X Y, Y Z, sorted([Z]).
213
(G2 )
214
Under the assumption that the interpreter is intelligent enough to realize that (X
Y Y Z) is satisfiable, the final recursive call can be eliminated:
X Y, Y Z.
(G3 )
14.1
In the previous chapter logic programming was extended with a dedicated predicate
.
symbol =, always interpreted as the identity relation. Constraint logic programming
languages generalize this idea by allowing also other dedicated interpreted predicates,
function symbols and constants (in addition to the uninterpreted symbols). Hence, a
CLP language CLP (D) is parameterized by an interpretation D of certain symbols in
the language.
Definition 14.1 (Constraint logic program) A constraint logic program is a finite
set of clauses:
A0 C1 , . . . , Cm , A1 , . . . , An
(m, n 0)
where C1 , . . . , Cm are formulas built from the interpreted alphabet (including variables, quantifiers and logical connectives) and A0 , . . . , An are atoms with uninterpreted
predicate symbols.
The formulas C1 , . . . , Cm are called constraints. In all our examples, a constraint will
be an atomic formula with an interpreted predicate symbols. All CLP languages are
.
assumed to contain the predicate = which is always interpreted as identity.
Let Z be an interpretation of numerals such as 0, 1, . . ., function symbols such
.
as +, , . . . and predicates such as =, <, , . . . Assume that |Z| = Z (the integers)
and that all symbols have their usual interpretation. (For instance, +Z is integer
addition.) Then the following is a CLP (Z) program with the uninterpreted constant
[ ], the functor /2 and the predicate symbol sorted /1:
sorted ([ ]).
sorted ([X]).
sorted ([X, Y |Xs]) X Y, sorted([Y |Xs]).
215
R2
R1 + R2
R1
R1 R2
R1 + R2
R2
R1
14.2
Given a specific CLP language CLP (D), there are several alternative approaches to
define the declarative meaning of a CLP (D) program P . One possibility is to assume that there is a so-called background theory Th D with a unique model, D, in
which case the declarative semantics of P can be defined in terms of classical models
of P Th D . Unfortunately, there are interpretations D which cannot be uniquely
axiomatized in predicate logic. Another approach that is sometimes used is to define
the declarative meaning of P in terms of a unique classical model (similar to the least
Herbrand model) defined by a generalized TP -operator. The approach used here is
an intermediate one similar to that of the previous chapter where a subset of
216
all classical interpretations are taken into account. Namely those that interpret the
pre-defined symbols in accordance with D.
Consider a CLP language CLP (D). A D-interpretation is an interpretation I which
complies with D on the interpreted symbols of the language:
Definition 14.2 (D-interpretation) A D-interpretation is an interpretation I such
that |D| |I| and for all interpreted constants c, functors f /n and predicates p/n
.
(except = /2):
cI = cD ;
fI (d1 , . . . , dn ) = fD (d1 , . . . , dn ) for all d1 , . . . , dn |D|;
hd1 , . . . , dn i pI iff hd1 , . . . , dn i pD .
.
As pointed out above = is always assumed to be contained in the language and always
denotes the identity relation. The notion of logical consequence can now be modified
taking into account D-interpretations only:
Definition 14.3 (D-model) A D-interpretation which is a model of a set P of closed
formulas is called a D-model of P .
Definition 14.4 (Logical consequence) A formula F is a logical D-consequence of
a CLP (D)-program P (denoted P, D |= F ) iff every D-model of P is a D-model of
F.
If P is the sorted /1-program then:
P, Z |= (X Y Y Z sorted ([X, Y, Z]))
The notation D |= F is used when F is true in every D-model. For instance:
Z |= (X Y Y Z)
.
.
H |= (X = f (Y ) Y = a)
14.3
This section describes a class of abstract execution strategies of CLP programs based
on the notion of derivation tree introduced in Section 3.6. Recall that a derivation tree
is a tree built from elementary trees that represent (renamed) program clauses (and
an atomic goal) such as:
sorted ([X0 , Y0 |Z0 ])
X0
,,@@@
,
sorted ([Y |Z ])
Y
0
sorted ([ ])
sorted ([X0 ])
217
sorted ([X,
. Y, Z])
=
sorted ([X0 , Y0 |Z0 ])
HH
HHH
sorted ([Y
. 0 |Z0 ])
=
sorted ([X1 , Y1 |Z1 ])
X0 Y0
X1
HH
HHH
sorted ([Y |Z ])
Y
1
The notion of derivation tree will have to be extended to permit the use of constraints,
such as X0 Y0 , in programs. Since interpreted predicate symbols are not allowed in
the head of any clause a constraint will always appear in the position of a leaf in a tree.
A derivation tree is said to be complete if all of its leaves are of the form or labelled by
constraints. A complete derivation tree is also called a proof tree. Figure 14.2 depicts
an (incomplete) derivation tree of the goal sorted ([X, Y, Z]). The tree can be made
complete by combining the rightmost leaf with one of the following elementary trees:
(i)
sorted ([ ])
(ii)
sorted([X2 ])
A derivation tree has an associated set of equalities (the labels of the internal nodes)
and constraints. This set will be called the constraint store. For instance, the derivation tree in Figure 14.2 has the following constraint store:
.
.
{[X, Y, Z] = [X0 , Y0 |Z0 ], X0 Y0 , [Y0 |Z0 ] = [X1 , Y1 |Z1 ], X1 Y1 }
()
218
sorted ([X,
. Y ])
=
sorted ([X0 , Y0 |Z0 ])
HH
HHH
X0 Y0
sorted ([Y
. 0 |Z0 ])
=
sorted ([X1 ])
satisfiability check. In such cases, it is usually required that the check is conservative.
That is to say:
if D |= (C1 Cn ) then sat({C1 , . . . , Cn }) succeeds
Thus, if the procedure fails (i.e. returns false) then the constraint store must be unsatisfiable. This is typically achieved by checking the satisfiability only of a subset of the
constraints in the store. This is the case in many CLP languages involving arithmetic
constraints the satisfiability check is complete as long as the arithmetic constraints
.
are linear. Non-linear constraints (such as X 2 = Y ) are not checked at all unless they
can be simplified into linear constraints.
Complete derivation trees with satisfiable constraint stores are of particular interest
since they represent answers to the initial goal. However, the constraint store usually
contains a large number of free variables which do not appear in the initial goal. Such
variables are called local variables. Since the bindings of local variables are of no
direct relevance they can be projected away (cf. computed answer substitutions) by
existential quantification:
Definition 14.6 (Answer constraint) Let A be an atomic goal with a complete
derivation tree and a satisfiable constraint store {C1 , . . . , Cn }. If X is the set of all
local variables in {C1 , . . . , Cn } then X(C1 Cn ) is called a (computed) answer
constraint.
The answer constraint (or an equivalent simplified expression) can be viewed as an
answer to the initial goal. However, in practice the satisfiability check may be incomplete, in which case the following weaker notion of conditional answer may be used
instead:
Definition 14.7 (Conditional answer) Let A be an atomic goal with a complete
derivation tree and a satisfiable constraint store {C1 , . . . , Cn }. Then ((C1 Cn )
A) is called a conditional answer.
The goal sorted ([X, Y ]) has a complete derivation tree depicted in Figure 14.3. The
associated constraint store is satisfiable. Hence, the following is a conditional answer:
219
HH
HHH
sorted ([Y, Z])
X Y
HHH
HH
sorted ([Z])
Y Z
sorted ([X, Y, Z])
.
.
(([X, Y ] = [X0 , Y0 |Z0 ] X0 Y0 [Y0 |Z0 ] = [Y0 ]) sorted ([X, Y ]))
This is obviously not a very informative answer. Fortunately it is usually possible to
eliminate or simplify the constraints. First note that a conditional answer may also
be written as follows:
(X(C1 Cn ) A)
where X is the set of all local variables. This means that all local variables are
existentially quantified on the level of the constraints. It is usually possible to eliminate
or simplify at least constraints involving local variables. Simplification is needed not
only for the purpose of producing readable answers, but it is often necessary to simplify
the store in order to avoid having to check the satisfiability of the whole store when new
constraints are added. Simplification, usually amounts to transforming the constraints
into some kind of canonical form, such as solved form. It is normally required that
the new store S 0 is equivalent to the old store S . That is:
D |= (S S 0 )
Many of the transformations are of course domain dependent (e.g. that X Y, Y X
.
can be replaced by X = Y ). However, some simplifications are always possible
the constraint store can be divided into equalities over uninterpreted symbols (and
variables) and other constraints involving interpreted symbols (and variables). The
former are called free constraints and the latter built-in constraints. (Equations such
.
as X = [3 + 3] which mix interpreted and uninterpreted symbols may be viewed as
.
.
shorthand for the free constraint X = [Y ] and the built-in constraint Y = 3 + 3.) If
a constraint store is satisfiable, it is always possible to transform the free constraints
into solved form. For instance, () can be transformed into the equivalent constraint
store:
.
.
.
.
.
.
{X0 = X, Y0 = Y, Z0 = [Z], X1 = Y, Y1 = Z, Z1 = [ ], X0 Y0 , X1 Y1 }
.
Such a store can be simplified further; all equations X = t where X is a local variable
can be removed provided that all occurrences of X in the store and in the tree are
replaced by t. Hence, the derivation tree in Figure 14.2 can be simplified to the
derivation tree in Figure 14.4 and the constraint store () can be simplified into:
{X Y, Y Z}
220
which is clearly satisfiable in Z (and thus, consistent provided that the check is conservative). Similarly, the conditional answer:
.
.
(([X, Y ] = [X0 , Y0 |Z0 ] X0 Y0 [Y0 |Z0 ] = [Y0 ]) sorted ([X, Y ]))
may be simplified into:
(X Y sorted ([X, Y ]))
The notions of tree construction, checking of satisfiability (i.e. consistency) and simplification are the basis of the operational semantics of many CLP languages. From
an abstract point of view a computation may be seen as a sequence of transitions:
hT0 , S0 i
hT1 , S1 i
hT2 , S2 i
over a space of computation states consisting of pairs of derivation trees and constraint
stores (and the additional computation state fail representing a failed derivation). A
computation starts with a computation state where T0 is a derivation tree representing
the initial (atomic) goal A and S0 is an empty constraint store. The only available
transitions are the following ones:
E
hT , S i
hT 0 , S 0 i if T can be extended into T 0 by combining a leaf labelled by
.
Ai with an elementary tree whose root is B0 . Moreover, S 0 = S {Ai = B0 };
hT , S i
hT , S i
hT , S i
hT , S i if sat(S ) = true;
fail if sat(S ) = false;
hT 0 , S 0 i if T and S can be simplified into T 0 and S 0 .
Different CLP systems use different strategies when applying these transitions. At
one end of the spectrum one may imagine a strategy where extension-transitions are
applied until the tree is complete, after which simplification and satisfiability-checking
are performed. Hence, computations are of the form:
Such a lazy approach runs the risk of entering infinite loops since failure due to an
unsatisfiable constraint store might not be detected. On the other hand, the constraint
store is checked for satisfiability only once.
At the other end of the spectrum one may imagine a strategy where simplification
and satisfiability-checking take place after each extension of the tree:
Such an eager strategy has a much improved termination behaviour compared to the
lazy approach above. However, checking for satisfiability is usually more expensive
than in the lazy strategy. With the eager strategy it is vital that the constraint store
can be checked incrementally to avoid computational overhead. Most CLP systems
seem to employ an eager strategy. This is often combined with a Prolog-like depth
221
res(series(r(R),
. r(R)), 20)
=
res(series(X0 , Xs 0 ), R0 + Rs 0 )
HH
HHH
res(X.0 , R0 )
=
res(r(R1 ), R1 )
res(Xs.0 , Rs 0 )
=
res(r(R2 ), R2 )
HHHH
H
sorted ([X, 2])
3X
HH
HHH
sorted ([3, X, 2])
X2
sorted([2])
222
HH
HHH
sorted ([Y, X])
X Y
HHH
HH
sorted ([X, Y, X])
Y X
sorted ([X])
Finally consider the goal sorted ([X, Y, X]). Using either a lazy or an eager
strategy the simplified proof tree in Figure 14.7 can be constructed. The corresponding
constraint store {X Y, Y X} is clearly satisfiable. The store can be further
simplified into the conditional answer:
.
(X = Y sorted ([X, Y, X]))
by exploiting domain knowledge.
The execution scheme described above can be shown to be sound:
Theorem 14.8 (Soundness) Let P be a CLP (D)-program and A an atomic goal.
If ((C1 Cn ) A) is a conditional answer of A then P, D |= ((C1
Cn ) A).
The execution scheme can also be shown to be complete and generalized to negation
as finite failure. However, for this discussion, which requires the introduction of a
number of auxiliary definitions, see Jaffar and Maher (1994).
14.4
Examples of CLP-languages
This section surveys some of the most popular constraint domains found in existing
CLP systems:
Boolean constraints;
Numerical constraints over integers, rational numbers or reals;
String constraints;
Finite and infinite tree constraints.
It should be noted that most CLP systems come with more than one constraint domain. For instance, Prolog III supports constraints over Booleans, rational numbers,
strings and infinite trees. CHIP contains constraints over finite domains, Booleans and
rational numbers. CLP(BNR) handles constraints involving Booleans and intervals of
natural numbers and reals.
223
z
Source
Gate
Drain
n-switch MOS
0
Source
Gate
tmp
Drain
p-switch MOS
Boolean constraints
Many CLP systems (e.g. CHIP, CAL, CLP(BNR), Prolog III and SICStus Prolog) are
equipped with Boolean constraints. Such a CLP (B) language has a binary domain
|B| = {true, false} and the language typically provides:
two interpreted constants 0, 1 such that 0B = false and 1B = true;
function symbols such as , , , . . . with the standard interpretation;
.
predicates such as =, 6=, . . .
Boolean constraints with more than two values are also available in some systems.
Boolean constraints are useful in many contexts, e.g. for modelling digital circuits.
The following example is due to Dincbas et.al. (1988).
Consider the circuit depicted in Figure 14.8. The circuit is a schematic model of an
xor-gate with inputs x and y and the output z. The gate is built from mos-transistors
of which there are two kinds n-mos and p-mos (also depicted in Figure 14.8). The
transistors have three connections usually referred to as the drain (D), source (S) and
gate (G). From the logical point of view the transistors may be viewed as binary
switches with the following (Boolean) relationship between D, S and G:
.
n-mos:
DG = GS
.
p-mos: D G = G S
In a CLP (B) language the circuit in Figure 14.8 can be described as follows:
xor(X, Y, Z)
pswitch(Tmp, 1, X),
nswitch(0, Tmp, X),
pswitch(Z, X, Y ),
nswitch(Z, Tmp, Y ),
nswitch(Z, Y, Tmp),
pswitch(Z, Y, X).
224
This program may be used to verify that the design in Figure 14.8 is an xor-gate by
giving the goal clause:
xor(X, Y, Z).
A system such as SICStus Prolog (version 2.1) which has an interpreted functor
denoting the operation of exclusive or, returns the conditional answer:
.
(X = Y Z xor(X, Y, Z))
which proves that the circuit is indeed correct.
Numerical constraints
Most CLP systems support constraints over a numerical domain. However, constraints
over the integers are difficult to handle efficiently and, as a consequence, most systems
support constraints only over the reals (CLP (R)) or the rational numbers (CLP (Q)).
Different systems support different operations and relations some CLP languages,
such as CLP(BNR), support arithmetic operations over intervals. Some systems support only linear equalities, inequalities and disequalities. That is, constraints that may
be written:
cn xn + cn1 xn1 + + c1 x1 + c0 2 0
.
where 2 {=, <, , 6=} and ci are constants. Systems that permit non-linear constraints usually employ an incomplete satisfiability check which does not take nonlinear constraints into account unless they can be simplified into linear equations. The
algorithms for checking satisfiability and for simplification of the built-in constraints
often rely on techniques from Operations Research such as Gauss elimination and
the simplex method and Artificial Intelligence. For an introduction to implementation of various CLP languages, see Jaffar and Maher (1994).
Consider the problem to position five queens on a five-by-five chess-board so that no
queen attacks another queen. (Two queens attack one another iff they are on the same
row, column or diagonal.) The program given below should be expressible in any CLP
system that supports linear equations and disequations over the reals, the integers or
the rational numbers.
Before presenting the solution some general observations should be made:
There must be exactly one queen in each column of the board. Hence, all solutions can be represented by a list of length five. Moreover, there must be exactly
one queen in each row of the board. This restriction can be imposed by requiring that the solution is a permutation of the list [1, 2, 3, 4, 5]. (For instance, the
solution in Figure 14.9 can be represented by the list [5, 3, 1, 4, 2].) With these
restrictions it is sufficient to check that each diagonal of the board contains at
most one piece;
225
226
Monoids
In addition to Boolean and numerical constraints, Prolog III also supports (a limited
form of) constraints over the monoid S of strings equipped with concatenation and a
neutral element. A CLP (S) language typically includes:
a set of constants denoting string elements;
an binary functor ] denoting the associative operation of concatenation;
a neutral element [ ].
In a CLP (S) language the reverse program may be written as follows:
reverse([ ], [ ]).
reverse([X] ] Y, Z ] [X]) reverse(Y, Z).
Equational constraints
The previous CLP language is interesting in that it can easily be axiomatized as a set
of equations. A monoid is completely characterized by the following equations:
.
X ] (Y ] Z) = (X ] Y ) ] Z
.
[] ] X = X
.
X ] [] = X
Hence, a CLP (S) program P may also be defined as a logic program with the above
equality axioms. Conversely, any logic program P with an equality theory E may be
viewed as a constraint logic program CLP (E) where:
|E| = (UP /E );
every ground term t is interpreted as t (i.e. {s UP | s E t});
.
= is the identity relation.
As already mentioned, the special case when E = ? is of course also a CLP language
where:
|E| = UP (the Herbrand universe);
every ground term is interpreted as itself;
Exercises
227
.
= is the identity relation.
Hence, definite programs may be viewed as constraint logic programs with equational
constraints over the Herbrand universe. The solved form algorithm (with occur-check)
provides a complete satisfiability check for definite programs.
The terms of the Herbrand domain may be viewed as ordered finite trees. Related
to finite trees are rational trees. A rational tree is a possibly infinite tree with a finite
set of subtrees. For instance, f (a, f (a, f (a, . . .))) has only two distinct subtrees, a and
the tree itself. Rational trees can be finitely represented as a (possibly) cyclic graph:
a
One of the first CLP languages, Prolog II, employed constraints (equations and disequations) over the rational trees. The solved form algorithm without the occur-check
provides a complete satisfiability check for rational trees.
Exercises
14.1 Solve the SEND MORE MONEY puzzle using logic programs with constrains similar to those above. The puzzle consists in associating with each
letter a distinct number from 0 to 9 such that the equation:
+
M
S
M
O
E
O
N
N
R
E
D
E
Y
is satisfied.
14.2 Modify the five-queens program so that it handles chess boards of arbitrary
(quadratic) size.
14.3 Three jars A, B and C contain a total of 1 liter of water. In each time unit
water flows as follows between the jars:
20%
A
10%
40%
Describe the relation between the initial amount of liquid in the three jars and
the amount after n units of time.
228
Chapter 15
Query-answering in Deductive
Databases
One of the great virtues of logic programming is that programs have a declarative
semantics which can be understood independently of any particular operational semantics. SLD-resolution is one example of a class of interpreters that can be used to
compute the logical consequences of a definite program. But also other strategies can
be used. In fact, SLD-resolution has several weaknesses also in the case of an ideal
interpreter. For instance, consider the following definition of the Fibonacci numbers
(for convenience X + n and n abbreviate the terms sn (X) and sn (0)):
fib(0, 1).
fib(1, 1).
fib(X + 2, Y ) fib(X + 1, Z), fib(X, W ), add (Z, W, Y ).
Now assume that the following goal clause is given:
fib(10, X).
The goal reduces to the following:
fib(9, Z0 ), fib(8, W0 ), add (Z0 , W0 , X).
And selection of the leftmost subgoal yields:
fib(8, Z1 ), fib(7, W1 ), add (Z1 , W1 , Z0 ), fib(8, W0 ), add (Z0 , W0 , X).
This goal contains two subgoals which are identical up to variable renaming: fib(8, Z1 )
and fib(8, W0 ). In order to resolve the whole goal, both subgoals have to be resolved
leading to duplicate work. As a matter of fact, the number of recursive calls to fib/2
grows exponentially with the size of the input.
229
230
fib(1, 1)
fib(2, 2)
fib(3, 3)
15.1
Naive Evaluation
231
fun naive(P )
begin
x := facts(P );
repeat
y := x;
x := SP (y);
until x = y;
return x;
end
Figure 15.1: Naive evaluation
232
fun semi-naive(P )
begin
x := facts(P );
x := x;
repeat
x := S P (x, x);
x := x x;
until x = ?;
return x;
end
Figure 15.2: Semi-naive evaluation
path(X, Y ) edge(X, Y ).
path(X, Y ) path(X, Z), edge(Z, Y ).
edge(a, b).
edge(b, a).
Let xi denote the value of x after i iterations. Then the iteration of the naive-evaluation
algorithm looks as follows:
x0
x1
x2
x3
=
=
=
=
15.2
Semi-naive Evaluation
233
The main advantage of the naive and semi-naive approach compared to SLD-resolution
is that they terminate for some programs where SLD-resolution loops. In particular
when no function symbols are involved (i.e. datalog programs). For instance, the
goal path(a, X) loops under SLD-resolution. On the other hand, there are also
examples where the (semi-) naive approach loops and SLD-resolution terminates. For
instance, consider the goal fib(5, X) and the following program (extended with the
appropriate definition of add /3):
fib(0, 1).
fib(1, 1).
fib(X + 2, Y ) fib(X + 1, Z), fib(X, W ), add (Z, W, Y ).
The SLD-derivation terminates but both the naive and the semi-naive evaluation loop.
The reason is that both naive and semi-naive evaluation blindly generate consequences
without taking the goal into account. However, the fact fib(5, 8) is obtained early on
in the iteration. (In fact, if it was not for the addition it would be computed in the
fourth iteration.)
Both naive and semi-naive evaluation also lend themselves to set-oriented operations in contrast to SLD-resolution which uses a tuple-at-a-time strategy. The setoriented approach is often advantageous in database applications where data may
reside on secondary storage and the number of disk accesses must be minimized.
15.3
Magic Transformation
234
the program P and a goal A into a new program magic(P { A}) which may be
executed by the naive or semi-naive algorithm.
One of the problems with the semi-naive evaluation is that it blindly generates
consequences which are not always needed to answer a specific query. This can be
repaired by inserting a filter (an extra condition) into the body of each program
clause A0 A1 , . . . , An so that (an instance of) A0 is a consequence of the program
only if it is needed in order to compute an answer to a specific atomic goal.
For the purpose of defining such filters, the alphabet of predicate symbols is
extended with one new predicate symbol call p for each original predicate symbol
p. If A is of the form p(t1 , . . . , tn ) then call (A) will be used to denote the atom
call p(t1 , . . . , tn ). Such an atom is called a magic template. The basic transformation
scheme may be formulated as follows:
Definition 15.4 (Magic transformation) Let magic(P ) be the smallest program
such that if A0 A1 , . . . , An P then:
A0 call (A0 ), A1 , . . . , An magic(P );
call (Ai ) call (A0 ), A1 , . . . , Ai1 magic(P ) for each 1 i n.
Given an initial goal A a transformed clause of the form:
A0 call (A0 ), A1 , . . . , An
can be interpreted as follows:
A0 is true if A0 is needed (to answer A) and A1 , . . . , An are true.
The statement . . . is needed (to answer A) can also be read as . . . is called (in a
goal-directed computation of A). Similarly a clause of the form:
call (Ai ) call (A0 ), A1 , . . . , Ai1
can then be understood as follows:
Ai is called if A0 is called and A1 , . . . , Ai1 are true.
Hence, the first clause extends each clause of the original program with a filter as
described above and the second clause defines when a filter is true. The magic transformation can be said to encode a top-down computation with Prologs computation
rule. In fact, as will be illustrated below there is a close correspondence between the
semi-naive evaluation of the magic program and the SLD-derivations of the original
program.
Example 15.5 Let P be the program in Example 15.1. Then magic(P ) is the following program:
path(X, Y ) call path(X, Y ), edge(X, Y ).
path(X, Y ) call path(X, Y ), path(X, Z), edge(Z, Y ).
edge(a, b) call edge(a, b).
edge(b, a) call edge(b, a).
call edge(X, Y ) call path(X, Y ).
call path(X, Z) call path(X, Y ).
call edge(Z, Y ) call path(X, Y ), path(X, Z).
235
XXXXX
XXX
3: path(X, Z ), edge(Z , Y ).
2: edge(X, Y ).
,@
HHH
H
, @
6: edge(X, Z ), edge(Z , Y ).
4: 2
5: 2
HHH
H
7: edge(b, Y ).
8: edge(a, Y ).
1: path(X, Y ).
X=a,
Y =b
X=b,
Y =a
9: 2
X=a,
Y =a
10: 2
X=b,
Y =b
For instance, note that the last clause may be read: edge(Z, Y ) is called if path(X, Y )
is called and path(X, Z) is true. Now compare this with the recursive clause of the
original program in Example 15.1!
Note that the program in the example does not contain any facts. Hence, no atomic
formula can be a logical consequence of the program. In order to be able to use the
magic program for answering a query the program has to be extended with such a
fact. More precisely, in order to answer an atomic goal A the transformed program
must be extended with the fact call (A). The fact may be read A is called.
Example 15.6 Consider a goal path(X, Y ) to the program in Example 15.1. The
semi-naive evaluation of the transformed program looks as follows:
x0
x1
x2
x3
x4
x5
=
=
=
=
=
=
{call path(X, Y )}
{call edge(X, Y )}
{edge(a, b), edge(b, a)}
{path(a, b), path(b, a)}
{call edge(a, Y ), call edge(b, Y ), path(a, a), path(b, b)}
Hence, the evaluation terminates and produces the expected answers: path(a, a),
path(a, b), path(b, a) and path(b, b).
It is interesting to compare the semi-naive evaluation of the magic program with the
SLD-tree of the goal path(X, Y ) with respect to the original program.
The selected subgoal in the root of the SLD-tree in Figure 15.3 is path(X, Y ).
Conceptually this amounts to a call to the procedure path/2. In the magic computation
this corresponds to the state before the first iteration. The first iteration generates the
fact call edge(X, Y ) which corresponds to the selection of the subgoal edge(X, Y ) in
node 2 of the SLD-tree. Simultaneously, path(X, Z0 ) is selected in node 3. However,
236
s1
s0
s3
s4
sn
s2
this is not explicitly visible in x1 since call path(X, Y ) and call path(X, Z0 ) are
renamings of each other. Iteration two yields two answers to the call to edge(X, Y );
namely edge(a, b) and edge(b, a) corresponding to nodes 4 and 5 in the SLD-tree. These
nodes also provide answers to the call path(X, Y ) (and path(X, Z0 )) and correspond
to the result of iteration three, and so forth.
The magic approach can be shown to be both sound and complete:
Theorem 15.7 (Soundness of magic) Let P be a definite program and A an
atomic goal. If A naive(magic(P { A})) then P |= (A).
Theorem 15.8 (Completeness of magic) Let P be a definite program and A
an atomic goal. If P |= (A) then there exists A naive(magic(P { A})) such
that A is an instance of A.
The magic approach combines advantages of naive (and semi-naive) evaluation with
goal-directedness. In particular, it has a much improved termination behaviour over
both SLD-resolution and naive (and semi-naive) evaluation of the original program P :
If the SLD-tree of A is finite then naive(magic(P { A})) terminates;
If naive(P ) terminates, then naive(magic(P { A})) terminates;
Moreover, the magic approach sometimes avoids repeating computations. Consider
the following program and graph in Figure 15.4:
path(X, Y ) edge(X, Y ).
path(X, Y ) edge(X, Z), path(Z, Y ).
Even if the SLD-tree of path(s0 , X) is finite the tree contains two branches which
are identical up to variable renaming one that computes all paths from s3 via s0 and
s1 and one branch that computes all paths from s3 via s0 and s2 . By using semi-naive
evaluation of the transformed program this is avoided since the algorithm computes a
set of magic templates and answers to the templates.
15.4
Optimizations
The magic transformation described in the previous section may be modified in various
ways to optimize the query-answering process. We give here a brief account of some
potential optimizations without going too much into technical detail.
15.4 Optimizations
237
Supplementary magic
Each iteration of the naive evaluation amounts to computing:
solve((A1 , . . . , An ), I)
for each program clause A0 A1 , . . . , An . This in turn amounts to finding an mgu of
sets of equations of the form:
.
.
{A1 = B1 , . . . , An = Bn }
If the program contains several clauses with common subgoals it means that the same
unification steps are repeated in each iteration of the evaluation. (The same can be
said about semi-naive evaluation.) This is a crucial observation for evaluation of magic
programs as the magic transformation of a clause A0 A1 , . . . , An gives rise to the
following sub-program:
call (A1 ) call (A0 ).
call (A2 ) call (A0 ), A1 .
call (A3 ) call (A0 ), A1 , A2 .
..
.
call (An ) call (A0 ), A1 , A2 , . . . , An1 .
A0 call (A0 ), A1 , A2 , . . . , An1 , An .
Hence, naive and semi-naive evaluation run the risk of having to repeat a great many
unification steps in each iteration of the evaluation.
It is possible to factor out the common subgoals using so-called supplementary
predicates 0 , . . . , n ; Let X be the sequence of all variables in the original clause and
let the supplementary predicates be defined as follows:
O (X) call (A )
O (X) O (X), A
0
..
.
n (X)
n1 (X), An
Intuitively, i (X) describes the state of the computation in a goal-directed computation of A0 A1 , . . . , An after the success of Ai (or before A1 if i = 0). For instance,
the last clause states that if n1 (X) is the state of the computation before calling
An and An succeeds then n (X) is the state of the computation after An .
Using supplementary predicates the magic transformation may be reformulated as
follows:
call (Ai+1 )
A0
O (X).
O (X).
i
(0 i < n)
238
Subsumption
In general we are only interested in most general answers to a goal. That is to say,
if the answer A1 is a special case of A2 then we are only interested in A2 . (This is
why the definition of SLD-resolution involves only most general unifiers.) In a naive or
semi-naive evaluation it may happen that the set being computed contains two atoms,
A1 and A2 , where A1 is an instance of A2 (i.e. there is a substitution such that
A1 = A2 ). Then A1 is said to be subsumed by A2 . In this case A1 is redundant and
may be removed from the set without sacrificing completeness of the query-answering
process. Moreover, keeping the set as small as possible also improves performance of
the algorithms. In the worst case, redundancy due to subsumption may propagate
leading to an explosion in the size of the set.
From a theoretical perspective it is easy to extend both naive and semi-naive
evaluation with a normalization procedure which removes redundancy from the set.
However, checking for subsumption may be so expensive from the computational point
of view (and is so rarely needed), that it is often not used in practice.
Exercises
239
call child (X, Z) call sd (X, Y ).
call child (Y, W ) call sd (X, Y ), child (X, Z).
call sd (Z, W ) call sd(X, Y ), child (X, Z), child (Y, W ).
In this particular case it would probably be more efficient to emit the clauses:
call child (X, Z) call sd (X, Y ).
call child (Y, W ) call sd (X, Y ).
call sd (Z, W ) call sd(X, Y ), child (X, Z), child (Y, W ).
Intuitively this means that the two calls to child /2 are carried out in parallel as
soon as sd /2 is called. The recursive call, on the other hand, goes ahead only if the
two calls to child /2 succeed.
This example illustrates that there are variations of the magic transformation which
potentially yield more efficient programs. However, in order to exploit such variations
the transformation must be parameterized by the strategy for solving the subgoals of
each clause. Which strategy to use relies on the flow of data between atoms in the
program and may require global analysis of the program. Such strategies are commonly
called sips (sideways information passing strategies) and the problem of generating
efficient strategies is an active area of research (see Ullman (1989) for further reading).
Exercises
15.1 Transform the following program using Definition 15.4:
expr(X, Z) expr(X, [+|Y ]), expr(Y, Z).
expr([id|Y ], Y ).
Then use naive and semi-naive evaluation to compute answers to the goal:
expr([id, +, id], X).
What happens if the goal is evaluated using SLD-resolution and the original
program?
15.2 Consider the program sd /2 on p. 238 and the following family tree:
child (b, a). child (c, a). child (d, b). child (e, b).
child (g, d). child (h, d). child (i, e). child (j, f ).
Transform the program using (a) magic templates (b) supplementary magic.
Then compute the answers to the goal:
sd (d, X)
240
242
A.1 Foundations
243
244
model) in the case of stratified (resp. locally stratified) programs. By allowing partial
(or three-valued) interpretations it applies to arbitrary general programs. Several alternative characterizations of the well-founded semantics can be found in the literature
(see Apt and Bol (1994)). An alternative to the well-founded semantics was proposed
by Gelfond and Lifschitz (1988) who suggested a notion of stable models. The stable model semantics coincides with perfect model semantics (and thus, well-founded
semantics) in the case of locally stratified programs. However, in the general case it
assigns a set of minimal models to a programs.
There is no well-established equivalent of SLDNF-resolution for computing answers
to goals with the well-founded semantics (or stable model semantics) as the underlying
declarative semantics. Przymusinski (1989) and Ross (1992) suggested a notion of
(global) SLS-resolution which is an idealistic and non-effective procedural semantics for
computing answers to goals using well-founded semantics as the underlying declarative
semantics. An alternative approach based on the notion of search forest was proposed
by Bol and Degerstedt (1993a). A similar idea was independently suggested by Chen
and Warren (1993).
One of the main shortcomings of the negation as finite failure rule is the disability
to fully handle existentially quantified negative subgoals that is, queries which
intuitively read is there an X such that p(X)?. This restriction has motivated a
number of techniques with the ability of producing answers (roughly speaking, bindings
for X) to this type of goals. This area of research is commonly called constructive
negation. For further reading see Chan (1988), Drabent (1995b) or Maluszy
nski and
N
aslund (1989).
As pointed out in Chapter 3 negation as implemented in Prolog, is unsound. In
particular, the subgoal A fails when the goal A succeeds. In a sound implementation it is necessary to check that the computed answer substitution for A is empty.
Still there are implementations such as NU-Prolog (cf. Thom and Zobel (1987)), which
incorporate sound versions of negation. In addition NU-Prolog allows variables to be
existentially quantified within the scope of . This, and other features of NU-Prolog,
are reported by Naish (1985) and (1986).
For a fine and extensive survey of negation in logic programming see Apt and Bol
(1994). Surveys are also provided e.g. by Shepherdson (1988).
CUT AND ARITHMETIC: Cut and built-in arithmetic are part of the ISO
Prolog standard (1995). Our discussion on the effects of cut is somewhat simplified
since it does not take into account the effects of combining cut with other built-in
predicates of Prolog. For an extensive treatment of different uses and effects of cut
see OKeefe (1990). Several logic programming languages have tried to introduce a
cleaner approach to built-in arithmetic than that employed in the Prolog standard.
For details, see e.g. Maluszy
nski et al. (1993).
A.2
Programming in Logic
DEDUCTIVE DATABASES: As pointed out in Chapter 6 there are many similarities between relational databases (as first defined by Codd (1970)) and logic programming in that they are both used to describe relations between objects. There has
245
been a growing interest in the database community to use logic programs as a language for representing data, integrity constraints, views and queries in a single uniform
framework. Several survey articles of the field of deductive databases are available.
For instance, both Gallaire, Minker and Nicolas (1984) and Reiter (1984) provide
extensive comparison between logic and relational databases, but use a richer logical
language than that normally found in the logic programming literature. Ullman (1988)
and (1989) provides a thorough introduction both to traditional database theory and
the use of logic programming for describing relational databases. Minker (1988) gives
a historical account of the field of deductive databases and discusses its relation to
negation.
Several suggestions have been put forward on how to increase the expressive power
of deductive databases. In a series of papers Lloyd and Topor (1984; 1985; 1986)
suggest several extensions. The main idea is to extend logic programs to include a
notion of program clauses which are formulas of the form (A F ) where A is an
atom and F is an arbitrary typed formula of predicate logic. It is shown how to compile
program clauses into Prolog programs. They also raise the problem of how to handle
integrity constraints. Roughly speaking, an integrity constraint is a formula which
constrains the information which may be stored in the database. The validity of the
constraints must be checked every time updates are made to the database. Lloyd,
Sonenberg and Topor (1987) provide a method for checking the validity of integrity
constraints in the case of stratified databases. A recapitulation of these results is also
available in Lloyd (1987).
The notion of integrity constraints concerns updates in databases. The semantics
of database updates is a major problem, not only in logic programming systems, but
in any system which must maintain consistent information. The problems become
particularly difficult when the updates are made while making deductions from the
database, since adding information to or deleting information from the database may
invalidate conclusions already made. These are problems which have engaged quite a
number of researchers in different fields. A common suggestion is to treat the database
as a collection of theories and to specify, explicitly, in which theory to prove subgoals.
Some alternative approaches have been suggested by Bacha (1987), Bowen (1985),
Bowen and Kowalski (1982), Hill and Lloyd (1988b) and Warren (1984).
RECURSIVE DATA-STRUCTURES: Most of the programs in Chapter 7 (together with programs operating on other recursive data structures) can be found in
Prolog monographs such as Clocksin and Mellish (1994), Sterling and Shapiro (1994)
and OKeefe (1990). Difference lists were discussed together with several other datastructures by Clark and Tarnlund (1977). Ways of transforming programs operating
on lists into programs operating on difference lists were discussed by Hansson and
T
arnlund (1981), Zhang and Grant (1988) and Marriott and Sndergaard (1988).
META-LOGICAL REASONING: The idea to describe a language in itself is
not new. Many of the most important results on computability and incompleteness of
predicate logic are based on this idea. For instance, G
odels incompleteness theorem
and the undecidability of the halting problem (see e.g. Boolos and Jeffrey (1980)
for a comprehensive account of these results). Bowen and Kowalski (1982) raised
the possibility of amalgamating the object- and meta-language in the case of logic
246
247
deviate somewhat from that implemented in most Prolog systems. In most implementations DCGs are viewed merely as a syntactic sugar for Prolog and, as a consequence,
all of Prolog built-in features (including cut, negation etc.) may be inserted into the
grammar rules. Any users manual of specific Prolog systems that support DCGs can
fill in the remaining gaps.
The simple translation of DCGs into Prolog clauses shown in Section 10.5 is by no
means the only possibility. Matsumoto et al. (1983) describe a left-corner bottom-up
strategy. Nilsson (1986) showed how to translate an arbitrary DCG into a Prolog program which embodies the LR(k) parsing technique. Finally, Cohen and Hickey (1987)
describe a whole range of parsing techniques and their use in compiler construction.
A large number of formalisms similar to DCGs have been suggested. Some of
the most noteworthy are Abramsons Definite Clause Translation Grammars (1984)
(which are closely related to attribute grammars) and Gapping Grammars by Dahl and
Abramson (1984). These, and other formalisms, are surveyed by Dahl and Abramson
(1989). For an extensive account of the use of Prolog in natural language processing, see Dahl (1994) and monographs by Pereira and Shieber (1987) (who also make
extensive use of partial evaluation techniques) and Gazdar and Mellish (1989).
SEARCHING: Chapter 11 presents some fundamental concepts related to the
problem of searching in a state space. Several other, more advanced techniques can
be found in textbooks by Bratko (1990), Sterling and Shapiro (1994), Clocksin and
Mellish (1994) and OKeefe (1990).
A.3
248
249
CONSTRAINTS: The use of constraints (see Leler (1988) and Steele (1980)) in
logic programming is closely related to the integration of logical and functional languages. Colmerauers Prolog II (1982; 1984), now succeeded by Prolog III (1990),
seems to be the first logic programming language that makes extensive use of constraints. In the case of Prolog II the constraints are restricted to equalities and disequalities over rational trees. Jaffar and Lassez (1987) lay the foundation for combining logic programming with other constraint domains by providing a parameterized
framework CLP(X ), where X may be instantiated to various domains. An instance
of the scheme CLP (R) where R stands for the domain of real numbers was
implemented at Monash University, Australia (see Heintze, Michaylov and Stuckey
(1987a) and Jaffar and Michaylov (1987)). Several applications of the system have
been demonstrated. For instance, in electrical engineering (Heintze et al. (1987b))
and in option trading (see Lassez, McAloon and Yap (1987)).
Several other constraint logic programming systems have been proposed. CAL,
by Aiba et al. (1988), supports (non-)linear algebraic polynomial equations, boolean
equations and linear inequalities. The language CHIP supports equations over finite
domains, Booleans and rational numbers (see Dincbas et al. (1988) and Van Hentenryck (1989)). CHIP subsequently split into several successor languages (such as Sepia
and cc(FD)). Prolog III provides constraints over the binary Boolean algebra, strings
and linear equations over the reals and rational numbers (see Colmerauer (1990)).
CLP(BNR) contains constraints over real and integer intervals, finite domains and the
Boolean algebra. The language CLP( ) supports constraints over domains of regular
sets (see Walinsky (1989)). The language LIFE supports constraints over a domain of
order-sorted feature trees (see At-Kaci and Podelski (1993)).
Imbert, Cohen and Weeger (1993) describe an incremental and efficient algorithm
for testing the satisfiability of linear constraints. They also describe how to incorporate
the algorithm into a Prolog meta-interpreter.
Constraints may also be combined with concurrent logic programming as shown
by Maher (1987). Saraswat (1993) proposed a family of concurrent constraint (logic)
programming languages. The language AKL (Agents Kernel Language)1 is a multiparadigm language which combines constraints with dont-care non-deteminism of
concurrent logic programming and (a restricted form of) dont-know non-determinism
of Prolog (see Janson (1994)). AKL provides constraints over finite domains and is in
several respects similar to the language Oz developed by Smolka (see Schulte, Smolka
and W
urtz (1994)).
Jaffar and Maher (1994) provide an excellent survey of the theory, implementation
and applications of constraint logic programming.
QUERY-ANSWERING IN DEDUCTIVE DATABASES: Two main streams
can be singled out in query-processing of deductive databases. One approach is based
on naive- or semi-naive evaluation of a transformed program. A large number of transformations have been proposed for various classes of programs. Most notably magic
sets of Bancilhon, Maier, Sagiv and Ullman (1986) and magic templates of Ramakrishnan (1988). For an introduction to these techniques and other methods such as
counting, envelopes see Bancilhon and Ramakrishnan (1988).
1 Formerly
called the ANDORRA Kernel Language (see Haridi and Brand (1988)).
250
Appendix B
Basic Set Theory
This appendix contains a brief summary of basic set theoretic notions used in the book.
It is not intended to be an introduction. To this end we recommend reading Gill (1976)
or Grimaldi (1994) or some other introductory textbook on discrete mathematics.
B.1
Sets
252
Let S be a set. By S we denote the set of all strings (sequences) of elements from
S. That is, S = {x1 , . . . , xn | n 0 xi S (1 i n)}. Note that S contains the
string of length 0, denoted and called the empty string.
B.2
Relations
B.3
Functions
Appendix C
Answers to Selected Exercises
1.1 The following is a possible solution (but not the only one):
X(natural(X) Y (equal (s(X), Y )))
Xbetter(X, taking a nap)
X(integer (X) negative(X))
X, Y (name(X, Y ) innocent(X) changed (Y ))
X(area of cs(X) important for (logic, X)
X(renter(X) in accident (X) pay deductible(X))
1.2 The following is a possible solution (but not the only one):
better(bronze medal, nothing)
Xbetter (X, gold medal )
better (bronze medal , gold medal )
1.3 Let MOD(X) denote the set of all models of the formulas X. Then:
P |= F
iff
iff
iff
iff
MOD(P ) MOD(F )
MOD(P ) MOD(F ) = ?
MOD(P {F }) = ?
P {F } is unsatisfiable
= |=
= |=
= |=
= |=
253
G whenever = |= F
G or = 6|= F
F or = |= G
F G
254
1.6 Let MOD(X) denote the set of all models of the formula X. Then:
F G iff
iff
iff
MOD(F ) = MOD(G)
MOD(F ) MOD(G) and MOD(G) MOD(F )
{F } |= G and {G} |= F
1.8 Hint: Assume that there is a finite interpretation and establish a contradiction
using the semantics of formulas.
1.12 Hints:
E() = (E): by the definition of application it suffices to consider the case
when E is a variable.
() = (): it suffices to show that the two substitutions give the same
result when applied to an arbitrary variable. The fact that E() = (E)
can be used to complete the proof.
1.15 Only the last one. (Look for counter-examples of the first two!)
2.1 Definite clauses:
(1)
(2)
(3)
(4)
p(X) q(X).
p(X) q(X, Y ), r(X).
r(X) p(X), q(X).
p(X) q(X), r(X).
0
1
2
3
= ?
= {q(a, g(b)), q(b, g(b))}
= {p(f (b))} TP 1
= TP 2
That is, MP = TP 3.
2.7 Use the immediate consequence operator:
TP 0 = ?
TP 1 = {p(0, 0, 0), p(0, s(0), s(0)), p(0, s(s(0)), s(s(0))), . . .}
TP 2 = {p(s(0), 0, s(0)), p(s(0), s(0), s(s(0))), . . .} TP 1
..
.
TP
255
3.1 {X/a, Y /a}, not unifiable, {X/f (a), Y /a, Z/a} and the last pair is not unifiable
because of occur-check.
3.2 Let be a unifier of s and t. By the definition of mgu there is a substitution
such that = . Now since is a renaming it follows also that = 1 .
Thus, for every unifier of s and t there is a substitution 1 such that
= ()( 1 ).
3.4 Assume that is a unifier of s and t. Then by definition = for some
substitution . Moreover, = since is idempotent. Thus, = .
Next, assume that = . Since is an mgu it must follow that is a unifier.
3.5 {X/b} is produced twice and {X/a} once.
3.6 For instance, the program and goal:
p.
p p, q.
Prologs computation rule produces an infinite tree whereas a computation
rule which always selects the rightmost subgoal yields a finitely failed tree.
3.7 Infinitely many. But there are only two answers, X = b and X = a.
4.4 Hint: Each clause of the form:
p(t1 , . . . , tm ) B
in P gives rise to a formula of the form:
p(X1 , . . . , Xm ) . . . . . . (X1 = t1 , . . . , Xm = tm , B) . . .
in comp(P ). Use truth-preserving rewritings of this formula to obtain the
program clause.
4.7 Only P1 and P3 .
4.8 comp(P ) consists of:
p(X1 ) X1 = a, q(b)
q(X1 ) 2
and some equalities including a = a and b = b.
4.14 The well-founded model is {r, s}.
5.1 Without cut there are seven answers. Replacing true(1) by cut eliminates the
answers X = e, Y = c and X = e, Y = d. Replacing true(2) by cut eliminates
in addition X = b, Y = c and X = b, Y = d.
5.3 The goal without negation gives the answer X = a while the other goal succeeds without binding X.
5.4 For example:
var(X) not(not(X = a)), not(not(X = b)).
256
257
258
259
7.20 Hint: Represent the empty binary tree by the constant empty and the nonempty tree by node(X, Left, Right) where X is the label and Left and Right
the two subtrees of the node.
8.3 The following program provides a starting point (the program finds all refutations but it does not terminate):
prove(Goal)
int(Depth), dfid(Goal, Depth, 0).
dfid (true, Depth, Depth).
dfid ((X, Y ), Depth, N ewDepth)
dfid (X, Depth, T mpDepth),
dfid (Y, T mpDepth, N ewDepth).
dfid (X, s(Depth), N ewDepth)
clause(X, Y ),
dfid (Y, Depth, N ewDepth).
int(s(0)).
int(s(X))
int(X).
8.4 Hint: For instance, the fourth rule may be defined as follows:
d(X + Y, Dx + Dy) d(X, Dx), d(Y, Dy).
10.3 Definite clause grammar:
bleat [b], aaa.
aaa [a].
aaa [a], aaa.
Prolog program:
bleat(X0, X2 ) connects(X0 , b, X1 ), aaa(X1 , X2 ).
aaa(X0 , X1 ) connects(X0 , a, X1 ).
aaa(X0 , X2 ) connects(X0 , a, X1 ), aaa(X1 , X2 ).
connects([X|Y ], X, Y ).
A refutation is obtained, for instance, by giving the goal bleat([b, a, a], []).
10.4 The DCG describes a language consisting only of the empty string. However,
at the same time it defines the concatenation-relation among lists. That is,
the nonterminal x([a, b], [c, d], X) not only derives the empty string but also
binds X to [a, b, c, d].
12.1 The definition of append/3 and member/2 is left to the reader:
260
12.2 Hint: write a program which transposes the second matrix and then computes
all inner products.
13.3 Hint: The overall structure of the proof is as follows:
.
E ` app(nil, X) = X
.
.
.
E ` app(c(X, Y ), Z) = c(X, app(Y, Z)) E ` a = a
E` =
.
.
E` =
E` =
.
E` =
14.3 The following program with real-valued or rational constraints can be used to
answer e.g. the goal jugs([M, 1 M, 0], Res, N ).
jugs([A, B, C], [A, B, C], N )
.
.
N = 0, A + B + C = 1.
jugs([A, B, C], Res, N )
N > 0,
jugs([0.6 A + 0.2 B, 0.7 B + 0.4 A, C + 0.1 B], Res, N 1).
15.1 The transformed program looks as follows:
expr(X, Z)
call expr(X, Z), expr(X, [+|Y ]), expr(Y, Z).
expr([id|Y ], Y )
call expr([id|Y ], Y ).
call expr(X, [+|Y ])
call expr(X, Z).
call expr(Y, Z)
call expr(X, Z), expr(X, [+|Y ]).
Adding call expr([id, +, id], X) to the program yields the semi-naive iteration:
=
=
=
=
=
261
262
Bibliography
Abiteboul, S., Hull, R., and Vianu, V. (1995). Foundations of Databases. AddisonWesley.
Abramson, H. (1984). Definite Clause Translation Grammars. In Proc. 1984 Symp. on
Logic Programming, Atlantic City, pages 233241.
Aiba, A., Sakai, K., Sato, Y., Hawley, D., and Hasegawa, R. (1988). Constraint
Logic Programming Language CAL. In Proc. of Intl Conf. on Fifth Generation
Computer Systems 88, Tokyo, pages 263276.
At-Kaci, H. and Podelski, A. (1993). Towards a Meaning of LIFE. J. of Logic
Programming, 16(34):195234.
Apt, K. (1990). Introduction to Logic Programming. In van Leeuwen, J., editor, Handbook of Theoretical Computer Science: Formal Models and Semantics, volume B,
chapter 10, pages 493574. Elsevier.
Apt, K., Blair, H., and Walker, A. (1988). Towards a Theory of Declarative Knowledge. In Minker, J., editor, Foundations of Deductive Databases and Logic Programming, pages 89148. Morgan Kaufmann, Los Altos.
Apt, K. and Bol, R. (1994). Logic Programming and Negation: A Survey. J. of Logic
Programming, 19/20:971.
Apt, K. and Doets, K. (1994). A New Definition of SLDNF-resolution. J. of Logic
Programming, 18(2):177190.
Apt, K. and Pellegrini, A. (1992). Why the Occur-check is Not a Problem. In Proc. of
PLILP92, Lecture Notes in Computer Science 631, pages 123. Springer-Verlag.
Apt, K. and van Emden, M. (1982). Contributions to the Theory of Logic Programming. J. of ACM, 29(3):841862.
263
264
Bibliography
Bibliography
265
266
Bibliography
Bibliography
267
Dincbas, M., Van Hentenryck, P., Simonis, H., Aggoun, A., Graf, T., and Berthier, F.
(1988). The Constraint Logic Programming Language CHIP. In Intl. Conf. on
Fifth Generation Computer Systems, volume 2, pages 693702.
Doets, K. (1994). From Logic to Logic Programming. MIT Press.
Drabent, W. (1995a). Completeness of SLDNF-resolution for Non-floundering Queries.
Submitted for publication.
Drabent, W. (1995b). What is Failure? An Approach to Constructive Negation. Acta
Informatica, 32(1):2759.
Eder, E. (1985). Properties of Substitutions and Unifications. J. Symbolic Computation, 1:3146.
Ershov, A. P. et al., editors (1988). Selected Papers from the Workshop on Partial
Evaluation and Mixed Computation. Special issue of New Generation Computing,
6(2-3).
F. Pereira, F. and Warren, D. H. D. (1980). Definite Clause Grammars for Language AnalysisA Survey of the Formalism and a Comparison with Augmented
Transision Networks. Artificial Intelligence, 13:231278.
Fitting, M. (1985). A Kripke-Kleene Semantics for Logic Programs. J. of Logic
Programming, 2(4):295312.
Gallaire, H., Minker, J., and Nicolas, J.-M. (1984). Logic and Databases: A Deductive
Approach. Computing Surveys, 16(2):153185.
Gallier, J. and Raatz, S. (1986). SLD-Resolution Methods for Horn Clauses with
Equality Based on E-Unification. In Proc. 1986 Symp. on Logic Programming,
Salt Lake City, pages 168179.
Galton, A. (1990). Logic for Information Technology. John Wiley & Sons.
Gazdar, G. and Mellish, C. (1989). Natural Language Processing in Prolog. AddisonWesley.
Gelfond, M. and Lifschitz, V. (1988). The Stable Model Semantics for Logic Programming. In Proc. of Fifth Intl Conf./Symp. on Logic Programming, Seattle, pages
10701080. MIT Press.
Gill, A. (1976). Applied Algebra for the Computer Sciences. Prentice-Hall.
Gregory, S. (1987). Parallel Logic Programming in PARLOG. Addison-Wesley.
Grimaldi, R. (1994). Discrete and Combinatorial Mathematics. Addison-Wesley.
Hansson,
A. and T
arnlund, S.-
A. (1981). Program Transformation by Data Structure
Mapping. In Clark, K. and T
arnlund, S.-
A., editors, Logic Programming, pages
117122. Academic Press.
268
Bibliography
Bibliography
269
ISO (1995). Information TechnologyProgramming LanguagePrologPart 1: General core. ISO/IEC DIS 13211-1:1995(E).
Jaffar, J. and Lassez, J.-L. (1987). Constraint Logic Programming. In Conf. Record
of 14th Annual ACM Symp. on POPL.
Jaffar, J., Lassez, J.-L., and Lloyd, J. (1983). Completeness of the Negation as Failure
Rule. In Proc. of IJCAI-83, pages 500506, Karlsruhe.
Jaffar, J., Lassez, J.-L., and Maher, M. (1984). A Theory of Complete Logic Programs
with Equality. J. of Logic Programming, 1(3):211223.
Jaffar, J., Lassez, J.-L., and Maher, M. (1986). Logic Programming Language Scheme.
In DeGroot, D. and Lindstrom, G., editors, Logic Programming, Functions, Relations and Equations, pages 441467. Prentice-Hall.
Jaffar, J. and Maher, M. (1994). Constraint Logic Programming: A Survey. J. of
Logic Programming, 19/20:503581.
Jaffar, J. and Michaylov, S. (1987). Methodology and Implementation of a CLP
System. In Proc. of Fourth Intl Conf. on Logic Programming, Melbourne, pages
196218. MIT Press.
Janson, S. (1994). AKLA Multiparadigm Programming Language. Phd thesis, Uppsala Univ, Computing Science Dept.
Kakas, A., Kowalski, R., and Toni, F. (1992). Abductive Logic Programming. J. of
Logic and Computation, 2.
Knight, K. (1989). Unification: A Multidisciplinary Survey. ACM Computing Surveys,
21(1):93124.
Komorowski, H. J. (1981). A Specification of an Abstract Prolog Machine and its
Application to Partial Evaluation. PhD thesis, Linkoping University.
Komorowski, H. J. (1982). QLOG The Programming Environment for Prolog in
Lisp. In Clark, K. and Tarnlund, S.-
A., editors, Logic Programming, pages 315
324. Academic Press.
Kowalski, R. (1974). Predicate Logic as a Programming Language. In Information
Processing 74, pages 569574. North-Holland.
Kowalski, R. (1979a). Algorithm = Logic + Control. Communications of the ACM,
22(7):424436.
Kowalski, R. (1979b). Logic For Problem Solving. Elsevier, North-Holland, New York.
Kowalski, R. and Kuehner, D. (1972). Linear Resolution with Selection Function.
Artificial Intelligence, 2:227260.
Kunen, K. (1987).
4(4):289308.
J. of Logic Programming,
270
Bibliography
Bibliography
271
272
Bibliography
Bibliography
273
IEEE Computer,
Shapiro, E., editor (1988). Concurrent Prolog: Collected Papers. MIT Press.
Shapiro, E. (1989). The Family of Concurrent Logic Programming Languages. Computing Surveys, 21(3):413510.
Shepherdson, J. (1988). Negation in Logic Programming. In Minker, J., editor, Foundations of Deductive Databases and Logic Programming, pages 1988. Morgan
Kaufmann, Los Altos.
Shoenfield, J. (1967). Mathematical Logic. Addison-Wesley.
Siekmann, J. (1984). Universal Unification. In Shostak, R. E., editor, Proc. of 7th
CADE, pages 142.
Siekmann, J. and Wrightson, G., editors (1983a). Automation of Reasoning I. SpringerVerlag.
Siekmann, J. and Wrightson, G., editors (1983b).
Springer-Verlag.
Slagle, J. R. (1974). Automated Theorem-Proving for Theories with Simplifiers, Commutativity and Associativity. J. of ACM, 28(3):622642.
Snyder, W. and Gallier, J. (1990). Higher Order-Unification Revisited: Complete Sets
of Transformations. In Kirchner, C., editor, Unification. Academic Press.
Stark, R. (1990). A Direct Proof for the Completeness of SLD-resolution. In CSL89,
Lecture Notes in Computer Science 440, pages 382383. Springer-Verlag.
Stark, R. (1992). The Proof Theory of Logic Programs with Negation. Phd thesis,
Univ of Bern.
Stark, R. (1993). Input/Output Dependencies of Normal Logic Programs. J. of Logic
and Computation. To appear.
Steele, G. L. (1980). The Definition and Implementation of a Computer Programming
Language based on Constraints. PhD thesis, MIT AITR 595, M.I.T.
Sterling, L. and Beer, R. (1989). Metainterpreters for Expert System Construction.
J. of Logic Programming, 6(1):163178.
Sterling, L. and Lakhotia, A. (1988). Composing Prolog Meta-Interpreters. In Proc. of
Fifth Intl Conf./Symp. on Logic Programming, Seattle, pages 386403. MIT
Press.
Sterling, L. and Shapiro, E. (1994). The Art of Prolog. MIT Press, 2nd edition.
274
Bibliography
Bibliography
275
276
Bibliography
Index
hx1 , . . . , xn i, 251
?, 251
= (t), 8
(S), 251
f (), 42
f /n, 5
f : S1 S2 , 252
f 1 , 252
f2 f1 , 252
p/n, 6
x S, 251
BA , 24
UA , 24
comp(P ), 62
magic(P ), 234
ground (P ), 29
|=|, 7
Dom(x), 15
F G, 12
MP , 28
P |= F , 11
P ` F , 14
Range(x), 15
S , 251
S n , 251
S1 S2 , 251
S1 S2 , 251
S1 \ S2 , 251
S1 S2 , 251
S1 S2 , 251
TP (x), 29
TP , 30
UP /E , 208
2, 21
Z, 251
\+, 92
N , 251
Q , 251
R, 251
, 14, 163
F, 7
F, 7
A , 137
= |= Q, 9
, 38
, 21
abduction, 152
AKL, 249
ALF, 248
allowed, 77
alphabet, 4, 5
answer constraint, 218
arithmetic, 9397, 244
arity, 4, 5
asserta/1, 144
assertz/1, 144
atom, 6
pq
277
278
attribute, 102
automated reasoning, 241
BABEL, 248
backtracking, 52, 88
backward-chaining, 152
body, 196
body of clause, 20
bound, 7
breadth-first, 53, 185
CAL, 223, 249
canonical model, 69, 78
cartesian product, 105, 251
CHIP, 222, 249
clause, 21
definite, 20
general, 67
guarded, 197
clause/2, 143
closed, 7
closed world assumption, 60, 77, 243
closure
existential, 7
reflexive, 112
symmetric, 111
transitive, 111
universal, 7
CLP( ), 249
CLP(X), 249
CLP(BNR), 222, 249
CLP(R), 249
codomain, 252
collecting proofs, 153
commit operator, 196, 197, 247
completeness, 14
of equational logic, 204
completion, 6165, 243
three-valued, 7577
composition, 252
computation rule, 43
independence of, 47, 56
Prologs, 45
conclusion, 13
concurrent constraint languages, 249
concurrent logic programming, 196
Concurrent Prolog, 197, 247
Index
conditional answer, 218
conjunction, 4, 6
consistent, see proof tree
constant, 4, 5
constrain-and-generate, 225
constraint, 214
Boolean, 223
equational, 226
monoid, 226
numerical, 224
constraint logic programming, 213227
constraint store, 217
context-free grammars, 163
coroutining, 193
cut, 8792, 244
green, 91
red, 91
cut-node, 88
cwa, see closed world assumption
D-interpretation, 216
D-model, 216
database
extensional, 103
intensional, 103
database relation, 101
datalog, 103
DCG, 171
deadlock, 196
declarative, 3, 19
deductive databases, 103104, 229239,
244
definite
clause, 20
goal, 23, 35
program, 19, 21, 242
program with equality, 95, 207
Definite Clause Grammar, 171176, 246
DeMorgans law, 13, 36
depth-first, 52, 185
depth-first-iterative-deepening, 147
derivability, 14
derivation
of CFG, 164
of DCG, 171
derivation tree, 53, 216
determinism, 36
Index
difference, 105
difference list, 129131, 167, 245
disjunction, 6
domain, 7, 101, 252
domain closure assumption, 108
E-base, 208
E-interpretation, 208
E-unification, 95, 204207
E-unifier, 95, 205
E-universe, 208
Earley deduction, 250
elementary tree, 53
empty goal, 23
equality theory, 95, 204
equation, 37, 53, 204, 226
equivalence, 6
fact, 19
failed derivation, 47
fair derivation, 64
finite failure
completeness of, 64
soundness of, 64
fixed point, 29, 81, 242
flat, 197
floundering, 73
formula, 4, 6
atomic, 6
forward-chaining, 152
free, 7
free equality axioms, 63
function, 5, 252
bijection, 252
inverse, 252
partial, 252
total, 252
functor, 5
FUNLOG, 248
G
odel, 246
general
clause, 67
goal, 65
program, 67
generate-and-test, 226
GHC, 247
goal
279
definite, 23
empty, 23
general, 65
ground, 7
guard, 196, 247
Guarded Horn Clauses, 247
head of clause, 20
Herbrand
base, 24
interpretation, 25
model, 26
partial interpretation, 76
universe, 24
Horn clause, 242
IC-Prolog, 247
immediate consequence operator, 29, 69,
78, 209, 230, 242
imperative, 3
implication, 4, 6
inconsistent, 14
inductive definition, 125
inference engine, 149
inference rule, 13, 204
infinite failure, 77
instance, 15
integrity constraint, 245
interpretation, 7
partial, 76
supported, 78
interrogative, 3
knowledge-base, 149
-Prolog, 248
language, 135
meta, 135
object, 135
LEAF, 248
lemmas, 145
LIFE, 249
list, 120129
head of, 120
tail of, 120
literal, 21
locally stratified programs, 243
log, 181
280
logical
connective, 4, 6
consequence, 11, 76, 204
equivalence, 12
LOGLISP, 248
magic sets, 249
magic template, 234, 249
magic transformation, 234
main tree, 71
meta-circular interpreter, 136
meta-interpreter, 136
Metamorphosis Grammars, 246
mgu, see unifier, most general
model, 10, 24, 204
canonical, 69, 78
Herbrand, 2430
intended, 21, 28
intersection property, 28
least, 29
least Herbrand, 27, 30, 83
minimal, 29
standard, 69, 83
well-founded, 80
modus ponens, 13, 36
MYCIN, 150
naive evaluation, 231
narrowing, 207
natural join, 106
negation, 4, 6, 5985, 90, 92, 143, 243
as failure, 60, 243
constructive, 244
unsafe use of, 157, 186
nondeterminism, 36
dont care, 196
dont know, 196
nonterminal
of CFG, 163
of DCG, 171
NU-Prolog, 244
occur-check, 41, 50, 130
OLDT-resolution, 250
operational semantics, 33
Oz, 249
pair, 251
Index
parallelism
AND, 193
OR, 196
PARLOG, 247
partial evaluation, 246
partial order, 112
Peano axioms, 93
perfect model, 243
POPLOG, 248
predicate, 6
predicate symbol, 4
premise, 13
process, 193
production rule, 150
of CFG, 163
projection, 106
Prolog, 5, 41, 74, 8798, 143146, 175
Prolog II, 249
Prolog III, 222, 249
proof tree, 5356, 217
consistent, 54
QLOG, 248
quantifier, 6
existential, 4
universal, 4
query-language, 107
query-the-user, 154
rational tree, 227
recursive data structure, 119
reductio ad absurdum, 36
reflexive, see relation
relation, 3, 252
anti-symmetric, 109, 252
asymmetric, 109
database, 101
equivalence, 112, 252
identity, 252
partial order, 252
reflexive, 109, 252
symmetric, 109, 252
transitive, 109, 252
relation scheme, 102
relational algebra, 104107
relational databases, 101103
Relational Language, 247
Index
renaming, see substitution, renaming
resolution, 33, 43
retract/1, 146
rule, 19
safe computation rule, 67
satisfiable, 10, 217
selection, 106
selection function, 43
self-interpreter, 136
semantics, 5
of formulas, 9
of terms, 8
semi-naive evaluation, 233
shell, 150
SICStus Prolog, 223
sideways information passing, 238, 250
SLD-AL-resolution, 250
SLD-derivation, 44
complete, 47
failed, 47
infinite, 47
SLD-refutation, 46
SLD-resolution, 19, 3353, 242
completeness of, 51
soundness of, 49
SLD-tree, 47, 235
finitely failed, 60
SLDE-resolution, 210
SLDNF-derivation, 71
finitely failed, 66, 72
infinite, 71
refutation, 72
stuck, 66, 72
SLDNF-forest, 70
SLDNF-resolution, 243
completeness of, 77
for definite programs, 6567
for general programs, 7074
soundness of, 66, 74, 76
SLDNF-tree, 71
SLS-resolution, 83, 244
solution, 37
solved form, 38, 54, 219
algorithm, 40
soundness, 13, 14, 21
of equational logic, 204
281
stable models, 244
standard model, 69
state, 179
state-space, 179
stratified program, 68
string, 251
structure
algebraic, 7
subgoal, 23
subsidiary tree, 71
substitution, 14
application of, 15
composition of, 15
computed, 45
computed answer, 46
empty, 14
generality of, 38
idempotent, 15
renaming, 42
subsumption, 238
supplementary magic, 237, 250
symmetric, see relation
syntax, 5
tabulation, 250
term, 6
compound, 5, 114
terminal
of CFG, 163
of DCG, 171
three-valued logic, 75
transitive, see relation
tuple, 4, 251
type, 103
type declaration, 104
uncertainty, 149
unfolding, 168
unfounded set, 79
unification, 3743, 242
unifier, 35, 38
most general, 38
union, 105
unit-clause, see fact
universe, 3
unsatisfiable, 10, 12, 36
update, 245
282
valuation, 8, 9
variable, 4, 5
local, 218
read-only, 194
write-enabled, 194
view, 104
well-founded semantics, 7783, 243
Index