Fuzziness and Randomness
Fuzziness and Randomness
Abstract. This paper presents a survey and some new results of the mathematical
investigation into formal connections between two types of uncertainty: fuzziness
and randomness.
1 Introduction
In his pioneering work on random elements in metric spaces, Fn3chet (1948)
pointed out that besides standard random objects (such as points, vectors,
functions), nature, science and technology offer other random elements, some
of which cannot be described mathematically. For example, to each population
of humans, chosen at random, one might be interested in its "morality," its
"political spiritj" to each town chosen at random, one might be interested in
its "form," its "beauty," .... It is clear that when we use natural language to
describe properties of things, we often run into such situations. A property p
on a collection of objects il defines a subset A of il, namely those elements of
il which possess the property p, provided that p is crisp, in the sense that each
element of il has the property or does not have it. If a property p stands for
"tall" in a human population, it is not clear how p determines a subset of il.
Concepts such as "tall" are called fuzzy concepts. Thus, examples of random
elements mentioned by Frechet are fuzzy concepts chosen at random. In 1965,
Zadeh (1965) proposed a mathematical theory for modeling offuzzy concepts,
in which fuzziness is a matter of degree and is described by membership
functions.
While it appears that fuzziness and randomness are two distinct types
of uncertainty, it is of interest to find out whether or not there exist for-
mal relations between them. This is similar to Potential Theory and Markov
Processes where a formal connection between them is beneficial : Potential
Theory provides powerful tools for studying Markov processes, Markov pro-
cesses provide probability interpretations for various concepts in Potential
Theory. This dual aspect is also reminiscent in many other areas of mathe-
matics : Fourier or Laplace tranforms are considered as appropriate according
to the need for a time domain analysis or a frequency domain analysisj or, as
an analogue with complex analyis : using complex variable z = x + iy such
as in residue representation theorems and complex Taylor series expansions,
but alternatively, at times, considering the real part (x) and the imaginary
part (y) such as in the Cauchy-Riemann criterion and in harmonic analysis.
C. Bertoluzza et al. (eds.), Statistical Modeling, Analysis and Management of Fuzzy Data
© Springer-Verlag Berlin Heidelberg 2002
4 I.R. Goodman & H.T. Nguyen
where III denotes the cardinality of the set I. This important result is referred
to as Choquet Theorem, see,e.g. Matheron (1975).
The capacity functional T of the random closed set S is defined as
But
n-i
L (~-i) (_I)k = 0 for every i = 1,2, ... , n - 1
k=O
Hence
L (-I)III+IT(UiEI) = bn = T(Bn) ~ T(nk=lB k ).
{I:0#~{1,2, ... ,n} }
The range R(SA) of the canonical random set SA associated with the
fuzzy set A is nested in the sense that R( SA) = {At : 0 ::; t ::; I} is
totally ordered (by set-inclusion). It is clear that P(w : SA(W) E R(SA)) = 1.
Moreover, for any At E R(SA)'
{w : At <:;; SA(W)} = {w : A(At) <:;; [a(w), I]} = {w : a(w) ::; inf A(At )} E A
where, as usual, A(At) is the image set of the set At by the function A(.),
i.e. {A(x) : x E Ad. In fact,
VB <:;; U, {w : B <:;; SA(W)} = {w : a(w) ::; in! A(B)} E A.
This leads to the following formal definition:
8 I.R. Goodman & H.T. Nguyen
Let B E R(S). If B = 0, then (2) is clearly satisfied since both sides are
equal to 1. Thus, consider the case where B =1= 0. Let W(B) = {D E R(S) :
0=1= DeB}.
If W(B) = 0, then for any x E B, we have, since R(S) is totally ordered
If W(B) =1= 0, then there exists some x E B n D' for any D E W(B). For
that x, (3) is clearly satisfied. Thus, whenever B =1= 0, there is an x E B such
that (3) holds.
Now
Thus,
JL(B) = 1
00
v{u: (A(u) 2: t) n B}dt for any B s;;: U
By analogy with standard Measure Theory, we can write dJL/dv = f, and call
fthe Radon-Nikodym derivative of JL with respect to v.
Remark 3. The problem of finding all possible random sets S which represent
a given fuzzy set A of a (finite) set U will be studied in Section 6. In the next
section, we are going to establish isomorphic and homomorphic-like relations
between Zadeh fuzzy logic operators and ordinary set operators over canonical
random sets.
Since canonical nested random sets representing fuzzy sets via covering func-
tions are randomized level sets, the connections between operations on fuzzy
sets and operations on (random) sets are essentially based upon results con-
cerning a-level sets.
Let J be an arbitrary index set, and A (j), j E J, be fuzzy subsets of
U. Then !\jEJ A(j), VjEJ A(j) stand for fuzzy sets of U with membership
functions inf { A (j) (.) : j E J }, sup { A (j) (.) : j E J }, respectively. For any
a E [0,1]' we have:
10 I.R. Goodman & H.T. Nguyen
but in general,
U A~jl ~ ( V A(j))
jEJ jEJ a
with equality if "ix E U, sup {A(j)(x) : j E J} is attained on J. This
fact is somewhat related to Nguyen's Theorem (1978) on level-sets of fuzzy
sets defined via Zadeh's extension principle. See also Fuller and Keresztfalvi
(1990), Bertoluzza and Bodini (1998). When J is finite, the above condition
is satisfied and hence equality holds for V. Recall that the (fuzzy/as well as
the ordinary) negation of A, denoted as A', has membership function 1-A(.).
Obviously, (A')a -=I- (Aa)'.
The probabilistic versions of the above are as follows. Let A and B be
fuzzy sets of U. Viewing now a as a random variable uniformly distributed
on [0,1]. We have, "ix E U :
it follows that
thus
~ P(UjEJ{W: x E A~{w)})'
As for negation, we note that, for each w,
and
A~(w) = {x E U: A'(x) > 1- a(w)}.
Thus,
P {w :(u.i,j E J) E EB
jEJ
A~{W)}
°
for an even number or for an odd number of i's.
(ii) C is grounded, i.e. C(Xl,'" ,xn) = for all (Xl, ... ,xn) such that Xi =
for at least one i.
°
(iii) Any (one-dimensional) margin C i of C satisfies Ci(x) = X for X E [0,1],
where C i : [0,1] -> [0,1] is defined as Ci(x) = C(l, ... , 1, x, 1, ... ,1), X
being located at the ith position.
Copulas are closely related to t-norms: associative 2-copulas are t-norms,
2-increasing t-norms are 2-copulas. The (DeMorgan) dual (or co-) copula of
an n-copula C is defined as C* (Xl, ... ,Xn ) = 1 - C(l - Xl> ... , 1 - xn). The
basic Sklar Theorem is this. If F is the joint cumulative distribution function
ofthe random vector (Xl"'" Xn) with marginal Fj,j = 1, ... , n, then there
exists a unique n-copula C such that F(Xl"" ,xn) = C(Fl(Xl), ... ,Fn(xn))
for all Xj E R Conversely, any n-copula C together the one-dimensional Fj's
define a legitimate joint distribution function this way. See Schweizer and
Sklar (1983).
With the above notations, it can be verified that : Let A (j) be fuzzy sets
of Uj, then
= P(UjEJ{W : Uj E (A(j))",(w)})
L (( -l)IIIC(A(j)(uj),j E 1)).
0#~{1, ... ,n}
Fuzziness and randomness 13
Let A be a fuzzy subset of U. Let S(A) denote the class of all random sets
on U having A as their common covering function. We are going to specify
S(A) in the case where U is finite.
Without lost of generality, assume U = {I, 2, ... ,n}. A random set S on
U is characterized by its probability function f : P(U) -7 [0,1] where
GA(i) (x)
0,
= { 1- A(i),
if X < °
ifO:S;x<1
1, if 1:S; X
If the fuzzy set A is given, then the marginal cdfs G A(i), i = 1, ... , n
where C is an n-copula.
Thus,
Remark 4. The above result can be readily extended to the case of a finite
number of fuzzy sets on finite domains. Specifically, let A (j) be fuzzy sets of
Uj, j E J (a finite index set). Then the joint distribution of (Sj, j E J),
where each Sj E S(ACi)), is of the form C(GA(j)(x), X E Uj , j E J) where C
is a I UjEJ (Uj X {j}) I-copula
14 LR. Goodman & H.T. Nguyen
with the convention that when K = 0, the corresponding term is 1. But for
K =f. 0,
p(njEK{W : Vj(w) = O}) = C(P(w: Vj(w) :::; 0) : j E K)
= C(P(w : Vj(w) = 0) : j E K) = C((1- A(j)(uj)) : j E K)
= 1 - C* (A(j) (Uj) :j E K).
Thus,
= L ((-1)IKI+1C*(A(j)(uj): j E K).
0i-Kr;,J
Remark 5. The expression on the right hand side of Theorem 3( (i)) in general
does not coincide with C(A(j)(uj),j E J). But, by choosing a restricted family
for C (and thus C*) it does coincide. This includes C = min or product.
This is also related to the issue of characterizing homomorphic-like relations
for arbitrary finite combinations of C and C* acting upon the A(j)'s. See
Goodman (1994).
Fuzziness and randomness 15
7 Some applications
L
xEU
A(x) = 1aEP(U)
ji,(a)d(PS-l)(a) = E(ISI).
where x = (Xl, ... , Xn) E IR n is the input vector, the Aji's and Bj's are
linguistic labels (fuzzy concepts in a natural language), y is the output scalar,
say. The approach to modeling and deriving control laws using Fuzzy Sets
Theory is called Fuzzy Control in the literature. First, it consists of modeling
the above linguistic labels by fuzzy sets of appropriate spaces. Next, decide
upon some inferential method to translate and combine information. For
example, the strength of each above rule R j is defined as
then the (typical) fuzzy output is obtained as a weighted average of the fuzzy
sets Bj's, via the extension principle, generalizing Minkowski's operations on
ordinary sets :
r
Bx(.) = L wj(x)Bj(.).
j=l
Fuzziness and randomness 17
For a given input x, the typical value Bx is precisely the " expected
value" of the random fuzzy set which takes values B j with corresponding
probabilities Wj(x), j = 1,2, ... ,r. The numerical output y, when the input
is x, is obtained by "defuzzifying" the fuzzy set Bx :
where>. denotes Lebesgue measure. Using again the fact that, if S is a random
set in U (~ IR)having the fuzzy set (on U) A as its covering function, then
we get
COA(A) = [E(C(S)>'(S))]· [E(>'(8))]-1
which is a sort of conditional expected centroid of 8 with respect to >'(8).
A multivariate version (i.e. for D ~ IRn) of the above exists using vector
means. Note that in many situations, such as when A(.) is strictly unimodal,
symmetric, then, with 8 being the canonical random set, COA(A) can be
taken as E(C(8)) in some approximate fashion.
Modeling and manipulating fuzzy rules are essential in applying fuzzy
technology to real world problems. A fuzzy rule is an uncertain conditional of
the form: "If X is A then Y is B" where X, Y are variables and A, B are fuzzy
subsets. Since such rules are in general uncertain, it is necessary to attach
to them their degrees of applicability, indicating their "strength". Two issues
arise. What is the logic behind using some form of implication modeling? How
the empirical "weights of evidence" of rules are obtained? The two issues are
related. In fact, from a practical point of view, the (empirically obtained)
strengths of the rules should dictate how the rules are going to be modelled.
This is typical in probabilistic systems in which conditional probabilities are
empirical strengths for "If... Then .... " rules. While in fuzzy systems, i.e.
systems involving fuzzy sets, there are several ways to model rules and to
extract their strengths consistently, e.g. in standard fuzzy control, it seems
that a satisfactory mathematical concept for " fuzzy conditionals" is lacking.
In the following, we will indicate a solution to this problem, based upon our
18 LR. Goodman & H.T. Nguyen
work on conditional events (see. e.g. Goodman et al., 1991, Goodman et al.,
1997) and on random set representations of fuzzy sets.
A rule can be written as a conditional A ==* B, where A and B are crisp
sets, elements of a (O")-algebra A of subsets of n. In the context of boolean
logic, it is natural to interprete such a rule as material implication, i.e. A'UB.
However, if the strength of A ==* B is quantified as conditional probability
P(BJA) (= P(A n B)/ P(A)), then obviously the material implication is not
appropriate, since
[AB, A -t B] = {C E A: An B ~ C ~ A' U B}
tJi: A x A -t A*
where AB stands for An B, and terms like AB, A' x AB are short hand
notation for AB x n x n x .... i.e. representing the cylinder in n* with base
AB, and thus U among these terms is the union of subsets in n*. Next, for any
P on (n,A), let P* denote the infinite product measure on (n*,A*) whose
one- dimensional marginals are all identical to P. Note that the terms in the
Fuzziness and randomness 19
which can be explicitly evaluated. For details see Goodman et al. (1997).
Another situation where covering functions of random sets can be related
to fuzzy concepts is in the usual way fuzzy logic employs modifiers. In general,
the modifier of a fuzzy concept A of U is obtained by composition with a fuzzy
subset M of the unit interval [0,1] : M 0 A, for example, "very A" is (A)2, i.e.
take M(x) = x 2 . Now the canonical random set of such a modifier is clearly
r(m,n,C) = C m - 1 X C' X c n- m
Note that we can in fact suppress C in the above because the construc-
tion of E(n, m, C) is valid for any such C. Applications of relational event
algebra, including constant-probability events, arise mainly in combination,
comparisons and testing for similarity of models. See again Goodman et al.
(1997) for details.
References
1. Bertoluzza, C. and Bodini, A. (1998). A new proof of Nguyen's compatibility
theorem in a more general context, Fuzzy Sets and Systems 95, 99-102.
2. Frechet, M. (1948). Les elements aleatoires de nature que1conque dans un espace
distancie, Ann. Inst. Henri Poincare X-IV, 215-310.
3. Fuller, R. and Keresztfalvi, T. (1990). On generalization of Nguyen's theorem,
Fuzzy Sets and Systems 41, 371-374.
4. Goodman, I.R. (1976). Some relations between fuzzy sets and random sets.
Preprint (cited in Nguyen, H.T. (1979) Some mathematical tools for linguistic
probabilities, Fuzzy Sets and Systems 2, 53-65.)
5. Goodman, I.R. (1994). A new characterization of fuzzy logic operators pro-
ducing homomorphic-like relations with one-point coverages of random sets.
In Advances in Fuzzy Theory and Technology. vol II ( P.P.Wang, Ed.). Duke
Univ., Durham, NC, 133-159.
6. Goodman, I.R. and Nguyen, H.T. (1985). Uncertainty Models for Knowledge-
Based Systems. North-Holland, Amsterdam.
7. Goodman, I.R., Nguyen, H.T. and Walker, E.A. (1991). Conditional Inference
and Logic for Intelligent Systems. North-Holland, Amsterdam.
Fuzziness and randomness 21