Principios para Machine Learning
Principios para Machine Learning
B y J. M ercer, .A
B, Trinity , Cambridge.
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
Introduction.
k (s,t) 6 (s) dt
may behave:—
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
[ [ (s) 0 {t) ds 0;
J a Ja
[ [ x(s,t) 6(
s) 6 (t) ds dt = tJ- [ \fjn (s) 0
Ja *a 7i= l a _
and \ u k2, ..., \ n, ..., respectively, are the corresponding singular values. It follows
at once from this that, when the singular values are all positive, k {s, t) is of positive
* ‘ Gott. Nachr.’ (1904), pp. 69-70. See also Schmidt, ‘ Math. Ann.,’ Band 63, pp. 452, 453. We
shall refer to the result given above as H ilbert’s theorem. The theorem stated by H ilbert on p. 70 of
the paper referred to can be deduced by writing 6{s) — x (s) + y (s) in the equation written above.
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 417
type in accordance with the above definition. Conversely, we may prove that, for
every function of positive type, the above integral equation has only positive singular
values. For, if we multiply along the homogeneous equation
'I’n(s) = fK k (. s, (t)
da
by if*n ,)sa( nd integrate with respect to s between the limits and we obtain
rb rb
K/
c(s, t) x\}n(s) xfjn( ) ds dt = 1.
Ja Ja
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
Since the double integral on the left cannot be negative, and \ n is a finite number,
it appears th a t
K > o.
Thus the necessary and sufficient condition that a continuous symmetric function
should be o f positive type is that the integral equation o f the second kind o f which it is
the characteristic function should have all singular values positive* '
In a similar manner it may be proved th at this statement remains true when we
replace the word positive by evitagn,in both places where it occurs.* M
since a function must be of ambiguous type when it is of neither the positive nor the
negative type, we conclude th a t the necessary and sufficient condition fo r a continuous
symmetric function to be o f ambiguous type is the existence o f both p
negative singular values o f the integral equation o f the second hind o f which it is the
characteristic function.
§ 3. I t is easy to see that, corresponding to a function k ( , t ) whose type is
ambiguous, there exists a function 9 (s)which is not zero in the
and satisfies the relation
[ f ks,( t) 0 (s)
For, if we employ the notation of (i) above, and suppose th at k is any real constant,
we shall have
f I K(s’ 0 [0i (*) + ^ 2 (s)] [0i (0 + &02 (*)] i I k (s, t) 6X(s) (t) ds dt
J aJ a J aJ a
+kf [ k5,( t) [#! ( s)92(t) + 9^(s) 9X(i)] ds
JaJa JaJa
* It follows from these results that, unless k (s, t)si identically zero, we can
| k (s, t) 0 (s) 6 (/) ds dt = 0,
for all members of 0. We shall prove this result in a different manner further on (§ 12), but it is useful to
make the remark at this stage, since it shows conclusively. that a function which is not identically zero
cannot be both of positive and negative type.
VOL. CCIX.— A. 3 H
418 MR. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
The coefficient of k2 on the right has a sign opposite to th at of the term independent
of k;accordingly, when we equate the right-hand member to zero, the resulting
quadratic has its roots real. It follows that, if we suppose one of them to be a, the
function
0 (s)= 01 (+ a02
will satisfy (A), and it cannot be identically zero, because this would imply th at 01(
is a constant multiple of 02 ,)as( nd hence th a t the two integrals m
the same sign.
The converse of this theorem, however, is not true, for there are functions both of
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
the positive and of the negative type which agree in this property with those of
ambiguous type; these are known as the semfun
called definite snoitc,uf and have the property th a t (A) can only be satisfied by
function 0 (s) which is zero at each point of
The two classes of functions we have just mentioned have distinctive properties in
the theory of integral equations. For, if t) is of positive or negative type, it is
evident from H ilbert ’s theorem th at (A) can only hold when
f
da
i pn()s6 (s)ds = 0 = 1, 2, ...).
Thus the necessary and sufficient condition that a function o f positive or negative
type should be definite is that it should be perfect.
( b - a )2 L t[* °h) ^2(a i) + K(a 2>a a)+ ... + *(«„, a») hfiafi + 2K(au aa) Ojaffi+ ... ]
respectively, and will evidently be positive numbers less than unity at interior points.
Consider now the values of the function
Si) si)
at the various points of the square a ^ t ^ b o± the (s, t) plane. In the
accompanying figure this large square, which we shall denote by Q, is intersected by*
* See, for example, B romwich, ‘ Quadratic Forms and their Classification by means of Invariant
Factors’ (1907), chap, ii., where necessary conditions are obtained. It is not difficult to obtain conditions
which are both necessary and sufficient.
3 h 2
420 ME. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYhE*
two sets of four lines drawn parallel to the axes of s and these are the lines
t = s1±rj, t = s1±(r) + e); s = s ^ r j, s = s1±(r) +
resp
identified by observing th at the number at the point where any one of them
intersects an axis is the value of the corresponding variable which is constant along
it. It will thus be seen th at the square denoted by is bounded by the four lines
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
A X I S OF S
may be looked upon as j k (s, t) 0e>v(s ; sx) 0(<r)( t ;taken over Q, or, as it
usually w ritten,#
I * s;( t ) 0e>r)(s;
JQ
and, from what has been said in the preceding paragraph, th a t portion of the latter
which arises from the part of Q exterior to d n is zero, while th at arising from qn is
simply
k ( s , t ) dt).
*hn
W e have, therefore,
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
( f k (s , t ) 0 e>ri(s] Sx)0e>ri( t ; s j d s d t
•J a J a
Again the total area of dn is 4e(2i7 + e), and so, it M is the maximum value of
| k ( s,t) | in Q, we have
*si-v s*-7!
which is evidently equal to
( k (sx + u, Sx + v) du dv.
J — y] J — yj
Recalling our hypothesis that k (s , t) is of positive type, it follows from this and
(3) th at
rfa 2e (2^ + e) M,
C
*f. H obson, ‘ The Theory of Functions of a Real V ariable’ (1907), p. 416.
422 MR. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
for all values of e which are less than a certain positive number (§ 5). But this is
evidently impossible, because, when e tends to zero, the right-hand side tends to zero,
and we arrive at the contradiction th at a fixed positive quantity (viz., 7 is less
than, or equal to, zero.
W e conclude th at k (sx, sx)cannot be negative when sx lies
(a, ;)b and hence, since k (s, s )is continuous in the same inte
closed, we have the result th at every function k ( 5 , t) 'which is o f positive type in the
square a < s < b, ^a t<6 satisfies the inequality
§ 7. This is a first condition which must be satisfied by these functions, and we may
obtain a second on similar lines. Let sx and be any two distinct points of the open
interval ( a,b), and, as before, let e and 77 be two positive numbers ; the latter will no
be supposed so small th at the intervals [sx—(77 + 6), sx+ (77+ e)], [s2—(17+ e), s2+ (1?+ e)]
are both contained within (a, b) and do not overlap. We now propose to consider the
values of the function
at points interior to Q, when xx and x 2 are any real constants. For this purpose we may
make use of a diagram (fig. 2) which is an obvious extension of the one employed in
the previous paragraph. The square Q is divided in this case not by eight, but by sixteen
lines, viz., those whose equations are s = sa± 77, .9 —sa± (
(a, /3 = 1, 2). By giving a and (3 all possible values in the equations just written, it
will be seen th at we obtain four sets of eight, for each of which we can distinguish a
square q# bounded by the lines s = sa ± 77, t = s^ 7±7 ; mor
evidently have borders dag of width e. I t is not difficult to see that, in those parts
of Q which are exterior to the borders daf} (a1, 2),
0e,v(s
or
^e,;r(t 5 ,<?l) = ^e,r, 5 ^2) = ^ 5 I
sa) = sp) = 1,
* The reader may compare this with the fact that, when we have a quadratic form which only assumes
non-negative values, and we put all the variables save one (say xx) equal to zero, we deduce that the
coefficient of aq2 must be >: 0.
f Both these pairs of equalities will hold in certain parts of the square, but we only require that at
least one of them should be true.
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 423
and th a t in the border daf}the last pair of equations still hold, but 0ttr) ;
are each less than, or equal to, unity. From this it appears th at the function
for the sake of brevity. I t follows from the remarks of the preceding paragraph th at
rb rb 2 2 r
k ( s , t) 0k(s) 9 (t) 'ds dt = Xx aXp k (s, t) d
*a J a a-1 ^= 1
2 2 r
2 2 x ax p ( , t) (< dt)
a = l /3= 1
^a/3
J <7 «
can be w ritten as
From this and the equation (4) we finally obtain the inequality
If P P F2(w, <
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
F 2{u, v) <
for | u|< r),| v|< 77. From this we deduce the inequality
fa < < b\
xxk (sx, sx)+ 2xxx2ks(1? s2)-t- x 2 k (s2, s2) >: 0
\a < s2< b) ‘
§ 9. The reader will now be prepared for a general theorem of which those already
considered are particular cases. After having been through the latter in detail it will
be sufficient to sketch the general proof.
Take any n distinct point sx,s2,..., sn in the open interval (
and y are so small th at the intervals [sa—(17+ e), sa+ (^?+ e)] (« = 1, 2,..., form a
non-overlapping set contained within (a, b). Now let
0{s) = t x a6 ^ ( s \ ),
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 425
where x u x 2, . . . , x na re any real constants; and consider the values of the function
0 (s) 0 (t)in Q. I t will be seen on consideration th at in this general case Q must be
regarded as divided by 8 nl
ines, and th at there are 2 squares each
border da/3 (a, (3 =1, 2 ,..., n).I t will also be seen th at
where
F„ ( u , v ) = x ? k (sl + u, sx+ v) +x £ k
+ (<§!-f + v') + ... ;
and hence we establish th a t Fre (0, 0) is always >: 0. Eventually we obtain the
general theorem :—
Every function k ( s,t) which is o f positive type in the square a < .9 < b, < 6
must be such tah, when sx, s 2, ..., sn awe any points o f the
have
X \ K (§i, Si) + X 2 K ( S 2,S2) + ... + X n2K ( , Sre) + (<9x, 2) 4" ...
k ( s u S i ) K ( S i , S 2) K ( S i , S n)
S-y, S 2, Sn
K
^*2? • • ' J S]l K ( S ,2 Si) K (<92, ^2) (s2, 6 n)
Then, by the theory of quadratic forms, it is known that, in virtue of the inequality
which has just been obtained, we must have#
k ( Su S‘2, s n\ 0.....
Vk, ^2, V
* Vide Bromwich, ‘ Quadratic Forms and their Classification by means of Invariant Factors’ (1906),
pp. 19, 20.
VOL. CCIX.—A. 3 I
426 MR. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
and this is true independently of the number of points, su and their situation
in the interval ( a, b).
Conversely, by an appeal to the theory of integral equations, we may prove th at
any continuous symmetric, function k (s,t)defined in Q
is of positive type. For it will be remembered that, according to F r e d h o l m ’s
theory,# the singular values of the equation
f ( s ) = <j>( s ) - \
Ja
f K t) (t) (0
are the zeros of the integral function
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
Applying our hypothesis th at (6) holds for all values of s1} s2, ..., it appears th at
the coefficient of ^ — din the series on the right cannot be nega
H il b e r t has proved th at every continuous symmetric function has its singular values
all real. It follows, therefore, that, if Xr is any one of the zeros of D (X), we shall
have
2 rb rb b rb
^1) ^2? • • • 5 S2r
1+ *' ' -• ] dsx ds2... ds2n
2! \Si ,s 2J 2 >a a \^1? ^2? • • • ) ^2n
where the series in the square brackets on the left is not negative and that on the
right is positive; and hence, that \ r must be positive. Since we have seen that, for
k ( s ,t ) to be of positive type, it is sufficient th at all the singular values of (7) should be
positive, we may now state the following theorem :—
In order that a continuous symmetric function k (s , t) defined in the square
a< s< b, <
a t < b may be o f positive
functions
/ Si, S2\ ..,s n\
•K («1, Si), K \Si,S2/ ’ ” K\Si, s2, •. s j ( 8)
should never take negative values when the variables s2, ..., sn each range over
the closed interval (a, b).
Vide ‘ Acta Mathematical XXVII (1903).
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 427
I t may be remarked that, as a corollary of this theorem, we have the notable fact
th at, if any continuous symmetric function is such th at the integrals
are none of them negative, then the functions (8) have the same property.
§ 11. The properties of the determinants (8) may be used to obtain some idea of the
nature of functions of positive type. Let us suppose, in the first place, th at there is
a point (cq, cq) belonging to Q at which one of these functions k vanishes. The
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
determinant k ^ (^ \ evidently reduces to —[#c (s, eq)]2; hence, because it can never
be negative,
k( s,cq) = kcq,
( s) = 0.
In other words, if we draw the square Q and the diagonal the existence of a
point (cq, cq) on this diagonal at which k ( s , )t vanishes in
vanishes everywhere on the lines drawn through this point parallel to the axes of s
and t. In particular, we deduce from this th a t function k (s, t) is o f positive
type, and is not zero everywhere Q
in , cannot vanish everywhere on the
More generally, let us suppose th at there are points cq, cq, ..., an of the interval
(cq h) such th at
dl.j CC2y •••) CLn
d \ y d 2y CLn • • •?
(0
By considering the determinant whose elements are the first minors of the four
elements belonging to the first two rows and columns of
S5 di, ( 10 )
Sy CLi? 0^2,
we obtain the equation4
Becalling th at the first term on the right vanishes in virtue of our hypothesis, and
th at neither of the terms in the product on the left can be negative, it is clear that
we have
s, cq,
cq, cq, ••• 5 a}
—L < k (s, t) S. L
in the whole of the square Q. This follows immediately from the fact that, since
we have
k (.9, s) k ( t, > [_k £ ) ] 2.
it is evident th at k.s,
( t)is of positive type in Q. Ap
about functions of positive type to k ( s , )t , we may deduc
k (s, t); o
f r instance, the necessary and sufficient condition a continuous symmetric
function k (s ,t) defined in the square a ^
that the functions
should never be negative when the variables 6*x, . sn, ... each range over the closed
interval ( a,b).
W e may remark th at this result and that of § 10 prove the classes of functions of
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 429
positive and negative types to be mutually exclusive, save for the trivial case when
k (.s1, )t vanishes everywhere. For, if k(s, t) belongs to both
k (su s1,)^
0 5x) > 0
for all points of the interval (a, b ) ;and hence k (su must be
this interval. I t follows, then, from a remark made in § 11, th at k (s, is zero in the
whole square Q.
P art III.— C e r t a i n F u n c t io n s of P o s it iv e T y p e .
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
K(
.9, t)=
= <f>(s)0 (t)
where 6 (s) and <j>(s) are both continuous in the interval (a, b). It will be remembered
th at functions of this kind occur as G r e e n ’s functions of certain linear differential
equations of the second order, and th at it is therefore of some interest to know when
they are of positive type. Accordingly we shall seek necessary and sufficient
conditions which will ensure th at this is so.
§ 14. In the first place, let us suppose th at and (,v) are any continuous
functions whatever ; and let t be the set of points belonging to (a, b) at which
neither of them vanish. This set will evidently be dense in itself in virtue of the
* Cf. Bateman , ‘ Messenger of Mathematics,’ New Series, 1907, p. 93.
430 MR. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
continuity of the functions ; but it cannot be closed, unless it contains every point of
the interval. Moreover, it can be proved th at a and /3, its lower and upper limits
respectively, do not belong to the set, unless they coincide with the end points of the
interval.
A t each point of the set X the quotient
will have a definite value, because (f>(.s) is never zero. We may therefore define a
single-valued function f(«), whose domain is and whose value at any point is th at
of this quotient. I t will appear in the sequel th at the properties of k (s, depend
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
very largely on the nature of f (s), and accordingly, in anticipation of this, we shall
Speak of it as the discriminator o f k(
continuous in its domain, hut it will never have the value zero.
§ 15. Let us now suppose th at k (s , t) is of positive type, and is not zero everywhere
in the square Q. We have proved (§ 11) that, under these circumstances, the function
k (sx, which in the present case is simply 0 (f> cannot be zero in the whole
of (a, ;)b also, at points where it does not vanish, we know th at k (sx, $i ) is positive
(§§ 6, 10). It follows that, for a function of positive type, the set X certainly exists,
and th at in it the discriminator only takes positive values.
Again, when s1 and s2 are any two points of X, and > we have
* & 3 = [* W * (*)]*/(*•) [ / ( * ) - / ( * • ) ] ;
/(* i) - / ( * i)-
This result may be combined with the previous one in the statement th at the
discriminator of k ($, t ) is a non-decreasing function whose values are all positive.
We have next to consider the points of ( , b) at which one or both of the functions
0 (s), </>(s) vanish. These fall naturally into three sets, according as they belong to
(l) the closed interval ( a,a), (2) the closed interval (/3, or (3)
(a, /3). As regards (l), it is not difficult to show th at 0 (s)vanishes in the whole
interval. For, if ax is any point of ( a,a), one at l
must be zero ; and hence, since k (au ax) is zero, the function k ax) is zero at each
point of ( a,)b§( 11).
Now when s > axwe have
k (s,ax) = </>(s),
clearly points of t both on its right and on its left. The argument we have ju st
employed will then establish that, by reason of the former, (ay) is zero, and that,
by reason of the latter, <£ (cq) is zero.
§ 16. Conversely, let us suppose th at kis defined in
functions 9 ( s ) , (j> (s)which have the properties mentioned in the preceding paragrap
and let us consider the function
Su s2, .,sn
sl> s2,... , sn
th at, as this function is symmetric, it will take all possible values in the domain
Si < s2< s3< ... < sn.T hus, since we are only concerned with the sign of the func
we may always suppose the variables to satisfy these inequalities. Firstly, let us
suppose th a t one of the variables has a value not belonging to the domain of the
discriminator of k ( s,t). If such a value belongs to (a, a), the point sx must eviden
lie in this in te rv al; hence, since
and 9(sx) vanishes by our hypothesis, it is evident th a t all the elements of the first
row of (12) are zero. In a similar manner it may be proved that, when one of the
variables has a value belonging to the interval (6, /3), all the elements of the last row
vanish. Again, if one of the variables, say sm, has a value belonging to the open
interval (a, /3), but not to we shall have
0 ( O = <£ (sm) = 0
by our hypothesis. It is thus easily seen th at the elements of the mth row of (12) all
vanish. Summing up our results so far, we conclude th at the function (12) can only
take values different from zero when the variables sx, ..., are each confined to
the set 2.
§ 17. Let us next consider the case when the variables are restricted in this manner.
The function (12), when expressed in terms of the functions 6 and <£, is
9 (sx) (f)(sx), 6(
sx) (f>(s2),..., (sx)
0 (sx) (j>(s2), 9 (s2) <j)(s2), ...,
9 (sx) <f> (s3),9 ( s2)(f>(s3), ..., 9 (s3) (j) (
hence, by dividing through both the r th row and the r th column of this determinant
by ()<
■r — L 2, n ),its value is seen to be
/ ( » i). /( * > ) . /W
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
The determinant ju st written can he evaluated without difficulty, and thus we find
th a t (12) is
can never take negative values, when the variables su s2, ..., ... each range over
the interval ( a, b),and hence, by the theorem of § 10, th at
W e may, therefore, state our results in the following theorem :—
If 0 (s)and )s( are each continuous functions the interval ( ,
necessary and sufficient conditions that the function
k (s, t)=
= </>00 0 W (s - 1),
should be o f 'positive type are (1) that the discriminator o f the function should be
positive and non-decreasing in its domain %, and (2) if
and upper limits o f 2, 0 (s)should be zero in the interval a), <
interval (/3, b), and both 6 (s)and <f>(s) zero at points o f the open interr
do not belong to %.
As a corollary of this, by supposing th at (s) 1 < < b), the reader may
deduce the corresponding conditions for the function defined in § 13.
§ 18. Let us now investigate under what circumstances a function which
satisfies the conditions stated in the enunciation of the theorem of § 17, is definite.
If the domain of its discriminator is not dense everywhere, it will be possible to find
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 433
in particular, k ($, t ) will vanish everywhere in the square < s c < £ < d.
Now, if x ( s) any continuous function of s defined in the interval b), which is
zero in the intervals a < s < c, lc<
we shall have
f f f
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
= 0,
by the properties of y (s) and k (,9, £). I t follows from this that, if k (s, £) is definite,
the domain of its discriminator must be dense everywhere in (a, b).
Again, let us suppose th a t the discriminator of k (.9, t) has a constant value
throughout a certain interval (c, d). I t will then be seen th at within the square
c < .9 < d , c < t < d
K (s, t) =p<j>(s) 4> ;
It. may be proved without difficulty th at there exists a function y (s) which is not
everywhere zero, and is such th at
f <Ms) x ( sM 5 = 0. . . . . . . . . . . . . . . . . . . . . . . . . . . (13)
Jc
For, let Xi (s)and X2( sh) e any two functions which are not m
another, and which satisfy the conditions imposed on y ($)• Then, if either of the
integrals
r d r d
<t>(s)Xi{s)ds, (s) \ 2(s) ds
JC Jc
is zero, we shall have an obvious solution of (13). O11 the other hand, if their
respective values /xx, be different from zero, it is easily seen that
X(S) = X ^ ) _ X ^ )
satisfies (13); and, in virtue of our hypothesis, y 18 not zero everywhere in (a, b).
W e conclude, therefore, th at we can always find a function which is such th at
( f
Ja Jfl
K(
.9, £) y (.9 ) y (£) ds dt = 0.
VOL. CCIX.— 3 K
434 MR. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
Now, as xf/ )s(is continuous, and is not zero everywhere, we can find an inter
(c, d) of (a, h) within which it does not vanish; also, as the domain of the discrimi
nator is dense everywhere, it will be possible to find a point, and, therefore, a whole
interval (y, 8), belonging both to (c, d) and the domain. The interval (y, 8) will thus
be such th at in it the functions i jf (s ), 6 (s), (J) (s do not
this interval the function of s
| </>(t) (t) dt . (15)
has a derivative which does not vanish; and hence, by a well-known theorem of the
differential calculus, that this function cannot be zero more than once in (y, 8). It is,
therefore, evident th at by contracting (y, 8) sufficiently we can ensure for it the
additional property th at (15) vanishes at no point belonging to it.
Returning now to the equation (14), and supposing th at s is confined to the
interval (y, 8), we see th at
f ( s ) = —| 0 (t) xp(t) dt ^I j
Hence, since both the numerator and the denominator on the right are
differentiable, and the latter does not vanish in (y, 8), the function
differentiable in this interval. In fact, by applying the ordinary rules, we obtain
/'(« ) = o (r - 5 - §)•
But this is impossible, because by our hypothesis f ( s ) cannot be constant in any
interval. VFe conclude, therefore, th at k ( s , t) is a definite function.
§ 20. I t may be remarked th at the conditions (l) and (2) of the preceding
paragraph may be stated in another and more convenient form. For, if a discrimi-
* Vide§ 3.
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 435
nator satisfying these conditions had the same value at two distinct points, it would
necessarily have th a t value at all points of its domain which lie between them (§ 15).
Thus, since the condition (l) and the continuity of 0 (s), <f>(s) assure us of an interval
of the domain which lies between these points, the condition (2) would be violated.
Hence a discriminator of this kind must be a steadily increasing function; and,
conversely, a steadily increasing discriminator satisfies (2). W e may, therefore,
combine the 'results of the two preceding paragraphs in the theoreiq :—
Thenecessary and sufficient noitdc , that a function k tfi sat
requirements ofthe theorem of § 17, should he , is that its discriminator
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
The discriminator has the open interval ( a,h) for its domain, and its value at any
point is
(s-a )/(h -s),
which steadily increases with s. I t follows from § 17 and the theorem just stated
th at k (s, t) is a definite function of positive type.
§21. Leaving the particular class of functions with which we have been dealing,
let us now suppose th at k (s, t)is any function of positive type defined
a< s< h,a < £ :< 6. Let cq, a2, ..., am be any m points of the interval ( , h) which
are such th a t
. ^ 1) tq, ‘••5
\0q, a2, •.., am
Then the function
,scq, a2, ..., am \/K( ai, (h, •••, «»
f tq, a2i ^mji V/Uj ^2>
K1
/ ^1? ^2) •••5 ^?i? ^2? *•*5
\Si, s2, ..., s„, cq, ct2, ..., am
* This is the generalised form of H ilbert ’s classical function, vide ‘Gott. N acho/ p. 227 (1904).
3 K 2
436 ME. J. MEECER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
The determinant of n rows and columns, whose elements are these minors, will
therefore he
^ {^ \ i •••> /'*lj **2? •••) '^"n\
\a u cq, ..., a j \ ..., s j ‘
hh’ S» M 2: 0 ;
Wl, #2) •••>
Confining our attention to the triangle s < it will he seen that the variables
6* and t can be related to the constant <q by either of the inequalities :—
(i) s<
(ii) s ^ cq <
(iii) cq — s <
The reader may find it convenient to refer to the accompanying diagram, in which
(a,#) (&,$)
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
By expressing h (s, t) in terms of the functions 0 and <j>, it is easily seen th at at each
point of the region (i)
h (s, t) = (f) (s) <P(0 0 (0
(cti) (ax)_
th at in (ii) h (s,t) is everywhere zero, and th at in (iii)
hi (*, t) = h(
s, t)
=0 elsewhere;
and
h2 (s,t) = h (s,
= 0 elsewhere.
h ( s , t) = hi (s, + (s, t)
at each point of the square in which these functions are defined. But it is easily seen
that, as k ( s , t) is of positive type, the functions lir t) satisfy the requirements of
the theorem enunciated in § 17. Thus h t) is merely the sum of two functions of
the same nature as k (s, t), and hence, as it is obvious a priori th at the sum of any
number of functions of positive type is a function of positive type, it appears th at we
do not in this way obtain any new species of these functions.
The reader may convince himself in a similar manner th at the same conclusion
holds in regard to the more general function considered in the preceding paragraph.
§ 23. Although the result of § 21 proves to be so barren in this respect, it may be
applied to obtain an interesting property of the symmetrical minors of the deter
minant of the integral equation
when k (s, t) is of positive type. Adopting the notation and hypothesis of the
paragraph referred to, let A (A.) be the determinant of the above integral equation
when h (.<?, t) replaces k ( s, t). Then, since
and is, therefore, a symmetrical mth minor of D (X), the determinant of (7), in accord
ance with F redholm’s definition. But, as we have shown that h (s, t) is of positive
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 439
ty p e, the function A (X) has its zeros ail real and positive. I t follows, therefore, from
(17) th a t all the zeros of the minor
JQ / ^ . Cl\,Ctg, Cf'm\
\ ? ^2? •• •> ®m/
are real and positive. Since the minor must be identically zero il
K a(s, t) = D (X ; 5, D (X),
where
§ 24. I t is to be remarked th at H ilbert and S chmidt have been able to give very
little information about the expansion of a given symmetric characteristic function in
a series of products of normal functions. H ilbert * has indeed shown incidentally
that, if the number of singular values is finite,
K (s, t) = $ ; .....(18)
n=1
and S chmidt f in his dissertation has established th at this equation remains valid
when the series on the right is uniformly convergent. The latter theorem is, of
course, much wider than the former as regards its generality; but it has the defect
th at the uniform convergence, which it postulates, is not connected with any other of
the properties of k ( s,t). In the present section we shall attem pt to remedy
some measure by proving th at the equality (18) certainly holds when t) is of
positive or negative type.
§ 25. In the paper referred to above, S chmidt* has proved that, if k (s , t) is any
continuous symmetric function, the solution of
take
/ ( S) = K (S, t),
4> (s)= K a
I t follows, therefore, from the above expansion and the homogeneous equations
= 4*n{x) K (x, t) dx 1, 2, . . . ),
Ja
th at
K, (s, t) = K ( s , t ) + i ............ ( 1 9 >
n= 1 Aw VArc — A /
2 | </»* (s)xfjn
the terms of the series on the right of (19) are never greater in absolute value than
those of
1 £ k [i/C2 (s)+ rpn (Q]
2 n =l X?l(Xn—X)
* Pp. 453, 454.
t We shall always suppose this to be the case in what follows.
J D ini , “ Fondamenti per la teoria delle funzioni di variabili reali ” (Pisa, 1878), §99. See also Y oung,
“ On Monotone Sequences of Continuous Functions,” ‘ Proc. Camb. Phil. Soc.,’ vol. XIV., pp. 520-3.
AND THEIR CONNECTION WITH THE THEORY OF INTEGRAL EQUATIONS. 441
Hence, as the latter converges uniformly for a < s < < t < by what has just
been said, the result follows.
§ 26. Let us denote the sum of the first m terms of the series on the right of (19)
by Sm(X ; .v, t),and the remainder after these terms by R m(X; t). We have
SV
H(X ; s, t) — 5 ^ x^n ^ •
n= 1 X„ X n=l X„
L «S„(\;s, t ) = - S
A - > • oo ?i —l Ajo
L^ (X 5 s, £) *Pn(s) $n(t)
Av.
This relation holds for any continuous function k t),but we now add the further
limitation th at the function shall be of positive type. Then, since
R . e ;* ,* ) = s
n=m + 1 An \AW A;
we shall have
R ni (X ; 5, < 0, • • (21)
ff
Ja J i
Kx(.s*, t) 0 ( s ) 0(t) dsdt =( [ / <■ (
*a Ja A?l yA n Aj
\pn (s) 0(s) s,
dst)
VOL. CCIX.— A. 3 L
442 ME. J. MERCEE: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE,
Now, when X is negative, the terms of the series on the right must be either zero
or positive. W e conclude, therefore, th at for all functions of the class ®
lb tb.
| K a( s , t) 6 (s) 6 (t) 0 (X < 0).
• a Ja
k (s , s)>
5 t t M Z ......................
n~l A.n
This is true, of course, for all values of m which are sufficiently g re a t; and, further,
when we increase m we only add positive terms to the right-hand side. By a well-
known theorem of the elementary theory of series, we thus see th at
converges for each value of s in the interval (a, ; and hence, since
a = [ * .« ] * + [+40T .
th at the series
V (s) 'K (t)
n—1 Xn
converges absolutely for each pair of values of the variables satisfying the inequalities
a < s 6 , a ^ t ^ i b . From this last result it follows th at the function
/( * , ■«).= K m - s A M M ) .(24)
n —1 An
has a definite finite value when the variables are restricted in the manner ju st
mentioned. In the paragraphs which follow we shall consider the properties of
f (s, t), and eventually prove th at it is everywhere zero. I t may be remarked th at
the inequality (23) proves the relation
§ 28. I f € is any arbitrarily assigned positive quantity, it follows from the absolute
convergence of the series on the right of (24) th a t we can choose m great enough to
ensure the inequality
£ 1*/>»(s) (t) 1
?i=m +1 X. < 3 ..................................................< ">
Again, from (20), we see th at a negative number 1/ can be chosen with so great an
absolute value that, when X < I/,
k(m J
R-a. M t) (X; s, t^j
< !;
while, from (24) and (25), we deduce
§ 29. I t may be proved# that, if c is any constant and ax any point of the interval
(a, b), then the solving function corresponding to the characteristic function
K, K a,) = / ( « „ « , ) + s t f e M C ,
n~\ An A
can only vanish for positive values of X. Thus, as D (X) has no negative roots, h (s,
is of positive type,* and, therefore, in virtue of the remark at the end of § 27,
f ( s,t) — 0
We have thus shown that, in the case of a function of positive type, the series
2 VA ( s ) (t)
K=-l X„
has k ( s,t) for its sum-function. I t was shown in § 27 th at the convergence of this
series is absolute, and, by an application of D in i ’s theorem, it may be shown th at the
convergence is also uniform in the square < < Hence, xpx ( ),
\p2 (s),..., rf>n(s), ... cire a complete system o f normal functions relating to a function
k (s,t) o f positive type and Xl5 X2, ..., Xn, ... are the corresponding singular ,
then the series
< ^n(s)^n
*
n=l
X
§ 30. From this theorem several interesting results may be deduced. For example,
replacing k (s, t) by the series (27) in (19), we obtain
K a ( s t) ^ ^ (0 ( 28 )
n= 1 A.
f K x ( s, s) ds t —..... (29)
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021
•J a n= 1 A7l A
Provided th a t X is not positive, the terms of the series on the right are all positive
and less than those of the series
t■
± \- >
?z= 1 i\n
which, by writing X = 0 in (29), is seen to converge. I t thus follows that, for X < 0,
the former series is uniformly convergent. Integrating (29) between the limits 0 and X,
where the latter is negative, and recollecting F redholm’s formula
- A p o g D(X)] = £ k x(s,
it is easily seen th at
D(x) = n ( i - X ) M O ),
w=l \ AnJ
since D (0) = 1. It now follows that, as the right-hand member of this equation is
an integral function of X, we may drop the restriction X21- 0. We have thus expressed
D (X) as an infinite product.
Finally, we may remark th at if | X| is less than the least of the numbers Xl5 X2,..., Xn,...
the right-hand side of (29) may be expressed as a power series in which the coefficient
of Xw is
2 ——
\ m+ 1
■.
ix—
—1
Also, by employing N eum ann ’s expansion for KA it is easily seen that the
coefficient of Xm on the left is
[b
Km+1 (s, s) ds,
where in the usual notation
rb rb rb
Km+l(s, t) =... k (sm, i) ds1 ds2...(m > 1),
Ja Ja Ja
and
Ki (S, l ) = K (S, t).
446 MR. J. MERCER: FUNCTIONS OF POSITIVE AND NEGATIVE TYPE.
I t follows th at
rb -j
I Km s) ds — S r—- (tm = 1,2,...).
*a n=l An
§ 31. In conclusion, it may be pointed out th at the theorem ot § 29 holds also when
k (s, t) is of negative type. This may be deduced from the theorem mentioned by
employing the usual device, or it may be proved directly by commencing with the
equation
u [ K , ( i , «)] = * (* ,* )- 5 [A M !!
A qo n= 1 A n
Downloaded from https://royalsocietypublishing.org/ on 22 November 2021