Measurement of Co-Localization of Objects in Dual-Colour Confocal Images
Measurement of Co-Localization of Objects in Dual-Colour Confocal Images
coefficients. The influence of image deterioration and image Ri = a . ~ ;and Gi = b . ~ : . This independence is a necessity
restoration on the result of the procedure was investigated. for all overlap and co-localization measurements. A
Finally, the method was tested on images of biological disadvantage of this method is that the result of the
specimens to determine the utility of the procedure. calculation is not unambiguous because of the strong
influence of the ratio of the number of objects in both
components.
Theoretical background
To cancel out this effect the overlap coefficient r should be
Pearson's correlation coefficient is one of the standard divided into two different coefficients by using for example
procedures in pattern recognition (Gonzalez & Wintz,
1987) for matching one image with another and can be
used to describe the degree of overlap between two patterns. with
It provides information about the similarity of shape
without regard to the average intensity of the signals.
Pearson's correlation coefficient (r,) can be calculated from
and
positional information of a 3-D image disappears because down. All other test images (Fig. IB-1D and IF-11) were
we are summing over all voxels of a 3-D image. This means constructed by copying parts of the images of Fig. 1(A) and
that the result of the co-localization measurement algor- (E). Simulated dual-colour images were obtained by
ithm applied to all data from a 3-D image is equivalent to combining two test images. The test images represented
the result of the algorithm applied to a representative part of the parts of a dual-colour image. e.g. a red and a green
the same 3-D data set (e.g. one optical section of a 3-D component.
image). Therefore, it was acceptable to carry out all
measurements on 2-D dual-colour test images (simulated
Measurement
optical sections). However, for testing the method on real
biological specimens 3-D images were used in the To measure the degree of overlap and co-localization
calculations. For image processing and analysis the between the two components of a simulated dual-colour
software package SCIL-IMAGE was used on a SUN Sparc image, Pearson's correlation coefficient r,, the overlap
workstation. coefficient r and the co-localization coefficients MI and M2
were used, as mentioned in the section on the theoretical
background. The correlation, overlap and co-localization
Test images
coefficients were tested on the synthesized images shown in
In our experiments we used several 2-D test images Fig. 1.
containing patterns of objects with Gaussian intensity
distributions. The number of objects and the spatial
Influence of background, noise and cross-talk
distribution of the objects differed for each image. We
constructed a Gaussian object with a diameter of 12 pixels Images were degraded with background, cross-talk and
full width at half maximum (FWHM). We then generated a Poisson noise to simulate the sources of deterioration that
2 5 6 x 2 5 6 image with 3 6 objects at intervals of 3 2 pixels must be dealt with in practical confocal imaging, namely
(Fig. 1A). Figure 1 ( E ) was constructed by shifting all dark current, non-specific binding and cross-reactivity of
objects of Figure 1(A) 1 6 pixels to the right and 1 6 pixels fluorescent probes, optical cross-talk and photon noise.
Simulated background caused by 'dark current' of the The S/N was calculated using
I
photo multipliers was added to the original images using
C ( ~ noise)
i,
and
R i , =
~ Ri
~ +~ B~~ @I = 20' log
/ [=i~~,noise -G ~ ) ~ (15)
Table 1. Pearson's correlation (rp).the overlap coefficient (r) and the co-localization coefficients (MI and M 2 ) performed on a set of generated
dual-colour test images. These images were made by combining the image in Fig. 1(A) (red component) with the other images of Fig. 1
(green component). The co-localization coefficient clearly reflects the fraction of co-localizing objects in the red and green components of an
image.
Number of objects
lg2p1
tion (A-C), after deterioration (D-F) and
after image- restoration (G-I).
~, The co-
Red value localization coefficients MI and M2 of the
original image (A, B) equal 1/12 and 314,
256
respectively. After degradation of the
:
-
images with noise, background and cross-
talk the values of the coefficients no longer
reflect the amount of co-localization in the
128
O) original image. Restoration of the degraded
5 64 image resulted in a accurate determination
0 64
-
128 192 256
of the coefficients MI and M2, which were
found to be equal to 0.09 and 1177.
Red value respectively.
discriminate between these two cases and is equal to 0.50 [MI = 0.083 (= 1/12) and M2 = 0.751 implies that three
(Table 1) in both cases. The interpretation is simple: one of the four objects in Fig. 2(B) co-localize with objects in Fig.
quarter of the red objects (Fig. 1A) co-localizes with green 2(A). Figure 2(C) shows the 2-D histogram of this dual-
objects (Fig. 1H) and all green objects co-localize with red colour image. Near the axes the populations of pixels of the
objects. Starting from the knowledge that the red non-colocalizing objects are visible and the dots represent-
component of the image contains 36 objects, it can be ing the pixels of co-localizing objects are located on the line
concluded that the green component contains only nine y = x. After degrading the image with a 6% uniform and
objects, which all co-localize with one of the red objects. 4% non-uniform background, 8% cross-talk and 5 dB
The co-localization coefficients are very sensitive for Poisson noise (Fig. 2D and E), the co-localization
uniform and non-uniform background and cross-talk. coefficients M , and M2 were calculated again. The
When an image was deteriorated by one of these sources degradation of the signals is clearly visible in the bivariate
of degradation, the co-localization coefficients very rapidly histogram (Fig. 2F). The values of MI and M2 both equal
converged to 1.0, as the number of non-zero voxels rapidly 1.0 and are not meaningful. After restoration of the image
decreased. The coefficients were insensitive to Poisson noise (Fig. 2G and H) the histogram (Fig. 21) is very similar to
as long as the S/N exceeded 1 0 dB. When the image was too that of the undegraded image. Finally, the values of M, and
noisy the coefficients diminished. Mz were found to be 0.09 and 0.77, respectively. When we
depart from the knowledge that Fig. 2(G) contains 36
objects, then these results would imply that the image of
Reconstruction
Fig. 2(H) contains 4.2 objects of which 3.2 co-localize with
We carried out an experiment to investigate the reliability of objects of Fig. 2(G).
the image restoration procedures described above. We
combined the images from Fig. 1(A) and ( I ) (which are
Application
shown again in Fig. 2A and B) and calculated the
co-localization coefficients MI and M2. The result The co-localization analysis procedure was tested on three
C O - L O C A L I Z A T I O N MEASUREMEN'I' 38 1
Discussion
To measure 3-D intensity distributions in dual-colour
confocal images, the problem of a rigid data reduction
must be dealt with. The reduction of a data set of four
million image elements (2 x 2 56 x 2 56 x 32) to one or
two values implies a considerable loss of information.
Therefore, it is important to define the information that
should be derived from the images and to investigate to
what extent the quality of the information is retained
when it is expressed in terms of one or two variables. In this
paper we have introduced a method to measure the
co-localization of objects in dual-colour confocal images.
The degree of co-localization has been defined as the ratio of
the integral of the intensity distribution of co-localizing
objects and the total intensity of the respective components
of the image. We have investigated the quality of the results
obtained with this method and determined its limitations.
Pearson's correlation coefficient has already proved to be
a useful value for measuring the degree of overlap (Manders
et al., 1992). An accurate interpretaion of this coefficient.
however, has not been given previously. Interpretation of
the overlap coefficient as defined in this paper can be
Fig. 3. The red (A. C and E) and green components (B, D and F) of understood more easily. An image with an overlap
optical sections of 3-D dual-colour confocal images of DNA coefficient equal to 0.5 implies that 50% of both
replication patterns in three different cells. These cells were components of the image overlap with the other part of
labelled with two different halogenated nucleotides (IdUrd and
the image. We must make one condition: the number of
CldUrd) at the same time (A/B), with 1 h (C/D) and with 3 h (E/F)
objects in both components of an image has to be more or
between the addition of the labels. Before image restoration the co-
localization coefficients were all equal to 1.00.After restoration the less equal. When the number of objects is not equal.
co-localization coefficients MI and M2 provide clear information determination of the two co-localization coefficients MI and
about the amount of co-localizing objects in the components of an M2 is the proper method. A number of possible applications
image. A/B: M1 = 0.93 and M2 = 0.91;C/D: M1 = 0.27 and can be mentioned. For example, specific organelles in a cell
M2 = 0.28; E/F: M1 = 0.05 and M2 = 0.06. can be labelled and a specific process in this organelle can
be detected with another label. Using this method, the
fraction of organelles that carry out the process can then be
images of three different doubly labelled cells. Figure 3(A, B) calculated.
show the red and the green components of the image of a We have demonstrated that restoration of an image
cell that was labelled with both deoxyuridines at the same degraded with background, cross-talk and noise makes
time (both at T = 0). The co-localization coefficients MI possible an accurate assessment of the values of the co-
and M2 of the original image both equal 1.0. After the localization coefficients in the undegraded image. This
reduction of background, cross-talk and noise, the coef- provides confidence that the result of the calculations
ficients equalled 0.93 and 0.9 1, respectively, which means reflects the biological reality of the image. In addition,
that the images are almost identical. In Fig. 3(C) and (D) different intensities of the components of an image, caused
the components of a dual-colour image of a cell labelled at by, for example, different amplifier settings, did not
T = 0 (IdUrd) and T = 60min (CldUrd) are shown. Again, influence the values of the co-localization coefficients MI
the co-localization coefficients of the original image equalled and M,.
382 E. M. M. M A N D E R S . F. J . VERBEEK & J . A. A T E N
We have tested the method on images of cells doubly contraction bands and segmentation of the contractile ele-
labelled with IdUrd and CldUrd at different periods of the ments. 1. Cell. Biol. 111, 2463-2473.
S-phase. The results of the co-localization coefficients are in van den Engh, G.J., Trask, B.J. & Grey, J.W. (1985) The binding
agreement with results of earlier studies (Manders et al., kinetics and interaction of DNA fluorochromes used in the
analysis of nuclei and chromosomes by flow cytometry.
1992). The images of these replication patterns contain
Histochemistry, 84, 501-508.
objects (labelled DNA) of quite different intensities, shapes
Fox, M.H.. Arndt-Jovin. D.J.. Jovin, T.M., Baumann, P.H. & Robert-
and positions, in contrast with the objects in the synthesized Nicoud. M. (1991) Spatial and temporal distribution of DNA
images. replication sites localized by immunofluorescence and confocal
microscopy in mouse fibroblast. J. Cell Sci. 99, 247-253.
Acknowledgments Gonzalez. R.C. & Wintz, P. (1987) Digital Image Processing. 2nd
edn., Addison Wesley Publication Company, Mass.
We thank C. Hersbach and C. Gravemeijer for the Kitamura, T., Gatmaitan, Z. & Arias, I.M. (1990) Serial
photography work, R. J. A. M. Baeten and J. Stap for quantitative image analysis and confocal microscopy of hepatic
experimental assistance and Dr A. C. Schoolwerth, uptake, intracellular distribution and biliary secretion of a
Professor G. W. Barendsen, Professor J. Strackee and the fluorescent bile acid analog in rat hepatocyte doublets.
anonymous referees for critical reading of the manuscript. Hepatology, 12, 1358-1364.
This work has been partially sponsored by SPIN, project 3-D Lynch, R.M., Fogarty, K.E. & Fay, F.S. (1991) Modulation of
analysis and The European Communities, proposal No. hexokinase association with mitochondria analyzed with
0104. quantitative three-dimensional confocal microscopy. 1. Cell
Biol. 112, 385-295.
References Manders, E.M.M., Stap, J.. Brakenhoff, G.J., van Driel, R. & Aten.
J.A. (1992) Dynamics of three dimensional replication patterns
Akner, G.. Mossberg, K., Wilkstrom, A., Sundqvist, K. & during the S-phase, analyzed by double labelling of DNA and
Gustafsson, J. (1991) Evidence for colocalization of glucocorti- confocal microscopy. 1. Cell. Sci. 103.3, 85 7-862.
coid receptor with cytoplasmic microtubiles in human gingival Merdes, A., Stelzer, E.H. & De Mey, J. (1991) The three-
fibroblasts, using two different monoclonal anti-gr antibodies, dimensional architecture of the mitotic spidle, analyzed by
confocal microscopy and image analysis. I. Steroid Biochem. confocal flurorescence and electron microscopy. 1. Electron.
Molec. Biol. 39, 419-432. Microsc. Tech. 18, 61-73.
Akner, G., Sundqvist, K., Denis. M., Wilkstrom, A. & Gustafsson, J. Mossberg, K.. Arvidsson, U. & Ulfjake. B. (1990) Computerized
(1990) Immunocytochemical localization of gIucocorticoid quantification of immunofluorescence labeled axon terminals
receptor in human gingival fibroblasts and evidence for and of co-localization of neurochemicals in axon terminals with
colocalization of glucocorticoid receptor with cytoplasmic a confocal scanning laser microscope. I. Histochem. Cytochem.
microtubiles. Eur. 1. Cell Biol. 53, 390-401. 38, 179-190.
Arndt-Jovin, D.J.. Robert-Nicoud, M. & Jovin. T.M. (1990) Probing Mossberg, K. & Ericsson. M., (1990) Detection of doubly stained
DNA structures and function with multi-wavelength fluores- fluorescent specimens using confocal microscopy. J. Microsc.
cence confocal laser microscope. 1. Microsc. 15 7, 6 1- 72. 158, 215-224.
Aten. J.A.. Bakker, P.J.M.. Stap, J.. Boschman. G.A. & Veenhof, Sato, M.. Sardana, M.K., Grasser, W.A., Garsky, V.M., Murray. J.M.
C.H.N. (1992) DNA double labeling with IdUrd and CldUrd for & Gould, R.J. (1990) Echistanin is a potent inhibitor of bone
spatial and temporal analysis of cell proliferation and DNA resorption in cultures. 1. Cell Biol. 111, 1713-1 723.
replication. Histochem. 1. 24, 2 5 1-2 59 Stamatoglou. S.C., Sullivan. K.H., Johansson, S.. Barley. P.M..
Carlsson, K. (1990) Scanning and detection techniques used in a Burdett, I.D. & Hughes. R.C. (1990) Localisation of two
confocal scanning laser microscope. 1. Microsc. 157, 2 1-2 7. fibronectii-binding glycoproteins in rat liver primary hepato-
Carlsson. K. & Mossberg, K.. (1992) Reduction of cross-talk cytes. Co-distribution in vitro of integrin (alpha 5 beta 1 ) and
between fluorescent labels in scanning laser microscopy. 1. non-integrin (AGpllO) receptors in cell-substratum adhesion
Microsc. 167, 23-37. sites. 1. Cell Sci. 97, 595-606.
Dean. P., Mascio, L., Ow, D., Sudar, D. & Mullikin, J. (1990) Titus, J.A., Haugland, H., Sharrow, S.O. & Segal, D.M. (1982)
Proposed standard for image cytometry data files. Cytometry, 11, Texas Red. a hydrophilic, red-emitting flurophore for use with
561-569. fluorescein in dual parameter flow microfluorometric and
Draeger, A., Amos, W.B., Lkebe, M. & Small, J.V. (1990) The fluorescence microscopy studies. 1. Immunol. Methods, 50,
cytoskeletal and contractile apparatus of smooth muscle: 193-204.