Scribd
Upload
46 views15 pages

Image Co Segmentation

The document discusses a method for object co-segmentation across multiple images using saliency. It proposes constructing a co-saliency map that assigns higher saliency scores to common objects by incorporating saliency information from other images. Regions are then merged based on similar saliency pixel ratios and the most salient region is selected as the segmented object. Results on standard datasets demonstrate the ability to accurately segment common objects by boosting their saliency using information from related images.

Uploaded by

Abhijit Sharang
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
46 views15 pages

Image Co Segmentation

The document discusses a method for object co-segmentation across multiple images using saliency. It proposes constructing a co-saliency map that assigns higher saliency scores to common objects by incorporating saliency information from other images. Regions are then merged based on similar saliency pixel ratios and the most salient region is selected as the segmented object. Results on standard datasets demonstrate the ability to accurately segment common objects by boosting their saliency using information from related images.

Uploaded by

Abhijit Sharang
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 15

Object co-segmentation across multiple images using saliency

Abhijit Sharang Mohd. Dawood

Introduction
Co-segmentation aims to segment common objects from a collection of images given by the user.
Compared with traditional segmentation methods, co-segmentation can accurately segment common objects from images by several related images. The task is less cumbersome and requires lesser supervision.

Past work
Most existing co-segmentation methods take foreground similarity under consideration [Rother et.al,06],[Singh et.al,09] and [Hochbaum et al.,09] model cosegmentation as an optimisation problem with added constraints on foreground similarity. Special clustering and discriminative clustering were combined by [Joulin et al.,10] to perform co-segmentation In order to segment common objects,[Vicente et al.,11] selected useful features from a total of 33 features through random forest regressor. [Kim et al.,11] proposed a diffusion-based optimization framework which used anisotropic heat diffusion method to locate seeded points of the common objects and employed random walks segmentation method for common objects segmentation.

Motivation for using saliency


The existing methods are based on similarity of features.

What if the background across the images also match? Saliency becomes useful under such a case as low score is attached to background Moreover, the saliency of the common object can be boosted by taking into account the saliency of similar objects across the images.

The objective and methodology


Two fold objective: improving the saliency map by using information from other images and using the improved saliency map for further segmentation Normal saliency map is constructed using the HC method discussed by [Cheng et al.,11]. This map is used to construct the co-saliency map, where the co-saliency of a colour k in image I is defined as: ik = ik + ik , where, ik = (
= =1 = ) =1 ( ,

),

m=number of images except the current image p=number of colours in the jth image d(Cik ,Cjl) is the Gaussian distance between the colours (i,k) and ( j,l) jl is the HC saliency value of the colour (j,l)

Saliency comparison
HC Saliency

Co-saliency

Methodology(cont.)
Having obtained the co-saliency map for the images, we divide the images into regions. We then compute the region-wise saliency using the saliency of the colours contained in the image, assigning higher weight to salient colours.

regions -----------------------

Methodology(cont..)
The salient object in the image might be fragmented into several regions. We perform region merging based on the idea that regions having similar ratio of the salient pixels and normal pixels have a high probability of belonging to the same object. The saliency of the merged region thus obtained is so high that we can perform a greedy selection of the region as the most salient region in the image

Segmented Object

Subjective results
Windmill (ICoseg dataset)

Subjective results(cont..)
Pyramids(ICoseg dataset)

Subjective results(cont..)
Statue of Liberty(ICoseg dataset)

Subjective results(cont..)
Kendo(ICoseg dataset)

Objective results

To do list..
Improving the region merging algorithm

Computing F-scores and Precision-Recall curves Testing the algorithm on more categories from ICoseg dataset and MSRC dataset

References

Meng, F.; Li, H.; Liu, G.; Ngan, K. N.; , "Object Co-Segmentation Based on Shortest Path Algorithm and Saliency Model," Multimedia, IEEE Transactions on , vol.14, no.5, pp.1429-1441, Oct. 2012 C. Rother, V. Kolmogorov, T. Minka, and A. Blake, "Co-segmentation of image pairs by histogram matching-incorporating a global constraint into mrfs," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2006, pp. 993-1000. L. Mukherjee, V. Singh, and C. R. Dyer, "Half-integrality based algorithms for co-segmentation of images," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2009, pp. 2028-2035. D. S. Hochbaum and V. Singh, "An efficient algorithm for co-segmentation," in Proc. Int. Conf. Computer Vision, Oct. 2009, pp. 269-276. A. Joulin, F. Bach, and J. Ponce, "Discriminative clustering for image co-segmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2010, pp. 1943-1950. G. Kim, E. P. Xing, L. Fei-Fei, and T. Kanade, "Distributed co-segmentation via submodular optimization on anisotropic diffusion," in Proc. Int. Conf. Computer Vision, Nov. 2011, pp. 169176. S. Vicente, C. Rother, and V. Kolmogorov, "Object co-segmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2011, pp. 2217-2224.nition, Jun. 2011, pp. 2129-2136. D. Batra, A. Kowdle, and D. Parikh, "ICoseg: Interactive co-segmentation with intelligent scribble guidance," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Jun. 2010, pp. 31693176.

You might also like