Proposed Multi Object Tracking Algorithm
Proposed Multi Object Tracking Algorithm
Received 20Dec, 2016; Accepted 17 Jan, 2017 © The author 2017. Published with open access at
www.questjournals.org
ABSTRACT:Tracking of moving objects that is called video tracking is used for measuring motion parameters
and obtaining a visual record of the moving objects, it is an important area of application in image processing.
In general there are two different approaches to obtain object tracking: the first is Recognition-based Tracking,
and the second is the Motion-based Tracking. Video tracking system raises a wide possibility in today’s society.
This system is used in various applications such as military, security, monitoring, robotic, and nowadays in day-
to-day applications. However the video tracking systems still have many open problems and various research
activities in a video tracking system are explores. This paper presents an algorithm for video tracking of any
moving targets with the uses of contour based detection technique that depends on the sobel operator. The
proposed system is suitable for indoor and outdoor applications. Our approach has the advantage of extending
the applicability of tracking system and also, as presented here improves the performance of the tracker making
feasible high frame rate video tracking. The goal of the tracking system is to analyze the video frames and
estimate the position of a part of the input video frame (usually a moving object), our approach can detect,
tracked any object more than one object and calculate the position of the moving objects. Therefore, the aim of
this paper is to construct a motion tracking system for moving objects. Where, at the end of this paper, the detail
outcome and result are discussed using experiments results of the proposed technique.
Keywords:Image processing, Tracking system, image tracking, Contour based tracking, Video Tracking, Edge
detection, Sobel operator.
I.INTRODUCTION
The problem of object tracking can be considered an interesting branch in the scientific community and
it is still an open and active field of research [1], [2]. This is a very useful skill that can be used in many fields
including visual serving, surveillance, gesture based human machine interfaces, video editing, compression,
augmented reality, visual effects, motion capture, medical and meteorological imaging, etc… [3], [4]. In the
most approaches, an initial representation of the tope-tracked object or its background is given to the tracker that
can measure and predict the motion of the moving object representation overtime. The most of the existing
algorithms depends upon the thresholing technique or feature that extracted from the object to be tracked or
combined it with the thresholding to try to separate the object from the background [5], [6], [7]. In this paper our
proposed algorithm try to solve the tracking problem based on edge (contour) of the object to track it (i.e. we
extracting the contour of the target and detect it among the whole sequence of frames using a mean of edge
detection technique.
Object tracking is a very specific field of study within the general scope of image processing and
analysis. Human can recognize and track any object perfectly, instantaneously, and effortlessly even the
presence of high clutter, occlusion, and non-linear variations in background, target shape, orientation and size.
However, it can be an overwhelming task for a machine! There are partial solutions, but the work is still
progressing toward a complete solution for this complex problem [8].
The detection and classification of moving objects is an important area of research in computer vision.
This problem assumes importance because of the fact that our visual world is dynamic and we constantly come
across video scene that contains a finite large number of moving objects. To segment, detect, and track these
objects from a video sequence of images is possibly the most important challenge that the vision experts con
front today. These systems find applications in human surveillance, security systems, traffic monitoring,
industrial vision, defense surveillance, home landing security, etc.
The remains of this paper, we will explain our literature review in Section 2. Then, in Section 3, we
describe the Desirable system features and algorithms necessary for successful system. In section 4 we describe
the system architecture (implementation environment of the system), and the proposed algorithm that will be
used in our method. In Section 5, the experimental results of the proposed Multi-object based on contour
tracking proposed. Finally, in Section 6 we will discuss and Analysis of the obtained results from section 5.
Where: ImN is the current frame, ImN-1 is the previous frame, and ImDiff is the difference frame
between the current frame and the previous Frame.
K. Chang and S. Lai [17] proposed an object contour tracking algorithm based on particle filter
framework. It is only need an initial contour at the first frame and then the object models and the prediction
matrix are constructed online from the previous contour tracking results automatically. This proposed algorithm
builds two online models for the tracked object, the first gets the shape model and the other gets the grayscale
histogram model. The grayscale histogram simply records the grayscale information inside the object contour
region. Each of these two models is represented by a mean vector and several principle components, which are
adaptively computed with the incremental singular value decomposition technique. E. Trucco, K. Plakas [18]
introduce a concise introduction to video tracking in computer vision, including design requirements and a
review of techniques from simple window tracking to tracking complex, deformable object by learning models
of shape and dynamics. Sallam et al [9] proposed feature extraction based video object tracking depend on
computing the features (mean, variance, length ...) of the object in 8 directions and compare it within a window
around the object, but this system has a little drawback that the measured position has an error between ±12
pixels from the exact trajectory of the object.
The systems that use the Motion-based tracking approach are the systems that track the fast and
specific targets (e.g., a military aircraft, guided missile, etc.). This systems is developed based on the Motion-
based predictive techniques such as (Kalman filter, Extended Kalman filter, Particle filter, etc.). In automatic
image processing based object tracking systems, the target object entering the field of view (FOV) are acquired
automatically without human intervention. In Recognition-based tracking, the object pattern is recognized in
successive image frames and tracking is carried-out using its positional information, this approach uses in
recorded video like (e.g., Traffic calculations, terrorism searching in videos, etc.) [19].
The detection and classification of moving objects is an important area of research in computer vision.
This problem assumes importance because of the fact that our visual world is dynamic and we constantly come
across video scene that contains a finite large number of moving objects. To segment, detect, and track these
objects from a video sequence of images is possibly the most important challenge that the vision experts con
front today.
In this paper we try to solve some of these problems by presenting it and the possible solution of its sub
task in dynamic image analysis. These systems find applications in human surveillance, security systems, traffic
monitoring, industrial vision, defense surveillance, home landing security, etc.
III. EDGE
In the early stages of vision processing it is usual to identify features in images that are relevant to
estimating the structure and properties of objects in a scene. Edges are one of such feature. Edges are
characterized by significant local changes in the image and are important features for analyzing image content.
Edges occur on the boundary between two different regions in an image, and edge detection is frequently the
first step in recovering information from images. Due to its fundamental importance, the task of edge detection
continues to be a very active research area [20].
Because of low-frequency components or the smoothing introduced by most sensing devices, sharp
discontinuities rarely exist in real images. Step edges become ramp edges and line edges become roof edges,
where intensity changes are not instantaneous but occur over a finite distance. Illustrations of these edge profiles
are shown in Figure 1.
Many edge detectors have been developed in the last two decades. The most frequently used edge
detection methods are used for image segmentation are Sobel, Prewitt, Robert, and Canny Edge detection
operator [22, 23, 24, 25].
The proposed Video Tracking Algorithm that we applied depends on extracting the contour of the
target. The algorithm description can subdivided into the following steps:
1- 4- If the algorithm doesn’t sense any target (targets), the algorithm goes into that loop until sensing any
moving targets.
5- After sensing target, the second step the algorithm starts to separate the target from the background and
tracking it by the following steps
6- For the tracked target we compute the center and the vertices that contains the target in between, we create a
search window that contains the target and bigger than the target with twenty pixels in each of the four
directions (top, bottom, right, and left).
7- We compute the total gradient of the current frame by the “Sobel” operator for each target within the search
window of each target, applying the thresholding and the average filter within the search window of each
*Corresponding Author: A. M. Sallam1 17 | Page
Proposed Multi-Object Tracking Algorithm Using Sobel Edge Detection Operator
target only (to reduce the computation time and the complexity of the process to make the algorithm fast as
possible).
8- After computing the “Sobeld edge search window” for the target, a search module used to search in that
window to get the current position of the target and compute the current vertices of the target that
containing it and compute the center of it to get the whole trajectory of the target in the whole sequence.
9- The algorithm getting the target data, if the target never lost, the algorithm still getting the data of that target,
but if the target lost during the tracking module more than 5 frames, the algorithm return to the search mode
module again.
10- If the number of frames that lost the target exceeds more than 5 frames the algorithm use a predictor to try to
predict the location of the target and return to the algorithm again as in figure 2.
We can compute the Average Mean Square Error for the whole sequence by equation 5.
Where: Dn(xc, yc) the desired trajectory at the center of the target for the frame n,
*Corresponding Author: A. M. Sallam1 18 | Page
Proposed Multi-Object Tracking Algorithm Using Sobel Edge Detection Operator
Mn(xc, yc) the measured trajectory st the center of the target for the frame n.
N the number of the frames at the whole video sequence.
Figure 4. The error in the X&Y-Position Trajectories of the first target get
Figure 5. The error in the X&Y-Position Trajectories of the second target in the “2airplane1” video sequence
Figure 7. The error in the X&Y-Position Trajectories of the first target in the “2airplane2” video sequence
Figure 8. The error in the X&Y-Position Trajectories of the second target in the “2airplane2” video sequence
TABLE I. TEST RESULTS OF PROPOSED ALGORITHM FOR MORE THAN ONE TARGET
BASED ON AMSE AND Q
*Corresponding Author: A. M. Sallam1 22 | Page
Proposed Multi-Object Tracking Algorithm Using Sobel Edge Detection Operator
*Low AMSE Lead to high detection, ** The larger the value of q is, the better the performance the algorithm
has.
REFERENCES
[1]. V. Manohar, P. Soundararajan, H. Raju, D. Goldgof, R. Kasturi, J. Garofolo, “Performance Evaluation of Object Detection and
Tracking in Video,” LNCS, vol. 3852, 2(2006), pp.151-161.
[2]. Y. T. Hsiao, C. L. Chuang, Y. L. Lu, J. A. Jiang, “Robust multiple objects tracking using image segmentation and trajectory
estimation scheme in video frames”, Image and Vision Computing, vol. 24, 10(2006), pp. 1123-1136.
[3]. T. Ellis, “Performance metrics and methods for tracking in surveillance”, 3rd IEEE Workshop on PETS, Copenhagen, Denmark
(2002), pp. 26-31.
[4]. P. Pérez, C. Hue, J. Vermaak, M. Gangnet, “Color-based probabilistic tracking”, Conference on Computer Vision, LNCS, vol.
2350 (2002), pp. 661-675.
[5]. T. Schoenemann, D. Cremers, “Near Real-Time Motion Segmentation Using Graph Cuts”, Springer, DAGM 2006, LNCS 4174,
2006, pp. 455-464.
[6]. Hu, W., Tan T., Wang L., Maybank S., "A Survey on Visual Surveillance of Object Motion and Behaviours" IEEE Transactions
on Systems, Man, and Cybernatics, Vol. 34, no. 3, August 2004.R. Polana and R. Nelson, “Low level recognition of human
motion.” Proceedings IEEE Workshop Motion of Non-Rigid and Articulated Objects, Austin, TX, 1994, pp. 77–82.
[7]. N. Paragios and R. Deriche, “Geodesic active contours and level sets for the detection and tracking of moving objects,” IEEE
Trans. Pattern Anal. Machine Intell., vol. 22, pp. 266–280, Mar. 2000.Burkay B. ÖRTEN, “Moving Object Identification and
Event Recognition in Video Surveillance Systems”, Master of Science, The Graduate School of Natural and Applied Sciences of
Middle East Technical University, July 2005.
[8]. Javed Ahmed, M. N. Jafri, J. Ahmed, M. I. Khan, “Design and Implementation of a Neural Network for Real-Time Object
Tracking”, World Academy of Science, Engineering and Technology, June 2005.
[9]. Sallam et all, “Real Time Algorithm for Video Tracking”, AL-Azhar Engineering Eleventh International Conference AEIC-2010
, Cairo, Egypt, December 21-23, pp. 228-235, 2010.
[10]. M. Yang and N. Ahuja, “Detecting Human Faces in Color Images”, Proceedings IEEE International Conference on Image
Processing, IEEE Computer Soc. Press, Los Alamos, Calif., pp. 127-139, 1998.
[11]. David N. McKinnon, “Multiple Object Tracking in Real-Time”, Undergraduate Thesis, Univ. Queensland, St Lucia, Dept.
Computer Science and Electrical Engineering, 1999.
[12]. Daniel R. Corbett, “Multiple Object Tracking in Real-Time”, Undergraduate Thesis, Univ. Queensland, St Lucia, Dept.
Computer Science and Electrical Engineering, 2000.
[13]. J. Vass, K. Palaniappan, X. Zhuang, “Automatic Spatio-Temporal Video Sequence Segmentation”, Proc. IEEE International
Conference on Image Processing V3, IEEE Computer Soc. Press, Los Alamos, Calif., pp.958-962, 1998.
[14]. Sallam et all, “Object Based Video Coding Algorithm”, Proceedings of the 7th International Conference on Electrical
Engineering, ICEENG 2010, May 2010.
[15]. Robert Andrews, “Multiple Object Tracking in Real-Time”, Undergraduate Thesis, Univ. Queensland, St Lucia, Dept. Computer
Science and Electrical Engineering, 1999.
[16]. Berthold. K. P. Horn, “Robot Vision”, Mc Graw-Hill Book Company, New York, 1986.
[17]. K. Chang, S. Lai, “Adaptive Object Tracking with Online Statistical Model Update”, Springer, ACCV 2006, LNCS 3852, 2006,
pp. 363-372.
[18]. E. Trucco, K. Plakas, “Video Tracking: A Concise Survey”, IEEE Journal of Oceanic Engineering, Vol. 31, No. 2, April 2006.
[19]. Tinku Acharya, Ajoy K. Ray, “Image Processing Principles and Applications”, Wily-Interscience, 2005.
[20]. A. M. Sallam, “Real Time Modern Target Tracking Techniques”, Ph.D thesis, Military Technical College, Cairo, Egypt, 2012.
[21]. N. Senthilkumaran, R. Rajesh, “Edge Detection Techniques for Image Segmentation – A Survey of Soft Computing
Approaches”, International Journal of Recent Trends in Engineering, pp. 250-254, Vol. 1, No. 2, May 2009.
[22] S. Al-amri, N. Kalyankar, Khamitkar S.D, “Image Segmentation by Using Edge Detection”, International Journal on Computer
Science and Engineering, pp. 804-807, Vol. 02, No. 03, 2010.
[23] E. Nadernejad, S. Sharifzadeh, “Edge Detection Techniques: Evaluations and Comparisons”, Applied Mathematical Sciences, pp.
1507–1520, Vol. 2, no.31, 2008.
[24] R. Maini, H. Aggarwal, “Study and Comparison of Various Image Edge Detection Techniques”, International Journal of Image
Processing (IJIP), pp. 1-12, Volume (3) : Issue (1).
[25] Parker, J.R., “Algorithms for Image Processing and Computer Vision”, Wiley Computer Publishing , 1997.
[26] Sallam et all, “Contour Based Algorithm for Object Tracking”, (IJCSIS) International Journal of Computer Science and Information
Security, Vol. 9, No. 7, July 2011.