Automatic Recognition and Counterfeit Detection of
Automatic Recognition and Counterfeit Detection of
net/publication/297650409
Article in International Journal of Image, Graphics and Signal Processing · February 2016
DOI: 10.5815/ijigsp.2016.02.04
CITATIONS READS
16 4,165
2 authors, including:
Yaregal Assabie
Addis Ababa University
52 PUBLICATIONS 309 CITATIONS
SEE PROFILE
All content following this page was uploaded by Yaregal Assabie on 22 September 2016.
Yaregal Assabie
Department of Computer Science, Addis Ababa University, Addis Ababa, Ethiopia
Email:[email protected]
Abstract—Currency recognition is a technology used to recognition is an image processing technology that is used
identify currencies of various countries. The use of to identify currency of various countries. In general,
automatic methods of currency recognition has been currency recognition systems usually have four major
increasing due its importance in many sectors such as processes: image acquisition, preprocessing, feature
vending machine, railway ticket counter, banking system, extraction and classification [1, 4, 19, 21]. Image
shopping mall, currency exchange service, etc. This paper acquisition is an activity of acquiring the currency image
describes the design of automatic recognition of in a digital form using a specific hardware designed for
Ethiopian currency. In this work, we propose hardware this purpose, usually scanner or camera. Image acquisition
and software solutions which take images of an Ethiopian is followed by preprocessing which is required to improve
currency from a scanner and camera as an input. We the currency image by suppressing unnecessary distortions
combined characteristic features of currency and local or enhancing major image features important for further
feature descriptors to design a four level classifier. The recognition processes. Feature extraction is a type of
design has a categorization component, which is dimensionality reduction that efficiently represents
responsible to denominate the currency notes into their interesting parts of the currency image as a compact
respective denomination and verification component feature vector. The types of features used for recognition
which is responsible to validate whether the currency is purpose play crucial role in currency recognition systems.
genuine or not. The system is tested using genuine There are mainly two types of features: structural feature
Ethiopian currencies, counterfeit Ethiopian currencies and statistical feature. Structural feature describes
and other countries’ currencies. The denomination geometrical and topological characteristics of pattern by
accuracy for genuine Ethiopian currency, counterfeit representing its global and local properties whereas
currencies and other countries’ currencies is found to be statistical feature describes characteristic measurements of
90.42%, 83.3% and 100% respectively. The verification the pattern. Some of the features commonly used for
accuracy of our system is 96.13%. currency recognition are Scale-Invariant Feature
Transform, Binary Robust Invariant Scalable Key points,
Index Terms—Ethiopian Currency, Currency Speeded Up Robust Feature, etc. [3, 7, 11, 16, 22].
Recognition, Counterfeit Detection. Classification is the final phase of the currecny
recognition process where the decision about a given
currency image is made based on the extracted feature sets.
I. INTRODUCTION The decision could be rejection or identification of the
currency image into one of the valid banknotes of a given
Currency is used almost everywhere in the world to
country.
facilitate business. Although electronic commerce is
The aim of currency recognition system is to help
emerging as an alternative means of making business
machines recognize different currencies and to help
without the use of paper currency, it is still an
people work with convenience and efficiency. An efficient
indispensable part of everyone’s daily routine. There are
currency recognition system is vital for automation in
various currencies all over the world, and each of them
many sectors such as vending machine, railway ticket
looks totally different and unique. This difference can be
counter, banking system, shopping mall, currency
due to the size of the paper currency, or color or pattern
exchange service, etc. Automatic machines capable of
drawn on the paper. Manual identification and counterfeit
recognizing banknotes are currently used in the developed
detection of currencies a difficult task requiring specially
part of the world in automatic dispensers of a number of
trained examiners which requires human labor and time.
different products ranging from cigarettes to bus tickets,
Since currency has great importance in facilitating the
as well as in many automatic banking operations [5, 13,
management of the economy of countries at large,
17]. Some other countries have been attempting to
automatic recognition of currency becomes a great area of
develop systems that recognize their respective currencies
interest for researchers and developers [17]. Currency
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency 29
[9, 10, 12, 14, 15, 18]. To the best of our knowledge, of US Dollars. The PCA algorithm is used to extract the
however, there is no research and development work main features of US banknotes and to reduce the size of
focused on recognition of Ethiopian paper currency which data. Linear Vector Quantization (LVQ) network is
is known as Birr. Thus, the purpose of this work is to applied for classification purpose. On the other hand,
design and develop a system that can identify Ethiopian Kagehiro et al. [13] take a number of discrete points
paper currency and categorize them in their denominations. selected from the entire image where the average of the
In addition, the proposed solution identifies counterfeit pixel at each point and its adjacent pixels is taken as the
currency from genuine Ethiopian currencies. The study observed value for each point. Then, the distance between
considers banknotes that are currently functional, i.e., 1 a template vectors and the feature vectors from the
Birr, 5 Birr, 10 Birr, 50 Birr and 100 Birr. observation points is used for classification. The authors
The remaining part of this paper is organized as follows. reported very low errors rates with high-speed processing.
Section II discusses related works. In Section III, we Aoba et al. [2] propose two types of neural networks for
present the proposed Ethiopian currency recognition recognition of Euro banknotes: a three-layered perceptron
system. Experimental results are reported in Section IV. and several Radial Basis Function (RBF) networks. They
Section V presents conclusion and future works. employ three-layered perceptron for classification of
banknotes whereas RBF network is used to reject invalid
data by estimating the probability distribution of the
II. RELATED WORK sample data. Since Euro banknotes have characteristic
features in IR images, the system uses infra-red (IR) and
The recognition of banknotes has been addressed in visible images as input data.
several ways depending on their types. Accordingly,
Verma et al. [18] propose an Indian currency
various methods have been proposed for recognition of recognition system based on the intrinsic feature of the
different banknotes. The commonly used methods include currency. The texture of the currency is extracted as
artificial neural network, currency characteristic intrinsic features fur currency recognition, and the class
comparison, principal component analysis, local feature discriminating capability of these features for Indian
descriptors comparison, hidden Markov models, Naï ve
currency is evaluated. On the other hand, Gogoi et al. [9]
Bayes classifier, etc. The selection of methods applied to classify Indian currency based on a set of unique features
recognize currencies depends on the characteristic features such as color, dimension and identification mark. Since
of the currencies.
each banknote has unique shape as identification mark,
Debnath et al. [6] used ensemble neural network to Fourier descriptor is used to extract the features. The,
recognize Bangladeshi currency where individual neural classification is made using artificial neural networks.
networks in an ensemble neural network are trained via
Liu et al. [15] develop real-time Chinese currency
negative correlation learning (NCL). NCL is used to recognition system using a combination of Haar wavelets
expertise the individuals on different parts or portion of and Support Vector Machine. The idea of this method is to
input patterns in an ensemble. The input patterns used in
extract the waveform features and transform them to the
this work are grayscale values of the currency image. The Support Vectors with fixed length. The waveform of a
decision of ensemble is computed using voting scheme banknote is a periodic signal that contains many features
where each network gives a vote for a certain class and
and details with varying scales. The Haar features are
classification is done by the winning neuron of that classified by making use of Support Vector Machine. The
network. The authors reported that they obtained authors reported that the recognition system is fast and
promising results even for noisy Bangladeshi currency
robust with high accuracy. Multiple-kernel Support Vector
images. Machines is also used to successfully detect counterfeit
Colors and texture features have been exploited for Taiwanese banknotes by minimizing false recognition
recognition of banknotes. Garcí a-Lamont et al. [7] rates [20]. In this method, each banknote is divided into
employ a method to recognize Mexican banknotes by partitions and each partition is associated with its own
using artificial vision, where the color and texture features
kernels. Then, the luminance histograms of the partitions
of the banknotes are extracted to classify them. The color are taken as the input of the system.
and texture features are extracted with the RGB space and The reviewed papers present different methods to
the Local Binary Patterns, respectively. The authors report
recognize banknotes and/or detect counterfeits. It can be
high denomination accuracies due to the fact Mexico, like seen that the banknotes of various countries have
many other countries, employs colors to recognize the characteristic features on which recognition systems rely.
denominations of the banknotes. Similarly, Yan et al. [19]
Accordingly, different classifiers are proposed based on
use color and texture features for recognition of US the types of features and the complexity of the problem.
banknotes in which the features are further processed and Due to such feature variations, none of the methods
classified by a Feed-forward Neural Network (FNN). The
guarantee us to work effectively across all currencies.
output of the system is a measurement of the similarity Thus, in this paper, we propose four different features
between existing samples and test banknote. (based on color and characteristic features) for recognition
Principal Component Analysis (PCA) is employed by
and counterfeit detection of Ethiopian banknotes.
Ahmadi et al. [1] for increasing the reliability of banknote
recognition machines. They define a method for validating
the reliability where they examine six different bill types
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
30 Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency
Scanner Camera
Preprocessing Preprocessing Fig.2. Banknote of 100 Birr captured with camera (top) and
scanner (bottom)
Result a) Preprocessing
In the preprocessing sub-component, we apply image
Fig.1. Architecture of the proposed system. re-sizing and enhancement with the purpose of preparing
the paper currency image to the main image processing
B. Currency Image Acquistion activities. All the five Ethiopian banknotes have different
The image acquisition component is responsible for sizes. However, size is not used as a feature for
acquiring images of paper currencies. Each of the classification in the proposed design and the size of the
Ethiopian banknotes have distinctive range of colors, sizes, image needs to be similar for comparing the correlation
looks, marks, texts and other characteristics that make coefficients of the color components among different
them unique for identification. Since these features are banknotes. Accordingly, the images of the banknotes are
visible under normal light conditions, they can be captured brought to a common size. On the other hand, the quality
by scanner. When seen against white light, Ethiopian of the images is degraded for old banknotes. To enhance
banknotes are also characterized by having thin golden the quality of such input images, we filter them using a
strip (for 5, 10, 50 and 100 Birr banknotes) and wide Gaussian filter of window 3x3.
golden strip (for 50 and 100 Birr banknotes) bearing the
name and sign of National Bank of Ethiopia in Amharic
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency 31
b) Feature Extraction and Classification Table 1. Correlation Between Input And Standard Images
Dominant color
classification of input images into their respective
of input image
denomination is carried out. The classification process is
applied after each feature is extracted. Because of this, the G x x
classifier is called a four level classifier. At each stage, a
currency image can be a candidate to be classified into one B x
of the five Ethiopian banknotes but needs to pass through
the four phases as discussed below.
Phase 1 (Dominant color): The image is acquired in The correlation coefficient (CCB) between the dominant
RGB format and it has three major components; Red (R), color values of an image A and the corresponding color
Green (G) and Blue (B). The composition of these three values of a candidate banknote B is computed as:
components gives the specific color of the currency image
[8]. In each image either red or green or blue is the ( A mn A)( Bmn B ) (1)
dominating color, i.e., the maximum pixel occupancy in CCB m n
2 2
( Amn A) ( Bmn B )
the image. The five Ethiopian banknotes have distinct
colors for human vision system. Each color of the m n m n
banknotes is different because the combination of the
primary colors (Red, Green and Blue) is different in each where m and n are pixel coordinates, Amn is the pixel value
currency. In addition to this, one of the three primary of the dominant color of the image, and A is mean of A.
colors has greater pixel occupancy in the image. To find Empirically, it is found that new Ethiopian banknotes have
the maximum pixel occupancy, the respective color correlation coefficient of more than 1.0 and degraded
components of the pixels are added for the entire image, Ethiopian banknotes have more than 0.3. Therefore, to
which will give three results in accordance with the three include degraded Ethiopian currencies a threshold value
primary colors. Among the three results, the one with (T1) of0.3 was taken. In order for the test image to
maximum pixel sum is considered to be the dominant. We continue as a candidate into the respective class or
empirically made dominant color analysis on samples of denomination, the correlation coefficient needs to be
Ethiopian banknotes and it was revealed that: greater than this threshold value. Otherwise, the input
image would be considered as counterfeit or non-
Red is dominant color for 1 Birr, 10 Birr and 50 Birr; Ethiopian banknote.
Green is dominant color for 5 Birr and 100 Birr; and Phase 3 (Hue value): The HSV color model, also
Blue is dominant color for 5 Birr. called HSB (Hue, Saturation, Brightness), defines a color
space in terms of three constituent components: hue,
Accordingly, the input image is classified based on the saturation and value. Hue is the color type (such as red,
analysis of the dominant color observed in the image. At magenta, blue, cyan, green or yellow); saturation refers to
this level we are still classifying the input image into the intensity of specific hue; and value refers to the
intermediate results and a final decision is yet to be made brightness of the color [8]. As hue varies from 0 to 1.0, the
after passing through the remaining phases. corresponding colors vary from red through yellow, green,
Phase 2 (Distribution of dominant color): The cyan, blue, magenta, and back to red, so that there are
distribution of the dominant color of the input image actually red values both at 0 and 1.0. As saturation varies
needs to be compared with the corresponding dominant from 0 to 1.0, the corresponding colors (hues) vary from
colors of candidate banknotes identified in Phase 1. This is unsaturated (shades of grey) to fully saturated (no white
achieved by computing the correlation coefficient (CC) of component). As value, or brightness, varies from 0 to 1.0,
the corresponding color values. For example, if the the corresponding colors become increasingly brighter [8].
dominant color of the image is red, then we compute the Among the three components, hue component is selected
correlation between red component of the input image and to compare the different currency images because the
the red components of 1 Birr, 10 Birr and 50 Birr, other two components could be easily affected by the
separately. Table 1 shows the dominant color correlations currency degradation and light effect while the image is
to be computed between input image and the standard scanned or captured. In addition to that, each image has a
sample banknotes. specific hue value.
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
32 Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency
In the proposed system, the hue value of the test image either of the features are counted and the ratio of these
is compared with each class of currency image’s hue value. two values is taken. An empirical analysis revealed
Since the test image is classified in the second that the match percent for genuine Ethiopian
classification step, the denomination of the test image is currencies is found to be more than 30. Accordingly,
known at this stage. Therefore, the hue value of the test we set a threshold value (T3) of 30 for match percent
image is compared against the hue value of a standard (MP). Thus, if the match percent between an input
image of its class. Empirically, it is found that the hue image and a standard image of the same denomination
difference (HD) of a genuine Ethiopian paper currency is greater than 30, it is classified as an Ethiopian
and the standard Ethiopian currency of its type is not more currency with the identified denomination. Otherwise,
than 75. Therefore, a threshold value (T2) of 75 is used to it is non-Ethiopian currency or counterfeit.
continue analyzing the input image or reject as counterfeit.
If the hue difference between the test image and the
standard image is less than 75, that test image is still
considered as a candidate of an Ethiopian currency in that
specific denomination. Otherwise, it is considered as a
counterfeit or non-Ethiopian paper currency.
Phase 4 (SURF matching): In this phase, the SURF
features of the input image are extracted for a final
decision making on the classes of denominations. The
feature extraction and classification process is
accomplished using the following five steps.
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency 33
The four levels of feature extraction and classification paper denominations. In this process, non-Ethiopian
processes of currency denomination component are currencies or counterfeit banknotes with major deviation
illustrated in Fig. 4. Once the final decision is made on the from genuine Ethiopian banknotes are rejected as
denomination of a given input image, verification process counterfeits. However, it is likely that banknotes produced
will continue to check if the classified image is genuine or with the purpose of counterfeiting Ethiopian currencies
counterfeit. will be classified into one of the five denominations. Thus,
results of currency denomination component are further
D. Currency Verification processed to check if the denomination is genuine or not.
The task of currency denomination component is to In Ethiopian paper currencies, there are few features that
classify an input image into one of the five Ethiopian distinguish the genuine currency from the counterfeit. The
Classification Classification
No Dominant color=B? No Dominant color=G?
Yes Yes
Feature Extraction
Get Correlation of R Get Correlation of B Get Correlation of G
Classification
No Yes
CC1 > CC50?
No No No Yes
CC10 > CC50? CC1 > CC10? CC100 > CC5?
Yes Yes
Feature Extraction
Get Hue Difference Get Hue Difference Get Hue Difference Get Hue Difference Get Hue Difference
Classification
Feature Extraction
SURF Matching SURF Matching SURF Matching SURF Matching SURF Matching
Classification
No No No No No
MP> T3? MP > T3? MP> T3? MP> T3? MP> T3?
Yes Yes Yes Yes Yes
Counterfeit
To Currency Verification Component
Fig.4. Flowchart of feature extraction and currency classification.
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
34 Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency
most outstanding feature in all denominations, except 1 The objective of binarization is to mark pixels that belong
Birr banknote, is the broken thin golden strip, which to true foreground regions with a single intensity and
becomes solid line when it is seen from the direction of background regions with different intensities. Through
background light. In addition to this thin golden strip, in experiment, it is found that for genuine Ethiopian currency,
50 Birr and 100 Birr, there is a wider golden strip which a region with pixel value less than 30 is noise. Therefore,
bears the name and sign of National Bank of Ethiopia in binarization is applied with a pixel intensity threshold of
Amharic and in English. These characteristic features are 30. This operation considers pixel intensities less than 30
captured by a digital camera which helps to apply as noise and therefore removes those pixels.
verification of the classified banknotes. In addition to the Morphological area opening: Morphological area
preprocessing step, the verification component has two opening removes from a binary image all connected
major processes: region of interest (ROI) extraction and components (objects) that have less than a given threshold
validation. However, the techniques we apply on these of pixels, producing another binary image. It is assumed
processes differ due to the difference in the features of that those objects which have less area than the given
banknotes. threshold of pixels are noises that need to be removed
from the ROI. In the proposed system, an area opening by
a) Verification by the Thin Strip
100-pixel object is done.
The thin golden strip exists in all Ethiopian banknotes, Morphological closing: Morphological closing of an
except 1 Birr banknote. The 1 Birr banknote is assumed to image is dilation followed by erosion, using the same
be genuine if it is correctly classified in the currency structuring element for both operations. In the proposed
denomination component. For the rest of paper banknotes, system, a morphological closing with square structural
ROI is now considered to be the thin golden strip. The element of size 5 symmetric with respect to the
localization of region of interest and validation processes neighborhood centre is applied. This size of the structural
are done using the following steps. element is set through experiment.
Counting the number of objects: If the number of
ROI localization: The position of the thin strip is not in objects is one (representing wide golden strip), it is a
a specific location for currencies in a specific genuine currency. Otherwise, it is a counterfeit.
denomination. Therefore, the existence of the thin strip is
checked by taking a strip iteratively.
Binarization: For better processing, the RGB is IV. EXPERIMENT
converted to HSV color format. From the three HSV
components, only saturation and value components are A. Dataset Collection
usually exposed to noise. And therefore binarization is For evaluating and testing the proposed prototype,
applied on these two components of the image with 0.3 different denomination of Ethiopian and non-Ethiopian
value and 0.4 saturation thresholds. This threshold value is currencies are collected. Genuine sixty 100 Birr notes,
set through experiment. sixty 50 Birr notes, forty 10 Birr notes, forty 5 Birr notes,
Morphological closing: A morphological closing with forty 1 Birr notes are collected. In these notes new, a little
a line structural element symmetric with respect to the old, very old and worn out currency notes are included. To
neighborhood center is applied. test the verification capability of the system, counterfeit
Morphological area opening: A morphological area currency notes are collected. Among these counterfeit
opening is applied with 30 pixel area to remove objects notes, previous Ethiopian genuine notes are also included.
less than 30 pixel area. The value 30 is set through In addition to these currencies, other countries’ currencies
experiment. are also collected, namely US dollar, Rand, Dirham, and
Counting the number of objects: The final Shilling. Both scanner and camera images of these
verification step is to count the number of objects in the currencies are acquired and stored for evaluating and
localized image. If the number of objects is one testing the system. The scanner used for capturing images
(representing thin golden strip), it is a genuine currency. is HP Scan jet G2710. Each currency is scanned with a
Otherwise, it is a counterfeit. resolution of 200dpi, size 1122 x 570 pixel and saved in a
JPEG image. From the scanned image, a standard image is
b) Verification by the Wide Strip selected from each denomination and stored as a reference
for comparing the test currency image. The camera used
In addition to the thin golden strip, 50 Birr and 100 Birr to capture the images is Canon PowerShot SD1400 IS
banknotes have wide strips that would help for further Digital ELPH with 14.1 Mega pixels. The images of the
verification. The verification involves the following steps. currency are taken with a background white light, so that
the broken thin golden strip to be solid line.
ROI localization: The position of the wide strip is
similar and, as a result, the ROI is be localized by using B. Implementation
pixel coordinates.
For this work, MATLAB tool is used as a development
Binarization: For better processing, the RGB is
environment. The SURF extraction and matching are
converted to grayscale format and the grayscale image is
implemented and included in MATLAB ToolBox.
converted to binary image by using an optimal threshold.
Toshiba laptop of the following specification is used for
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency 35
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36
36 Automatic Recognition and Counterfeit Detection of Ethiopian Paper Currency
Authors’ Profiles
Copyright © 2016 MECS I.J. Image, Graphics and Signal Processing, 2016, 2, 28-36