15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

14,297,708 members 263 ☰

articles Q&A forums stuff lounge ? Search for articles, questions,

Follow

A C# Project in Optical Character Recognition (OCR)

Using Chain Code
Hussein El Saadi Rate me! 4.85 (74 votes)

22 Feb 2011 CPOL

An article that looks to use chaing code to do optical character recognition

Is your email address OK? You are signed up for our newsletters but your email address is either unconfirmed, or
has not been reconfirmed in a long time. Please click here to have a confirmation email sent so we can confirm
your email address and start sending you newsletters again. Alternatively, you can update your subscriptions.

Download source code - 96.88 KB

Introduction: What is OCR?

OCR stands for optical character recognition i.e. it is a method to help computers recognize different textures or characters

OCR are some times used in signature recognition which is used in bank

And other high security buildings

In addition, texture recognition could be used in fingerprint recognition

OCR's are known to be used in radar systems for reading speeders license plates and lot other things

A Detailed Look on the OCR Implementation and its use in this Paper
The goal of Optical Character Recognition (OCR) is to classify optical patterns (often contained

A digital image) corresponding to alphanumeric or other characters. The process of OCR

Involves several steps including segmentation, feature extraction, and classification. Each of

These steps is a field unto itself, and is described briefly here

Implementation of OCR.

One example of OCR is shown below. A portion of a scanned image of text, borrowed from the

Web, is shown along with the corresponding (human recognized) characters from that text.
https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 1/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

Of descriptive bibliographies of authors and presses. His ubiquity in the broad field of bibliographical and textual study, his
seemingly complete possession of it, distinguished him from his illustrious predecessors and made him the personification of
bibliographical scholarship in his time.

Figure 1: Scanned image of text and its corresponding recognized representation

A few examples of OCR applications are listed here. The most common for use OCR is the first

Item, people often wish to convert text documents to some sort of digital representation.

1. People wish to scan in a document and have the text of that document available in a word processor.
2. Recognizing license plate numbers
3. Post Office needs to recognize zip codes

Other Examples of Pattern Recognition

1. Facial feature recognition (airport security) – Is this person a bad-guy?
2. Speech recognition – Translate acoustic waveforms into text.
3. A Submarine wishes to classify underwater sounds – A whale. A Russian sub? A

Friendly ship?

The Classification Process

(Classification in general for any type of classifier) There are two steps in building a classifier:

Training and testing. These steps can be broken down further into sub-steps.

1. Training

a. Pre-processing – Processes the data so it is in a suitable form for…

b. Feature extraction – Reduce the amount of data by extracting relevant

Information—usually results in a vector of scalar values. (We also need to

NORMALIZE the features for distance measurements!)

c. Model Estimation – from the finite set of feature vectors, need to estimate a model

(Usually statistical) for each class of the training data

2. Testing

a. Pre-processing
b. Feature extraction – (both same as above)
c. Classification – Compare feature vectors to the various models and find the

Closest match. One can use a distance measure

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 2/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

OCR – Pre-processing
These are the pre-processing steps often performed in OCR

Binarization – Usually presented with a grayscale image, binarization is then simply a matter of choosing a threshold value.
Morphological Operators – Remove isolated specks and holes in characters, can use the majority operator.
Segmentation – Check connectivity of shapes, label, and isolate.

Segmentation is by far the most important aspect of the pre-processing stage. It allows the

Recognizer to extract features from each individual character. In the more complicated case of

Handwritten text, the segmentation problem becomes much more difficult as letters tend to be

Connected to each other.

OCR – Feature Extraction

Given a segmented (isolated) character, what are useful features for recognition?

1. Moment based features

Think of each character as a PDF. The 2-D moments of the character are:

From the moments, we can compute features like:

1. Total mass (number of pixels in a binarized character)

2. Centroid - Center of mass
3. Elliptical parameters

i. Eccentricity (ratio of major to minor axis)

ii. Orientation (angle of major axis)

4. Skewness

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 3/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject
5. Kurtosis
6. Higher order moments
7. Hough and Chain code transform
8. Fourier transform and series

There are different methods for feature extraction or finding an image descriptor, these methods lie into two categories

1. one which uses the whole area of the image

2. an other that uses the contour or edges of the object

All the above methods uses the contour of the object to collect the object’s features.

ALGORITHIM REQURIMENTS
The algorithm we needed for this OCR had to satisfy requirements

1. It must faithfully preserve the information of interest

2. Its must permit for compact storing and convenient retrieval
3. It must facilitate the required processing
4. Scaling invariant
5. Easy to implement

And so we decided to implement for this OCR in particular is the chain code

Which is also known as Freeman’s chain code.

Freeman’s chain code is one of the best and easiest methods for texture recognition

Freeman designed the chain-code in 1964 (also, the chain code is known to be a good method for image encoding but here we are
using it as a method for feature extraction)

Although the chain code is a compact way to represent the contour of an abject yet is has some serious draw back when used as a
shape descriptor

Chain-code Drawbacks

1. It works only on contoured shapes (which in our case means characters should be inputted in bold font )
2. it is so sensitive to noise as the errors are cumulative
3. The starting point of the chain code, and the orientation and scale of a contour affects the chain code.

Therefore, the chain correlation scheme, which can be used to match two chains, suffers from these drawbacks

N.B: How ever the scaling draw back was partially overcame

The Freeman’s chain-code implementation process for character recognition?

First step as discussed before is the pre processing:

The only preprocessing step we will discuss in this paper is the edge detection or contouring.

First, what does a contoured object mean?

Well it means an object with edges only.

How to obtain a contoured object of the BOLD character object?

The concept of obtaining the edges was applied in reverse manner

I.e. if we can detect the filling and remove it then the remains are the edges.

So all we need is to find a unique property of the filling and apply this

Filling property:

All eight surrounding pixels are black

Pseudo-code:

Hide   Copy Code

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 4/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

Begin
WHILE (! end of image)
Search original image for black pixel
If (the eight surrounding are black)
Then
This pixel is filling and we should remove it
Go to next-pixel
WHILEEND
END

So by implementing the above code in an image like this

Second step is the feature extraction process (using freeman’s chain-code)

There are many methods to implement the chain-code and all of them lead to the idea of partitioning the target objects

And so the one we used is based on the idea of partitioning the object into tracks and sectors and then apply the chain-code in each
sector for getting the pixels relations and saving it on a file.

How do we achieve this level of partitioning on the contoured object and extracting the feature vector it?

Achieving a sectors tracks partitioned object and extracting the feature vector from it involves applying the following steps

1. get the Centroid - Center of mass

2. find the longest radius
3. getting the track-step
4. virtually divide the object into tracks using the track-step(which is based on the default number of tracks used i.e. the same
number of tracks must be used for both training and testing)
5. getting the sector step
6. divide those virtual tracks into equal sectors using the sector-step (which is based on the default number of sectors used i.e.
the same number of sectors must be used for both training and testing)
7. find relations between adjacent pixels
8. putting all the features together

The above steps will be discussed later in greater details

A DETAILED LOOK ON HOW TO achieve this level of partitioning of the contoured object.

1- GETTING THE CENTER OF MASS

The center of mass of any texture (in our case character) is driven by the following equation:

Hide   Copy Code

Xc=∑x/ ∑∑f(x, y)
Yc= ∑y/ ∑∑f(x,y)

In English, this means that the X coordinate of the centroid is the sum of all the positions of x coordinate of all the pixels in the object

Divided by the number of pixel of the object

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 5/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

So the Xc for the above image= (0+1+2+2+3)/5

Therefore, the Y coordinate of the centroid is the sum of all the positions of y coordinate of all the pixels in the object divided by the
number of pixel of the object

So the Yc for the above image= (3+2+2+2+1)/5

And so by applying the above rule on a character we get

2- FINDING THE LONGEST RADIUS

To get the longest radius we have to calculate the distance between the centriod (center of mass) and every other pixel of the
contoured object and find the maximum length and this would be the longest radius

How to get the distance between to pixels?

Thanks to Pythagoras who invented Pythagoras theorem, which gives us the distance between any, two points and it states:

"The distance between any two points equals

Sqrt ((Xc-Xi) 2 +(Yc-Yi) 2)"

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 6/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

3- GETTING THE TRACK STEP

What is the track-step?

The track step is the distance between any two adjacent tracks, which will be used to identify the pixels position i.e. in which track

How to get the track step?

The track step equals max-radius dived by the predefined number of tracks i.e. (Track_Step=M-radius/No’ of tracks)

In our case, the number of tracks we used was five

4- VIRTUALLY DIVIDE THE OBJECT INTO TRACKS USING THE TRACK-STEP

(Which is based on the default number of tracks used i.e. the same number of tracks must be used for both training and testing)

This way we can identify in which track a pixel lies in.

5- GETTING THE SECTOR STEP

Based on the number of sectors you decide to use

The (SECTOR_STEP =360/No’ of Sectors).

The sector step will be used to know under which sector does a pixel lie.

6- DIVIDE THOSE VIRTUAL TRACKS INTO EQUAL SECTORS USING THE SECTOR-STEP

(Which is based on the default number of sectors used i.e. the same number of sectors must be used for both training and testing);

In other words using the sector-step and the track-step we can identify under which sector and which track a pixel lies.

A detailed look on how to identify a pixel lies on which sector:

First, we have to get Ө, which is the angle between the pixel and the x-axis

Өi=tan-1(y-Yc/x-Xc)

Then pixel would lie at sector=Ө/sector-step

7- FINDING THE PIXEL RELATIONS

Finding pixel relation is by far the most important and easiest step in the feature extraction step since it some how describes the
shape.

How do you extract relations?

To extract relations between pixels we follow this algorithm in

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 7/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject
Pseudo-code

Hide   Copy Code

Begin
For every pixel surrounding the target pixel
Moving clock-wise from north direction
If a pixel is, present surrounding the target pixel
Then
Store its position
Go to next target pixel
End if
Next
END

By now, you should be able to identify for any pixel in which track and sector it lies on and its relation with its neighboring pixels.

By the way, those are the image features;

THE FEATURE VECTOR

The feature vector is simply the collection of the features of every pixel sorted by the track i.e. check the position of each pixel and
add its properties to the feature vector. E.g. if we have two pixels lie in sector 1 and track 1 with the same relation of 4 then in cell4 in
the relations table the one in t1 and s1 will be incremented twice since there are TWO pixels having this property

Freeman’s chain code drawbacks that we were able to solve:

Actually, the only draw back that was solved was the scaling problem and it was partially solved (i.e. up scaling only).

How to over come the up scaling draw back of the chain code?

It has been solved by dividing the feature vector by the number of pixels in the object so this way the number of pixels (size of
character) has no effect on the feature vector.

Classification

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 8/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject
Classification is the process of identifing the unknown object

There are a number of classifiers availible that can be used such as

1. Neural networks
2. Support vecotor machines
3. K-nearest neighbor
4. Eculidian distance

In this article we discuss eculidian distance which is a variation from the knn

Simply the eculidian distance is calculating the distnace between the relations

Hide   Copy Code

public double get_distence(cfeature_vector vec2)

{
double x=0,y=0,z=0,zf=0;
for (int i=0;i<6;i++)
{
for (int j=0;j<4;j++)
{
for (int k=0;k<8;k++)
{
x=current_features.tracks[i].sectors[j].relations[k];
y=vec2.tracks[i].sectors[j].relations[k];
z=x-y ;
z*=z;
zf+=z ;
}
}
}
return zf ;
}

RECOGNITION RESULTS & CONLCUSIONS

The recognition rate for character images of the same font used (Arial) of up scaling is almost 100% correct

How ever, for down scaling the recognition rate is very poor

When we tested our OCR on hand written there where two VI observations that affects the recognition rate

1st people tend to use different fonts than the on it’s trained

2nd objects with curves and like character “C” &”O”&”Q” ESPECIALLY were not recognized at all perhaps because most people used
very bad handwriting

The handwritten test data we used where from two different sources

1. We asked people to draw the characters using the paintbrush and so we got so little number of volunteers actually one and
my self.
2. the 2nd source was hand written letters on a piece of paper and we had approximately 7 samples of 3 different hand written
letters

Correctness Rate for the Different Sources

For the first source the recognition rate came to its peek of 75% correctness (on a well-written letters <”neat writing”> but on the
other samples the recognition rate was approximately 62%

As for source, number two the recognition rate was poorer than what was expected, it was approximately 57% for most of the
samples

THE FOLLOWING IS SOME OF THE SAMPLES USED IN TESTING PROCESS:

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 9/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject
The following is teaching sample the engine was originally trained for:

THE FOLLOWING IS A HANDWRITING SAMPLE TAKEN TROUGH A SCANNER:

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 10/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

License
This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 11/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

Hussein El Saadi
No Biography provided
Follow
Egypt
this Member

Comments and Discussions

 
  Email Alerts Search Comments
Add a Comment or Question 

First Prev Next

Throws Exception
Member 13070685 2-Apr-18 4:35

Re: Throws Exception

Member 11845862 9-Apr-18 14:56

help
Member 13374696 23-Dec-17 19:17

for colored image

Member 12702459 28-Aug-16 20:47

character segmentation can u please sir help .........

Member 12072113 12-Jan-16 18:55

Help plz..
Member 11579679 12-May-15 18:00

Question
Member 11579679 11-May-15 15:27

need help please?

adam syria 28-Apr-15 10:37

error "recognize the target image"

adam syria 27-Apr-15 18:54

Format Exception (form1.cs, Function Name Feature_Read() line 575)

Suresh Kumar MCA 24-Feb-15 0:19

Re: Format Exception (form1.cs, Function Name Feature_Read() line 575)

adam syria 27-Apr-15 22:18

How to run this code ?

Member 11069740 9-Sep-14 2:41

Re: How to run this code ?

Member 11432369 5-Feb-15 22:58

Re: How to run this code ?

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 12/13
15/9/2019 A C# Project in Optical Character Recognition (OCR) Using Chain Code - CodeProject

adam syria 27-Apr-15 23:11

monotype cursiva
salimkadri 5-Mar-14 0:09

please reply
Member 10454183 11-Feb-14 14:21

pleasee help
Member 10454183 14-Jan-14 14:38

Re: pleasee help

Hussein El Saadi 9-Feb-14 9:41

please help
Member 10454183 14-Jan-14 14:26

My vote of 5
al13n 12-Jan-14 17:17

how to use the application??

Member 10361398 1-Dec-13 18:19

Please Help!
Member 10349626 21-Oct-13 2:06

Re: Please Help!

Hussein El Saadi 27-Oct-13 7:02

Re: Please Help!

Member 10349626 19-Nov-13 5:10

My Vote is 5
thaer.sqor 5-Mar-13 12:37

Refresh 1 2 3 Next »

General    News    Suggestion    Question    Bug    Answer    Joke    Praise    Rant    Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

Permalink Layout: fixed | fluid Article Copyright 2011 by Hussein El Saadi

Advertise Everything else Copyright © CodeProject,
Privacy 1999-2019
Cookies
Terms of Use Web01 2.8.190913.2

https://www.codeproject.com/Articles/160868/A-C-Project-in-Optical-Character-Recognition-OCR-U 13/13