Smart Note Taker
Smart Note Taker
Smart Note Taker
Submitted to
Jawaharlal Nehru Technological University Kakinada
in partial fulfillment for the award of the degree of
BACHELOR OF TECHNOLOGY
in
ELECTRONICS & COMMUNICATION ENGINEERING
Submitted by
N.Raasi(18H71A0434)
CERTIFICATE
This is to certify that the Main Project entitled “Smart Note Taker” is a bonafide
work carried out by N.Raasi(18H71A0434) in partial fulfillment for the award of degree
(Dr. K. Srinivas)
Principal
Examiner 1 Examiner 2
Smart Note Taker
ACKNOWLEDGEMENT
I have the immense pleasure in expressing my thanks and deep sense of gratitude
to, Mr. CH. Pulla Rao, Head of the Department, Electronics and Communication
Engineering for extending necessary facilities for the completion of the Project.
N.RAASI(18H71A0434)
Smart Note Taker
DECLARATION
I N.Raasi of the main-Project “Smart Note Taker”, hereby declare that the
matter embodied in this Project is the genuine work done by us and has not been
submitted either to this university or to any other university/institute for the fulfilment of
the requirement of any course of study.
N.Raasi(18H71A0434)
Smart Note Taker
CONTENTS PAGENO
LIST OF FIGURES
ABTRACT
CHAPTER 1 INTRODUCTION
1.) Features of smart note taker
CHAPTER 2 SYSTEM OVERVIEW
2.1) Construction
2.2) Technical definition of the product
CHAPTER 3 CURRENT PRODUCTS
3.1) Mobile Note Taker
3.2) PC Note Taker
3.3) Smart Pen
3.4) Solo Pen
3.5) Smart Quill
CHAPTER 4 TECHNOLOGY
4.1) Display Technology
4.2) Handwriting Recognition And Signature Verification
4.3) Accelerometer Technology
4.4) Handwriting Recognition Software
4.4.1) Handwriting Transcription
4.4.2) Handwriting Recognition
CHAPTER 5 ADVANTAGES
5.1) Advantages
5.2) Disadvantages
CHAPTER 6 APPLICATIONS
CHAPTER 7 FUTURE SCOPE
CHAPTER 8 CONCLUSION
CHAPTER 9 REFERENCES
Smart Note Taker
LIST OF FIGURES
FIGURE NO FIGURE NAME PAGE NO
2.1) Interior structure of Smart Note Taker
3.1) Mobile Note Taker
3.2) PC Note Taker
3.3) Smart Pen
4.1) Display Technology
4.2) Represents the acceleration signals recorded
while one is writing a small capital B
Smart Note Taker
ABSTRACT
Smart Note Taker is a helpful product that satisfies the needs of the people in today's
technologic and fast life. This product can be used in many ways. The Smart Note Taker
provides taking fast and easy note making to people who are busy with one's self.
With the help of Smart Note Taker, people will be able to write notes in air, while being
busy with their work. The written note will be stored in the memory chip of the pen, and
will be able to read in digital medium after the job is done. This saves time and facilitate
life.
This product is simple but powerful. It has the ability to sense 3D shapes and motions
that the user tries to draw. The sensed information will be processed and transferred to
the memory chip and then will be monitored on the display device. The shape that is
drawn can be broadcasted to the network or sent to a mobile device.
Smart Note Taker
1.INTRODUCTION
The Smart Note Taker is such a helpful product that satisfies the needs of the
people in today's technologic and fast life. This product can be used in many ways. The
Smart Note Taker provides taking fast and easy notes to people who are busy one's self
with something. With the help of Smart Note Taker, people will be able to write notes on
the air, while being busy with their work. The written note will be stored on the memory
chip of the pen, and will be able to read in digital medium after the job has done. This
will save time and facilitate life.
The Smart Note Taker is good and helpful for blinds that think and write freely. Another
place, where our product can play an important role, is where two people talks on the
phone. The subscribers are apart from each other while their talk, and they may want to
use figures or texts to understand themselves better.
It's also useful especially for instructors in presentations. The instructors may not
want to present the lecture in front of the board. The drawn figure can be processed and
directly sent to the server computer in the room. The server computer then can broadcast
the drawn shape through network to all of the computers which are present in the room.
By this way, the lectures are aimed to be more efficient and fun. This product will be
simple but powerful.
The product will be able to sense 3D shapes and motions that user tries to draw.
The sensed information will be processed and transferred to the memory chip and then
will be monitored on the display device. The drawn shape then can be broadcasted to the
network or sent to a mobile device.
There will be an additional feature of the product which will monitor the notes,
which were taken before, on the application program used in the computer. This
application program can be a word document or an image file.
Then, the sensed figures that were drawn onto the air will be recognized and by
the help of the software program we will write, the desired character will be printed in the
word document.
With the help of smart note taker hand written notes will be instantly converted
into editable text.
It is good and helpful for blinds that think and write freely.
Another place, where our product can play an important role is where
two people talk on the phone. The subscribers are apart from each other while
their talk, and they may want to use figures or texts to understand themselves
better.
It’s also useful especially for instructors in presentation . The Instructors
may not want to present the lecture in front of the board. drawn figure can be
processed and directly sent to the server computer in the room. The server
computer then can broadcast the drawn shape through network to all of the
computers which are present in theorem. By this way lectures are aimed to be
more efficient and fun.
It recognize up to 22 Languages : English – Canada , English - GB, English-
US ,Germany , Simplified Chinese, Traditional Chinese ,Korean Danish,
Spanish, Spanish - Mexico, Finnish, French , French-Canada, Greez, Italian,
Japanese, Dutch, Norwegian, Portuguese , Portuguese- Brazil, Russian, Swedish.
2. SYSTEM OVERVIEW
2.1. CONSTRUCTION
Since, JAVA applet is suitable for both the drawings and strings, all these
applications can be put together by developing a single JAVA applet program. The java
code that we will develop will also be installed on the pen so that the processor in
the pen will and type the able to draw desired text on the display panel.
Applet:
Applet is a function of java which for example, is a kind of container (file)
which contains a set of programs made in java. Java is a high level language. It is
widely used in making various application Based on java. It is one of the best
features of java. The various strings, drawings etc will be made using a class file and
this file will not be a single file. It will be a set of files linked together in a single
Database:
The system installed in the pen will consist of a database which will help the
processor to recognize various words made visually in the air. Each word written in the
air will resemble to a word in the database and the word present in the database will be
printed. This will remain the basic principle of the working of a smart note taker.
Working:
Smart note taker will be simple but powerful. The product will be able to sense 3D
shapes and motions that user tries to draw.The sensed information will be processed and
transferred to the memory chip and then will be monitored on the display device. The
drawn shape then can be broadcasted to the network or sent to a mobile device.
There will be an additional feature of the product that will monitor the notes, which were
taken before, on the application program used in the computer. This application program
can be a word document or an image file.
DVR & DR HS MIC COLLEGE OF TECHNOLOGY 3
Smart Note Taker
Then, the sensed that were drawn into the air will be recognized and with the help
of the software program software we will write the desired character will be printed in the
word document. If the application program is a paint related program, then the most
similar shape will be chosen by the program and then will be printed on screen.
Operating System
Software program to convert data into text or string format
Displacement Sensor
Parallel cable
Analog to digital converter
Switch
Rechargeable battery
3. CURRENT PRODUCTS
Mobile Note Taker TM has a built-in LCD to confirm input. The on-board
flash memory can store up to 50 pages (size A4).
Mobile Note Taker works in two modes :- mobile mode and Connected mode. In
mobile mode note taker receiver unit is not connected to a PC via USB cable. In
connected mode the base unit is connected to a PC through USB cable.
MS® Office applications (in Connected mode) Allows file transfer over LAN, email, and
instant messaging application (in connected mode).
Capture, Organize, and Share Your Notes Digitally-Anywhere, Anytime!
Mobile Mode Enables capture and storage of notes and sketches digitally at
meetings, lectures, and conference.
Connected mode synchronizes the Mobile Note Taker TM and a PC/Notebook via USB
cable (included). You can upload, organize, move, edit or add to handwritten notes, ideas,
sketches, phone numbers, or reminders. The included software also enables memos,
notes, and sketches to be sent via e-mail or over the LAN network. It is also possible to
write directly into MS® Word or Outlook, and add a personal touch to ICQ® instant
messages. Based on Pegasus’ successful PC Notes Taker, Mobile NoteTakerTM is the
ultimate handwriting capture device. Everything you need to get started is right in the
box. Even if you don’t have standard size paper or piece of paper with you - you can use
anything - an envelope, an old receipt, a tear-off from a paper bag and best of all in your
own natural and writing. As long as you have the Mobile Note Taker, you can jot down
your most inspired ideas and be sure that you’ll never lose them again.
PC Notes Taker is the world's first device that captures natural handwriting on
any surface onto a PC in real time. Based on a revolutionary electronic pen, PC Notes
Taker displays the user's handwritten notes, memos or drawings on the computer, and
stores the image for future use. PC Notes Taker is ideal for markets where handwritten
input is essential, such as health, educational and financial sectors. Supplied with user-
friendly software, PC Notes Taker is compatible with PCs and notebooks.
Adds Handwriting Input to any Computer PC Notes Taker is the world's first
device that captures natural handwriting on any surface onto a PC in real time. Based on
a evolutionary electronic pen, PC Notes Taker displays the user's handwritten notes,
memos or drawings on the computer, and stores the image for future use. PC Notes Taker
is ideal for markets where handwritten input is essential, such as health, educational and
financial sectors. Supplied with user-friendly software, PC Notes Taker is compatible
with PCs and notebooks.
Capture of handwriting from any plain paper or other writing surface Input of
continuous writing up to A4 page size Insert sketches, signatures, equations, and notes
into Word® documents E-mail sketches or handwritten notes in any language using MS®
OUTLOOK Convert handwriting to digital text using MS® word recognition engine
Annotate, add comments, edit and draw in your own handwriting onto MS® office
documents Create instant messaging using ICQNEW
The Smart Pen is a device that resembles a fat pen or stylus, but
contains a tiny computer and a set of sophisticated sensors that record and
analyze every motion, and then transmit this information to a nearby computer via
infrared, radio or direct electric signal .A Smart Pen helps a computer to recognize
handwritten or drawn input. A computer is treated as 1 level of Complexity higher in
its ability to recognize the handwriting of anybody who uses a Smart Pen. Costs
$50, weight is negligible.
The pen works in conjunction with a regular PC; onto which users install special
handwriting recognition software developed by BT Labs, Collins said.
Users write down notes in their regular handwriting and the movements are stored
within Smart Quill. Up to 10 pages of notes can be stored locally on the pen, Collins said.
Once the pen is hooked up to the computer, the handwriting recognition software
translates the movements into text on-screen. Unlike many handwriting recognition
programs, the Smart Quill system analyzes movements instead of shapes, Collins said.
This allowed BT to get rid of the electronic notepad associated with most
computer pens.
Smart Quill contains a few local applications such as an address book, daily
planner, and calculator. Users can enter information into these applications by pushing a
button on the pen and writing down what they would like to enter, Collins said. There is
also a small three-line screen to read the information stored in the pen; users can scroll
down the screen by tilting the pen slightly, he said.
One of the major asset is that Smart Quill does not need a screen to work. This is possible
through revolutionary "Spatial Sensing" system which uses semiconductor
accelerometers. Accelerometers senses pen/hand movement instead of shapes. It also
automatically detects left or right handed use.
TECHNOLOGY
DISPLAY TECHNOLOGY
Technology used in Smart Note Taker for display is Kopin Corp’s Cyber Display
technology.
Cybe Display is a¼ inch diagonal LCD that uses circuitry built on a silicon wafer, then
removed and mounted to glass. The displays are integrated to miniature monitors using
its own back lighting, optics, ICS and packaging.
Smart Note Taker works by measuring the pen's movements and matching them to the
movements that produce letters and words programmed into its memory. It's similar to
the way a microphone detects sound. Consistency of handwriting, rather than neatness, is
the only condition for accuracy.
Accelerometer Technology:
This technology uses a device called Accelerometer which is used for measuring motion.
A tiny accelerometer in a pen could be used to detect the stops and starts, arcs and loops
of handwriting, and transmit this information to a small microprocessor that would make
sense of it as text. There's also the possibility of viewing a full page of text through a
special monocular magnified "virtual" screen that could be built into the end of the pen.
It records movement by using the earth's gravity system, whether you write on paper or
in the air. Hence it is independent of surface used. Movements are stored within the
This Smart Note Taker prototype records writing on paper for radio transmission to a
pocket pc, desktop, cell phone or tablet computer. The accelerometer tracks the angular
movement of the top of the pen at an angle in the air and these angles plotted as x/y
position on pc screen.
An early hardware prototype picture shows, left to right, tilt sensor , PIC 8 bit
microcontroller, batteries, and 433Mhz 1200 Baud radio transmitter. Currently a radio
receiver on the RS232 port of a pc records the pen movement for analysis via pc. The pen
will power down after a period of no movement so doesn't need an on/off switch. The
battery life is approximately 22 hours.
1. Handwriting transcription
DVR & DR HS MIC COLLEGE OF TECHNOLOGY 14
Smart Note Taker
2. Handwriting recognition
Handwriting transcription:
In this phase, the recorded acceleration signals are then transcripted to it’s original form.
Here this aspect is solved using ‘simple’ double integration method in order to retrace the
pen tip movement on paper.
Method:
In order for this principle to work properly, we have to solve two main problems:
Firstly, we have to know pen’s spatial orientation in order to withdraw the earth gravity
component to the measured accelerations.
Secondly, we have to succeed in the double integration, which is to solve all the
derivation problems due to this method. 7
Fig: 3.7.1Represents the acceleration signals recorded while one is writing a small
capital B.
Handwriting recognition:
The second huge aspect is the characters and signatures recognition. The hardware
(accelerometers plus contact detector) embedded in the pen has proved a really efficient
combination for this application.
Method
The same method is used to recognize the characters written by a single user and to find
whose
signature is the one that has just been done.
We use a simple Euclidian distance as the comparison process, and of course the decision
process is the smaller distance found.
The first step consists in creating the reference database for the characters as for the
signatures. For this a mean signal is computed for each recorded symbol.
The second step is the recognition process
1. For the creation of database, each symbol was reproduced several times and a mean
normalized symbol was computed.
2. For recognition process, the unknown symbol is first normalized, the distance between
this symbol and the entire database symbol is computed. Then the unknown symbol is
recognized as the one with the lowest distance.
ADVANTAGES
-Can be used as standard pen and can carry anywhere without stressing mind to carry it.
-With the help of smart note taker we can write notes on any surface
even in air. That is we can write notes any time without using a paper.
-is used along with paint and JAVA graphics so we can say this
product is compatible with all graphics software.
-Light weighted and easily portable
on phone talks or for instructor.
-Useful for any person, any institute
DISADVANTAGES
Expensive
Awareness requires.
APPLICATIONS
With the help of smart note taker handwritten notes will be instantly converted into
editable text
Another place, where this product can play important role is where two people talk on the
phone. The subscribers are apart from each other while their talk and they may want to
use figures or text to understand themselves better.
Can be use by teachers directly and indirectly by students, too
Smart note taker is reliable and powerful.
It is helpful for blinds that think and write freely.
Smart note taker is used for instructors in presentations.
It is used along with paint and JAVA graphics so we can say this
product is compatible with all graphics software.
Easy-to-use wireless connection.
FUTURE SCOPE
Companies had succeeded to make similar products and put them in the
market. Putting a newly invented, innovative product in the market is not easy. The
prices in the market must be well observed for similar products. The prices of 2-D digital
pens are about 50 dollars to 90 dollars. So the price of smart note taker will be high .
But this disadvantage definitely be eliminated in near future.
CONCLUSION
The system will try to improve a pen, which helps people get rid of typing
problems on computer by the technology, which converts your handwriting to text format
on your PC. However, the technology provides opportunity to write on air, which means
it, needs no any item to convert the typing to your computer such as 3D view. Beside this,
it can also be used like all other classical pens. Therefore, this device will increase the
capacity of noting the texts, lessons and projects you work on. One other fact that appears
is similar products generally works in a way that they store the writing by memory
systems and direct the data to computer.
REFERENCES
1. http:/www.wikipedia.com
2. http://www.newscientist.com
3. http://fp.uni.edu/its/et/studioit/smartboard.htm
4. http://www.campus-technology.com
5. http://www2.smarttech.com/st/enUS/Products/Interactive+Pen+Displays
6. http://www.ipen4you.com
7. http://ge402.bilkent.edu.trs
8. http://www.pegatech.com
9. http://www.cnn.com