Scribd
Upload
70 views25 pages

Smart Camera As Embedded Systems: Albin Thomas S7 Cse NO2

Smart cameras perform real-time image analysis without an external processing unit. They contain image sensors, memory, processors, communication interfaces and other components. Smart cameras have advantages like lower cost, simplicity of integration and reliability. As embedded systems, they can perform dedicated functions with real-time constraints. Smart cameras use algorithms like region extraction, contour following, ellipse fitting and graph matching to detect and recognize objects and activities in images. They have applications in surveillance, medical imaging, quality inspection and more.

Uploaded by

liyamol
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
70 views25 pages

Smart Camera As Embedded Systems: Albin Thomas S7 Cse NO2

Smart cameras perform real-time image analysis without an external processing unit. They contain image sensors, memory, processors, communication interfaces and other components. Smart cameras have advantages like lower cost, simplicity of integration and reliability. As embedded systems, they can perform dedicated functions with real-time constraints. Smart cameras use algorithms like region extraction, contour following, ellipse fitting and graph matching to detect and recognize objects and activities in images. They have applications in surveillance, medical imaging, quality inspection and more.

Uploaded by

liyamol
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 25

SMART CAMERA AS

EMBEDDED SYSTEMS
ALBIN THOMAS
S7 CSE
NO 2
SMART CAMERA
• A smart camera performs real-time
analysis to recognize scenic elements.
• Smart cameras are useful in a variety of
scenarios surveillance, medicine, etc.
• A "smart camera" is basically a video
camera coupled to a computer vision
system in a tiny package.
• Smart camera can extract information from
images without need for an external
processing unit, and interface devices.
• Having a dedicated processor in each unit,
smart cameras are especially suited for
applications where several cameras must
operate independently and often
asynchronously, or when distributed vision
required
COMPONENTS
• Image sensor (matrix or linear, CCD- or CMOS)
• Image memory
• processor (often a DSP or suitably powerful
processor)
• Communication interface (RS232, Ethernet)
• I/O lines (often opt isolated)
• Lens holder or built in lens
• Built in illumination device (usually LED)
• Purpose developed real-time operating system
ADVANTAGES
• Cost
• Simplicity and Integration
• Reliability
EMBEDDED SYSTEMS

• An embedded system is a special-purpose


computer system designed to perform one or
a few dedicated functions, often with real-time
computing constraints
• Today embedded technology produces
Intelligent, Multitasking, Compact electronic
products with networking facilities.
Embedded computing systems

• Computing systems embedded within


electronic devices
• Hard to define. Nearly any computing
system other than a desktop computer
• Billions of units produced yearly, versus
millions of desktop units
• Perhaps 50 per household and per
automobile.
Characteristics of embedded
systems
• Device programmability or manageable-
• Multitasking
• Real time response-
• The program instructions written for
embedded systems are referred to as
firmware stored in read-only memory or
Flash memory chips.
Smart camera as embedded
system
• Data from the cameras is, assembled into
images
• Then image is transferred to the host
computer
• Subsequent analysis of the data is
performed at the analysis workstation with
analysis software that allows extraction of
data from the database for creation of
reports..
• All system and analysis software is
multithreaded and provides real time data
access and display.
• Via a modem connection the system is also
operable remotely.
• These devices could support a wide variety
of applications including human and animal
detection, surveillance, motion analysis, and
facial identification.
Detection and Recognition
Algorithms
• Algorithms use both low-level and high-level processing.
• The low-level component identifies different body parts and
categorizes their movement in simple terms
• The high-level component, which is application-dependent,
uses this information to recognize each body part's action
and the person's overall activity based on scenario
parameters
LOW LEVEL PROCESSING
ALGORITHMS
• REGION EXTRACTION
• CONTOUR
• ELLIPSE FITTING
• GRAPH MATCHING
REGION EXTRACTION
• The first algorithm transforms the
pixels of an image
• Eliminates the background.
• It then detects the body part's skin area
REGION EXTRACTION
CONTOUR FOLLOWING
• The next step in the process involves
linking the separate groups of pixels
into contours that geometrically define
the regions.
Ellipse fitting
• To correct for deformations in image processing
caused by clothing, objects in the frame, or some
body parts blocking others, an algorithm fits
ellipses to the pixel regions shows to provide
simplified part attributes.
• The algorithm uses these parametric surface
approximations to compute geometric descriptors
for segments such as area,and spatial
relationships.
Graph matching
• Each extracted region modeled with
ellipses corresponds to a node in a
graphical representation of the human
body.
HIGH LEVEL PROCESSING
• The high-level processing component, which
can be adapted to different applications,
compares the motion pattern of each body part
• To help compensate for image-processing
problems, we use two cameras set at a 90-
degree angle to each other to capture the best
view of the face and other key body parts.
Requirements

• Frame rate:
The algorithms we use as well as the platform's
computational power determine the achievable
frame rate, which can be extremely high in some
systems.
• Latency:
The amount of time it takes to produce a result for
a frame is also important because smart cameras
will likely be used in closed-loop control systems,
where high latency makes it difficult to initiate
events in a timely fashion based on action in the
video field.
APPLICATIONS
• 3D scene analysis with distributed sensors.
• Code reading and verification (barcode, Data Matrix,
alphanumeric etc.)
• Biometric recognition and access control (face,
fingerprint, iris recognition)
• Automated inspection for quality assurance (detection of
defects, flaws, missing parts...)
CONCLUSION
• The vision industry is rapidly moving away from
the video camera/frame grabber systems of the
twentieth century to a new generation of smart-
camera-based systems for the 21st century.
• These 21st century smart-camera systems will
perform real-time, pixel-data extraction and
processing operations within the camera at
extremely high speeds and at a cost, which is
considerably less than required today for
comparable capabilities..

You might also like