How to calculate image resolution

The detail in an image is determined by resolution. The shorter the lens focal length, the wider the field of view. Greater than about 90 most lenses start to show curved, barrel distorted images that compress the image at the edges. Rectilinear lenses such as those using Theia Technologies Linear Optical Technology dont exhibit barrel distortion and thus maintain image resolution out to the edge of the image. Many definitions Resolution has many definitions; no one definition is correct for all situations. Ill list only the definitions relevant to the video surveillance industry here. Definition 1: Resolution can be expressed as the number of TV lines or pixels of the image sensor used to record an image. The greater the number of lines, the greater detail or larger field of view can be recorded with the camera. For analog cameras this is the usual definition. The number of TV lines in the image can be 320, 480, 570, etc. Definition 2: Resolution can be expressed as the total number of pixels. With megapixel cameras, the resolution is generally the total number of pixels, divided by 1,000,000, and rounded off. Table 1 below shows examples of typical megapixel camera resolutions. Megapixels HD* 720 1.3 MPix HD* 1080 2 MPix 3 MPix 5 MPix Total number of pixels 921,600 1,310,720 2,073,600 1,920,000 3,145,728 4,915,200 Vertical pixels 720 1024 1080 1200 1536 1920 Horizontal pixels 1280 1280 1920 1600 2048 2560

Table 1: Number of pixels for different megapixel camera formats. *There are two definitions for HD video. Twice as much resolution in a 1080 HD cameras means twice as much detail or field of view compared to a 720 HD camera.

Definition 3: Resolution can be the level of detail with which an image can be reproduced or recorded. At the image sensor resolution is expressed as line pairs per millimeter (lpm) commonly used by lens designers and optical engineers. As the total number of pixels on an image sensor increases, the pixel size gets smaller and requires a higher quality lens to achieve best focus. These high quality lenses, including those manufactured by Theia Technologies, are rated for megapixel or multi megapixel cameras meaning the image will be sharply in focus at the camera resolution it is rated for. Definition 4: Resolution can be specified in pixels per foot or meter at the object. This mapping of the image sensor dimensions onto the object is most intuitive for calculating what level of detail can be seen in the image. Fundamentally it is the horizontal field of view (HFOV) of the camera divided by the horizontal number of pixels. This gives a pixels per foot number that can be related to image quality. This is the definition that I will expand upon further in the rest of this white paper. Resolution requirements There is not yet an industry standard for the level of sharpness required in every video surveillance application. The more pixels on a target, the higher the resolution will be and the more likely recognition and positive identification will be made. However, higher detail requires higher resolution cameras or more cameras and thus more bandwidth and storage. There is a balance that must be made between level of detail and project budget.
2009 Theia Technologies Page 1 of 9

In Table 2 below, an image is shown at different levels of resolution from high detail for clear identification at 60pix/ft to motion tracking for wide field of view at 10pix/ft. Each image has the same number of pixels but as the field of view increases, the pixels per foot in the image decreases. Because there are no more pixels in one image compared to another, there is no effect on the amount of data transferred over the network and no degradation of network performance by going to either higher image resolution or greater field of view. Resolution level Identification (high detail) Pix/ft 60 Pix/m 200 Resolution level Detection (general security) Pix/ft 20 Pix/m 70

Resolution level Recognition (forensic detail)

Pix/ft 40

Pix/m 130

Resolution level Overview (motion, tracking)

Pix/ft 10

Pix/m 30

Table 2: As field of view increases the pixels per foot decreases so that each picture has the same number of pixels and thus causes the same amount of network loading.

Wide angle field of view Another advantage of the higher resolution available from megapixel cameras is the ability to cover a much wider area with the same or better resolution compared to analog cameras. Because the total available pixels spread across the field of view is greater, the field of view can be increased without decreasing image resolution. Table 3 below compares the field of view of different cameras at a distance of 32 feet from the subject at the same image resolution. As the camera resolution (total number of pixels) increases, so does the field of view at constant image resolution (pixels per foot). Clearly the higher the number of pixels in the camera, the wider the field of view at a constant image resolution. This increase in field of view is also shown in Figure 1 below.

2009 Theia Technologies

Page 2 of 9

Camera Analog 1.3MPix 3MPix 5MPix

Image width Not so wide Wide angle Super wide Ultra wide

Lens focal length 4.5 mm 2.2 mm* 1.7 mm* 1.3 mm*

Field of view 58 (36 ft) 96 (71 ft) 120 (110 ft) 132 (144 ft)

Resolution 18 pix/ft 18 pix/ft 19 pix/ft 18 pix/ft

Field of view increase 2X 3X 4X

Table 3: Image width increases with total number of pixels at constant image resolution. *For the same field of view, rectilinear lenses (see below) and lenses with barrel distortion will have different focal lengths. A 180 fisheye lens may have a focal length of 2.2mm because it has more than 80% distortion whereas a rectilinear lens can have a focal length of 1.3mm and field of view of only 125.

Figure 1: Field of view increases with increasing camera resolution (total number of pixels) without any change in image resolution (pixels per foot). The 3 and 5 megapixel images are cropped vertically to eliminate uninteresting sky and ground areas of the image. This cropping reduces the total number of pixels but doesnt affect the pixels per foot resolution

Rectilinear v. fisheye Most wide angle lenses have barrel distortion (also known as fisheye distortion) that causes the image to look curved and bulged out in the center. Rectilinear lenses, like those made for the security industry by Theia Technologies, keep lines that appear straight in the real world straight on the image sensor. This has the benefit of increasing the resolution of the image at the edges (i.e. an object will cover more pixels in the image when the object is at the edge of the image) whereas lenses with barrel distortion cause the image to be compressed at the edges and resolution is reduced. With typical distorted wide angle lenses, potentially valuable information is lost in the lens and no software, dewarping or otherwise, can recapture or reconstruct this lost information in the image. Any dewarping will create an image that looks like that from a rectilinear lens but at lower resolution. With a rectilinear lens, the image is spread over a greater number of pixels at the edges, increasing the probability of detection and identification. Objects in a plane With a rectilinear lens, objects in a common plane perpendicular to the camera have the same image resolution at the center and edge even though the objects at the edges are much farther away from the camera. This is shown in Figures 2 and 3 below.

2009 Theia Technologies

Page 3 of 9

Figure 2: Objects in a plane perpendicular to the camera have the same image resolution at the center and edge of the image.

Figure 3: These targets are in a 10x10ft grid. At 20ft from the camera using Theias SY110 lens with 120deg field of view, the HFOV is 60 feet. Targets at the edge of the image are twice as far from the camera but can be seen as clearly as those in the center of the image along the same plane.

This rectilinearity creates an effect called 3D stretching or lean-over in which objects at the image edge seem to be stretched because they are being flattened onto a plane along the tangent angle from the lens. With rectilinear lenses, the wider the field of view, the more noticeable this effect. This effect is not what most people are used to seeing but it has the advantage of increased resolution (pixels per foot) for objects at the edge of the image compared to lenses with barrel distortion. For lenses with barrel distortion, the objects at the edge of the image will be smaller than those in the center and they will curve towards the center. Figure 4 below shows this 3D stretching. The length of the black car near the edge of the image is flattened onto the image plane along a steep tangent angle so it appears stretched. But the width of the two cars is the same because they are in the same plane perpendicular to the camera. Because the effect is only present when objects have length parallel to the camera in the third (depth) dimension, such as the length of the cars, it is called 3D stretching.

2009 Theia Technologies

Page 4 of 9

Figure 4: 3D stretching. The objects are projected onto the image plane along the tangent line causing objects at the image edge with dimensions parallel to the lens axis to appear stretched.

Objects in an arc With a rectilinear lens, the calculation of resolution of objects in an arc with the camera at the center is a little more complicated. As an object moves from the center of the image towards the edge in an arc without changing the distance to the camera, the object will increase in resolution significantly. This is shown in figures 5 and 6 below.
Figure 5: Objects in a circle, equidistant from the camera, will increase in resolution as they move from the image center to edge.

This case, shown in Figure 6 below, clearly shows the resolution increase as objects move around the arc at constant distance from the camera. The image of the person standing 11.5ft from the camera will increase in width due to 3D stretching as they move to the edge of the image. At the image edge, they may be more clearly identified compared to the center and compared to a lens with barrel distortion. Lenses with barrel distortion will not show an increase in object width.

2009 Theia Technologies

Page 5 of 9

Figure 6: As subjects move in a circle with the camera at the center, they increase in size due to 3D stretching, making them more recognizable towards the edges of the image. This 135 field of view was captured using Theias SY125 lens.

Resolution Performance of lenses based on Linear Optical Technology

The charts below show image resolution and horizontal field of view (HFOV) as a function of camera distance for Theias rectilinear lenses. For example, if 20 pixels per foot is required for a general surveillance application with a 5MPix camera and Theias SY110 lens, the camera would need to be 37 feet away from an object in the center of the image. As the object moves perpendicular to the camera as described in Figure 1, the image resolution will remain 20 pixels per foot even though the object is getting farther from the camera. The resolution of wide angle, non-rectilinear lenses will decrease as the object moves along this line.

2009 Theia Technologies

Page 6 of 9

SY110 camera distance vs. image resolution and HFOV

70 High Res 1.3MPix 3MPix 5MPix Field of View 350

60

300

50
Image resolution [pix/ft]

250 Field of view

Horizontal field of view [ft] Horizontal field of view [ft]

40

200

30

150

20

100

10

50

0 10 20 30 40 50 60 70 80 90 Camera distance [ft]

0 100

SY125 camera distance vs. image resolution and HFOV

70 High Res 1.3MPix 3MPix 5MPix Field of View 350

60

300 Field of view 250

50
Image resolution [pix/ft]

40

200

30

150

20

100

10

50

0 10 20 30 40 50 60 70 80 90 Camera distance [ft]

0 100

Figures 7a and 7b: Image resolution and field of view calculation based on Theias lenses. Both these charts are also available in metric units from Theias image resolution calculator web page.

2009 Theia Technologies

Page 7 of 9

Resolution calculation
Given a lens and camera, it is possible to calculate the image resolution by using the simple equations below. If the field of view is not known, it can be calculated for a rectilinear lens using the equation in Table 4. If the lens has barrel distortion it is best to look up the HFOV in the specification sheet. Rectilinear lens field of view as a function of lens focal length: Example

HFOV camera _ dist *

chip _ width focal _ length

80 ft 23 ft *

5.76mm 1.7mm

A 5MPix camera with Theias SY110 lens has a field of view of 80 feet at a distance of 23 feet. Table 4: Rectilinear lens HFOV as a function of focal length. Chip width depends on the camera. The most common sizes are listed in Table 8.

Once the horizontal field of view is calculated and the camera is known, the image resolution is simply the ratio of the pixels to HFOV. Image resolution as a function of field of view Example

resolution

number _ pixels horizontal HFOV

32 pix / ft

2560 pixels 80 ft

The same 5MPix camera as above has an image resolution of 32 pixels/foot at a distance of 23 feet. Table 5: Resolution in pixels per foot or meter depending on the units of image width. Number of pixels is also listed in Table 8 for the most common megapixel cameras.

Lens focal length for given image resolution calculation For a design with a known resolution requirement, it is possible to invert the equations above to calculate the lens focal length required for a given camera. This equation is shown in below. Lens focal length for a known camera Example

focal _ length

camera _ dist * chip _ width * image _ res number _ pixelshorizontal

1.7mm

23 ft * 5.76mm * 32 pix / ft 2560 pixels

To maintain 32 pixels/foot resolution at 23 feet from the camera, a 1.7mm lens is required. Longer focal length gives a smaller field of view but higher image resolution. Table 6: Lens focal length for a known camera. Chip_width and Focal_length are both in millimeters. Camera_dist and image_resolution are either both English or metric units.

For objects in the same plane, the edge resolution equals the center resolution. However, for objects in an arc, equidistant from the camera, the edge resolution is related to the center resolution by the cosine of the maximum HFOV angle. This equation is shown in Table 7 below.

2009 Theia Technologies

Page 8 of 9

Edge resolution based on center resolution

Example

edge _ resolution

center _ resolution lens _ anglemax cos 2

64 pixels / ft

32 pixels / 120 o cos 2

ft

The previous example has 32pixels/foot image resolution in the center. With Theias SY110 lens with 120 field of view, the edge image resolution increases to 64pixels/foot. Table 7: Edge resolution is greater than center resolution for an object moving in an arc about the camera.

The variables in the equations depend not only on the lens choice but camera choice as well. Different camera resolutions have different chip sizes, therefore different fields of view for the same lens. Below are tables of data for the most common megapixel cameras and the corresponding fields of view for two of Theias rectilinear lenses. Camera Chip size Chip_width # pixelshoriz SY110 HFOV SY125 HFOV 1.3MPix 1/3 4.8mm 1280 110 125 2MPix 1/2 6.4mm 1600 126 140 3MPix 1/2 6.4mm 2048 126 140 5MPix 1/2.5 5.76mm 2560 120 135

Table 8: Common chip sizes for megapixel cameras and corresponding angular fields of view for two rectilinear lenses.

In summary, there are many definitions of resolution. The two most commonly used in the security industry are total number of pixels in a camera and the pixels per foot in an image. As the total number of pixels increases, the detail in the image or the field of view or both can be increased. For wide angle lenses, rectilinear lenses increase the image resolution at the edges of the image improving the possibility of detection and identification. For any further explanation please contact Theia Technologies:
Mark Peterson
VP Advanced Technology
Theia Technologies | 29765 SW Town Center Loop W, Suite #4 | Wilsonville, OR 97070 |503 570-3296 [email protected] | www.TheiaTech.com

2009 Theia Technologies

Page 9 of 9