FLIR Lepton Data Brief
FLIR Lepton Data Brief
FLIR Lepton Data Brief
General Description
Lepton is a complete long-wave infrared (LWIR)
camera module designed to interface easily into
native mobile-device interfaces and other consumer
electronics. It captures infrared radiation input in its
nominal response wavelength band (from 8 to 14
microns) and outputs a uniform thermal image.
Features
Dimensions:
8.5 x 11.7 x 5.6 mm (without socket),
10.6 x 11.7 x 5.9 mm (including socket)
Applications
Mobile phones
Gesture recognition
Building automation
Thermal imaging
Night vision
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
VoSPI
MIPI 1
2.8V, 1.2V, 2.5V to 3.1V IO
CLKin
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Date
Description of Change
1.0
5/1/2014
Initial release
1.1
7/7/2014
1.2
9/23/2014
Minor corrections
1.2.3
10/15/2014
Contact Us
email: [email protected]
phone: 1-888-747-3547
http://www.FLIR.com
References
Lepton Software Interface Description Document (IDD) - Public. Document #110-0144-03.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Typical Application
Camera Module
Camera Supply Inputs
VDD (2.8V)
VDDIO (2.5 V to 3.1V)
VDDC (1.2V)
PWR DWN L
RESET L
MASTER CLK
MIPI DATA P
MIPI DATA N
MIPI CLK P
MIPI CLK N
VDDIO (2.5 V to3.1V)
SCL
SDA
SPI MOSI
SPI MISO
SPI CS L
SPI_ CLK
GPIO [3:0]
Note:
(1 ) The CCI pullup resistors are required and must be handled
outside the camera module by a host controller
.
(2 ) MIPI is not currently supported
.
.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Description
Overview
Function
Sensor technology
Spectral range
Array format
Pixel size
Effective frame rate
Thermal sensitivity
Temperature compensation
Non-uniformity corrections
FOV - horizontal
FOV - diagonal
Depth of field
Lens type
Output format
Solar protection
Electrical
Input clock
Video data interface
Control port
Input supply voltage (nominal)
Power dissipation
Mechanical
Package dimensions socket version
Weight
Environmental
Optimum operating temperature
range
Non-operating temperature range
Shock
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
32 MIPI DATA P
31 MIPI DATA N
30 GND
29 MIPI CLK P
28 MIPI CLK N
27 GND
26 MASTER CLK
25 GND
Figure 3
24 RESET L
1 GND
23 PWR DWN L
2 GPIO3
22 SDA
3 GPIO2
21 SCL
4 GPIO1
20 GND
5 GPIO0
19 VDD
6 GND
18 GND
7 VDDC
8 GND
9 GND
10 GND
11 SPI MOSI
12 SPI MISO
13 SPI CLK
14 SPI CS L
15 GND
16 VDDIO
17 NC
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Pin Name
Signal
Type
Signal Level
Description
1, 6, 8,
9, 10,
15, 18,
20, 25,
27, 30
GND
Power
GND
Common Ground
GPIO3
IN/OUT
VDDIO
GPIO2
IN/OUT
VDDIO
GPIO1
IN/OUT
VDDIO
GPIO0
IN/OUT
VDDIO
VDDC
Power
1.2V
11
SPI_MOSI
IN
VDDIO
12
SPI_MISO
OUT
VDDIO
13
SPI_CLK
IN
VDDIO
14
SPI_CS_L
IN
VDDIO
16
VDDIO
Power
2.5 V 3.1 V
17
No connection
19
VDD
Power
2.8V
21
SCL
IN
VDDIO
22
SDA
IN/OUT
VDDIO
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
Pin Name
Signal
Type
Signal Level
Description
23
PWR_DWN_L
IN
VDDIO
24
RESET_L
IN
VDDIO
26
MASTER_CLK
IN
VDDIO
28
MIPI_CLK_N
OUT
Diff Pair
29
MIPI_CLK_P
OUT
Diff Pair
31
MIPI_DATA_N
OUT
Diff Pair
32
MIPI_DATA_P
OUT
Diff Pair
Note(s)
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
10
Lepton Architecture
Bias,
timing,
&
ctrl
Housing
Lens
Assy.
Focused
IR image
MIPI
VoSPI
OTP
Focalplane
array
(FPA)
SoC
I2C
( comm)
GPIO
(optional)
Discrete controls
Digital
data
stream
Image
Pipeline
Clk
VDD, VDDC, VDDIO
Thermistor
The lens assembly focuses infrared radiation from the scene onto an 80x60 array of thermal detectors with
17-micron pitch. Each detector element is a vanadium-oxide (VOx) microbolometer whose temperature
fluctuates in response to incident flux. The change in temperature causes a proportional change in each
microbolometers resistance. VOx provides a high temperature coefficient of resistance (TCR) and low 1/f
noise, resulting in excellent thermal sensitivity and stable uniformity. The microbolometer array is grown
monolithically on top of a readout integrated circuit (ROIC) to comprise the complete focal plane array (FPA).
Once per frame, the ROIC senses the resistance of each detector by applying a bias voltage and integrating
the resulting current for a finite period of time called the integration period.
The serial stream from the FPA is received by a system on a chip (SoC) device, which provides signal
processing and output formatting. The image pipeline is defined in Video Pipeline, page 12.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
11
Image Pipeline
raw data in
Non-uniformity
correction (NUC)
Defect
Replacement
Spatial / Temporal
Filtering
AGC disabled
AGC enabled
AGC
Colorize
The video pipeline includes non-uniformity correction (NUC), defect replacement, spatial and temporal
filtering, automatic gain correction (AGC), and colorization.
7.1
NUC
The non-uniformity correction (NUC) block applies correction terms to ensure that the camera produces a
uniform output for each pixel when imaging a uniform thermal scene. Factory-calibrated terms are applied to
compensate for temperature effects, pixel response variations, and lens-illumination roll-off. To compensate
for temporal drift, the NUC block also applies an offset term that can be periodically updated at runtime via a
process called flat-field correction (FFC). The FFC process is further described in FFC States, page 17.
7.2
Defect Replacement
The defect-replacement block substitutes for any pixels identified as defective during factory calibration or
during runtime. The replacement algorithm assesses the values of neighboring pixels and calculates an
optimum replacement value. The typical number of defective pixels is 1.
7.3
The image pipeline includes a number of sophisticated image filters designed to enhance signal-to-noise ratio
(SNR) by eliminating temporal noise and residual non-uniformity. The filtering suite includes a scene-based
non-uniformity correction (SBNUC) algorithm which relies on motion within the scene to isolate fixed pattern
noise (FPN) from image content.
7.4
AGC
The AGC algorithm for converting the full-resolution (14-bit) thermal image into a contrast-enhanced image
suitable for display is a histogram-based non-linear mapping function. See AGC Modes, page 25.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
12
Colorize
The colorize block takes the contrast-enhanced thermal image as input and generates a 24-bit RGB color
output. This feature is anticipated in a future release and is not currently accessible.
8.1
Power States
Lepton currently provides five power states. As depicted in the state diagram shown in Figure 6, most of the
transitions among the power states are the result of explicit action from the host. The automatic transition to
and from the overtemp state is an exception. In the figure, transitions that require specific host-side action are
shown in bold. Automatic transitions are not bolded.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
13
Off
Standby
10-sec counter
times out
Reset
Start-up
sequence
Uninitialized
Shutdown
sequence
Overtemp
On
Start-up sequence
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
14
Off: When no voltage is applied, Lepton is in the off state. In the off state, no camera functions are
available.
Uninitialized: In the uninitialized state, all voltage forms are applied, but Lepton has not yet been
booted and is in an indeterminate state. It is not recommended to leave Lepton in this state as power is
not optimized; it should instead be booted to the on-state (and then transitioned back to standby if
imaging is not required).
On: In the on state, all functions and interfaces are fully available.
Standby: In the standby state, all voltage forms are applied, but power consumption is approximately 4
mW. In the standby state, no functions are available, but it is possible to transition to the on state via
the start-up sequence defined in Figure 7 on page 16. The shutdown sequence shown in Figure 7 on
page 16 is the recommended transition back to the standby state. It is also possible to transition
between standby and on states via software commands, as further defined in the software IDD.
Overtemp: The overtemp state is automatically entered when the Lepton senses that its temperature
has exceeded approximately 80 C. Upon entering the overtemp state, Lepton enables a shutdown
imminent status bit in the telemetry line and starts a 10-second counter. If the temperature of the
Lepton falls below 80 C before the counter times out, the shutdown imminent bit is cleared and the
system transitions back to the on state. If the counter does time out, Lepton automatically transitions to
the standby state.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
15
Power Sequencing
Start-up Sequence
(from uninitialized to on
and standby to on)
Shutdown Sequence
(from on to standby)
De-assert
PWR_DWN_L
(should be high)
Assert PWR_DWN_L
Assert RESET_L
(should be low)
Enable MASTER_CLK
Disable MASTER_CLK
De-assert RESET_L
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
16
FFC States
Lepton is factory calibrated to produce an output image that is highly uniform, such as shown in Figure 8 (a),
when viewing a uniform-temperature scene. However, drift effects over long periods of time degrade
uniformity, resulting in imagery which appears more grainy (Figure 8 (b)) and/or blotchy (Figure 8 (c)).
Operation over a wide temperature range (for example, powering on at -10 C and heating to 65 C) will also
have a detrimental effect on image quality.
For scenarios in which there is ample scene movement, such as most handheld applications, Lepton is
capable of automatically compensating for drift effects using an internal algorithm called scene-based
non-uniformity correction (scene-based NUC or SBNUC). However, for use cases in which the scene is
essentially stationary, such as fixed-mount applications, scene-based NUC is less effective. In those
applications, it is recommended to periodically perform a flat-field correction (FFC). FFC is a process whereby
the NUC terms applied by the camera's signal processing engine are automatically recalibrated to produce the
most optimal image quality. The sensor is briefly exposed to a uniform thermal scene, and the camera updates
the NUC terms to ensure uniform output. The entire FFC process takes less than a second.
Figure 8
The current FFC state is provided through the telemetry line. There are three FFC states, as illustrated in
Figure 9 on page 18:
1. FFC not commanded (default): In this state, Lepton applies by default a set of factory-generated
FFC terms.
2. FFC in progress: Lepton enters this state when FFC is commanded. The default FFC duration is
nominally 23 frames.
3. FFC complete: Lepton automatically enters this state whenever FFC is completed.
Lepton also provides an FFC desired flag in the telemetry line. The FFC desired flag is asserted at
start-up, when a specified period (default = 3 minutes) has elapsed since the last FFC, or when the
sensor temperature has changed by a specified value (default = 3 Celsius degrees) since the last FFC.
The FFC desired flag is intended to indicate to the host to command an FFC at the next possible
opportunity.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
17
FFC States
Lepton powered on
FFC
Commanded
FFC Not
Commanded
FFC In
Progress
FFC Complete
FFC
Complete
FFC
Commanded
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
18
Telemetry Modes
There are three telemetry modes that affect the video output signal:
Telemetry disabled (default)
Telemetry as header
Telemetry as footer
Explicit commands over the CCI select each mode. The contents and encoding of the telemetry data are
shown in Table 3. Note that the second and third lines (line B and line C) are reserved for future growth and
contain no information at this time.
Table 3 Telemetry Data Content and Encoding
Telemetry
Row
Word
start
Word
End
Number
of 16-bit
Words
Name
Telemetry
Revision
Time Counter
Status Bits
12
Module serial #
13
16
Software revision
17
19
Reserved
20
21
Frame Counter
22
22
Frame Mean
23
23
FPA Temp
24
24
FPA Temp
In Kelvin x 100
25
25
Housing Temp
Notes
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
19
Word
start
Word
End
Number
of 16-bit
Words
Name
26
26
Housing Temp
27
28
Reserved
29
29
30
31
Time Counter at
last FFC
32
32
Housing temp at
last FFC
33
33
Reserved
34
37
AGC ROI
38
38
AGC Clip-Limit
High
39
39
AGC Clip-Limit
Low
40
73
34
Reserved
74
74
Log2 of FFC
frames
75
79
Reserved
79
80
Reserved
78
79
Reserved
Notes
In Kelvin x 100
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
20
Bit end
Number of
Bits
Name
Notes
Reserved
FFC Desired1
FFC State1
Telemetry Revision 8:
00 = FFC never commanded
01 = FFC in progress
10 = FFC complete
11 = undefined
Telemetry Revision 9:
00 = FFC never commanded
01 = Reserved
10 = FFC in progress
11 = FFC complete
11
Reserved
12
12
AGC State
13
19
Reserved
20
20
21
31
11
Reserved
0=Disabled
1=Enabled
Note(s)
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
21
Radiometry Modes
There are two radiometry modes that affect the video output signal:
The radiometric modes affect the transfer function between incident flux (scene temperature) and pixel output.
From an image-quality standpoint, both radiometry modes produce nearly identical performance (no change in
NEDT), and either mode is appropriate for strict imaging applications. However, for applications in which it is
intended to convert the Lepton output signal to one proportional to scene temperature, the radiometry-enabled
mode is preferred because the conversion is constant over the full operating temperature range of the
camera. Note that the following discussion assumes AGC is disabled (see AGC Modes, page 25). If AGC is
enabled, the differences between the two radiometry modes are completely obscured by the AGC algorithm.
In other words, with AGC enabled, any differences in signal output between radiometry-disabled and
radiometry-enabled modes are negligible.
8.4.1
Radiometry Disabled
With radiometry disabled, the output of a given pixel is intended to be near the middle of the 14-bit range
(~8192) when viewing a scene with a temperature equal to the temperature of the camera. Furthermore, the
responsivity, which is defined as the change in pixel output value for a change in scene temperature, varies
over the camera's operating temperature range. The resulting output for three different scene temperatures is
illustrated hypothetically in Figure 10 (note that the figure is for illustration purposes and not perfectly
representative).
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
22
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
23
Radiometry Enabled
With radiometry enabled, Lepton performs internal adjustments to the signal level such that in principle the
output is independent of the camera's own temperature. The resulting output for three different scene
temperatures is illustrated hypothetically in Figure 11. Notice in Figure 11 that the output is only a function of
scene temperature, not camera temperature (again, the figure is for illustration purposes only and not
perfectly representative. In practice, there is slight output variation as camera temperature changes,
particularly when the temperature change is rapid). Also notice that responsivity is also independent of
camera temperature; that is, the difference in output between two different scene temperatures is a constant,
as opposed to in Figure 10 on page 23, where it decreases with increasing camera temperature.
Figure 11
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
24
AGC Modes
AGC is a process whereby the large dynamic range of the infrared sensor is collapsed to a range more
appropriate for a display system. For Lepton, this is a 14-bit to 8-bit conversion. In its most simplistic form,
AGC can be a linear mapping from 14-bit to 8-bit; however, a simple linear AGC is generally incapable of
providing pleasing imagery in all imaging conditions. For example, when a scene includes both cold and hot
regions (for example, a hot object in front of a cold background as illustrated in Figure 13 on page 26), linear
AGC can produce an output image in which most pixels are mapped to either full black or full white with very
little use of the grayshades (8-bit values) in between. Because of this limitation of linear AGC, a more
sophisticated algorithm is preferred.
Similar to most AGC algorithms that optimize the use of grayshades, Lepton's is histogram-based. Essentially
a histogram counts the number of pixels in each frame that have a given 14-bit value. Figure 12 on page 25
illustrates the concept for a 3x3 pixel area.
Figure 12
Classic histogram equalization uses the cumulative histogram as a mapping function between 14-bit and 8-bit.
The intent is to devote the most grayshades to those portions of the input range occupied by the most pixels.
For example, an image consisting of 60% sky devotes 60% of the available grayshades to the sky, leaving
only 40% for the remainder of the image. By comparison, linear AGC wastes grayshades when there are
gaps in the histogram, whereas classic histogram equalization allocates no grayshades to the gaps. This
behavior is in principle an efficient use of the available grayshades, but there are a few drawbacks:
The resulting contrast between an object and a much colder (or hotter) background can be rendered
poor by the fact the algorithm collapses the separation between such that the object is only 1
grayshade above the background. This phenomenon is illustrated in Figure 13.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
25
Too much emphasis can be placed on background clutter, particularly when a mostly isothermal
background comprises a large fraction of the total image area. This is also illustrated in Figure 13.
The Lepton AGC algorithm is a modified version of classic histogram equalization that mitigates these
shortcomings. One such modification is a parameter called clip limit high. It clips the maximum population of
any single bin, limiting the influence of heavily populated bins on the mapping function. Another parameter
utilized by the Lepton algorithm is called clip limit low. It adds a constant value to every non-zero bin in the
histogram, resulting in additional contrast between portions of the histogram separated by gaps. Figure 13 is
an example showing the benefit of the Lepton clip parameters.
Figure 13
A high value of clip limit high results in a mapping more like classic histogram equalization, whereas a low
value results in mapping more like linear AGC. For clip limit low, the opposite is true: a high value results in a
mapping more like linear AGC, whereas a low value results in a mapping more like classic histogram
equalization. The default values of both parameters produce a good compromise between the two; however,
because optimum AGC is highly subjective and often application dependent, customers are encouraged to
experiment to find settings most appropriate for the target application.
By default, the histogram used to generate Lepton's 14-bit to 8-bit mapping function is collected from the full
array. In some applications, it is desirable to have the AGC algorithm ignore a portion of the scene when
collecting the histogram. For example, in some applications it may be beneficial to optimize the display to a
region of interest (ROI) in the central portion of the image. When the AGC ROI is set to a subset of the full
image, any scene content located outside of the ROI is not included in the histogram and therefore does not
affect the mapping function (note: this does not mean the portion outside of the ROI is not displayed or that
AGC is not applied there, only that those portions outside the AGC ROI do not influence the mapping
function).
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
26
Lepton provides a command and control interface (CCI) via a two-wire interface similar to I2C (the only
difference relative to the true I2C standard is that all Lepton registers are 16 bits wide and consequently, only
16-bit transfers are allowed). The CCI address is 0x2A. The interface is described in detail in a separate
document, the Lepton Software Interface Description Document (IDD), FLIR document #110-0144-03.
Generally speaking, all commands issued through the CCI take the form of a get (reading data), a set
(writing data), or a run (executing a function). Table 5 shows a partial list of parameters / features
controllable through the CCI.
Table 5 Partial List of Parameters Controllable through the CCI
Power-On
Default
Parameter
Telemetry Line
Location
AGC Mode
Disabled
A3-4
AGC ROI
(0,0,79,59)
A34-A37
64
A42
4800
A38
512
A39
Disabled
n/a
Footer
n/a
A74
Fusion
n/a
n/a
n/a
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
27
VoSPI Channel
The Lepton VoSPI protocol allows efficient and verifiable transfer of video over a SPI channel. The protocol is
packet-based with no embedded timing signals and no requirement for flow control. The host (master) initiates
all transactions and controls the clock speed. Data can be pulled from the Lepton (the slave) at a flexible rate.
This flexibility is depicted in Figure 14, which shows the use of a relatively slow clock utilizing most of the
available frame period as well as the use of a fast clock that bursts frame data. Once all data for a given frame
is read, the master has the option to stop the clock and/or deassert the chip select until the next available
frame. Alternatively, the master can simply leave the clock and chip select enabled, in which case Lepton
transmits discard packets until the next valid video data is available.
Figure 14
1/27 sec
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
28
As illustrated in Figure 15, VoSPI utilizes 3 of the 4 lines of a typical SPI channel:
Figure 15
VoSPI I/O
The MOSI (Master Out/Slave In) signal is not currently employed and should be grounded. Implementations
are restricted to a single master and single slave. The Lepton uses SPI Mode 3 (CPOL=1, CPHA=1); SCK is
HIGH when idle. Data is set up by the Lepton on the falling edge of SCK and should be sampled by the host
controller on the rising edge. See Figure 16. Data is transferred most-significant byte first and in big-endian
order. Figure 17 provides an example of the transmission of the value 0x8C08.
Figure 16
Figure 17
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
29
9.2.2
VoSPI Protocol
VoSPI Packet: The Lepton VoSPI protocol is based on a single standardized VoSPI packet, the
minimum transaction between master and slave. Each video packet contains data for a single video
line or telemetry line. In addition to video packets, the VoSPI protocol includes discard packets that are
provided when no video packets are available.
VoSPI Frame: A VoSPI frame is defined as a continuous sequence of VoSPI packets consisting of a
full frame's worth of pixel data.
VoSPI Stream: A VoSPI stream is defined as a continuous sequence of VoSPI frames.
As summarized in Table 6 on page 30, the number of packets per frame varies depending upon telemetry
mode.
Table 6 Packet Length and Number of Video Packets per Frame as a Function of User Settings
Video Format Mode
Raw14
Telemetry Mode
Telemetry Disabled
Telemetry Enabled
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
30
ID
Payload
4 bytes
160 bytes
For video packets, the header includes a 2-byte ID and a 2-byte CRC. The ID field is a 12-bit packet number
as shown in Figure 19 (the leading 4 bits of the ID field are reserved and are not part of the packet number).
Note that packet numbering restarts at zero on each new frame. The CRC portion of the packet header
contains a 16-bit cyclic redundancy check (CRC), computed using the following polynomial:
16
+x
12
+x +x
The CRC is calculated over the entire packet, including the ID and CRC fields. However, the four
most-significant bits of the ID and all sixteen bits of the CRC are set to zero for calculation of the CRC. There
is no requirement for the host to verify the CRC. However, if the host does find a CRC mismatch, it is
recommended to re-synchronize the VoSPI stream to prevent potential misalignment.
Figure 19
Video Packet
ID
CRC
xNNN
(16 bits)
CRC
(16 bits)
Payload
Video pixels for one video line
At the beginning of SPI video transmission until synchronization is achieved (see VoSPI Stream, page 33)
and also in the idle period between frames, Lepton transmits discard packets until it has a new frame from its
imaging pipeline. As shown in Figure 20, the 2-byte ID field for discard packets is always xFxx (where 'x'
signifies a don't care condition). Note that VoSPI-enabled cameras do not have vertical resolution
approaching 3840 lines (0xF00), and therefore it is never possible for the ID field in a discard packet to be
mistaken for a video line.
Figure 20
ID
xFxx
Discard Packet
CRC
Payload
xxxx
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
31
Byte 2
Byte 3
Line m
Line m
Pixel 0
Pixel 1
...
...
Byte 158
Byte 159
Line m
Pixel 79
9.2.2.2VoSPI Frames
A single Lepton frame contains data from all 60 rows of the sensor. However, the total number of video
packets is not necessarily 60; the exact number depends upon user settings, specifically the telemetry mode
(disabled, as header, or as footer). Table 7 shows the number of packets per frame and the contents of each
packet for all of the various combinations.
Table 7 Video Packet Contents Per Frame as a Function of Video Format and Telemetry-mode Settings
Configuration
Telemetry
Mode
As header
As footer
Disabled
Packet 0
Telemetry line A
FPA Row 0
FPA Row 0
Packet 1
Telemetry line B
FPA Row 1
FPA Row 1
Packet 2
Telemetry line C
FPA Row 2
FPA Row 2
Packet 3
FPA Row 0
FPA Row 3
FPA Row 3
Packet 29
FPA Row 26
FPA Row 29
FPA Row 29
Packet 30
FPA Row 27
FPA Row 30
FPA Row 30
Packet 31
FPA Row 28
FPA Row 31
FPA Row 31
Packet 32
FPA Row 29
FPA Row 32
FPA Row 32
Note(s)
1. See Telemetry Modes, page 19 for payload contents of the telemetry lines
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
32
Packet 59
FPA Row 56
FPA Row 59
FPA Row 59
Packet 60
FPA Row 57
Telemetry line A
n/a
Packet 61
FPA Row 58
Telemetry line B
n/a
Packet 63
FPA Row 59
Telemetry line C
n/a
9.2.2.3VoSPI Stream
A VoSPI stream is simply a continuous sequence of VoSPI frames following a synchronization event. Provided
that synchronization is maintained, a VoSPI stream can continue indefinitely. Note that the frame rate of the
stream is nominally just below 27 Hz, allowing easy interface to a display system without the need for
host-side frame buffering. However, the rate of unique frames is just below 9 Hz to comply with US export
restrictions. For each unique frame, two duplicates follow in the VoSPI stream. This pattern is illustrated in
Figure 22, with unique frames shown in blue and duplicates shown in gray. In some applications, it might be
beneficial to identify the first of the three identical frames (the frame with the least latency). The 32-bit frame
counter provided in the telemetry lines (see Telemetry Modes, page 19) can be used for this purpose. It only
increments on new frames, which is also illustrated in Figure 22.
Figure 22
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
33
9.2.2.3.1Establishing/Re-Establishing Sync
The basic process for establishing synchronization is listed below:
Deassert /CS and idle SCK for at least 5 frame periods (>185 msec). This step ensures a timeout of
the VoSPI interface, which puts the Lepton in the proper state to establish (or re-establish)
synchronization.
Assert /CS and enable SCLK. This action causes the Lepton to start transmission of a first packet.
Examine the ID field of the packet, identifying a discard packet. Read out the entire packet.
Continue reading packets. When a new frame is available (should be less than 39 msec after asserting
/CS and reading the first packet), the first video packet will be transmitted. The master and slave are
now synchronized.
9.2.2.3.2Maintaining Sync
There are three main violations that can result in a loss of synchronization:
Intra-packet timeout. Once a packet starts, it must be completely clocked out within 3 line periods.
Provided that VoSPI clock rate is appropriately selected and that /CS is not de-asserted (or SCLK
disrupted) in the midst of the packet transfer, an intra-packet timeout is an unexpected event.
Failing to read out all packets for a given frame before the next frame is available. Two examples of
this violation are shown in Figure 24 and Figure 25 on page 35. Note that the vertical blue line shown
in the illustrations represents an internal frame-sync signal that indicates a new frame is ready for
read-out.
Failing to read out all available frames. This violation is depicted in Figure 26 on page 35. Note that
the requirement to read out all frames applies to both the unique and the duplicate frames.
A CRC error does not result in an automatic loss of synchronization. However, as mentioned previously, it is
recommended to intentionally re-synchronize (de-assert /CS for >185 msec) following a CRC error.
The following figures are examples of violations that result in a loss of synchronization.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
34
Figure 24
Clock Too Slow - Failure to Read an Entire Frame Within the Frame Period
Figure 25
Intra-frame Delay Too Long - Failure to Read Out an Entire Frame Before the Next is Available
Figure 26
9.3
MIPI Interface
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
35
In addition to integrating signal current, the ROIC also digitizes and multiplexes the signal from each detector
into a serial stream. And the Lepton ROIC digitizes data from an on-chip temperature sensor as well as a
thermistor attached to the camera housing. An anti-reflection (AR) coated window is bonded above the sensor
array via a wafer-level packaging (WLP) process, encapsulating the array in a vacuum. The purpose of the
vacuum is to provide high thermal resistance between the microbolometer elements and the ROIC substrate,
allowing for maximum temperature change in response to incident radiation.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
36
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
37
105028-2011
105028-1001
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
38
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
39
The Lepton camera is not a sealed assembly. Consequently, for most applications it is recommended to locate
the assembly behind a sealed protective window. Common materials for LWIR windows include silicon,
germanium, and zinc selenide (LWIR absorption in silicon is on the order of 15%/mm, which means NEDT is
adversely affected using a silicon window. Bulk absorption in germanium and zinc selenide is negligible, and
performance is essentially unchanged provided both surfaces of the window are anti-reflection (AR) coated.)
Note that the window should be sized large enough to avoid encroaching upon the optical keepout zone (see
Optical Considerations, page 41).
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
40
Lens flange
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
41
Description
Value
NETD
<50 mK
Intrascene Range
0 K to >400 K
Operability
Number of non-defective
pixels
>99.0%
Unallowed1
Clusters
(20 mK typical)
The nominal curve of on-axis modulation transfer function (MTF) for the Lepton lens assembly is shown for
reference in Figure 33.
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
42
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
43
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
44
Parameter
Min
Typ
Max
Units
VDDC
1.14
1.20
1.26
Volts
VDD
2.72
2.80
2.88
Volts
VDDIO
2.5
3.1
Volts
I_DDC
76
84
110
mA
I_DD
12
14
161
mA
I_DDIO
mA
Note(s)
1. Maximum at 65 degrees C
Min
Typ
Max
Units
MASTER_CLK, Fclk
TBD
25 MHz
TBD
Master clock
rate
45%
50%
55%
Master clock
duty cycle
MASTER_CLK, tr
--
--
TBD
MASTER_CLK, tf
--
--
TBD
SPI_CLK, Fclk
See note1
45%
50%
20 MHz
55%
SPI-clock duty
cycle
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
45
Min
Typ
Max
Units
SPI_CLK, tr
--
--
TBD
SPI_CLK, tf
--
--
TBD
1 MHz
SCL, Fclk
SCL, Fclk duty
45%
50%
55%
I2C-clock duty
cycle
SCL_CLK, tr
--
--
TBD
SCL_CLK, tf
--
--
TBD
Note(s)
1. As described in VoSPI Protocol, page 30, the minimum VoSPI clock frequency is dependent upon the
requirement to read out all video packets for a given frame within the frame period. The size and number of
video packets vary with user settings.
1.5 V
4.8 V
4.8 V
4.8 V
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
46
Maximum Rating
-10 C to 65 C
(-20 C to 75 C with some possible performance degradation)
80 C1
Storage Temperature
-40 C to 80 C
Altitude (pressure)
12 km altitude equivalent
Relative Humidity
95%
Thermal Shock
Mechanical Shock
Vibration
ESD
Note(s)
1. Lepton contains an automatic shutdown feature when its internal temperature exceeds the maximum safe
operating value. See Power States, page 13.
Directive 2002/95/EC, Restriction of the use of certain Hazardous Substances in electrical and
electronic equipment (RoHS)
Directive 2002/96/ EC, Waste Electrical and Electronic Equipment (WEEE).
Regulation (EC) 1907/2006, Registration, Evaluation, Authorization and Restriction of Chemicals
(REACH)
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
47
Description
AGC
AR
Anti-reflection
CCI
CRC
DSP
EMC
Electromagnetic Compatibility
FFC
FOV
Field of View
FPA
FPN
GPIO
General Purpose IO
HFOV
I2C
Inter-Integrated Circuit
IDD
LWIR
MIPI
MISO
MOSI
Master Out/Slave In
NEDT
NUC
Non-Uniformity Correction
OTP
One-Time Programmable
PLL
Phase-Lock Loop
REACH
RoHS
48
SBNUC
SNR
SoC
System on a Chip
SPI
SVP
TCR
TWI
Two-wire Interface
VoSPI
VOx
Vanadium-oxide
WEEE
WLP
Wafer-level Packaging
Information on this page is subject to change without notice. Shipping: CIP per INCOTERMS 2010.
FLIR Proprietary-Confidential, and approved for distribution to authorized FLIR dealers only.
49
50