Shutter Less
Shutter Less
, 5, 9–16, 2016
www.j-sens-sens-syst.net/5/9/2016/
doi:10.5194/jsss-5-9-2016
© Author(s) 2016. CC Attribution 3.0 License.
Abstract. Infrared (IR) cameras based on microbolometer focal plane arrays (FPAs) are the most widely used
cameras in thermography. New fields of applications like handheld devices and small distributed sensors benefit
from the latest sensor improvements in terms of cost and size reduction. In order to compensate for disturbing
influences derived from changing ambient conditions, radiometric cameras use an optical shutter for online re-
calibration purposes, partially also together with sensor temperature stabilization. For these new applications, IR
cameras should consist only of infrared optics, a sensor array, and digital signal processing (DSP). For accept-
able measurement uncertainty values without using an optical shutter (shutter-less), the disturbing influences of
changing thermal conditions have to be treated based on temperature measurements of the camera interior. We
propose a compensation approach based on calibration measurements under controlled ambient conditions. All
correction parameters are determined during the calibration process. Without sensor temperature stabilization
(TEC-less), the pixel responsivity is also affected by the camera temperature changes and has to be considered
separately. This paper presents the details of the compensation procedure and discusses relevant aspects to gain
low temperature measurement uncertainty. The residual measurement uncertainty values are compared to the
shutter-based compensation approach.
Published by Copernicus Publications on behalf of the AMA Association for Sensor Technology.
10 A. Tempelhahn et al.: Shutter-less calibration of uncooled infrared cameras
the vacuum packaging technology from common chip level bration procedure for determining correction parameters that
packages (CLPs) via wafer level packaging (WLP) to pixel allow one to compensate for the disturbing influences of
level packaging (PLP). This integration of vacuum packag- a changing ambient temperature. Relevant aspects to gain
ing technology into the semiconductor processing will dra- low temperature measurement uncertainty are discussed and
matically reduce the sensor cost and, therefore, will make compared to the shutter-based compensation approach.
microbolometer FPAs more attractive for lowest-cost appli-
cations like handheld devices and small distributed IR sen-
sors (Hoelter et al., 2015; Takasawa, 2015). 2 Radiation model
IR cameras are used for radiometric measurement of tem-
perature distributions. Here, two concerns mainly have to be In the following, the setup of an IR camera as shown in Fig. 2
taken into account: the sensor non-uniformity due to fabrica- is considered. The microbolometer FPA consists of pixels lo-
tion variations and the influences derived from changing am- cated in line i and column j . The exchanged (incident minus
bient conditions, especially the ambient temperature. In the emitted) radiant flux 8ij of each pixel (ij ) is converted into
past such cameras used an integrated thermoelectric cooler the raw signal voltage Vraw,ij corresponding to the linear re-
(TEC) for keeping the temperature of the FPA constant and lation between radiation and signal voltage,
preventing the sensor parameters’ offset voltage and respon-
sivity to change according to the ambient temperature. But Vraw,ij = RV ,ij 8ij + V0,ij , (1)
the high power consumption of this stabilization is a big
drawback and is the decisive reason for using TEC-less mi- with the two sensor parameters responsivity RV ,ij and offset
crobolometer FPAs, e.g., for mobile IR devices or distributed voltage V0,ij . Both of them vary over the sensor array due
sensor networks. to process variations during the sensor fabrication. Further-
The correction approaches for infrared imagers and radio- more, both also depend on the sensor temperature ϑfpa .
metric cameras differ in the required calibration effort (Tem- Previous investigations have shown that the pixel’s field of
pelhahn et al., 2015). Radiometrically calibrated infrared view covers nearly the entire half space. Therefore, the corre-
cameras typically use optical shutters for runtime recalibra- sponding pixel’s projected solid angle ωpix amounts almost to
tion purposes in order to regularly correct thermal drift in- π (Tempelhahn et al., 2013). Infrared cameras usually com-
fluences on the measurement. The calibration procedure for prise infrared optics with an f -number about unity. For that
the shutter-based compensation approach is presented in de- reason, the projected solid angle ωobj related to the object
tail in Budzier and Gerlach (2015). But the shutter is often irradiance Eobj is about 1/5 of ωpix (Budzier, 2014). The re-
the size-limiting component of an infrared camera because maining projected solid angle ωcam equals 4/5 of ωpix and is
it has to cover the entire aperture. Another drawback of the covered by the camera interior. Hence, each pixel also detects
shutter-based compensation approach is the interruption of the irradiance Ecam emitted by the camera housing and de-
the measurement during recalibration. Therefore, shutter-less pending on the camera temperature ϑcam . Furthermore, each
infrared cameras are advantageous, especially for the new pixel emits the radiant exitance Mpix into the environment
fields of application mentioned above. This paper presents due to the sensor temperature ϑfpa . The exchanged radiant
a novel shutter-less compensation approach based on a cali- flux 8ij from Eq. (1) can be written as a product of the pixel
area Apix and a linear combination of these three radiant den-
ferred inside the camera housing due to heat conduction and Table 1. Properties of the used infrared camera.
convection, and change the camera’s and sensor’s tempera-
ture with specific delay times and time constants. Manufacturer ULIS, France
The sensor temperature dependency of the pixel respon- Sensor type UL03162-028
sivity RV ,ij is determined using two switchable blackbodies TEC w/o
at different constant temperatures. This ensures a constant Shutter w/o
incident radiant flux difference 18. Changes in RV ,ij are NETD < 100 mK (F/1, 300 K, 50 Hz)
Resolution 384 × 288
measured using the signal voltage difference 1V in relation
Pixel pitch 25 µm
to the sensor temperature ϑfpa via the relation Uniformity (deviation) < 1.5 %
Power consumption < 100 mW
1V f -number 1.0
RV = . (7)
18 Focal length 18 mm
Figure 6. NUC coefficient matrices aij (a) and bij (b). The central symmetric shape of aij is due to the relation to the pixel-dependent
projected solid angle ωfov,ij .
Figure 7. Temperature courses during the offset calibration regime: (a) temperature sensor signals; (b) mean signal voltage versus the four
temperature inputs. The shape of the steady-state curves corresponds to a polynomial of the second or third order. The deviations from these
steady-state functions are due to the transient behavior during the temperature change.
NUC can be improved by using more than two raw infrared 5.4 Offset correction
images and applying the least-squares method to determine
The offset correction is based on a multivariate linear regres-
the NUC coefficients.
sion model comprising
– polynomials of the second order for each temperature
5.3 Gain correction
probe inside the camera (Eq. 9), and
Here the relation between responsivity and sensor tempera-
– one polynomial of the third order for the relation be-
ture pertaining to Eq. (11) is determined for each pixel and
tween offset voltage and sensor temperature (Eq. 12).
will be taken as the weighting function gV ,ij in Eq. (8). Ac-
cording to Eq. (7), different infrared images of two blackbod- Since all temperature inputs are correlated with each other
ies with constant temperatures of 20 and 80 ◦ C were used. due to heat propagation and equalization processes, addi-
Since the responsivity depends only on the absolute sensor tional information on the temperature distribution is needed.
temperature ϑfpa and corresponds to a second-order polyno- It can be extracted from the cross-correlation of two or more
mial, it is sufficient to use at least three pairs of infrared im- temperature inputs.
ages taken at different ambient temperatures. Both blackbod- The offset correction function oV ,ij in Eq. (10) comprises
ies used (Table 2) cover the entire camera field of view. for instance 17 coefficients if all temperature inputs and all
Table 3. Residual uncertainty after offset correction using different numbers and kinds of temperature inputs.
oV ,ij = (14)
3
X X 2
3 X 3
X
k m
c+ dk ϑfpa + el,m ϑTP1
+ fn ϑfpa · ϑTPn
k=1 l=1 m=1 n=1
+ g1 ϑTP1 · ϑTP2 + g2 ϑTP1 · ϑTP3 + g3 ϑTP2 · ϑTP3
+ g4 ϑTP1 · ϑTP2 · ϑTP3 .
sensor array. It should be noted that the more correction in- e( ϑobj,ij +273.15 ) −f
puts are used, the lower measurement uncertainty values can
be achieved. Figure 8 depicts the mean signal voltage and the
spatial standard deviation versus time of the calibration using especially for interpolation outside the supporting points
the offset correction function given by Eq. (14). (Budzier and Gerlach, 2015). The inverted function defines
the calculation rule to convert signal voltages into tempera-
ture values:
5.5 Radiometric calibration
The relation of the signal voltage Voffset,ij after ambient b
temperature compensation and the observed object temper- ϑobj,ij = + 273.15. (16)
r
ature ϑobj can be estimated using a second-order polynomial. ln Voffset,ij −o +f
Figure 9. Comparison of the correction of (a) the shutter-less and (b) shutter-based IR cameras for ambient temperature jumps from 25 to
45 ◦ C and back. The non-continuous shape of the shutter-based correction is due to the shutter procedure and the thermal drift occurring
afterwards. The residual measurement uncertainty of the shutter-less approach is significantly lower due to the continuous online correction.