Color Appearance Models: CIECAM02 and Beyond: IS&T/SID 12 Color Imaging Conference
Color Appearance Models: CIECAM02 and Beyond: IS&T/SID 12 Color Imaging Conference
Outline
Simultaneous Contrast
The background in which a stimulus is
presented influences the apparent color of the
stimulus.
Stimulus
Lighter Darker
Red Green
Green Red
Yellow Blue
Blue Yellow
Simultaneous Contrast
Example
(a)
(b)
Josef Albers
Complex Spatial
Interactions
Hunt Effect
Corresponding chromaticities across indicated
relative changes in luminance (Hypothetical Data)
For a constant chromaticity, perceived
0.6
colorfulness increases with luminance.
1
Perceived lightness contrast increases with
increasing adapting luminance.
L (97 dB)
0.1
0.1 1
Y/Yn
20 Lightness (Dim)
Dark Adaptation:
Increase in visual sensitivity with decreases in luminance.
(Automatic Exposure Control)
Chromatic Adaptation:
Independent sensitivity regulation of the mechanisms of color vision.
(Automatic Color Balance)
Local Adaptation
Chromatic Adaptation
1.25
0
400 450 500 550 600 650 700
Wavelength (nm)
Color Constancy
(Discounting)
0.54
Adapting Chromaticities
Achromatic Chromaticities
Incandescent We perceive the colors of objects to remain
0.52
<-- Hands
unchanged across large changes in
<-- No Hands illumination color.
•Not True
v' 0.50 •Chromatic Adaptation
•Poor Color Memory
•Cognitive Discounting-the-Illuminant
0.48
Daylight
<-- Hands
<-- No Hands
0.46
0.18 0.20 0.22 0.24 0.26
u'
Diamonds
With Tips
On Backgrounds
Chromatic Adaptation
Modeling
Chromatic Adaptation:
Largely independent sensitivity regulation of the (three) mechanisms of color vision.
1.25
0.75
0.5
0.25
0
400 450 500 550 600 650 700
Wavelength (nm)
Chromatic Adaptation
Models
Model: X1Y1Z1
L a = f(L, Lwhite ,...) 3x3
M a = f(M, M white ,...) L1M1S1
S a = f(S, S white ,...)
VC1
LaMaSa
Transform (CAT): VC2
XYZ 2 = f(XYZ1 , XYZwhite ,...)
L2M2S2
3x3
X2Y2Z2
A Image Transformed to
Corresponding D65 Appearance
Analysis of Chromatic
Adaptation Models
ADVANTAGES: DISADVANTAGES:
•Corresponding Colors •No Appearance Attributes
userdict
/mypsb
currentpoint
/newXScale
/newYScale
/psb
/pse /mypse
/mypsb •Thus,
{} store
/md
/psb newWidth
newHeight
/pse
pop
/newHeight
/picOriginY
load {}
store
def
storeColor
Cricket
known{/CricketAdjust
load/newWidth
store
/mypse
614
340
exch
div
div Reproductions
Software!
exch
def
picOriginY
/pse
def
def/picOriginX
picOriginX
load
true def
def}{/CricketAdjust
sub sub
def
exch
pop
defdef (e.g., Lightness, Chroma, Hue)
false def}ifelse
Relative sensitivity
•Chromatic Adaptation w/Model
•Selective Retinal Conditioning/Thresholds
0.5
•Retinal Pigment Absorption Measurements
•Genetics
0.25
XYZ-to-LMS
2
z
1
S M L 1.5
0.75
Relative sensitivity
Tristimulus values
0
380 480 580 680 780
Wavelength, nm 0
380 480 580 680 780
Wavelength, nm
Johannes von Kries
Johannes von Kries
"Father of Chromatic-Adaptation Models"
La = kLL
M a = k MM
Sa = k S S
kS = 1 or 1
S max S white
Insignificant Differences
CAT02 in CIECAM02
Simple von Kies (100 years later!) non-LMS Matrix
Linear CATs
Simple von Kries Model
“Optimized” XYZ-to-RGB Transform
X2 Rw 2 0 0 1/Rw1 0 0 X1
"1
Y2 = MCAT 0 Gw 2 0 0 1/Gw1 0 MCAT Y1
Z2 0 0 Bw 2 0 0 1/Bw1 Z1
!
MCAT Defines the Transform
Picking a CAT
Various Techniques used to Derive M CAT
Basis of CIECAM02
!
What About Appearance?
Chromatic-adaptation models provide nominal scales for color appearance.
equal intervals
Perceptual
equal intervals
? ?
no intervals no zero no zero zero
no zero
Stimulus, Background,
Surround, etc.
Stimulus, Background,
Surround, etc.
Calculate Correlates of
Perceptual Attributes
Structure of CAMs
1.25
0
400 450 500 550 600 650 700
Wavelength (nm)
CIELAB Does:
•Model Chromatic Adaptation
•Model Response Compression
•Include Correlates for Lightness, Chroma, Hue
•Include Useful Color Difference Measure
CIELAB Doesn't:
•Predict Luminance Dependent Effects
•Predict Background or Surround Effects
•Have an Accurate Adaptation Transform
CIELAB as a CAM
L* = 100 (white)
yellowish
b*
X-Y
Y-Z Lightness L
Yellowness +b
Uniform Spacing
Constants 116, 500, 200 Greenness –a Redness +a
Cube Root
Blueness –b
CIELAB Equations
L* = 116f(Y / Y n ) ! 16
a* = 500[ f(X / X n ) ! f(Y / Y n )]
b* = 200[ f(Y / Y n ) ! f(Z / Z n )]
CIELAB Lightness
L* = 116f(Y / Y n ) ! 16
10
9
8
7
6
Munsell
Value
5
4
3
2
1
0
0 1 2 3 4 5 6 7 8 9 10
L*/10
CIELAB Chroma
1/ 2
C* = (a * 2 +b *2 )
Increasing Chroma,
C*
Saturation in CIELAB
Due to the lack of a related chromaticity diagram,
saturation is not officially defined in CIELAB.
Constant
Lightness
Saturation = C*/L*
C*
CIELAB Hue
90°
+b*
h°
ab
" b *$ +a*
h ab = tan !1 180° 0°
# a *% -a*
-b*
Note: The number of discriminable hue steps is not equal between each of the unique hues.
CIELAB Performance
100
Value 3
50
b* 0
-50 100
Value 5
-100 50
-150 -100 -50 0 50 100 150
a*
b* 0
-50
125
Value 7
-100
-150 -100 -50 0 50 100 150
75
a*
b* 25
-25
-75
-150 -100 -50 0 50 100 150
a*
Why Not Just CIELAB?
Positive Aspects:
•Accounts for Chromatic Adaptation
•Works Well for Near-Daylight Illuminants
(also Medium Gray Background & Surround and Moderate Luminance Levels)
•
Negative Aspects:
•Does Not Account for Changes in:
Background
Surround
Luminance
Cognition
•Cannot Predict Brightness & Colorfulness
•"Wrong" von Kries Transform Works Poorly for Large Changes From Daylight
•Constant-Hue Predictions could be Improved
(especially Blue)
Beyond CIELAB
• More Accurate Adaptation Transform
• Luminance Dependencies
• Surround Dependencies
• Hue Linearity
CIELAB Equations
CIECAM02
Need for CIECAM02
• Industrial Demand
History
• Task Assigned to TC1-34 (1996)
CIECAM02
• Revision of CIECAM97s
Stimulus
• Required Measurements
Relative XYZ (CIE 2°)
Background
• Required Measurements
Relative Y (called Yb)
Surround
• Required Measurements
Often Categorical
Average (>20%)
Dim (0-20%)
Dark (0%)
• Required Measurements
Absolute XYZ (CIE 2°, cd/m2)
or
Relative XYZ and LA (cd/m2)
Viewing Condition c Nc F
Average Surround 0.69 1.0 1.0
Dim Surround 0.59 0.9 0.9
Dark Surround 0.525 0.8 0.8
Discounting
• Required Measurements
) # 1 & #% "La"42&( ,
Yes: D=1.0 D = F+1" % (e 92 .
$ '
Chromatic Adaptation
Chromatic Adaptation
Transform: CAT02
Transform to RGB
Responses
" R% "X %
$ ' $ '
G
$ ' = M CAT 02 $Y '
$#B'& $# Z '&
" 0.7328 0.4296 (0.1624% " 1.0961 (0.2789 0.1827%
$ ' (1 $ '
MCAT 02 = $(0.7036 1.6975 0.0061 ' MB = $ 0.4544 0.4735 0.0721'
#$ 0.0030 0.0136 0.9834 '& $#(0.0096 (0.0057 1.0153'&
!
!
Relative Response
0.75 0.600
0.5
0.400
0.25
0
0.200
-0.25
400 450 500 550 600 650 700
Wavelength (nm)
0.000
360 410 460 510 560 610 660 710 760
-0.200
Wavelength (nm)
Adaptation Transform
! [
Bc = YW ( D /Bw ) + (1" D) B ]
!
!
Changes from CIECAM97s:
YW Added (for cases it is not 100)
Nonlinearity on B Removed
Color Space
• Hyperbolic Nonlinearity
• Appearance Correlates
Intermediate Parameters
Some numbers for further computations...
z = 1.48 + n1/ 2
Changes from CIECAM97s:
Slight Change in z Equation
"
Adapted Cone Responses
"R'% " Rc %
$ ' (1 $ '
$G'' = M H MCAT 02 $Gc '
$#B''& $# Bc '&
" 0.38971 0.68898 (0.07868 % "1.9102 (1. 1121 0.2019%
$ ' (1 $ '
M H = $ (0.22981 1.18340 0. 04641 ' MH = $0.3710 0.6291 0.00 '
$# 0.00 0.00 1.00 '& $# 0.00 0.00 1.00 '&
!
0.42
400( FL R' /100)
R' a = + 0.1
[(F R' /100)
L
0.42
+ 27.13 ]
0.42
400( FL G' /100)
G'a = + 0.1
[(F G' /100)
L
0.42
+ 27.13 ]
! 0.42
400( FL B' /100)
B'a = + 0.1
[(F B' /100)
L
0.42
+ 27.13 ]
!
Opponent Responses
Hue
!1 1) # " & ,
h = tan (b / a) e = +cos% h + 2( + 3.8.
4 * $ 180 ' -
cz
J =100 (A/A w )
Brightness
0.5
Q = ( 4 /c )( J /100) ( Aw + 4 )FL0.25
1/ 2
(50000 /13)N c N cb e( a 2 + b 2 )
t=
R'a +G'a +(21/20)B' a
0.5 n 0.73
! C = t 0.9 ( J /100) (1.64 " 0.29 )
Colorfulness
M = CFL0.25
s = 100 M Q
!
Changes from CIECAM97s:
Simple, Logical Definition
Data Now Available
Chroma/Saturation
Lightness
Lightness
Chroma Saturation
Definitions in “Equations”
Saturation = (Colorfulness)/(Brightness)
Saturation
= (Chroma)/(Lightness)
= [(Colorfulness)/(Brightness of White)][(Brightness of White)/(Brightness)]
=(Colorfulness)/(Brightness)
Reproduction at Higher
Luminance
Lightness/Chroma
Brightness/Colorfulness
Lightness/Chroma
Brightness/Colorfulness
bC = Csin(h)
aC = Ccos(h)
Profile
Original Connection Reproduction
Space
CAM CAM
Inversion
• CIECAM02 is Invertible
Linear CAT Fixes It!
Pointwise iCAM
Spatial iCAM
iCAM Performance
Examples
Chromatic Adaptation Transform
(CAT)
Color Appearance Scales
Constant Hue Lines
Simultaneous Contrast
Chroma Crispening
Hue Spreading
HDR Tone Mapping
Image Difference (Quality)
Basic Appearance Attributes
iCAM Simultaneous
Contrast
http://www.hpl.hp.com/personal/Nathan_Moroney/
iCAM Spreading
Earlier-Model Results
<www.debevec.org>
Spatial Filtering, Local Attention, Local & Global Contrast, CIE Color Difference
iCAM Image Difference
(Image Quality)
1.2
Model Prediction
0.8
!Im 0.6
0.4
0.2
0
-5 -4 -3 -2 -1 0 1 2
Perceived Difference
12
10
Model Prediction
!Im
6
0
-4.00 -3.00 -2.00 -1.00 0.00 1.00 2.00
Perceived Contrast
Open-Source Science
<www.cis.rit.edu/mcsl/iCAM>
Image
Rendering
Examples
<www.debevec.org>
Conclusions
Ingredients
Color Appearance Model
Spatial Adaptation & Filtering Models
Temporal Adaptation & Filtering Models
Image Difference Metrics
Results
Still & Video Rendering Algorithms
Still & Video Quality Metrics
Free Code
<www.cis.rit.edu/mcsl/iCAM/>
Mathematica, Matlab, IDL, C++, etc.
Updates.
Summary
<www.cis.rit.edu/fairchild/CAM.html>
ROCHESTER INSTITUTE OF TECHNOLOGY
Munsell Color Science Laboratory
READING LIST:
Course Text
M.D. Fairchild, Color Appearance Models, Addison-Wesley, Reading, MA (1998).
1
Viewing Conditions
OSA, Psychological concepts: Perceptual and affective aspects of color, Chapter 5
in The Science of Color, Optical Society of America, Washington, 145-171 (1963).
Chromatic Adaptation
J. von Kries, Chromatic adaptation, Festschrift der Albrecht-Ludwig-Universität,
(Fribourg) (1902) (Translation: D.L. MacAdam, Sources of Color Science, MIT
Press, Cambridge, (1970)).
H. Helson, D.B. Judd, and M.H. Warren, Object color changes from daylight to
incandescent filament illumination, Illum. Eng. 47, 221-233 (1952)
W.D. Wright, Why and how chromatic adaptation has been studied, Color Res.
Appl. 6, 147-152 (1981).
M.D. Fairchild, Chromatic adaptation to image displays, TAGA 2, 803-824 (1992).
J. Neitz, J. Carroll, Y. Yamauchi, M. Neitz, and D.R. Williams, Color perception is
mediated by a plastic neural mechanism that is adjustable in adults, Neuron
35, 1-20 (2002).
2
Testing Color Appearance Models
M.R. Luo, A.A. Clarke, P.A. Rhodes, A. Schappo, S.A.R. Scrivner, and C.J. Tait,
Quantifying colour appearance. Part I. LUTCHI colour appearance data, Color
Res. Appl. 16, 166-180 (1991).
R.W.G. Hunt and M.R. Luo, Evaluation of a model of colour vision by magnitude
scalings: Discussion of collected results, Color Res. Appl. 19, 27-33 (1994).
L. Mori, H. Sobagaki, H. Komatsubara and K. Ikeda, Field trials on CIE chromatic
adaptation formula, Proceedings of the CIE 22nd Session, 55-58 (1991).
P.J. Alessi, CIE guidelines for coordinated research on evaluation of colour
appearance models for reflection print and self-luminous display
comparisons, Color Res. Appl. 19, 48-58 (1994).
K.M. Braun and M.D. Fairchild, Testing five color appearance models for
changes in viewing conditions, Color Res. and Appl. 22, 165-174 (1997).
C.J Li, M.R. Luo, R.W.G. Hunt, N. Moroney, M.D. Fairchild, and T. Newman, The
performance of CIECAM02, IS&T/SID CIC 10, Scottsdale, 28-32 (2002).
Spatial Models
E.M. Granger, Uniform color space as a function of spatial frequency, SPIE 1913,
449-461 (1993).
X. Zhang and B.A. Wandell, A spatial extension of CIELAB for digital color
image reproduction, SID Digest. 19, 27-33 (1996).
X. Zhang and B.A. Wandell, Color image fidelity metrics evaluated using image
distortion maps, Signal Processing 70, 201-214 (1998).
G.M. Johnson and M.D. Fairchild, A top down description of S-CIELAB and
CIEDE2000, Color Res. and Appl. 28, in press (2003).
M.D. Fairchild, and G.M. Johnson, Meet iCAM: A next-generation color
appearance model, IS&T/SID CIC 10, Scottsdale, 33-38 (2002).