Digital Image Processing
Digital Image Processing
Henry Ford
Health System
Display processing is used to transform digital
RADIOLOGY RESEARCH radiography data to display values for
presentation using a workstation or film printer.
Digital Image Processing DETECTION DISPLAY
in
Radiography
Michael Flynn
(A) Subject contrast
Dept. of Radiology
(B) is recorded by the detector
[email protected]
(C) and transformed to display values
(D) that are sent to a display device
(E) for presentation to the human visual system. 1
M. Flynn 2007
- Introduction (4)
1. Preprocessing (12) 1. Understand how recorded signals are conditioned
to produce image data for processing.
2. Generic Image Processing (2)
A. Grayscale rendition (10)
2. Understand the approaches used to improve the
B. Exposure recognition (7)
visibility of structures in radiological images.
C. Edge restoration (10)
D. Noise reduction (10)
3. Survey current commercial implementations and
E. Contrast enhancement (14)
distinguish essential similarities / differences.
3. Commercial Implementations (23)
preamp
RAW data from the detector is pre-processed • Pixels with high or low values or with excessive noise
to produce an image suitable for processing.
• Values corrected by interpolation from neighbors
DR FOR • There are presently no requirements to report bad
RAW PROCESSING
pixel statistics as a part of DR system purchase.
LINEAR LOG
• The linear gain may slightly differ from pixel to pixel. • Dark Image (ID)
• These variations produce fixed pattern noise. Obtained by averaging many images obtained
with no xray input to the detector.
• Gain Image (IG)
Obtained by averaging many images obtained
with a uniform x-ray fluence.
• Uniformity correction is performed subtracting the
dark offset and adjusting for gain differences.
ICOR = (IRAW – ID) {k/ (IG – ID)}
• Log transformation using a Log look-up table allows
this to be performed with a subtraction.
IFP = log (IRAW – ID) - log(IG – ID) - K
Uniform radiation exposure
M. Flynn 2007 12 M. Flynn 2007 13
I2FP α P2(x,y) + ∆P 14
0.1 mR 1.0 10.0
15
M. Flynn 2007 M. Flynn 2007
1 - IFP proportional to mR1/2 1 - Normalized IFP values, TG116
I_nfp
ESTD in micro-Gray units,
used by Agfa products. RAW
3000
400
Data exported using
RAW**2/1k
Eo = 0.001 micro-Gray, 2000
1. Preprocessing
2. Generic Image Processing
3. Commercial Implementations
Grayscale LUTs
3000
Grayscale Rendition: Convert signal values to display values
Exposure Recognition: Adjust for high/low average exposure. ‘For Processing’ data 2000
5 - HC-CR
Noise Reduction: Reduce noise and maintain sharpness a grayscale Look Up Table 0
0 500 1000 1500 2000 2500 3000 3500 4000
Contrast Enhancement: Increase contrast for local detail
Spatial Processes
Exposure •Edge Restoration Grayscale
Recognition •Noise Reduction (VOI-LUT)
•Contrast Enhance
When communicating images to a PACS Presently, many systems send images to a PACS
systems, it can be beneficial to send the system as scaled P values with the VOI LUT already
VOI-LUT sequence for application at display. applied to the processed data.
PACS
120
4500
should be 3500
histogram
VOI LUT
can not adjust the histogram
VOI-LUT to
Rel Probability
80
capable of 3000
demonstrate
P value
translating or
2500 60
stretching the
2000
contrast in over or
under penetrated
40
1500
VOI LUT to
make contrast
1000
regions. 20
500
and brightness 0 0
changes 0 500 1000 1500 2000 2500 3000 3500 4000 0 500 1000 1500 2000 2500 3000 3500 4000
Image value with applied VOI-LUT
Image value with VOI-LUT sequence
The applied VOI-LUT produces good contrast for the The applied VOI-LUT produces good contrast for the
primary tissues of interest. For the full range of P values, primary tissues of interest. For the full range of P values,
contrast is limited in the toe and shoulder regions. contrast is limited in the toe and shoulder regions.
3000 3000
2000 2000
1000 1000
Shifting the Window Level (WL) to inspect highly The ability to shifting the VOI-LUT at the display
penetrated regions renders gray levels with a poorly workstation permits regions of secondary interest to be
shaped portion of the VOI LUT. viewed with good radidographic contrast.
3000 3000
2000 2000
1000 1000
Signal Range:
Grayscale Rendition: Convert signal values to display values A signal range of up to 104 can be recorded by digital
radiography systems. Unusually high or low exposures
Exposure Recognition: Adjust for high/low average exposure.
can thus be recorded. However, display of the full range
Edge Restoration: Sharpen edges while limiting noise. of data presents the information with very poor
Noise Reduction: Reduce noise and maintain sharpness contrast. It is necessary to determine the values of
interest for the acquired signal data.
Contrast Enhancement: Increase contrast for local detail
100
log(S) probability
Spatial Processes
Exposure •Edge Restoration Grayscale
Recognition •Noise Reduction (VOI-LUT)
•Contrast Enhance
0
2000 log(S) value 4000
M. Flynn 2007 30 M. Flynn 2007 31
2B – Exposure recognition: regions 2B – Exposure recognition: VOI LUT
All digital radiographic systems have an exposure recognition • The values of interest obtained from exposure recognition
process to determine the range and the average exposure to the processes are used to set the level and width of the VOI LUT.
detector in anatomic regions. A combination of edge detection, • Areas outside of the collimated field may be masked to prevent
noise pattern analysis, and histogram analysis may be used to bright light from adversely effecting visual adaptation.
identify Values of Interest (VOI).
D 100
100 A A
log(S) probability
log(S) probability
C
C B
C B
B
D
0
2000 log(S) value 4000
0
2000 log(S) value 4000
M. Flynn 2007 32 M. Flynn 2007 33
Tissue region
• DR systems report a metric indicating the detector
Advanced image segmentation response to the incident radiation exposure.
algorithms are used is some • The methods used to deduce this metric are all different
systems to identify the region •The regions from which exposure is measured vary.
where tissue attenuation has •Reported exposures may increase proportional to the log of
occurred. This provides exposure or may vary inversely with exposure.
information on the values of •The scale of units varies widely with factor of 2 changes in
interest for presentation. exposure associated with changes varying from 0.15 to 300.
1.5
• Radiographs with high contrast
details input high spatial
Signal Power equalization but no edge 1.0
by the MTF.
MTF
• Enhancing these frequencies can
help restore image detail.
• However, at sufficiently high
frequencies there is little signal Frequency
left and the quantum mottle
(noise) is amplified. Noise Power
Without Edge
With Edge Restoration
Restoration
filter strength
1.5
Edge restoration applied using a
filter equal to 1/MTF with slight 1.0
2C – MTF – CR, DR, and XTL 2C – Edge Restoration – DR and CR Phalanx of hand phantom
Exposure of 100 speed film.
1.0
dXTL
.8 CR
DR-Se
1/MTF
2xG 1/MTF (.8B)
(.8B)
unprocessed
.6
MTF
DR-CsI
.4
CRGP
.2 DR
0 unprocessed
2xG1/sinc
1/sinc
0 1 2 3 4 5 6 7
cycles/mm
M. Flynn 2007 42 M. Flynn 2007 43
2C – Edge Restoration – dDR and iDR Clinical Wrist 2C – Chest Edge Restoration
Identical Manual Exposure 2.0
dDR iDR
filter strength
1.5
1.0
0.5
relativespatialfrequency
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Chest Processing
• Edge restoration: lung tissue typically produces low frequency signals and
the chest radiograph has high quantum noise. Thus, very modest edge
restoration should be used.
• Quantum mottle in the abdomen: Low exposure and thick tissue result in
significant quantum mottle below the diaphragm. Inverse MTF filters need
to be damped at high frequency to prevent excessive noise (Metz filter).
High DQE iDR systems can restore edges
M. Flynn 2007
without producing excessive noise. 44 M. Flynn 2007 45
1.5
Edge Restoration: Sharpen edges while limiting noise.
1.0
Noise Reduction: Reduce noise and maintain sharpness
Contrast Enhancement: Increase contrast for local detail
0.5
1200 1200
1000 1000
Signal
Signal
800 800
600 600
400 400
200 200
0 0
100 150 200 250 300 350 400 100 150 200 250 300 350 400
Position Position
M. Flynn 2007 48 M. Flynn 2007 49
1200 1200
1000 1000
Signal
Signal
800 800
600 600
400 400
200 200
0 0
100 150 200 250 300 350 400 100 150 200 250 300 350 400
Position Position
M. Flynn 2007 50 M. Flynn 2007 51
2D – mcp joint noise 2D – mcp joint noise Vertical profiles of the mcp joint in an AP radiograph
show the effects of noise reduction.
image value
Noise reduction OFF Noise reduction ON
150
100
Agfa
CR
50
0 100 row number 200
2D – ‘coring’ Simoncelli EP, Adelson EH, “Noise removal via 2D – ‘coring’, non-linear subband transform
Bayesian wavelet coring,” Proc. 3rd IEEE Int.
Conf. Image Proc., vol. I, pp. 379–382, 1996
• Conceptual method (Simoncelli):
“A common technique for noise reduction is known as
a) Original image
(cropped). ‘coring’. An image signal is split into two or more
b) Image contaminated bands; the highpass bands are subjected to a
with additive threshold non-linearity that suppresses low-amplitude
Gaussian white noise values while retaining high-amplitude values.”
(SNR = 9.00dB).
a b • Statistical significance (Simoncelli):
c) Image restored
using (semi-blind) • “Removal of noise from images relies on differences in the
Wiener filter statistical properties of noise and signal.
(SNR = 11.88dB). • The classic Wiener solution utilizes differences in power
d) Image restored spectral density, a second-order property.
using (semi-blind) • The Bayesian estimator described .. provides a natural
Bayesian estimator
extension for incorporating the higher-order statistical
(SNR = 13.82dB).
c d regularity present in the point statistics of sub-band
representations.”
M. Flynn 2007 Figure 4. Noise reduction example. 54 M. Flynn 2007 55
2D – adaptive non-linear coring 2E – Constrast Enhancement
Couwenhoven, 2005,
SPIE MI vol 5749, pg318 Grayscale Rendition: Convert signal values to display values
• High frequency sub-band Exposure Recognition: Adjust for high/low average exposure.
• Coring function Edge Restoration: Sharpen edges while limiting noise.
P = P/(1+s/P2) Noise Reduction: Reduce noise and maintain sharpness
• Adaptation Contrast Enhancement: Increase contrast for local detail
• Signal amplitude
• Signal to noise
Spatial Processes
Exposure •Edge Restoration Grayscale
Recognition •Noise Reduction (VOI-LUT)
•Contrast Enhance
Detail contrast
enhancement is
The contrast enhanced
image has improved
obtained by adding 1.0
lung contrast and good the scaled
presentation of subtracted detail to
structures in the the image.
mediastinum.
Cycles/mm
M. Flynn 2007 60 M. Flynn 2007 61
3.0
4000
Detail Contrast
of 5,8,11 LUTs
Methods using large 2.0
3000
11 LUT Latitude
0
Gain== =2.6
Gain
Gain 0
1.4
0 500 1000 1500 2000 2500 3000 3500 4000
Cycles/mm
M. Flynn 2007 62 M. Flynn 2007 63
2E – Optimal PA chest gain 2E – chest, wide latitude
Optimal Contrast/Latitude
All Reader Mean (n=5) for 8 Cases
Detail Contrast (.85 to 5.75, logscale)
5 thoracic radiologists
at 3 medical centers
preferred a gain of 2.4
for the interpretation
of PA chest G = 2.4
radiographs of any
latitude. 1
T3-c
• Lat = 1.44
• Con = 3.00
• G = 2.4
Latitude 1200
Latitude 2X Gain contrast enhancement
600 – 0X
1. Preprocessing
2. Generic Image Processing
3. Commercial Implementations
• 1997 SPIE3034
Senn, skinline detection
• 1998 SPIE3335
Barski, ptone grayscale
• 1999 SPIE3658
Barski, grid suppression
• 1999 SPIE3658 EVP
Van Metter, EVP
• 2001 SPIE4322
Pakin, extremity segment.
• 2003 SPIE5367
Couwenhoven, control
• 2004 SPIE5370
A series of proceedings articles describes
Wang, auto segmentation
the image processing approaches used by
• 2005 SPIE5749 Eastman Kodak Company
Couwenhoven, noise
EVP
Blurred β3
KERNEL SIZE
Image +
…
βn
PTONE NEW Original Edge-Restored
LUT PTONE LUT Image Image
βn+1
EVP GAIN and EVP DENSITY
M. Flynn 2007
“Enhanced latitude for digital projection radiography,” R. Van Metter and D. Foos, Proc. SPIE 3658, 468-483, 1999. 76 M. Flynn 2007 77
Brightness
Couwenhoven,
RSNA Inforad
2005
Latitude
1st World
Congress
Thoracic Imaging UNIQUE
2005 UNified Image QU ality Enhancement
Contrast
UNIQUE Principle
Multi-Resolution Decomposition
Original Image
3D – Agfa, multiscale transforms Prokop, J.Thoracic Img., 18:148–164,2003 3D – Agfa, non-linear transfer
3E - Canon 3E - Canon
Narrowed Signal Range Increased Detail
Contrast
3E - Canon 3 – “multi-frequency”
MTF Dependant Edge
Enhancement
In General
• Linear Filters
Linear filters implemented with Fourier
transforms or convolution with large area, variable
amplitude kernels can achieve equalization and
edge restoration with full control of the
frequency transfer characteristics.
• Multi-scale Filters
Multi-scale filters have coarse control of
frequency transfer characteristics but can apply
non-linear transformations to achieve noise
reduction and prevent high contrast saturation.