Complete 3-D Computer Vision: Principles, Algorithms and Applications 1st Edition Yu-Jin Zhang PDF For All Chapters
Complete 3-D Computer Vision: Principles, Algorithms and Applications 1st Edition Yu-Jin Zhang PDF For All Chapters
https://ebookmass.com
https://ebookmass.com/product/3-d-computer-vision-
principles-algorithms-and-applications-1st-
edition-yu-jin-zhang/
https://ebookmass.com/product/computer-vision-theory-algorithms-
practicalities-fifth-edition-davies/
testbankdeal.com
https://ebookmass.com/product/hidden-semi-markov-models-theory-
algorithms-and-applications-1st-edition-yu/
testbankdeal.com
https://ebookmass.com/product/building-computer-vision-applications-
using-artificial-neural-networks-2nd-edition-shamshad-ansari/
testbankdeal.com
Feature extraction and image processing for computer
vision Fourth Edition Aguado
https://ebookmass.com/product/feature-extraction-and-image-processing-
for-computer-vision-fourth-edition-aguado/
testbankdeal.com
https://ebookmass.com/product/probabilistic-graphical-models-for-
computer-vision-ji-q/
testbankdeal.com
https://ebookmass.com/product/transformers-for-natural-language-
processing-and-computer-vision-third-edition-denis-rothman/
testbankdeal.com
https://ebookmass.com/product/computer-vision-technology-for-food-
quality-evaluation-second-edition-sun/
testbankdeal.com
https://ebookmass.com/product/algorithms-for-dummies-for-dummies-
computer-tech-2nd-edition-mueller/
testbankdeal.com
Yu-Jin Zhang
3-D Computer
Vision
Principles, Algorithms and Applications
3-D Computer Vision
Yu-Jin Zhang
© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore
Pte Ltd. 2023
This Springer imprint is published by the registered company Springer Nature Singapore Pte Ltd.
The registered company address is: 152 Beach Road, #21-01/04 Gateway East, Singapore 189721,
Singapore
Preface
This book is a specialized textbook that introduces the basic principles, typical
methods, and practical techniques of 3-D computer vision. It can provide an
advanced/second course service of computer vision for graduate students of related
majors in higher engineering colleges and universities, after studying 2D Computer
Vision: Principles, Algorithms and Applications.
This book mainly covers the higher level of computer vision from the selection of
materials. This book is self-contained, mainly for information majors, but also takes
into account learners of different professional backgrounds, and also considers the
needs of self-study readers. After learning the fundamental content of computer
vision in this book, readers can carry out scientific research and solve more and even
difficult specific problems in practical applications.
This book pays more attention to practicality in writing. Considering that com-
puter vision technology has been involved in many professional fields in recent
years, but many working people are not specialized in computer vision technology,
this book does not emphasize the theoretical system too much, minimizes the
formula derivation, and focuses on commonly used techniques. This book has
many sample questions and uses intuitive explanation to help readers understand
abstract concepts. A subject index list is given at the end of the book, and those
corresponding terms are marked in bold in the text.
This book provides a large number of self-test questions (including hints and
answers). In terms of purpose: on the one hand, it is convenient for self-study to
judge whether they have mastered the key content; on the other hand, it is also
convenient for teachers to carry out online teaching and strengthen teacher-student
interaction during lectures. The types of questions are multiple-choice questions,
which can be easily judged by a computer. In terms of content, many questions
express the basic concepts in a different way, supplementing the text, so that learners
can deepen their understanding. Some questions list descriptions that are similar but
not the same, or even have opposite meanings. Through dialectical thinking of pros
and cons, learners can also deeply understand the essence. The hints have been
provided for all self-test questions, allowing readers to obtain more information to
v
vi Preface
further identify the meaning of the questions. At the same time, each question can be
said to be divided into two levels in this way. Readers can complete the self-test after
reading the hints to show that they basically understand it, and to complete the self-
test without looking at the hints indicates that they have an even better grasp.
From the structure of this book, there are 12 chapters in total, plus one appendix,
answers to self-test questions, and subject index. Under these 15 first-level headings,
there are a total of 103 second-level headings (sections), and there are 141 third-level
headings (subsections) underneath. The book has a total of about 500,000 words
(including pictures, drawings, tables, formulas, etc.) and a total of (numbered)
228 figures, 22 tables, and 566 formulas. In order to facilitate teaching and learning,
this book provides a total of 68 examples of various types and 157 self-test questions
(all with hints and answers). In addition, there are a list of more than 100 directly
related references and a list of more than 500 subject terms for indexing, at the end of
the book.
This book can consider three aspects from the knowledge requirements of the
prerequisite courses: (1) Mathematics: including linear algebra and matrix theory, as
well as basic knowledge about statistics, probability theory, and random modeling;
(2) Computer science: including the mastery of computer software technology, the
understanding of computer structure system, and the application of computer pro-
gramming methods; (3) Electronics: On the one hand, the characteristics and prin-
ciples of electronic equipment; on the other hand, circuit design and other content. In
addition, the book 2D Computer Vision: Principles, Algorithms and Applications
can be counted as the discipline prerequisite of this book.
Thanks to the editors of the publisher for carefully composing the manuscript,
seriously reviewing, and attentively modifying.
Finally, the author thanks his wife Yun HE and daughter Heming ZHANG for
their understanding and support in all aspects.
vii
viii Contents
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2023 1
Y.-J. Zhang, 3-D Computer Vision, https://doi.org/10.1007/978-981-19-7580-6_1
2 1 Computer Vision Overview
It is generally believed that humans have five senses of vision, hearing, smell, taste,
and touch and the corresponding sensory organs, for obtaining information from the
objective world. Among them, vision provides humans with most of the data they
receive; in other words, humans often rely more on vision than other senses when
they acquaint the world. For example, the input information obtained by humans
from eye observation often reaches several million bits, and the data rate during
continuous viewing can exceed tens of million bits per second. The human brain has
more than 1010 cells/neurons, some of which have more than 10,000 connections
(or synapses) with other neurons. It is estimated that the amount of visual informa-
tion the brain receives from the eyes is at least two orders of magnitude larger than all
the information obtained from other sense organs.
Although computer vision needs to realize the functions of human vision, there are
still differences between human vision and computer vision. Human vision first
receives light stimulation in a certain wavelength range from the external environ-
ment through the sensory organs (eyes) of the visual system to the retina and then
encodes and processes the perceptive organs (brain or cerebral visual cortex) of the
visual system to obtain subjective feelings. Therefore, vision involves not only
physics and chemistry but also psychophysiology. Computer vision mainly relies
on photoelectric conversion for image acquisition, then uses processing and analysis
1.1 Human Vision and Characteristics 3
functions to obtain objective data, and makes stricter reasoning and judgments based
on these results.
In the early days, computer vision put more emphasis on the research of vision
science and design system software, while machine vision not only considered
design system and software but also considered hardware environment and image
acquisition technology as well as the integration of vision systems. Therefore, from
the perspective of vision system integration, machine vision systems are more
comparable to human vision systems (human visual systems). However, with the
development of electronic technology and computer technology, true and real-time
applications can be realized to a considerable extent on a stand-alone PC. Due to the
increase in knowledge in related fields, the difference between machine vision and
computer vision has been significantly reduced, and they are more interchangeably
used nowadays.
The brightness of vision corresponds to the light intensity that the human eye feels
from the scene. A psychological term closely related to brightness is subjective
brightness or subjective luminance The subjective brightness refers to the bright-
ness of the observed object, which is judged by the human eyes according to the
intensity of the light stimulation of the retina. Examples of three typical brightness
properties in which the perception of brightness is related to multiple factors are as
follows.
4 1 Computer Vision Overview
The subjective brightness felt from the surface of an object is not only related to the
brightness of the surface itself but also to the relative relationship (ratio) between the
brightness of the surface and the surrounding environment (background). If two
objects with different brightness have a similar relative relationship with their
respective backgrounds, they can appear to have the same brightness. At this time,
the subjective brightness perceived by people has nothing to do with the absolute
value of the object brightness. Conversely, the surface of the same object will appear
brighter if it is placed on a darker background and will appear darker if it is placed on
a brighter background. This phenomenon is called simultaneous contrast, also
called conditional contrast.
Example 1.1 Simultaneous Contrast Example
All the small squares in the center of big squares (background) in Fig. 1.1 have
exactly the same brightness. However, it looks brighter when it is on a dark
background and looks darker when it is on a bright background. So, it feels like
when these four pictures are viewed from left to right, the small square in the center
gradually darkens. This is just the result of simultaneous contrast.
At the boundary of the touch regions with different brightness in the object, human
vision may estimate the brightness value too high or too low. In other words, the
subjective brightness felt from the surface of an object is not a simple proportional
function of the illuminance the object receives. This phenomenon was discovered by
Mach, so it is called the Mach band effect.
Example 1.2 Example of Mach Band Effect
Figure 1.2a is a Mach band pattern, which includes three parts: the left side is a
uniform low-brightness area, the right side is a uniform high-brightness area, and the
middle is a gradual transition from low brightness to high brightness. Fig. 1.2b
shows the actual brightness distribution (three straight lines) from left to right. If one
looks at Fig. 1.2a with the eyes, one will find that there is a darker band at the
junction of the left and middle bands than the left band and a darker band at the
junction of the middle and right bands than the right band. The subjective brightness
Brightness
(b)
Distance
Subjective
brightness
(c)
Distance
obtained should be as shown in Fig. 1.2c. In fact, the darker band and the brighter
band do not exist objectively; it is the result of subjective brightness perception.
Contrast sensitivity (also called contrast susceptibility) reflects the ability of the
human eye to distinguish differences in brightness. It is affected by the observation
time and the size of the observed object. If a grid composed of lines of different
thickness and contrast is used for testing, the closer the contrast between the bright
and dark lines of the grid perceived by the eyes is to the contrast between the bright
and dark lines of the original test grid, the greater the contrast sensitivity. Under ideal
conditions, people with good eyesight can distinguish a brightness contrast of 0.01,
which means that the contrast sensitivity can reach up to 100.
If the abscissa represents the thickness of the bright and dark lines of the test grid
and the ordinate represents the contrast sensitivity, then the measured result will give
the modulation transfer function of the visual system, that is, the ability that human
visual system accurately converts the test grid into an optical image. Here the grid
thickness can be expressed by spatial frequency, and its unit is the number of circles
(number of lines) contained in each degree of viewing angle, that is, circle/degree
(CPD).
The contrast sensitivity can be regulated by the light modulation factor M. If Lmax,
Lmin, and Lav are, respectively, the maximum, minimum, and average brightness
values, then
Visit https://ebookmass.com
now to explore a rich
collection of eBooks and enjoy
exciting offers!
6 1 Computer Vision Overview
L max - L min
M= ð1:1Þ
Lav
Vision is first and foremost a spatial experience, so the spatial properties of vision
have a great influence on visual effects.
Vision has a cumulative effect in space. The range of light stimulus intensity
experienced by the human eye can reach about 13 orders of magnitude. If described
by light illuminance, the lowest absolute stimulus threshold is 10-6 lx (lux), and the
highest absolute stimulus threshold exceeds 107lx. Under the best conditions, every
light quantum in the peripheral region of the retina will be absorbed by a rod cell, and
a visual response can be caused by only a few light quanta. This is considered to have
taken place in a complete spatial accumulation, and it can be described by the law of
the inverse ratio of light intensity and area. This law can be written as
E c = kAL ð1:2Þ
where Ec is the absolute threshold of vision, which is the critical light energy
required for 50% detection probability (i.e., the light energy when the light stimu-
lation is observed once in every two tests in multiple experiments); A is the
cumulative area; L is the brightness; and k is a constant, which is related to the
units used by Ec, A, and L. Note that the area that can satisfy the above law has a
critical value Ac (corresponding to a round solid angle with a diameter of about
0.3 rad). When A < Ac, the above law holds; otherwise the above law does not hold.
It can be seen that the spatial cumulative effect can be understood as follows:
when a small and weak light spot is presented alone, it may be invisible (cannot
cause a visual response), but when multiple such light spots are connected together
as a large spot at the same time, one can see it. Its functional significance lies in: large
objects may be seen in a dark environment even if the outline is blurred.
The spatial frequency corresponds to the changing speed of the visual image in
space. This can be tested with stripes whose brightness sinusoidally changes in
space. The brightness function Y(x, y) = B(1 + mcos2πfx). Among them, B is the
basic brightness, m is the amplitude (corresponding to black and white contrast), and
1.1 Human Vision and Characteristics 7
f is the fringe frequency (corresponding to the fringe width). The spatial resolution
capability can be tested by changing m when f is given as a fixed value. Obviously,
the larger m, the stronger the spatial resolution ability. In practice, to test the
minimum m value that can distinguish bright and dark stripes at different angles
and frequencies, one can define 1/m minute (1′) as the contrast sensitivity. Usually
the human eye, in terms of spatial frequency felling, is equivalent to a band-pass
filter (more sensitive to the intermediate thickness of the stripes), the most sensitive
is 2 ~ 5 CPD, and the spatial cut-off frequency is 30 CPD.
When a person observes a still image, the eyeball is not still in one place, usually
after staying in one place for a few hundred milliseconds to complete the image
acquisition, the eyeball will move to another place to take another image, and so
on. This kind of movement is called saccadic eye movement. Studies have shown
that jumping movement can increase contrast sensitivity, but the peak sensitivity will
decrease.
Visual acuity is usually defined as the reciprocal of the viewing angle value
corresponding to the smallest detail that can be distinguished under certain condi-
tions. The smaller the viewing angle, the greater the visual acuity. If V is used for
visual acuity, then V = 1/(viewing angle). It represents the ability of the human eye
to correctly distinguish the details and contours of objects. A visual acuity of
1 indicates the resolution capability at a standard distance when the corresponding
viewing angle is 1°. The actual viewing angle of the human eye is 30″ ~ 60″ (this is
basically consistent with the cone cell diameter of about 0.004 mm), that is, the best
visual acuity can reach 2.0.
Visual acuity is affected by many factors, including the following:
1. Distance: When the distance of the object from the observer increases, the visual
acuity of the human eye decreases. This phenomenon is most obvious at about
10 m, and beyond a certain distance limit, the details of the object can no longer
be recognized.
2. Brightness: Increasing the brightness of the object (or enlarging the pupil) will
increase the visual acuity. The relationship between visual acuity and brightness
I is
V = a log I þ b ð1:3Þ
where a and b are constants. Visual acuity increases with increasing brightness, and
the relationship between the two is logarithmic. If the brightness continues to
increase to a certain level, the visual acuity will be close to saturation and will not
increase.
Random documents with unrelated
content Scribd suggests to you:
BLACK-THROATED DIVER.
Colymbus arcticus, Linn. Syst. Nat. vol. i. p. 221.—Lath. Ind. Ornith. vol. ii.
p. 800.—Ch. Bonaparte, Synopsis of Birds of United States, p. 420.
Colymbus arcticus, Black-throated Diver, Richards. and Swains. Fauna
Boreali-Americana, vol. ii. p. 475.
Black-throated Diver, Nuttall, Manual, vol. ii.
Mergus Albellus, Linn. Syst. Nat. vol. i. p. 209.—Lath. Ind. Ornith. vol. ii. p.
831.—Ch. Bonaparte, Synopsis of Birds of United States, p. 398.
Smew or White Nun, Mergus Albellus, Wils. Amer. Ornith. vol. viii. p. 126,
pl. 71, fig. 4. Male.
The Smew, or White Nun, Nuttall, Manual, vol. ii. p. 467.
4/ ,
12third toe 1 11/12, its claw 4 1/2/12; fourth toe 1 10/12, its claw 5/12.
Weight 1 lb. 8 oz.
Adult Female. Plate CCCXLVII. Fig. 2.
The Female is much smaller. The feathers of the hind part of the
head and neck are also elongated so as to form a crest. The bill, iris,
and feet, are coloured as in the male. All the lower parts are white,
excepting a broad band of light grey across the middle of the neck,
and a narrow portion of the sides, which are of a deeper tint. There is
a patch of brownish-black on the lore and beneath the eye; the upper
part of the head and half of the hind neck, are light reddish-brown;
the rest of the hind neck, and all the upper parts, bluish-grey, darker
behind, and in the middle of the back approaching to black. The
wings as in the male, that is black, with a large patch of white, and
two narrow transverse bands of the same; the tail dusky grey.
Length to end of tail 15 1/4 inches, to end of claws 16 1/2, to end of
wings 14 1/2; extent of wings 25. Weight 1 lb. 4 oz.
GADWALL DUCK.
I have met with this species along the whole of our Atlantic coast,
from Eastport in Maine to Texas. It is, however, more abundant in the
interior than in most of our maritime districts, and is particularly so on
the tributaries of the Ohio, Missouri, and Mississippi. In the early part
of autumn and late in spring many are found on the margins of our
great lakes. Yet the Gadwall has been represented as not plentiful in
the United States, probably on account of its being generally
dispersed, and not congregated in particular districts.
The Creoles of Louisiana name it “Violon,” on account of the
whistling sound of its wings. It arrives in the neighbourhood of New
Orleans and the mouths of the Mississippi along with the Widgeon,
and is fond of the company of the Red-head, to which it is about
equal as an article of food. The Gadwalls are usually seen in small
flocks, and during winter resort to the larger lakes and the pools in
the interior of the great marshes, adjoining the waters of the Gulf. In
that part of the country they feed on small fish, insects, and aquatic
grasses. Fewer of them are found in Massachusetts and the State of
New York than elsewhere, and this probably on account of these
districts being more elevated and less marshy than those farther
south. My friend Dr Bachman informs me that they are rather
plentiful in South Carolina, where they are considered good eating,
and where they arrive in the beginning of October, but are more
frequently met with at that season, and in early spring, than during
winter, when a single individual may sometimes be seen in a flock of
other ducks.
While we were in the Texas, in the latter part of April and the
beginning of May, we found the Gadwall quite abundant on all the
inland ponds and streams, as well as on the brackish pools and
inlets of the islands and shores of Galveston Bay. Many of them had
paired and separated from the other ducks; and I was assured that
this species breeds there, as does the Dusky Duck, the Mallard, the
Blue-winged Teal, the Widgeon, and the Shoveller, the young of all
these species being plentiful in the end of June and beginning of
July. I was satisfied as to the truth of the repeated assurances I had
received on this subject, by observing the manners of individuals of
all these species before my departure from that country. After a
continuance of rainy weather, Gadwalls are found in great numbers
on the vast prairies of Oppelousas and Attacapas, where I have
been told they continue until very late in spring, and some remain to
breed.
This species dives well on occasion, especially on being wounded.
At the appearance of danger, it rises on wing—whether from the
ground or from the water—at a single spring, in the manner of the
Mallard, and, like it also, ascends almost perpendicularly for several
yards, after which it moves off in a direct course with great celerity. I
have never seen it dive on seeing the flash of the gun; but when
approached it always swims to the opposite part of the pond, and,
when the danger increases, flies off. On being wounded, it
sometimes by diving makes its escape among the grass, where it
squats and remains concealed. It walks with ease, and prettily, often
making incursions upon the land, when the ponds are not
surrounded by trees, for the purpose of searching for food. It nibbles
the tender shoots and blades of grasses with apparent pleasure, and
will feed on beech-nuts, acorns, and seeds of all kinds of gramineæ,
as well as on tadpoles, small fishes, and leeches. After rain it alights
in the corn-fields, like the Mallard, and picks up the scattered grains
of maize. The common notes or cry of the female have a
considerable resemblance to those of the female Mallard; but the cry
of the male is weaker as in that species.
It is by no means shy in the Western Country, where I have often
found it associating with other species, which would leave the pond
before it. Near the sea, however, it is much more wary, and this no
doubt on account of the greater number of persons who there follow
shooting as a regular and profitable employment. From the following
note of my friend Dr Bachman, you may judge how easily this fine
species might be domesticated.
“In the year 1812 I saw in Dutchess County, in the State of New
York, at the house of a miller, a fine flock of ducks, to the number of
at least thirty, which, from their peculiar appearance, struck me as
differing from any I had before seen among the different varieties of
the tame Duck. On inquiry, I was informed that three years before, a
pair of these ducks had been captured in the mill pond, whether in a
trap, or by being wounded, I cannot recollect. They were kept in the
poultry-yard, and, it was said, were easily tamed. One joint of the
wing was taken off, to prevent their flying away. In the following
spring they were suffered to go into the pond, and they returned daily
to the house to be fed. They built their nest on the edge of the pond,
and reared a large brood. The young were perfectly reconciled to
domestication, and made no attempts, even at the migratory season,
to fly away, although their wings were perfect. In the following
season they produced large broods. The family of the miller used
them occasionally as food, and considered them equal in flavour to
the common duck, and more easily raised. The old males were more
beautiful than any that I have examined since; and as yet
domestication had produced no variety in their plumage.”
The migration of this species extends to the Fur Countries, where it
is said to breed. The description of a male killed on the
Saskatchewan River, on the 22d of May 1827, is given in the Fauna
Boreali-Americana; and I have a fine male procured by Dr
Townsend on the Columbia River.
Anas strepera, Linn. Syst. Nat. vol. i. p. 200.—Lath. Ind. Ornith. vol. ii. p.
859.—Ch. Bonaparte, Synopsis of Birds of United States, p. 383.
Gadwall, Anas strepera, Wils. Amer. Ornith. vol. viii. p. 120, pl. 71, fig. 1.—
Richards. and Swains. Fauna Bor.-Amer. vol. ii. p. 440.
Gadwall or Grey, Nuttall, Manual, vol. ii. p. 383.
Titian R. Peale.”
Inclosed in Mr Peale’s letter was the following note from Dr Rowan
“to the Messrs Peales.”
“On Saturday last I wrote to you of the Rail Bird breeding near this
place. I then described one that I caught last summer, which was
unlike the Rail in the fall season, and I presumed that all in the wet
ground were the same, but this day my men mowing around the
pond started up two of the usual kind. The hen flew a few rods, and
then flew back to her young in an instant, when they caught her
together with her four young, which I herewith send you. Many more
can be caught. I have seen them in our meadow every month of the
year, but they never make a great noise except when very fat on the
wild oat’s seed. From the above you will conclude that they do not
migrate to the south, but breed here. Respectfully,
Thomas Rowan.”
Rallus jamaicensis, Brisson Sup. p. 140.—Gmel. Syst. Nat. vol. ii. p. 718.—
Lath. Ind. Ornith. vol. ii. p. 761.