(FREE PDF Sample) Image and Video Compression For Multimedia Engineering: Fundamentals, Algorithms, and Standards Third Edition Shi Ebooks
(FREE PDF Sample) Image and Video Compression For Multimedia Engineering: Fundamentals, Algorithms, and Standards Third Edition Shi Ebooks
com
https://textbookfull.com/product/image-and-
video-compression-for-multimedia-engineering-
fundamentals-algorithms-and-standards-third-
edition-shi/
textbookfull
More products digital (pdf, epub, mobi) instant
download maybe you interests ...
https://textbookfull.com/product/biota-grow-2c-gather-2c-cook-
loucas/
https://textbookfull.com/product/academic-press-library-in-
signal-processing-volume-5-image-and-video-compression-and-
multimedia-sergios-theodoridis/
https://textbookfull.com/product/intelligent-image-and-video-
compression-communicating-pictures-2nd-edition-david-bull/
https://textbookfull.com/product/digital-image-enhancement-
restoration-and-compression-digital-image-processing-and-
analysis-for-true-epub-scott-e-umbaugh/
Image and Video Technology Shin'Ichi Satoh
https://textbookfull.com/product/image-and-video-technology-
shinichi-satoh/
https://textbookfull.com/product/fundamentals-of-nuclear-science-
and-engineering-third-edition-faw/
https://textbookfull.com/product/cryptography-algorithms-
protocols-and-standards-for-computer-security-1st-edition-zoubir-
mammeri/
https://textbookfull.com/product/coulson-and-richardsons-
chemical-engineering-fourth-edition-volume-3a-chemical-and-
biochemical-reactors-and-reaction-engineering-r-ravi/
https://textbookfull.com/product/metaheuristic-algorithms-for-
image-segmentation-theory-and-applications-diego-oliva/
THIRD EDITION
Image and Video Compression for
MULTIMEDIA
ENGINEERING
FUNDAMENTALS, ALGORITHMS, AND STANDARDS
Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and
Standards, by Yun-Qing Shi and Huifang Sun
Single-Sensor Imaging: Methods and Applications for Digital Cameras, edited by Rastislav Lukac
Multimedia Image and Video Processing, edited by Ling Guan, Yifeng He, and Sun-Yuan Kung
Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and
Standards, Third Edition, edited by Yun-Qing Shi and Huifang Sun
This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been made
to publish reliable data and information, but the author and publisher cannot assume responsibility for the validity of all
materials or the consequences of their use. The authors and publishers have attempted to trace the copyright holders of all
material reproduced in this publication and apologize to copyright holders if permission to publish in this form has not been
obtained. If any copyright material has not been acknowledged please write and let us know so we may rectify in any future
reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or utilized
in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying,
microfilming, and recording, or in any information storage or retrieval system, without written permission from the
publishers.
For permission to photocopy or use material electronically from this work, please access www.copyright.com (http://www.
copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400.
CCC is a not-for-profit organization that provides licenses and registration for a variety of users. For organizations that have been
granted a photocopy license by the CCC, a separate system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for
identification and explanation without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and
Xuedong, Min, Yin, Andrew, Rich, Haixin, Allison, Adam, Emily, Kailey
Contents
Part I Fundamentals
1. Introduction .............................................................................................................................3
1.1 Practical Needs for Image and Video Compression ................................................4
1.2 Feasibility of Image and Video Compression ........................................................... 5
1.2.1 Statistical Redundancy....................................................................................5
1.2.1.1 Spatial Redundancy .........................................................................5
1.2.1.2 Temporal Redundancy .................................................................... 8
1.2.1.3 Coding Redundancy ........................................................................9
1.2.2 Psychovisual Redundancy ........................................................................... 10
1.2.2.1 Luminance Masking ...................................................................... 11
1.2.2.2 Texture Masking............................................................................. 14
1.2.2.3 Frequency Masking........................................................................ 14
1.2.2.4 Temporal Masking ......................................................................... 14
1.2.2.5 Color Masking ................................................................................ 16
1.2.2.6 Color Masking and Its Application in Video Compression ....... 19
1.2.2.7 Summary: Differential Sensitivity ............................................... 20
1.3 Visual Quality Measurement .................................................................................... 20
1.3.1 Subjective Quality Measurement ................................................................ 21
1.3.2 Objective Quality Measurement..................................................................22
1.3.2.1 Signal-to-Noise Ratio .....................................................................22
1.3.2.2 An Objective Quality Measure Based on Human Visual
Perception ........................................................................................23
1.4 Information Theory Results ...................................................................................... 27
1.4.1 Entropy ............................................................................................................ 27
1.4.1.1 Information Measure ..................................................................... 27
1.4.1.2 Average Information per Symbol................................................. 28
1.4.2 Shannon’s Noiseless Source Coding Theorem .......................................... 28
1.4.3 Shannon’s Noisy Channel Coding Theorem ............................................. 29
1.4.4 Shannon’s Source Coding Theorem ............................................................ 29
1.4.5 Information Transmission Theorem ........................................................... 30
1.5 Summary ...................................................................................................................... 30
Exercises .................................................................................................................................. 31
References ............................................................................................................................... 32
vii
viii Contents
2. Quantization .......................................................................................................................... 33
2.1 Quantization and the Source Encoder ..................................................................... 33
2.2 Uniform Quantization ................................................................................................ 35
2.2.1 Basics................................................................................................................ 36
2.2.1.1 Definitions ....................................................................................... 36
2.2.1.2 Quantization Distortion ................................................................ 38
2.2.1.3 Quantizer Design ........................................................................... 39
2.2.2 Optimum Uniform Quantizer ..................................................................... 40
2.2.2.1 Uniform Quantizer with Uniformly Distributed Input ............40
2.2.2.2 Conditions of Optimum Quantization .......................................42
2.2.2.3 Optimum Uniform Quantizer with Different Input
Distributions ...................................................................................43
2.3 Nonuniform Quantization ........................................................................................ 45
2.3.1 Optimum (Nonuniform) Quantization ...................................................... 45
2.3.2 Companding Quantization .......................................................................... 45
2.4 Adaptive Quantization............................................................................................... 49
2.4.1 Forward Adaptive Quantization ................................................................. 50
2.4.2 Backward Adaptive Quantization............................................................... 51
2.4.3 Adaptive Quantization with a One-Word Memory ................................. 52
2.4.4 Switched Quantization ................................................................................. 52
2.5 PCM............................................................................................................................... 53
2.6 Summary ...................................................................................................................... 56
Exercises .................................................................................................................................. 57
References ............................................................................................................................... 57
6. Run-Length and Dictionary Coding: Information Theory Results (III) ................ 143
6.1 Markov Source Model .............................................................................................. 143
6.1.1 Discrete Markov Source .............................................................................. 144
6.1.2 Extensions of a Discrete Markov Source .................................................. 145
6.1.2.1 Definition ....................................................................................... 145
6.1.2.2 Entropy .......................................................................................... 145
6.1.3 Autoregressive Model ................................................................................. 146
Contents xi
15. Further Discussion and Summary on 2-D Motion Estimation ................................. 357
15.1 General Characterization ......................................................................................... 357
15.1.1 Aperture Problem ....................................................................................... 357
15.1.2 Ill-Posed Inverse Problem .......................................................................... 357
15.1.3 Conservation Information and Neighborhood Information ................ 358
15.1.4 Occlusion and Disocclusion ...................................................................... 358
15.1.5 Rigid and Nonrigid Motion ...................................................................... 359
15.2 Different Classifications ........................................................................................... 360
15.2.1 Deterministic Methods vs. Stochastic Methods ..................................... 360
15.2.2 Spatial Domain Methods vs. Frequency Domain Methods ................. 360
15.2.2.1 Optical-Flow Determination Using Gabor Energy Filters ..... 361
15.2.3 Region-Based Approaches vs. Gradient-Based Approaches ................364
15.2.4 Forward vs. Backward Motion Estimation ............................................. 365
15.3 Performance Comparison between Three Major Approaches ........................... 367
15.3.1 Three Representatives ................................................................................ 367
15.3.2 Algorithm Parameters ................................................................................ 367
15.3.3 Experimental Results and Observations ................................................. 367
15.4 New Trends ................................................................................................................ 368
15.4.1 DCT-Based Motion Estimation ................................................................. 368
15.4.1.1 DCT and DST Pseudophases.................................................... 368
15.4.1.2 Sinusoidal Orthogonal Principle ............................................. 370
15.4.1.3 Performance Comparison ......................................................... 371
15.5 Summary.................................................................................................................... 371
Exercises ................................................................................................................................ 372
References ............................................................................................................................. 372
21.3.4 Intra Frame Coding with Directional Spatial Prediction ..................... 536
21.3.5 Adaptive Block Size Motion Compensation ........................................... 536
21.3.6 Motion Compensation with Multiple References .................................. 537
21.3.7 Entropy Coding........................................................................................... 538
21.3.8 Loop Filter ....................................................................................................543
21.3.9 Error Resilience Tools .................................................................................545
21.4 Profiles and Levels of H.264/AVC ..........................................................................546
21.4.1 Profiles of H.264/AVC ................................................................................. 547
21.4.2 Levels of H.264/AVC ...................................................................................548
21.5 Summary.................................................................................................................... 550
Exercises ................................................................................................................................ 550
References ............................................................................................................................. 550
When looking at the prefaces of the first and second editions of this book published in 1999
and 2008, respectively, it is observed that the most of analyses, discussion and estimation
made there are still correct. The image and video compression as well as audio compres-
sion continue to play an important role in multimedia engineering. The trend of switch-
ing from analog to digital communications continues. Digital image and video, digital
multimedia, Internet, world wide web (WWW) have been continuously and vigorously
growing in the past 10 years. Therefore, in this third edition of the book, we have kept the
most of material in the second edition with some new additions. Some major changes we
have made are listed as follows.
First, in this book’s third edition, one chapter has been added (new Chapter 7), which
briefly introduces the digital watermarking technology. Furthermore, the so-called revers-
ible data hiding and information forensics have been briefly introduced.
Second, two new chapters describing the recently developed video coding standard,
HEVC/H.265 (Chapter 22) and IVC (Chapter 23) are added into the third edition. New
Chapter 22 introduces HEVC/H.265 which is the video coding standard, and has greatly
improved the coding efficiency compared with currently existing video coding standards.
In the new Chapter 23 an MPEG royalty free video coding standards has been introduced,
which is used for applications of internet video transmission. Third, for the previous
Chapter 21 covering the system part of MPEG, multiplexing/demultiplexing and synchro-
nizing the coded audio, video and other data has been changed as Chapter 24 in this
new addition. Since we have added two new MPEG Transport standards: MPEG media
transport (MMT) and MPEG DASH (Dynamic Adaptive Streaming over HTTP) into this
chapter, we change the title of this chapter to MPEG Transportation Standards.
For the rest of this new edition, we just made some minor changes and, of course, we
reorganized the chapter orders.
xxiii
Acknowledgments
We are pleased to express our gratitude for the support and help we received during the
course of writing this book.
Dr. Yun-Qing Shi thanks his friend and former colleague Dr. C. Q. Shu for fruitful tech-
nical discussion related to some contents of the book. Sincere thanks are also directed to
several of his friends and former students, Drs. J. N. Pan, X. Xia, S. Lin and Y. Shi, for their
technical contributions and computer simulations related to some subjects of the book. He
is grateful to Ms. L. Fitton for her English editing of 11 chapters, and to Dr. Z. F. Chen for
her help in preparing many graphics.
Dr. Huifang Sun expresses his appreciation to many friends and colleagues of the
MPEGers who provided MPEG documents and tutorial materials that are cited in some
revised chapters of this edition. He extends his appreciation to his colleague Dr. Anthony
Vetro for his supports and providing a good working environment to complete this revised
edition.
We would like to express our deep appreciation to Dr. Z. F. Chen for her great help in
formatting all the chapters of the book. We both thank Dr. F. Chichester for his help in
preparing the book.
Special thanks go to the editor-in-chief of the CRC Press Digital Image Processing book
series, Dr. P. Laplante, for his constant encouragement and guidance. The help from the
publisher of Electrical Engineering at CRC Press, Nora Konopka, is also appreciated.
The last, but not the least, we thank our families for their patient support during the
course of the writing. Without their understanding and support, we would not have been
able to complete this book.
xxv
Authors
Yun-Qing Shi has been a professor with the Department of Electrical and Computer
Engineering at the New Jersey Institute of Technology (NJIT), Newark, NJ, since 1987. He
has authored and co-authored more than 300 papers in his research areas, a book on Image
and Video Compression, three book chapters on Image Data Hiding, one book chapter on
Steganalysis, and one book chapter on Digital Image Processing. He has edited more than
10 proceedings of international workshops and conferences, holds 29 awarded US patents,
and delivered more than 120 invited talks around the world. He is a member of IEEE
Circuits and Systems Society (CASS)'s Technical Committee of Visual Signal Processing
and Communications, Technical Committee of Multimedia Systems and Applications, an
associate editor of IEEE Transactions on Information Forensics and Security, and a fellow
of IEEE for his contribution to Multidimensional Signal Processing since 2005.
Huifang Sun received the BS degree in Electrical Engineering from Harbin Engineering
Institute (Harbin Engineering University now), Harbin, China, in 1967, and the PhD degree
in Electrical Engineering from University of Ottawa, Ottawa, Canada. In 1986, he jointed
Fairleigh Dickinson University, Teaneck, New Jersey, as an assistant professor and pro-
moted to an associate professor in 1990. From 1990 to 1995, he was with the David Sarnoff
Research Center (Sarnoff Corp), Princeton, New Jersey, as a member of technical staff and
later promoted to Technology Leader of Digital Video Technology. He joined Mitsubishi
Electric Research Laboratories (MERL), in 1995 as a senior principal technical staff member
and was promoted as deputy director in 1997, vice president and MERL Fellow in 2003 and
now as MERL Fellow. He holds 66 U.S. patents and has authored or co-authored 2 books as
well as more than 150 journal and conference papers. For his contributions on HDTV devel-
opment he obtained 1994 Sarnoff Technical Achievement Award. He also obtained the best
paper award of IEEE Transactions on Consumer Electronics in 1993, the best paper award
of International Conference on Consumer Electronics in 1997 and the best paper award
of IEEE Transaction on CSVT in 2003. He was an associate editor for IEEE Transaction on
Circuits and Systems for Video Technology and the chair of Visual Processing Technical
Committee of IEEE Circuits and System Society. He is an IEEE Life Fellow. He also served
as a guest professor of Peking University, Tianjin University, Shanghai Jiaotong University
(Guest Researcher) and several other universities in China.
xxvii
Another random document with
no related content on Scribd:
40. PYHÄ-AAMU.
Sano, miksi yhä ystäväni olet? — Löysitkö kenties sinä sen, mitä
eivät löytäneet muut, enkä minä?
Liian kirkkaat ovat silmäsi, tyttöni, minun niihin katsoa, ja liian valkea
on kätesi minun käteeni annettavaksi. Puhtaampi sieluani on jo sinun
ruumiisikin ja sielusi kauniimpi kauneintakin ajatustani.
Syy ei ole sinun, eikä minun, ettei meistä tullut ystäviä, — vaan
Jumalan, joka meidät niin erilaisiksi loi.
49. JUURI SELLAISENA.