1 Introduction
1 Introduction
1 Introduction
1
Text Book
• “Fundamentals of Multimedia”, Ze-Nian Li and
Mark S.Drew, 3rd Edition, Springer 2021
2
Outlines
• Introduction to media types (text, image, audio, video)
• Multimedia Representation and Storage
• Color images and videos
• Basics of Digital Audio
• Fundamentals Concepts of Videos
• Lossless Compression
• Lossless Media Compression
• Lossy Media Compression
3
Why we need Media
• Better representation than text
– Speaking is faster than writing
– Listening is faster than reading
– Showing is clearer than describing
• A picture is worth a thousand words
4
Why we need Media
5
What is Multimedia
• Multi
– Many, much, multiple
• Media: medium
– A means to distribute and represent information
(Text, graphics, images, animation, voice, sound
and video)
• Multimedia
– To distribute and represent information coded as
(Text, graphics, images, animation, voice, sound
and video)
– By computer, smartphones, digital TV, … 6
What is Multimedia
• Applications that use multiple modalities,
including text, images, drawings (graphics),
animation, video, sound including speech, and
interactivity
7
What is Multimedia
• Fields share multimedia area
– Graphics
– Visualization
– Human Computer Interaction(HCI)
– Computer Vision
– Data compression
– Networking
– Database systems
8
What is Multimedia
• Examples
– Video teleconferencing
– Distributed lectures for higher education
– Co-operative work environments (edit a shared
document)
– Searching in (very) large video and image
– Augmented reality: placing computer objects into
scenes
– Interactive TV
– Video in demand
9
History of Multimedia
• Newspaper: uses text, graphics, and images
• Motion pictures (1830’s): observe motion too
rapid for perception by the human eye.
• Wireless radio transmission (1895): Guglielmo
Marconi, at Pontecchio, Italy
• Television (20th century): video as a
commonly available medium
10
History of Multimedia
• 1945: Hypermedia, Vannevar Bush wrote a
landmark article describing what amounts to a
hypermedia
• 1960: Hypertext
• 1989: World Wide Web, Tim Berners-Lee
invented the World Wide Web, Switzerland
• 1991: Apple Multimedia Lab
• 1991: MPEG-1, MPEG-2, MPEG-4 in 1990’s
• 1992: JPEG, then new JPEG2000 standard
11
History of Multimedia
• 1993: HTML
• 1994: NetScape
• 1996: Internet Explorer
• 1996: DVD video
• 1998: Hand-held MP3 devices
• 2001: iPod
• 2003: Skype, free peer-to-peer voice over the
Internet
• 2005: Youtube
12
History of Multimedia
• 2006: twitter, 2012 allow uploading up to 6s video
• 2007: iPhone, 2008 first android powered phone
• 2010: Netflix, a DVD rental service provider
• 2010: Instagram
• 2012: HTML5, improve HTML with support for the
latest multimedia features
• 2013: Sony released its PlayStation 4
• 2016: Oculus Rift (virtual reality headset)
• 2020: Sony released its PlayStation 5
13
Hypermedia and Multimedia
• Hypertext
– System meant to be read nonlinearly, by following
links
14
Hypermedia and Multimedia
• Hypermedia
– Not constrained to be text-based
– Can include other media, e.g., graphics, images,
sound and video
• Multimedia
– means that computer information can be
represented through audio, graphics, images,
video, and animation in addition to traditional
media (text and graphics).
15
Multimedia Software Tools
• Music
– Cakewalk (Pro Audio)
– Macromedia Soundedit
• Digital Audio
– Adobe Audition (Cool Edit)
– Sound Forge
• Graphics and Images
– Adobe Illustrator
– Adobe Photoshop
– Adobe Fireworks 16
Multimedia Software Tools
• Video Editing
– Adobe Premiere
– Adobe After Effects
– Final Cut Pro (by Apple)
– CyberLink PowerDirector
• Animation
– DirectX & OpenGL
– 3D Studio Max
– Maya
17
Multimedia Software Tools
• Multimedia Authoring: creating a complete
multimedia presentation, including interactive
user control
– Adobe Flash
– Adobe Director
– Adobe Dreamweaver
– Adobe Authorware
– Silverlight
18