Course Policy Image and Video Processing

Mukesh Patel School of Technology Management and Engineering

Electronics and Telecommunication Engineering Department

Course Policy
Program/Branch/Semester : B Tech (Computer Engineering) / MBA Tech (Computer
Engineering), Sem V

Academic Year : 2022-23

Course Code & Name : Image and Video Processing

Credit Details :

L T P C

2 0 2 3

Course Coordinator : Mumbai Cmpus

Faculty
Dr. Archana Bhise [MPSTME, Mumbai Campus]
Dr. Vidya Sawant [MPSTME, Mumbai Campus]

Shirpur Campus
Prof. Sachin Chavan /Prof. Deepti Barhate

Navi Mumbai Campus

Prof. Swati Rastogi

Indore Campus
Prof. Amit Holkar

[email protected] (02242334069)
Contact No. & Email :
[email protected] (02242334751)

[email protected] ( 9370493420, 9404970424)

[email protected] (7057340798)

[email protected] (8879439380)

Page 1 of 12
Course Policy Image and Video Processing

[email protected] (982757903)

Office : 5B Faculty area, 5th floor, MPSTME, Mumbai.

Student contact hours : Tuesday- 10 am to 1 pm

Wednesday- 10 am onwards
Saturday – 9 am to 2 pm

*Queries by Emails are encouraged.

Course link : https://teams.microsoft.com/_?culture=en-

in&country=IN&lm=deeplink&lmsrc=homePageWeb&c
mpid=WebSignIn#/school/FileBrowserTabApp/General?
threadId=19:PZ7Het59JuR7sW9QxDx5TBFTuShz4YP
[email protected]&ctx=channel

1 Introduction to the Course

1.1 Importance of the course

Image and Video Processing is a contemporary, practical oriented, application based course.
Various image-processing techniques like enhancement, segmentation, morphology,
restoration, filtering, compression etc have found relevance in multiple areas like remote
sensing, pattern recognition, machine/robot vision, medical field etc.
High quality images and digital video are significant components of the multimedia offered
in smart devices. Various tools and techniques are required to address these aspects of digital
video to achieve the best visual quality possible.
1.2 Objective of the Course
This course introduces concepts, methodologies and performance metrics for still image and
motion picture processing. It also helps to develop a foundation for further study and research
in the signal processing domain.
1.3 Pre-requisite

● Knowledge of frequency domain representation of signals

● Python Programming

2 Course Outcomes (CO) and mapping with Program Outcomes(PO)

Page 2 of 12
Course Policy Image and Video Processing

2.1 Course Outcomes

After successful completion of the course, a student will be able to-

1. Implement spatial domain enhancement techniques on grey images

2. Apply various frequency domain transforms to process an image
3. Analyze images processed by various morphological and segmentation techniques
4. Comprehend motion picture processing

2.2 CO-PO Mapping

  PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12
CO1 3 2 2 2 3 1 1
CO2 3 2 2 3 1
CO3 3 2 2 3 1
CO4 2 3 1 1
Low (1), Medium (2), High (3)

Page 3 of 12
Course Policy Image and Video Processing

3 Syllabus, Pre-class activity and References

3.1 Teaching and evaluation scheme

Teaching Scheme Evaluation Scheme

Internal Continuous
Lecture
Practical Tutorial Assessment (ICA) Theory
Hours
Hours Hours Credit As per Institute Norms (3 Hrs,
per
per week per week (50 Marks) 100 Marks)
week
2 2 0 3 Marks Scaled to 50 Marks Scaled to 50

a. 3.2 Syllabus

Unit Description Duration

1 Image fundamentals- Basics of sampling and quantization, representing 02
digital image, spatial and gray level resolution, basic relationships
between pixels, image file format.

2 Image enhancement 06
Point processing techniques - digital negative, contrast stretching,
thresholding, gray level slicing, bit plane slicing, log transformation,
power law transformation, neighborhood processing-smoothing spatial
filters, sharpening spatial filters, histogram processing-histogram
equalization.
3 Image transforms - Walsh transform, Hadamard transform, discrete
cosine transform, Slant transform, discrete wavelet transform. 06

4 Morphological image processing

Dilation, erosion, opening, closing, Hit–or-Miss transformation, basic 05
morphological algorithms- boundary extraction on binary images,
skeletonization, thinning, thickening.
5 Image Segmentation
Detection of discontinuities- point, line and edge detection, edge linking 06
and boundary detection using local processing, segmentation using
thresholding, region based segmentation- region growing, region splitting
and merging
6 Fundamentals of digital video
Video representation- digital video sampling, temporal correlation, video 02
frame classifications, I, P and B frames, digital video quality measure.
7 Digital Video Processing Techniques
Fundamentals of motion estimation and compensation, region of support 03
and its types, motion estimation algorithms-exhaustive search block
matching, 2D-log search method and 3 step search method.
Total hours 30

Page 4 of 12
 Course Policy Image and Video Processing

3.2 Pre-class activity

Outline for preliminary study to be done for each unit will be provided for each unit. Study
material (books and presentation) will be made available on MS Team. Students are expected
to spend good amount of time for self-study. During the lecture session, emphasis will be
given to knowledge in depth, practical applications and doubt solving.

3.3 References

Text Books:
1. R.C Gonzalez and Richard Woods, “Digital Image Processing”, Pearson, 3rd Edition,
2009.
2. Oge Marques, “Practical Image and Video Processing using Matlab”, John Wiley &
Sons, 2011.
Reference Books:
1. Murat Tekalp, Digital Video Processing, Pearson publication, 2010.
2. ZiNian, Li and Mark S. Drew, Fundamentals of Multimedia, Pearson Education
International, 2004.

Note: The latest edition of books should be referred.

4 Laboratory details

Knowledge of Python for laboratory exercise is a prerequisite. Students are expected to recall
the fundamental theory concepts relevant to the exercise to be performed in the upcoming
laboratory.
The following 10 programming exercises and Mini-project on the application of image/video
processing techniques beyond syllabus (to be done by the students) will form the submission
for laboratory coursework.

Date of
Sr. Week Mapped
List of Lab Exercises Submissi
No. No.# CO
on
1 0 Apply image processing algorithms on the test image to CO1
obtain new image.

i. Open, show and save images using different

techniques.
ii. To observe the effect of different gray level images
on their corresponding image matrix Week 2
iii. Image conversion (Color to Gray, Gray to Binary,
Color to Binary).
iv. Covert image formats.

Comment on subjective quality of the image for obtained

Page 5 of 12
 Course Policy Image and Video Processing

output.
1. For the given test image, apply power law
transformation with gamma

Comment on the enhancement results obtained for each

value of gamma.

2 1. 2. For the given low contrast image, apply CO1 Week 3

thresholding and contrast stretching point
processing techniques to enhance the image.

Comment on the comparison and performance of both

the techniques.

1. Classify the test images of different contrast levels by

plotting their histograms.
2. Implement histogram equalization on the above
images
3 2 CO1 Week 4
Examine the effect of equalization on the test images by
comparing the histograms of the test images with the
equalized images.

Apply a suitable spatial domain filtering technique to

enhance the following three images.
i. Image with Gaussian Noise.
ii. Image with salt and pepper noise.
4 3 iii. Blurred image. CO1 Week 5

Analyze the effect of various masks sizes of filter used and

comprehend your findings.

1. Apply 2D-Discrete Cosine Transform on the given

test image.
2. Obtain compression ratio between the test image and
reconstructed image using selected number of highest
5 4 energy coefficients of the transformed image are CO2 Week 6
retained.
Comment on the subjective quality of the reconstructed
image.

1. Apply Hadamard transform on the given test image.

2. Obtain compression ratio between the test image and
reconstructed image using selected number of highest
energy coefficients of the transformed image are Week 7
6 5 retained. CO2
Comment on the subjective quality of the reconstructed
image.

Page 6 of 12
 Course Policy Image and Video Processing

1. Apply Sobel’s mask on the given test image to

obtain component of gradient |g x| ,|g y|∧¿
|g x + g y|.
7 6 2. Apply 5x5 averaging filter on the test image and CO3 Week 8
then implement the sequence in step a.

Summarize your observations after comparing the results

obtained in step a and b.
1. Perform erosion on the given test image using a
square structuring element of size 11x11,15x15,
45x45.
2. Perform erosion on the given test image using a
circular shaped structuring element of size
11x11,15x15, 45x45.
8 7 3. Perform dilation on the given test image with broken CO3 Week 9
text characters using a suitable structuring element to
show that the broken segments were joined.

Analyze and compare the effect of structuring elements

of different sizes on the test images. Also observe the
effect of opening and closing on the given test images.
1. To perform image segmentation region growing.
Take center of the image as seed point. Display the
resultant image.
2. Change the seed point and observe its effect on the
9 8 CO3
resulting segmented image Week 10

Summarize your observations after comparing the results

obtained in step a and b.
10 Lab Exam and viva Week 10
11 Lab Exam and viva Week 11
2. Extract frames from the given video sequence.
3. Apply blurring effect on one/two extracted frames
12 9 CO4
using suitable image processing technique. Week 13
4. Re-insert the blurred frame in the video sequence.
1. Estimate motion vectors using exhaustive search
algorithm. Week 14
13 10 CO4
2. Use the MAD (Mean Absolute Difference) as a
measure.
Mini-project on the application of image/video processing Week 14
14 -
techniques (beyond syllabus) - Submission
15 Think pair share activity - Week 15

5 Assessment Policy
5.1 Component wise Continuous Evaluation Internal Continuous Assessment (ICA) and
Term End Examination (TEE)

Page 7 of 12
Course Policy Image and Video Processing

Assessment ICA (100 Marks) TEE (100

Component marks)
(Marks scaled to 50)
(Marks
scaled to
50)

Lab Lab Mini-project on Class Class

Performa Exam the application Test1 and activity
nce and of image/video Class
Viva processing Test 2
techniques
(beyond
syllabus)
(C)
(B) (D)
(A)
(E)

Weightage 05% 10% 10% 20% 05% 50%

Marks 10 20 20 20+20 10 100

Date of Weekly Week Week 14 Test 1: Week 15 November

Submission 10 & August 16- 16 to
11 23, 2022 December 2,
2022
Test 2:
September
26-October
3, 2022

5.2 Assessment Policy for Internal Continuous Assessment (ICA)

Assessment of ICA comprises of the following components.

A. Lab performance evaluation (10 marks)

a. Continuous assessment for laboratory experiments will be conducted. There

are 10 practical’s of 10 marks.
b. Discussion of your work with your peers is allowed. However, each student is
expected to submit his/her original work. Assessment of the lab work will be
carried out based on parameters like timely completion of lab work file,
understanding of the experiment performed, originality in the work,
involvement of the student, regularity, discipline etc. during the session.

B. Lab exam and viva (20 marks) : Lab test will be conducted based on the concepts
learnt. Viva will be based on the lab test topic.
Page 8 of 12
Course Policy Image and Video Processing

 Implementation (05 marks)

 Results (05 marks)
 Observations and conclusion (05 marks)
 Viva (05 marks)

C. Implementation of Mini-project on the application of image/video processing

techniques (beyond syllabus) (20 marks)
a. Faculty will make group of 2-3 students.
b. Student(s) will identify problem statement based on real life application of
the image / video processing techniques (beyond syllabus) and implement
the technique.
c. Assessment will be based:
 Implementation (05 marks)
 Results obtained (05 marks)
 Originality (05 marks)
 Viva (05 marks)

D. Class test 1 and 2 (20+20 Marks)

a. Two class tests will be conducted as per the academic calendar.

b. First question will be compulsory and will cover all topics marked for the test.
Thereafter an option to attempt two questions out of the remaining three.
c. It will conducted for 20 marks each.

E. Class activity (10 marks)- Students will be given weightage for participating in any
of the activity given below:
● Participating in national/international competitions
● Coding competitions
● SRG projects
● Publications
● Startup initiatives
● Any other activity
For students who have not been involved in any of these activities, a think pair share
activity will be conducted where the faculty will ask questions in every class based on
the content being taught. The question will be asked to the students. Assessment will
be based on the active participation and correctness of the answer.
5.3 Assessment Policy for Term End Examination (TEE)
A written examination of 100 marks for 03 hours duration will be conducted for the course as
per the academic calendar.

6. Lesson Plan

Sessio Topics Mapped Reference

n
Page 9 of 12
Course Policy Image and Video Processing

No. CO

Basics of sampling and quantization, Representing TB1

1 1
Digital Image

Spatial and gray level resolution, Basic 1 TB1

2
relationships between pixels, image file format.

Image Enhancement - Digital negative, contrast 1 TB1

3
stretching

4 Thresholding, gray level slicing, bit plane slicing, 1 TB1

5 Log transformation, power law transformation. 1 TB1

Neighbourhood Processing: Smoothing spatial 1 TB1

6
filters.

7 Sharpening spatial filters. 1 TB1

8 Histogram processing-histogram equalization 1 TB1

9 Image transforms - Significance of transforms, 2 TB1

10 Walsh transform, 2 TB1

11 Hadamard transform. 2 TB1

12 Discrete Cosine Transform. 2 TB1

13 Slant transform. 2 TB1

14 Class Test 1 [16 August 2021 to 21 August 2021]

14 Discrete Wavelet Transform. 2 TB1

Morphological Image Processing: Dilation, erosion, 3 TB1

15

16 Opening, closing, 3 TB1

17 Hit –or-Miss transformation. 3 TB1

Basic morphological algorithms-Boundary 3 TB1

18
extraction on binary images,

Class Test 2 [27 September 2021 to 04 October

27
2021]

19 Skeletonization, Thinning, Thickening 3 TB1

20 Image Segmentation - Detection of discontinuities: 3 TB1

Point, Line.

Page 10 of 12
Course Policy Image and Video Processing

Edge detection. 3 TB1

21

Edge linking and boundary detection using 3 TB1

22
Local processing,

23 Segmentation using thresholding 3 TB1

24 Region based segmentation: Region growing. 3 TB1

25 Region splitting and merging. 3 TB1

Fundamentals of Digital Video. 4 TB2,RBI

26 Video representation-digital video sampling,
temporal correlation, video frame.

Classifications, I, P and B frames, Digital video 4 TB2, RB1

27
quality measure.

Digital Video Processing Techniques. 4 TB2, RB1

28 Fundamentals of motion estimation and
compensation.

29 Region of support and its types, 4 TB2, RB1

Motion Estimation Algorithms - 4 TB2, RB1

30 Exhaustive Search Block Matching, 2D-log search
method and 3 step search method.

7 Teaching-learning methodology
Faculty will make a group of 2-3 students for any group based activity such as class
participation, project, presentation etc. Lecture and laboratory session will be conducted as
follows-
1. Lectures:
o Outline for preliminary study to be done for each unit will be provided prior to
commencement of each unit.
o Deeper concepts and applications will be explained through Presentations.

2. Laboratory:
o Lab manual consisting of theory and algorithm to support the lab experiment
will be uploaded on student portal/ MS Teams.
o Regular lab assessment and grading will be done. Students will be marked
based on parameters like completion of lab assignment, originality, logic
developed, interaction during the lab, submission, punctuality and discipline

Page 11 of 12
Course Policy Image and Video Processing

8 Active learning techniques

Active learning is a method of learning in which students are actively or
experientially involved in the learning process. Following active learning techniques
will be adopted for the course.
i) Muddiest topic: Faculty will find out the least understood point/topic in the session.
This topic is then further explained to ensure that it is understood well.
ii) Think Pair Share: A group of students will work together to solve a problem or
answer a question about an assigned reading. Students are expected to think
individually about a topic or answer to a question and share ideas with classmates.
vi) Brainstorming: Students will be asked to generate ideas on a certain challenging
topics and the faculty will facilitate the answers.
vii) Problem solving using real data: Students use a variety of images for quantitative
and qualitative analyses.

9 Course Material
Following will be uploaded on the MS Teams as and when required.
● Course Policy.
● Lecture Presentations.
● Books / Reference Books
● Lab Manuals, test images.

10 Course Outcome Attainment

Following means will be used to assess attainment of course learning outcomes.

● Use of formal evaluation components of continuous evaluation, assignments,
laboratory work, semester end examination.
● Informal feedback during course conduction.

11 Academic Integrity Statement

Students are expected to carry out assigned work under Internal Continuous
Assessment (ICA) independently. Copying in any form is not acceptable and will
invite strict disciplinary action. Evaluation of corresponding component will be
affected proportionately in such cases. Plagiarism detection software will be used to
check plagiarism wherever applicable. Academic integrity is expected from students
in all components of course assessment.

Page 12 of 12