CAP 5636 - Advanced Artificial Intelligence

Fall 2022
Course Principles of artificial intelligence. Uninformed and informed search.
description: Constraint satisfaction. AI for game playing. Probabilistic reasoning, Markov
decision processes, hidden Markov models, Bayes nets. Neural networks and
deep learning.
Student By the end of the semester the students will be able to:
learning
outcomes: understand the search and decision making techniques used in modern
artificial intelligence
apply artificial intelligence techniques in their own code
understand the societal and ethical implications of artificial intelligence

Instructor: Dr. Lotzi Bölöni

Office HEC - 319
Location:
Phone: (407) 823-2320 (on last resort)
E-mail: [email protected] (preferred means of communication)
Grader: Karthiek Duggirala [email protected]
Web Site: http://www.cs.ucf.edu/~lboloni/Teaching/CAP5636_Fall2022/index.html
The assignments and the other announcements will be posted on the course
web site
Classroom: HEC 103
Class hours: Tue, Th 12:00PM - 1:15PM
Office hours: Tue, Th 6:00PM - 7:30PM
See webcourses announcement for Zoom link.
Enrollment CAP 4630, or consent of instructor.
requirements:
Required There is no required textbook.
texts:
Recommended Stuart Russel and Peter Norvig, Artificial Intelligence - A Modern
readings: Approach, 4rd edition

Grading Grading scale: Letter grades only (A,B,C and F)

methods: Point based grading. The points obtained in all exams are added up for
the final score. The grade will be A for 90 and above, B for 80-89, C for
70-79, F for lower than 70.
Points awarded: Midterm 1: 20 points, Midterm 2: 20 points,
Homeworks/Projects: 30 points total, Final exam 30 points.
Some midterms, exams and homeworks will have bonus points, but no
curve will be applied.
The exams will be administered through ProctorHub, and are open
book, open notes.
Make up exams will be given only in justified cases.

Sample exams Sample Midterm 1

Sample Midterm 2
 Sample Final Exam
Note: you should not expect that the new exams are just variations with
different data.
Verification of As of Fall 2014, all faculty members are required to document students'
engagement: academic activity at the beginning of each course. In order to document that
you began this course, please complete the following academic activity by the
end of the first week of classes, or as soon as possible after adding the
course, but no later than August 27. Failure to do so will result in a delay in
the disbursement of your financial aid.
To satisfy this requirement, you must finish the first quiz posted online. Log in
to Webcourses, choose CAP 5636, and submit your answers online.
Academic Students should familiarize themselves with UCF's Rules of Conduct at .
integrity According to Section 1, “Academic Misconduct,” students are prohibited from
engaging in

1. Unauthorized assistance: Using or attempting to use unauthorized

materials, information or study aids in any academic exercise unless
specifically authorized by the instructor of record. The unauthorized
possession of examination or course-related material also constitutes
cheating.
2. Communication to another through written, visual, electronic, or oral
means: The presentation of material which has not been studied or learned,
but rather was obtained through someone else's efforts and used as part of an
examination, course assignment, or project.
3. Commercial Use of Academic Material: Selling of course material to
another person, student, and/or uploading course material to a third-party
vendor without authorization or without the express written permission of the
university and the instructor. Course materials include but are not limited to
class notes, Instructor's PowerPoints, course syllabi, tests, quizzes, labs,
instruction sheets, homework, study guides, handouts, etc.
4. Falsifying or misrepresenting the student's own academic work.
5. Plagiarism: Using or appropriating another's work without any indication of
the source, thereby attempting to convey the impression that such work is the
student' s own.
6. Multiple Submissions: Submitting the same academic work for credit more
than once without the express written permission of the instructor.
7. Helping another violate academic behavior standards.
8. Soliciting assistance with academic coursework and/or degree
requirements.

Responses to Academic Dishonesty, Plagiarism, or Cheating

Students should also familiarize themselves with the procedures for academic
misconduct in UCF's student handbook, The Golden Rule . UCF faculty
members have a responsibility for students' education and the value of a UCF
degree, and so seek to prevent unethical behavior and respond to academic
misconduct when necessary. Penalties for violating rules, policies, and
instructions within this course can range from a zero on the exercise to an “F”
letter grade in the course. In addition, an Academic Misconduct report could
be filed with the Office of Student Conduct, which could lead to disciplinary
warning, disciplinary probation, or deferred suspension or separation from the
University through suspension, dismissal, or expulsion with the addition of a
“Z” designation on one's transcript. Being found in violation of academic
conduct standards could result in a student having to disclose such behavior
on a graduate school application, being removed from a leadership position
 within a student organization, the recipient of scholarships, participation in
University activities such as study abroad, internships, etc. Let's avoid all of
this by demonstrating values of honesty, trust, and integrity. No grade is worth
compromising your integrity and moving your moral compass. Stay true to
doing the right thing: take the zero, not a shortcut.

Unauthorized Use of Websites and Internet Resources There are many

websites claiming to offer study aids to students, but in using such websites,
students could find themselves in violation of academic conduct guidelines.
These websites include (but are not limited to) Quizlet, Course Hero, Chegg
Study, and Clutch Prep. UCF does not endorse the use of these products in
an unethical manner, which could lead to a violation of our University's Rules
of Conduct. They encourage students to upload course materials, such as test
questions, individual assignments, and examples of graded material. Such
materials are the intellectual property of instructors, the university, or
publishers and may not be distributed without prior authorization. Students
who engage in such activity could be found in violation of academic conduct
standards and could face course and/or University penalties. Please let me
know if you are uncertain about the use of a website so I can determine its
legitimacy.

Unauthorized Distribution of Class Notes Third parties may attempt to

connect with you to sell your notes and other course information from this
class. Distributing course materials to a third party without my authorization is
a violation of our University's Rules of Conduct. Please be aware that such
class materials that may have already been given to such third parties may
contain errors, which could affect your performance or grade.
Recommendations for success in this course include coming to class on a
routine basis, visiting me during my office hours, connecting with the Teaching
Assistant (TA), and making use of the Student Academic Resource Center
(SARC), the University Writing Center (UWC), the Math Lab, etc. If a third
party should contact you regarding such an offer, I would appreciate your
bringing this to my attention. We all play a part in creating a course climate of
integrity.
In-class Students may, without prior notice, record video or audio of a class lecture for
recording a class in which the student is enrolled for their own personal educational use.
A class lecture is defined as a formal or methodical oral presentation as part
of a university course intended to present information or teach enrolled
students about a particular subject. Recording class activities other than class
lectures, including but not limited to lab sessions, student presentations
(whether individually or part of a group), class discussion (except when
incidental to and incorporated within a class lecture), clinical presentations
such as patient history, academic exercises involving student participation,
test or examination administrations, field trips, private conversations between
students in the class or between a student and the faculty member, and
invited guest speakers is prohibited. Recordings may not be used as a
substitute for class participation and class attendance, and may not be
published or shared without the written consent of the faculty member. Failure
to adhere to these requirements may constitute a violation of the University's
Student Code of Conduct as described in the Golden Rule.
Course The University of Central Florida is committed to providing access and
accessibility: inclusion for all persons with disabilities. Students with disabilities who need
access to course content due to course design limitations should contact the
professor as soon as possible. Students should also connect with Student
 Accessibility Services (Ferrell Commons 185, [email protected], phone 407-823-
2371). For students connected with SAS, a Course Accessibility Letter may
be created and sent to professors, which informs faculty of potential course
access and accommodations that might be necessary and reasonable.
Determining reasonable access and accommodations requires consideration
of the course design, course learning objectives and the individual academic
and course barriers experienced by the student. Further conversation with
SAS, faculty and the student may be warranted to ensure an accessible
course experience.
Campus safety Emergencies on campus are rare, but if one should arise during class,
statement: everyone needs to work together. Students should be aware of their
surroundings and familiar with some basic safety and security concepts.

In case of an emergency, dial 911 for assistance.

Every UCF classroom contains an emergency procedure guide posted
on a wall near the door. Students should make a note of the guide's
physical location and review the online version at https://centralflorida-
prod.modolabs.net/student/safety/index.
Students should know the evacuation routes from each of their
classrooms and have a plan for finding safety in case of an emergency.
If there is a medical emergency during class, students may need to
access a first-aid kit or AED (Automated External Defibrillator). To learn
where those are located, see https://ehs.ucf.edu/automated-external-
defibrillator-aed-locations.
To stay informed about emergency situations, students can sign up to
receive UCF text alerts by going to https://my.ucf.edu and logging in.
Click on “Student Self Service” located on the left side of the screen in
the toolbar, scroll down to the blue “Personal Information” heading on
the Student Center screen, click on “UCF Alert”, fill out the information,
including e-mail address, cell phone number, and cell phone provider,
click “Apply” to save the changes, and then click “OK.”
Students with special needs related to emergency situations should
speak with their instructors outside of class.
To learn about how to manage an active-shooter situation on campus or
elsewhere, consider viewing this video https://youtu.be/NIKYajEx4pk.

Deployed If you are a deployed active duty military student and feel that you may need a
active duty special accommodation due to that unique status, please contact your
military instructor to discuss your circumstances.
students

Syllabus

Date Topic Lecture Notes, Readings, Homeworks

History and positioning of AI

Motivating AI. Dangers of AI and

Tue, [slides] History and positioning of AI
AGI.
Aug. 23
Early history
Expert systems
Date Topic Lecture Notes, Readings, Homeworks
History and positioning of AI

Neural networks
Thu, The two intellectual traditions of
Aug. 25 logic vs neural networks
A melting pot of other ideas
The agent view of AI

Uninformed search

Reflex agents
Tue, Search problems
[slides] Uninformed search
Aug. 30 Depth first and breadth first search
Uniform cost search

Thu,
Sep. 1
Tue,
Sept. 6
Informed search: A* search and
heuristics

Informed search methods

Thu,
Heuristics [slides] Informed search
Sep. 8
Greedy search
A* search
Graph search

Game playing and adversarial search

Types of games
Tue, Adversarial search, minimax
[slides] Adversarial search
Sep. 13 The problem of depth
Evaluation functions
Alpha Beta pruning

Expectimax search and utilities

Thu, Expectimax search [slides] Expectimax search and

Sep. 15 Refresher about probabilities utilities
Utilities and rationality

Markov decision processes 1

Defining MDPs: policies and

Tue,
utilities [slides] Markov Decision Processes 1
Sep. 20
Optimal policy, value of state, value
of Q-state

Thu, Midterm 1 - Introduction to

Sept. 22 Adversarial Search
Date Topic Lecture Notes, Readings, Homeworks
Markov decision processes 2
Tue,
[slides] Markov Decision Processes 2
Sep. 27 Policy iteration

Reinforcement learning 1
Thu,
Reinforcement learning as a twist [slides] Reinforcement learning 1
Sept. 29
on MDPs

Model-based and model-free

Tue, learning
Oct. 4 Temporal difference learning

Reinforcement learning 2

Thu, Exploration vs. exploitation, regret

[slides] Reinforcement learning 2
Oct. 6 Generalization across states
Policy search

Probability

Tue, Random variables

[slides] Probability
Oct. 11 Joint and marginal distributions,
conditional distribution

Product rule, chain rule, Bayes'

rule
Thu,
Oct. 13 Inference
Independence

Markov models

Tue, Markov chains

[slides] Markov models
Oct. 18 Conditional independence
Stationary distributions

Hidden Markov models

Thu,
Hidden Markov models [slides] Hidden Markov models
Oct. 20
Example: robot localization

Tue, Most likely explanation

Oct. 25 Speech recognition

Thu,
Oct. 27
Tue, Midterm 2 - from MDP to Markov
Nov. 1 Chains
Date Topic Lecture Notes, Readings, Homeworks
Particle filters and applications of
HMMs

Thu, Particle filters [slides] Particle filters and

Nov. 3 Robot localization with particle Applications of HMMs
filters
Dynamic Bayes nets

Classification, principles of machine

learning, naive Bayes

Classification
Model-based classification
Tue, [slides] Classification and naive
Naive Bayes
Nov. 8 Bayes
Spam filter example
Generalization and overfitting
Parameter estimation

Thu,
Nov. 10
Tue, Classification and machine
Nov. 15 learning cont'd

Neural networks
Thu,
Perceptron [slides] Perceptrons
Nov. 17

Machine learning background of deep

learning

History and impact

Machine learning background
Tue,
Loss functions: squared, cross- [slides] Neural Networks I
Nov. 22
entropy, softmax
Optimization, stochastic gradient
descent
Backpropagation

Thu,
Thanksgiving break - no class
Nov 24
Feedforward neural networks
Tue,
Feedforward networks
Nov. 29
Stochastic gradient descent
Date Topic Lecture Notes, Readings, Homeworks
Convolutional neural networks

Convolutions
Thu,
Convolutional filters in neural [slides] Convolutional networks
Dec. 1
networks
Pooling layers

Thu,
Final exam Thursday December 8,
Dec. 9
2022 10:00 AM - 12:50 PM