0% found this document useful (0 votes)
15 views32 pages

2 Agent and Environment

Uploaded by

ashishaustin05
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
15 views32 pages

2 Agent and Environment

Uploaded by

ashishaustin05
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 32

Course Name - Artificial Intelligence

Course Code - SHIT601

Semester – IV

Dr. Rajani, IBS Bangalore

1
Artificial Intelligence – SHIT601 - Syllabus
• Introduction to the course, What is AI, Fundamentals of AI, usage of AI in a Business Perspective
• Basic Programming and other Data structural (DS) concepts for AI
• Agents and Environments, Good Behaviour: The Concept of Rationality, the Nature of Environments, Structure of Agents.
• Constraint Satisfaction Problems, Backtracking Search for CSPs. Local Search for Constraint Satisfaction Problems, The
Structure of Problems.
• To Study Informed Search and Exploration: Heuristic Function, Hill Climbing Function, 8 queen problem
• To Study First order logic: Representation Revisited Syntax and Semantic of First-order Logic, Models for first order logic,
Symbols and interpretations Atomic Sentences Complex Sentences Quantifiers
• Inference in First-order Logic Forward and Backward Chaining
• Knowledge Representation
• Uncertain Knowledge and reasoning
• Probability Reasoning
• Deep Learning, Q Learning and applications, Neural Networks, Optimizing Processes

2
Resources for the course- Books

Recommended Text Book:


• Artificial Intelligence: Making a System Intelligent, Dr. Nilakshi Jain, Wiley

Suggested Reference Books:


• Artificial Intelligence A Modern Approach – Second Edition, Stuart Russell, Peter
Norvig, Prentice Hall
• Artificial Intelligence - Second Edition – Elaine Rich, Kevin Knight, TATA McGraw-Hill.
• Artificial Intelligence - SK Bansal, 2012

3
Expected Learning Outcomes:

At the end of the course, the student is expected to

•Understand the significance of Artificial Intelligence.


•Understand some of the techniques used in AI to derive solutions to business and/or
real time problems
•Realize the use of AI in optimizing business processes.

4
Evaluation Timelines and Weightage

Component Component Number Expected slot / due date Weightage


Class Participation 1 Session 33 10
Test 1 Session 12 20
Test 2 Session 22 20
Test /Seminar 3 Session 32 10
End Term 4 After session 33 40

5
Introduction to AI

Artificial Intelligence is composed of two words Artificial and Intelligence, where


Artificial defines "man-made," and intelligence defines "thinking power", hence AI
means "a man-made thinking power.“

Definition
"It is a branch of computer science by which we can create intelligent machines which
can behave like a human, think like humans, and able to make decisions."

6
Agents
and
Environments

7
An agent can be anything that can be viewed as perceiving its environment through sensors
and acting upon that environment through actuators.

In artificial intelligence, an agent is


a computer program or system
that is designed to perceive its
environment, make decisions and
take actions to achieve a specific
goal or set of goals.

8
•Perceiving its environment through sensors and

•Acting upon that environment through actuators

9
Example:

Human agent – Sensor and Actions ??

Robotic agent - Sensor and Actions ??

Software agent - Sensor and Actions ??

10
11
Examples of Agents and Environments

12
Good Behaviour- The Concept of Rationality

The agent operates independently, not directly controlled by a human operator.

Artificial intelligence is defined as the study of rational agents.

A rational agent could be anything that makes decisions, such as a person, firm,
machine, or software. It carries out an action with the best outcome after
considering past and current percepts.

The agents act in their environment. The environment may contain other agents.

13
Properties of Rational Agent
• Omniscience : Expected Vs Actual Performance

• Learning Capability : A priori Knowledge

• Autonomous in decision making: An agent is autonomous if its behaviour is determined by


its own experience (with ability to learn and adapt)

The concept of right thing is mainly based on performance measure.

For designing an agent we need to specify the PEAS.

14
Agent terminology

• Performance measure of agent: It is the criteria determining the success of an agent.

• Behavior/action of agent: It is the action performed by an agent after any specified sequence of the
percepts.

• Percept: It is defined as an agent’s perceptual inputs at a specified instance.

• Percept sequence: It is defined as the history of everything that an agent has perceived till date.

15
Agent terminology
Agent function: It is defined as a map from the precept sequence to an action.

Agent function, a = F(p)


where p is the current percept, a is the action carried out, and F is the agent function.

F maps precepts to actions


F :P → A

where P is the set of all precepts, and A is the set of all actions.

Generally, an action may be dependent of all the precepts observed, not only the current percept,
ak = F( p0 p1 p2 … pk )

Where p0 , p1, p2, … ,pk is the sequence of percepts recorded till date, ak is the resulting action carried out
and F now maps percept sequences to action

16
Vacuum cleaner problem

Performance measure of vacuum cleaner agent: All the rooms are well cleaned.
Behavior / action of agent: Left, right, suck and no-op (Doing nothing).
Percept: Location and status, for example, [A, Dirty].
Agent function: Mapping of precept sequence to an action

17
Percept sequence Action

[A, Clean] Right

[A, Dirty] Suck

Left
[B, Clean]
Percept sequence Suck
[B, Dirty]
Right
[A, Dirty], [A, Clean]
Suck
[A, Clean], [B, Dirty]
Left
[B, Dirty], [B, Clean]
Suck
[B, Clean], [A, Dirty]
No-op
[A, Clean], [B, Clean]
No-op
[B, Clean], [A, Clean]

18
PEAS for vacuum cleaner
Performance Measure cleanness, efficiency: distance travelled
to clean, battery life, security

Environment room, table, wood floor, carpet, different


obstacles

Actuators wheels, different brushes, vacuum


extractor

Sensors camera, dirt detection sensor, cliff sensor,


bump sensors, infrared wall sensors

19
Example: PEAS description for An Automated taxi driver

Agent type: Taxi Driver

● Performance measure: safe, fast, legal, comfortable trip, maximise profits

● Environment: Roads, other traffic, customers, person walking around.

● Actuators: Steering, accelerators, brake, signal, horn, display.

● Sensors: Cameras, sonar, speedometer, GPS, odometer, accelerometer, engine sensors, keyboard.

20
Internet shopping agent

21
Internet shopping agent

22
23
Properties of Task Environment

1. Fully Vs Partially Observable


2. Deterministic Vs Stochastic
3. Episodic Vs Sequential
4. Static Vs Dynamic
5. Discrete Vs Continuous
6. Single agent Vs Multi agent

24
Fully observable (accessible) vs. partially observable (inaccessible)

Fully observable if agents sensors detect all aspects of environment relevant to choice of action
Example Chess – the board is fully observable, as are opponent’s moves.

Could be partially observable due to noisy, inaccurate or missing sensors, or inability to measure everything that
is needed
Driving – what is around the next bend is not observable (yet).

25
Deterministic vs. stochastic (non-deterministic)

Deterministic - the next state of the environment is completely predictable from the current state and the action
executed by the agent
Example - Tic Tac Toe game

Stochastic - the next state has some uncertainty associated with it


Examples: physical world: Robot

● If the environment is fully observable then it is deterministic.

● Most real situations are stochastic.

26
Episodic vs. sequential

In episodic task environment the agents experience is divided into number of episodes and
each episode the agent receives the input and takes single action.
The next episode the action do not depend on the action taken in the previous episode.

Examples: mail sorting system

In Sequential environment the current decision can affect all the future decisions.
Example: Chess game

27
Discrete vs. continuous

Discrete - time moves in fixed steps, usually with one measurement per step (and perhaps
one action, but could be no action).
E.g. a game of chess

Continuous - Signals constantly coming into sensors, actions continually changing.


E.g. driving a car

28
Static vs. Dynamic

Dynamic - if the environment may change over time. Other agents in an environment make it dynamic
E.g. – Playing football, other players make it dynamic

Static - if nothing (other than the agent) in the environment changes


E.g. - Expert systems usually static (unless knowledge changes)

29
Single agent vs. Multi agent

An agent operating by itself in an environment is single agent!


Human users are an example of another agent in a system
E.g. Doctor and Patient

Multi agent is when other agents are present!


E.g. Other players in a football team (or opposing team),
other cars in a taxi driver

30
31
32

You might also like