UNIT-II 4MCA AI and Machine Learning
UNIT-II 4MCA AI and Machine Learning
Learning
UNIT-II
Problem Solving, General Problem Solving, Production Systems,
Control Strategies Forward and Backward Chaining,
Searching:Searching for Solutions, Uniformed Search Strategies –
Breadth First Search, Depth First Search. Heuristic Search, Greedy
Best First Search, Knowledge Representations Mapping & Issues
Problem Solving in Artificial Intelligence
1. Search Algorithms
Search algorithms are foundational in AI, used
to explore possible solutions in a structured
manner. Common types include:
– Uninformed Search: Such as breadth-first and
depth-first search, which do not use problem-
specific information.
– Informed Search: Algorithms like A* that use
heuristics to find solutions more efficiently.
Techniques for Problem Solving in AI
Optimization Techniques
AI often tackles optimization problems, where
the goal is to find the best solution from a set
of feasible solutions. Techniques such as linear
programming, dynamic programming,
and evolutionary algorithms are commonly
employed.
Techniques for Problem Solving in AI
Machine Learning
• Machine learning techniques allow AI systems
to learn from data and improve their problem-
solving abilities over time. Supervised,
unsupervised, and reinforcement learning
paradigms offer various approaches to adapt
and enhance performance.
Techniques for Problem Solving in AI
– A State Space. Set of all possible states where you can be.
– A Start State. The state from where the search begins.
– A Goal State. A function that looks at the current state
returns whether or not it is the goal state.
• The Solution to a search problem is a sequence of actions, called
the plan that transforms the start state to the goal state.
• This plan is achieved through search algorithms.
Types of Search Algorithms
• 3. Structural Knowledge
• What it is: This type of knowledge deals with the relationships between entities or
concepts, organizing knowledge into structures like hierarchies or networks.
• Example: Understanding that a dog is a type of animal and a poodle is a type of dog
reflects structural knowledge.
• 4. Meta Knowledge
• What it is: Meta knowledge is knowledge about knowledge. It refers to
understanding which knowledge to use in a particular situation or context.
• Example: In a medical diagnostic system, knowing which symptoms to prioritize
when diagnosing a disease is an example of meta knowledge.
• 5. Heuristic Knowledge
• What it is: Heuristic knowledge consists of experience-based rules of thumb or best
practices that help in making decisions quickly without complete information.
• Example: A heuristic might be “If a website loads slowly, refresh the page” — it’s
not always guaranteed to work, but it’s often useful.
Cycle of Knowledge Representation
Cycle of Knowledge Representation
• 3. Frame Representation
• Description: Frames represent knowledge in structured “frames” or
templates, each containing information about an object or situation.
Each frame holds slots that store attributes or related information.
• Example: A frame for a car might include slots for attributes such as
“make,” “model,” “color,” and “owner.” This structure allows for easy
organization of knowledge about similar objects.
• Strengths: Frames are effective for representing structured,
hierarchical knowledge and allow easy modification or extension of
attributes.
• Weaknesses: Limited flexibility when dealing with highly dynamic or
unpredictable information.
Techniques of Knowledge Representation in AI
• 4. Production Rules
• Description: Production rules consist of “if-then” statements
that define actions based on conditions. This method is often
used in rule-based systems and expert systems.
• Example: “If the temperature is above 30°C, then turn on the
air conditioning” is a simple production rule that can guide the
behavior of a thermostat system.
• Strengths: Simple and intuitive, production rules are effective
in systems that need to apply a set of predefined rules for
decision-making.
• Weaknesses: Can lead to rule conflicts and may become
unmanageable in large systems with numerous rules.
Issues in Knowledge Representation
Mapping
• 1. Ambiguity and Vagueness
• Issue: Natural language is often ambiguous and vague,
leading to multiple interpretations of the same
statement.
• Example: The sentence "I saw her duck" can mean seeing
a bird or observing someone lower their head.
• Challenge: Designing KR systems that can accurately
interpret context and resolve ambiguity.
• Solution Approaches:
– Contextual Ontologies to provide context-specific meanings.
– Probabilistic Reasoning to handle uncertainty and ambiguity.
Issues in Knowledge Representation
Mapping
• 2. Incomplete and Uncertain Knowledge
• Issue: In the real world, information is often incomplete or
uncertain. AI systems must make decisions with partial data.
• Example: Diagnosing a disease with incomplete symptom
data.
• Challenge: Representing and reasoning with incomplete or
probabilistic information.
• Solution Approaches:
– Probabilistic Graphical Models (e.g., Bayesian Networks) to
represent uncertainties.
– Fuzzy Logic to model vague concepts like "hot" or "cold."
Issues in Knowledge Representation
Mapping
• 3. Complexity and Scalability
• Issue: As knowledge bases grow, maintaining consistency,
accuracy, and performance becomes challenging.
• Example: Large-scale knowledge graphs (like Google's
Knowledge Graph) require efficient storage and retrieval
mechanisms.
• Challenge: Ensuring scalability without compromising on
reasoning speed and accuracy.
• Solution Approaches:
– Distributed Knowledge Bases to manage large-scale data.
– Efficient Indexing and Search Algorithms to speed up information
retrieval.
Issues in Knowledge Representation
Mapping
• 4. Knowledge Acquisition Bottleneck
• Issue: Manually encoding expert knowledge is time-
consuming and error-prone.
• Example: Creating expert systems requires domain experts to
provide detailed rules.
• Challenge: Automating the extraction and updating of
knowledge from dynamic sources.
• Solution Approaches:
– Machine Learning and NLP for automatic knowledge extraction
from text.
– Crowdsourcing and Collaborative Knowledge Platforms like
Wikidata.
Issues in Knowledge Representation
Mapping
• 5. Representation of Common-Sense Knowledge
• Issue: AI systems lack basic common-sense reasoning,
which humans take for granted.
• Example: Understanding that "water is wet" or "people
cannot walk through walls."
• Challenge: Formalizing everyday knowledge in a way that
machines can use it for reasoning.
• Solution Approaches:
– Common-Sense Knowledge Bases like ConceptNet and Cyc.
– Neuro-Symbolic AI to integrate symbolic reasoning with neural
networks.
Issues in Knowledge Representation
Mapping
• 6. Semantic Heterogeneity
• Issue: Different systems use varying terminologies and
structures, leading to interoperability issues.
• Example: One system may use "car" while another uses
"automobile" to refer to the same concept.
• Challenge: Ensuring consistent interpretation across diverse
systems and domains.
• Solution Approaches:
– Ontologies and Semantic Mappings to standardize terminologies.
– Ontology Alignment and Integration Techniques to resolve
semantic conflicts.
Issues in Knowledge Representation
Mapping
• 7. Reasoning and Inference Limitations
• Issue: Logical reasoning can be computationally expensive
and may not handle exceptions well.
• Example: Rule-based systems struggle with contradictory
rules or incomplete data.
• Challenge: Balancing expressiveness and computational
efficiency in reasoning systems.
• Solution Approaches:
– Non-monotonic Logic to handle exceptions and changing
knowledge.
– Approximate Reasoning Techniques for faster, scalable reasoning.
Issues in Knowledge Representation
Mapping
• 8. Dynamic and Evolving Knowledge
• Issue: Real-world knowledge is dynamic and constantly
changing, requiring continuous updates.
• Example: News events, scientific discoveries, and social
trends evolve over time.
• Challenge: Keeping knowledge bases up-to-date and
relevant.
• Solution Approaches:
– Incremental Learning Algorithms to adapt to new data.
– Automated Knowledge Extraction from news feeds and social
media.
Issues in Knowledge Representation
Mapping
• 9. Ethical and Bias Concerns
• Issue: Knowledge bases can inadvertently inherit biases
present in data or human input.
• Example: Biased word associations in NLP models (e.g.,
gender stereotypes).
• Challenge: Ensuring fairness, transparency, and
accountability in AI reasoning.
• Solution Approaches:
– Bias Detection and Mitigation Techniques in machine learning.
– Ethical Ontologies to enforce fairness constraints in reasoning
systems.
Issues in Knowledge Representation
Mapping
• 10. Lack of Standardization
• Issue: No universal standard for knowledge representation
formats or ontologies.
• Example: Different domains (e.g., healthcare, finance) use
distinct knowledge structures.
• Challenge: Achieving interoperability and data sharing
across heterogeneous systems.
• Solution Approaches:
– Adopting Semantic Web Standards like RDF, OWL, and SPARQL.
– Community-Driven Ontologies for domain-specific
standardization.
Applications of Knowledge Representation in AI