AICP23 - 24 06.chapter8
AICP23 - 24 06.chapter8
DEPARTMENT OF PSYCHOLOGY
Thinking and problem solving
1 2
Introduction Introduction
3 4 1
5/19/2024
5 6
Problem solving
Cognitive Psychology
7 8 2
5/19/2024
Problem solving
Behaviourist approaches to problem-solving
• First studies on problem solving: behaviourism (USA
from about 1910 to 1960)
• Explanation: stimulus–response links.
• Participants to experiment: animals (assumption
that could be extrapolated to humans)
• Findings (p.e. Thorndike, 1898):
• solution by trial and error Figure 8.2 Thorndike’s box (Thorndike, 1898).
• Performance improves through reproducing learned
responses.
https://www.youtube.com/watch?v=Vk6H7Ukp6To
Cognitive Psychology
9 10
11 12 3
5/19/2024
13 14
Problem solving
The Gestalt approach to problem-solving
• Example of problems: Maier’s (1931) two-string
problem
• participants have to tie together two strings that are
hanging from the ceiling.
• the two strings are too far apart to be simultaneously
held by the two hands.
• Various objects are in the room
Cognitive Psychology
15 16 4
5/19/2024
17 18
Problem solving
The Gestalt approach to problem-solving
• Mental sets Phenomenon (Einstellung effects) - an idea
that comes immediately to mind during a familiar
problem blocks alternative solutions from being taken
into account.
19 20 5
5/19/2024
21 22
23 24 6
5/19/2024
25 26
Problem solving
Problem spaces, states, and search
• The number of possible moves in each state is small
(a maximum of two moves per state).
• Moving the tower to the middle peg (left part of the
figure) considerably increases the length of the
solution, and requires some backtracking.
• Things get quickly more complicated: try drawing
the problem space of the three-disk Tower of
Figure 8.5 Problem space of the two-disk tower of Hanoi. Hanoi!
Cognitive Psychology
27 28 7
5/19/2024
29 30
Problem solving
Problem spaces, states, and search
• Kotovsky et al. (1985)
• on average two minutes to solve the problem in the
Tower of Hanoi version
• 14 minutes to solve the monster-move version.
• It took even longer (29 minutes) to solve another version
(the monster-change) in which the globes shrink and
expand.
• These differences can be explained by the difficulties
Figure 8.6 Monsters-move problem: Example of the start state and goal state of the involved in learning and applying rules, and increased
Monster-Move problem, with the corresponding states of the tower of Hanoi. working memory load.
Cognitive Psychology
31 32 8
5/19/2024
• Strengths of problem space theory(Gobet & Lane, 2015). • One relative weakness of this approach is that the
• problem space theory offers a normative theory of problem-solving
• participants used identifiable strategies, often means–end analysis.
problems that are studied tend to be puzzles:
• an analysis of the task environment and its complexity often made it possible artificial and fairly simple problems.
to predict the strategies used by the participants and their solution times.
• this analysis and the generation of external problem spaces make it possible
to measure the differences between human participants and an ideal solver.
• In general, the results show that people do not opt for the optimal solution
but rather use heuristics, which supports Simon’s theory of bounded
rationality.
• the models developed in this tradition tend to be well specified, and
are often implemented as computer programs.
• Examples include the Logic Theorist (Newell et al., 1958), one of the very first
artificial intelligence (AI) programs, which proves theorems in mathematical
logic and has led to a theory of creativity
33 34
35 36 9
5/19/2024
DEPARTMENT OF PSYCHOLOGY
Thinking and problem solving
37 38
Creativity Creativity
• Creativity = form of problem-solving with more complex problems (e.g. • Most of the support for Wallas’s theory comes from biographies
discovering a new law in psychology) and autobiographies of creative scientists and artists.
• Wallas (1926) proposed that creativity involves four broad stages (The first three
based on work by Poincaré,1913) • BUT self-reports are unreliable – human memory is reconstructive
• The first stage, preparation, is characterised by conscious attempts to solve the and cannot be fully relied upon for old memories!
problem, often from multiple directions. With more difficult problems, these attempts • Also the history of art and science contains many counter-
are unsuccessful,
• One must move to the second stage, incubation. The problem is left aside, but examples that clearly show that creators depend on a systematic
unconscious processing remains active and multiple ideas get combined behind the search for a solution rather than unconscious processing.
scenes, so to speak. (example Edison)
• This is followed by the illumination stage, where the solution comes as a flash of
insight, sometimes at an unexpected moment.
• Finally, there is the verification stage, where there is a conscious and deliberate effort
to check the solution. • The most influential theory of creativity is Newell and Simon’s
• Wallas’s four-stage theory emphasises unconscious processing, but the (1972) problem space theory
experimental evidence for this mechanism is sparse. • nothing mysterious about creativity: it is just a kind of problem-solving.
• P.e. Penaloza and Calvillo (2012) that a two-minute incubation was beneficial, • Creators selectively explore a problem space, using their knowledge and
but only when the problems were presented with misleading clues. a variety of strategies to keep the search efficient.
• Strong support from two sources: experimental psychology and artificial
intelligence.
39 40 10
5/19/2024
Creativity Creativity
• Experimental psychology support: Qin and Simon • Artificial intelligence support: a number of
(1990) carried out a ‘replication’ of Kepler’s computer programs embodying selective search can
discovery of the Third Law of Planetary Motion, be described as showing creativity.
which describes the motion of planets around the • Strong support for the theory, as this shows that the
Sun – an important discovery in astronomy. mechanisms proposed by problem space theory are
• They gave undergraduate students the data that Kepler sufficient for creativity.
used; however, there was no information about the • There are two main approaches, which sometimes
context (i.e. the labels ‘distance’ and ‘period’ were overlap.
replaced by X and Y). • The first approach is mainly interested in AI: the use of computers
to produce intelligent or creative behaviour, not necessarily in the
• The correct equation was found within one hour by about same way as humans.
one third of the students; in line with problem space • The second approach, falling under the umbrella ‘computational
theory, the successful students performed a limited modelling’, embodies theories of human behaviour that are
search with efficient heuristics. tested against empirical data.
41 42
43 44 11
5/19/2024
Analogy Analogy
• Analogy making is another important type of thinking. • Making analogies is very hard indeed
• It can be defined as the transfer of the solution of one • Finding: Series of experiments carried out by Gick and Holyoak
(1980) using Duncker’s (1945) tumour problem
problem to another problem. It is an efficient and • Question: providing analogical knowledge to the participants improve
sometimes creative reuse of knowledge. their success rate?
• Story about a general wanting to attack a well-defended fortress. The
• Examples of analogy from history of science: Rutherford’s roads leading to it were mined and would explode in the presence of
use of the solar system to explain the structure of the atom. large groups of soldiers; thus, it was not possible to send the entire army
on a single road. What the general did was to divide his force into small
• Models to explain analogy making (Gentner, 1983; Lovett & groups that approached the fortress simultaneously from different
Forbus, 2017) usually incorporate two mechanisms. directions. When they converged on the fortress, the whole army could
attack it with full power.
• First, an analogue or source (i.e. a problem similar to the one • Clearly, the fortress problem provides an analogy to the tumour problem:
currently faced) must be retrieved from long-term memory (p.e solar the soldiers correspond to the rays, the general to the surgeon, the
system) fortress to the tumour, and the risk of detonating mines to the risk of
• Second, a mapping should be made between the source and the hurting healthy tissue.
current or target problem (correspondence between the sun and the • In both cases, the solution is to spread one’s forces (the soldiers and the
rays, respectively) before hitting the target.
atom nucleus).
45 46
47 48 12
5/19/2024
Summary Reasoning
• The main subfields of the psychology of thinking are • Do people follow the laws of logic when they think? If
problem-solving, expertise, creativity, analogy making,
reasoning, and decision-making. not, how they depart from these laws?
• Behaviourists proposed that problem-solving can be • Research can be divided into two main topics:
explained by learning stimulus–response links. Gestalt • deductive reasoning, where the conclusions necessarily follow
psychologists devised clever experiments, but their
theoretical explanations were vague. from the premises
• Deductive reasoning task = A problem that has a well-defined
• Problem space theory proposed that problem-solving structure in a system of formal logic where the conclusion is certain.
consists of search within a problem space. It has received
support from both experiments and computer simulations.
The theory has also been successfully applied to the • inductive reasoning, where only probable conclusions can be
subfields of expertise and creativity. derived from the available information
• Some authors have proposed that analogy making is at the • Inductive reasoning task = A problem that has a well-defined
heart of thinking, but experiments have shown that people structure in a system of formal logic where the conclusion is highly
struggle when trying to use analogies. probable but not necessarily true.
49 50
Reasoning Reasoning
Deductive reasoning Deductive reasoning – Truth tables
• Basics of deductive reasoning (form of logic). • Truth table for the logical conjunctive AND.
• building blocks: propositions (e.g. ‘the sky is blue’), which A B A AND b
can be either true or false.
T T T
• propositions can modified or joined by logical operators
T F F
(NOT, AND, OR, IF-THEN …)
F T F
• Propositional logic allows one to establish the truth of
modified propositions F F F
• Example
• P1 = ‘the sky is blue’ is TRUE , P1 =‘roses are red’ is TRUE
• compound proposition P1 AND P2 is true?
• formalism of truth tables to deduce the correctness of a new
proposition mechanically
51 52 13
5/19/2024
A B A AND b
T T T
Reasoning Reasoning T F F
F F T
• Truth table for the conditional operator IF-THEN. • Correct and incorrect inferences
A B A AND b • It is also possible to assume that the implication is true, to give
T T T
the truth value of A (or B), and ask what can be inferred about the
truth value of the other statement.
T F F • Example
F T T • ‘IF I study hard, THEN I’ll pass the exam’ TRUE
• I studied hard; can we conclude that I’ll pass the exam?
F F T
• From Table if A is true and ‘IF A THEN B’ is also true, then B is also true.
=> correct inference to conclude that I’ll pass the exam. This type of
• P1 = ‘it’s raining; P2 = I’m wet inference is called the modus ponens.
• if statement A is false, then the value of statement B does not matter: the IF- • The meaning of the statements is irrelevant! what matters is their
THEN statement is always true. form. Example:
• Important consequences: if a statement is incorrect in a logical system, then by a • If psychology is a science, then the moon is blue
chain of inferences any statement can be derived. • Psychology is a science
• Thus, if one or several statements are false in a scientific theory, then anything • Therefore the moon is blue
can be concluded from this theory.
• This is a correct inference, even though it is semantically incorrect.
53 54
A B A AND b A B A AND b
T T T T T T
Reasoning T F F Reasoning T F F
F F T F F T
• Correct and incorrect inferences • Correct and incorrect inferences
• The second correct inference is called modus tollens. • Modus ponens and modus tollens are the only two
• ‘IF P THEN Q’ is true
• Q is not true; the inference is: therefore P is not true. This valid inferences with conditional problems.
inference can be abbreviated as ‘IF NOT Q then NOT P’. • Two inferences are incorrect, although very
• This is a much less intuitive rule. Modus tollens is at the heart common.
of much experimental psychology, where the aim of running an
experiment is to refute a theory. • Affirming the consequent
• Consider the following example, which uses some information • ‘IF P THEN Q’ is true
you learned in this chapter. • Q is true, and the conclusion is ‘Therefore P is true’.
• If Gestalt theory is correct, then solving insight problems requires an
‘Aha!’ experience (IF P THEN Q) • Why is it incorrect?
• Insight problems are sometimes solved without an ‘Aha!’ experience • Example: if it rains, then I’m wet; I’m wet. To conclude that it
(Webb et al., 2016) (not Q) rained is incorrect, because I could be wet for other reasons (for
• Therefore, Gestalt theory is incorrect (not P). example, I took a shower).
55 56 14
5/19/2024
A B A AND b
T T T
Reasoning T F F Reasoning
Deductive reasoning F T T Deductive reasoning
F F T
57 58
Reasoning
Deductive reasoning
• Empirical results
• Finding: Wason’s (1968) selection task
• You are presented four cards
• decide whether the following rule is correct or not:
• if a card has a vowel on one side, it has an even number on the Figure 8.7 The Wason Selection Task
other side.
• You should turn over only the card(s) needed for testing the rule. Note: The rule is ‘If there is an A on one side of the card, then there is a 2 on the other
Which card(s) do you turn over? side of the card.’ Select only those cards that would need to be turned over in order to
decide whether or not the rule is correct. Each card has a letter on one side and a
number on the other.
Cognitive Psychology
59 60 15
5/19/2024
Reasoning Reasoning
Deductive reasoning Deductive reasoning
• Empirical results • Empirical results
• The card ‘A’ is a correct choice, and this is an application of
the modus ponens. Intuitively, this makes sense: if there is
no even number on the back of ‘A’, the cards would not • Ample evidence that people struggle with reasoning
follow the rule. tasks when they are presented with abstract material.
• By contrast, the card ‘2’ is incorrect – it is equivalent to • They do much better when the material consists of
affirming the consequent. concrete information.
• What we need to do is to try to falsify the rule, using modus • Example: variation of Wason’s task.
tollens; this can be done by turning over the card ‘7’ and • As a police officer, you must implement the rule that only people over
18 can drink beer in a pub. So, the rule is: if a customer in the bar is
expecting to see a ‘K’ on the other side. drinking beer then that individual must be older than 18. You are a
• Only few people choose the correct cards. police officer trying to enforce the rule, and you see four customers in
the bar. The first customer is having a beer; the second is sipping
• Most people select the cards ‘A’ and ‘2’ (46 per cent) coke; the third is clearly older than 18; and the last seems to be 16
• even ‘A’ alone (33 per cent) years old
• Only 4 per cent selected the two correct cards, ‘A’ and ‘7’ (Johnson- • Which customer(s) do you need to check?
Laird & Wason, 1970).
61 62
Reasoning
Deductive reasoning
• Empirical results
• The problem is an isomorph to Wason’s selection
task
• Results: about 75 per cent of the participants get
the answer correct: the person drinking beer and
Figure 8.8 Drinking beer
the person looking under 18 (Griggs & Cox, 1982).
• Remember that only 4 per cent of the participants
got the correct answer in the abstract version.
Cognitive Psychology
63 64 16
5/19/2024
Reasoning Reasoning
Deductive reasoning Deductive reasoning
• Theories • Theories
• A first group of theories propose that people use • Second approach: mental models (Johnson-Laird, 2001),
content-free logical rules, similar to those used in • people build an internal representation of the information
formal logic (Rips, 1994) based on abstract rules. contained in a problem
• Reasoning consists in applying these rules in the same way • then mentally inspect this representation to establish whether
logicians use them to derive a proof. Thus, in ideal conditions,
human reasoning would be perfect. it is correct. In particular, they try to find counter-examples
• However, people commit errors because they fail to that would invalidate an inference.
understand the statements of the problems, use the wrong • The mental model approach has been predominantly
strategy to tackle the problem, or suffer from limits in working
memory. used with a type of reasoning problems called syllogism,
• Weakness: they assume full rationality only to add a such as:
number of ad hoc assumptions to limit it and thus • All the artists are beekeepers.
explain the pattern of errors seen in the data. • Some of the beekeepers are chemists.
• Can we conclude that all the artists are chemists?
65 66
Reasoning Reasoning
Deductive reasoning Deductive reasoning
• If you are told that Caroline is taller than Hannah and that Hannah is • Finding: participants perform better on the concrete version of Wason’s
taller than Julian, it is likely that you imagine these persons in a row in selection task
your mind’s eye. • => theory based on pragmatic reasoning schemas (Cheng and Holyoak,
• If you are now told that Paul is smaller than Julian, you can add Paul to 1985).
your mental picture, and you can ‘see’ that Paul is the smallest person. • schemas are general and abstract, but less so than logical rules as they are
• Mental models in reasoning are based on the same idea, but the details constrained by the satisfaction of a goal.
rapidly become more complicated. • Example: permission schema (if one wants to do X, then one must satisfy
condition Y).
• Mental model theory does a fairly good job at predicting the time it • In everyday reasoning, people do not use rules or construct internal
takes participants to solve reasoning problems of varying difficulty. representations of the problem at hand, but rather use schemas based on their
experience.
• Weaknesses of mental models: • For example, in the pub version of Wason’s task, but not in the original abstract
• gives importance to the way the statements of a problem are encoded to build version, people can use a permission schema. When it is difficult to apply such a
models, it lacks mechanisms specifying how encoding occurs. schema, as in abstract problems, then people tend to make mistakes.
• Prediction: problems requiring the construction of many mental models are • Strength: accounts for the fact that people do better with concrete
harder to solve, because this drains working-memory resources. BUT empirical
data do not support problems than abstract problems.
• verbal protocols offer little evidence that people try to find counter-examples, • Weakness:
which is a central assumption of the theory.. • it is silent about the first phase of reasoning, where verbal information is
encoded.
• It is limited to problems of the type IF-THEN, and does not say much about other
Cognitive Psychology
types of reasoning problems. Cognitive Psychology
67 68 17
5/19/2024
Reasoning Reasoning
Inductive reasoning Inductive reasoning
69 70
Reasoning Reasoning
Inductive reasoning Inductive reasoning
• Inductive reasoning: • H: Deductive and inductive reasoning rely on different
• Experimenters have tried all sorts of manipulations, but it has turned out
surprisingly difficult to improve participants’ performance in the 2–4–6 task. Ù
mechanisms.
• One of the rare successful manipulations consists in telling participants that the • Disconfirmation: Stephens et al. (2018)
experimenter has two rules in mind, the DAX rule and the MED rule. • Using three data sets, they compared models that assumed
• DAX is the original ‘any sequence of increasing numbers’ rule, while MED covers two different processes with models assuming only one
all the number triplets not following that rule (so MED is the complement of process.
DAX: any triplet not made of ascending numbers; e.g. 2–2–8).
• Only one model was able to account for all the data, and it was
• At the beginning, participants are given the triplet 2–4–6 as an instance of DAX. a model which incorporated only one mechanism: argument
• In this version of the experiment, about twice as many participants state the strength. This strength is evaluated on a single dimension, with
correct rule in their first attempt, as compared to the standard version of the different decision thresholds used for inductive and deductive
task (Wharton et al., 1993). judgments.
• However, participants took advantage of the two rules only if they were told • If Stephens et al.’s conclusions are replicable, this means that
explicitly that they are complementary. One possible explanation for the
increased success in this experiment is that participants do not need to refute a the experimental results on deductive reasoning and inductive
rule; rather, what they do is to confirm its complement. reasoning can be explained by a single theory, which would be
an important step in our understanding of thinking.
71 72 18
5/19/2024
73 74
• Example of how expected utility is computed. • BUT people are probably not maximisers (Simon
• You have to choose between two lottery tickets (i.e. two bounded rationality)
options).
• First ticket • Finding: Kahneman and Tversky
• outcome 1, probability .1: winning £10 • No computation of expected utility
• Outcome 2, probability .9: losing £1.
• Expected value i= (£10 x .10) + (–£1 x .90) = £1.00 – £0.90 = £0.10. • humans often violate the predictions of the theory.
• With this ticket, you are expected to win £0.10. • humans often use heuristics, but that these heuristics can
• Second ticket lead to systematic biases.
• outcome 1, probability .1: winning £20
• Many heuristics. Examples
• Outcome 2, probability .9: losing £2.
• Expected value i= (£20 x .10) + (–£2 x .90) = £2.00 – £1.80 = £0.20. • availability heuristic
• With this ticket, you are expected to win £0.20. • representativeness heuristic
• you should choose the second ticket.
75 76 19
5/19/2024
• Example 1: Statistics show that flying is much safer than • Example 2: if a word of three letters or more is sampled
travelling by car. In fact, you are 10,000 times less likely at random from an English text, is it more likely that the
to die in a plane accident than in a car accident. word (a) starts with ‘r’ or (b) has ‘r’ as its third letter?
However, people generally think that travelling by car is • When facing this question, participants usually try to generate
safer. How can that be? words starting with an ‘r’ and words having an ‘r’ as the third
• People use the availability heuristic: basing one’s letter.
estimate of probability on how easy it is to retrieve • However, it is much easier to generate words with a given
examples from long-term memory. letter in the first position than in the third position, in part
• Typically, there are few casualties in a car accident. because people occasionally do the former but never the latter.
• By contrast, there are many deaths in an airplane crash and the • Thus, participants conclude that words with an ‘r’ in the first
accident is widely covered in the news, with horrific pictures. position are more common. In fact, there are more words with
• As a consequence, more details are stored in long-term an ‘r’ in the third position.
memory, which makes retrieval of plane accidents easier.
77 78
79 80 20
5/19/2024
81 82
83 84 21
5/19/2024
85 86
• Evans’s (2006) theory provides a good example of this • Kahneman (2003) applied similar ideas to the field
dual approach in the field of reasoning. of judgement and decision-making.
• heuristics are implemented in System 1
• analytical processes in System 2. • Just like Evans’s (2006) theory, Kahneman’s (2003)
• When a reasoning problem is encountered, theory involves serial processing:
• System 1 rapidly constructs a mental model using simple heuristics. • System 1 enters into action first, generating a rapid and
• Only then does System 2 enter the picture to possibly revise or even
replace the original mental model, using deliberate and slow intuitive answer.
analytical processes. • In a second step, System 2 improves and possibly changes
• Which system is engaged is affected by a number of factors, the original answer.
including
• the amount of time available to provide an answer,
• the level of intelligence of the participants
• The instructions provided by the experimenter.
87 88 22
5/19/2024
• Do experts solve problems by pattern recognition – • Dual-process theories have been highly influential in the
rapid identification of the key features of a problem last two decades or so.
that lead automatically to a solution – or by look- • good empirical support for the existence of the two
ahead search and analytical thinking? different modes of processing,
• Simon and Chase (1973) emphasised the former • number of criticisms have been levelled at these
mechanism theories.
• Holding (1992) argued that the importance of perception, • First, they do not propose anything new (Brakel & Shevrin,
intuition, and knowledge had been overstated by Simon 2003), as the key ideas were already present in Freud’s
and Chase, and that experts mostly solve problems by (2001/1915) distinction between primary and secondary
analysing the consequences of possible options. processes.
• More recently, researchers have emphasised that most • Second, these theories are not well specified, and could be
domains of expertise engage both processes (Gobet, characterised as circular restatements of the phenomena
2016). under study (Gigerenzer, 2010).
89 90
91 92 23
5/19/2024
Summary Summary
• The main subfields of the psychology of thinking are problem-solving, • Expected utility theory offers a normative theory of decision-
expertise, creativity, analogy making, reasoning, and decision-making. making under uncertainty. Humans’ decisions do not follow the
• Behaviourists proposed that problem-solving can be explained by predictions of this theory, in part because they use heuristics that
learning stimulus–response links. Gestalt psychologists devised clever sometimes lead to systematic biases.
experiments, but their theoretical explanations were vague. • Dual-process theories have been developed to explain the
• Problem space theory proposed that problem-solving consists of search empirical results in most subfields of thinking. These theories
within a problem space. It has received support from both experiments postulate the existence of two systems: System 1 is fast and
and computer simulations. The theory has also been successfully applied intuitive whilst System 2 is slow and deliberative.
to the subfields of expertise and creativity.
• Some authors have proposed that analogy making is at the heart of
• Research on thinking has been dominated by the question of
thinking, but experiments have shown that people struggle when trying rationality. In general, the data do not support the hypothesis of
to use analogies. full rationality. Rather, they support the hypothesis of bounded
rationality. Due to the limits of attention and working memory,
• Research into deductive reasoning compares the way people reason with biases affecting retrieval from long-term memory, and the
solutions obtained by the application of logic, which offers a normative difficulty of searching large problem spaces, humans are
theory. People commit many errors when faced with reasoning satisficers rather than optimisers, and choose solutions that are
problems. With inductive reasoning, people suffer from confirmation
bias. good enough rather than optimal.
93 94
24