SQL: Data Manipulation: Pearson Education © 2009
SQL: Data Manipulation: Pearson Education © 2009
2
Pearson Education © 2009
Lecture 6 - Objectives
– Join tables together.
– Perform set operations (UNION, INTERSECT,
EXCEPT).
3
Pearson Education © 2009
Objectives of SQL
Ideally, database language should allow user to:
– create the database and relation structures;
– perform insertion, modification, deletion of
data from relations;
– perform simple and complex queries.
Must perform these tasks with minimal user
effort and command structure/syntax must be
easy to learn.
It must be portable.
4
Pearson Education © 2009
Objectives of SQL
SQL is a transform-oriented language with 2 major
components:
5
Pearson Education © 2009
Objectives of SQL
SQL is relatively easy to learn:
6
Pearson Education © 2009
Objectives of SQL
Consists of standard English words:
7
Pearson Education © 2009
Objectives of SQL
Can be used by range of users including DBAs,
management, application developers, and other
types of end users.
8
Pearson Education © 2009
History of SQL
In 1974, D. Chamberlin (IBM San Jose
Laboratory) defined language called ‘Structured
English Query Language’ (SEQUEL).
A revised version, SEQUEL/2, was defined in
1976 but name was subsequently changed to SQL
for legal reasons.
9
Pearson Education © 2009
History of SQL
Still pronounced ‘see-quel’, though official
pronunciation is ‘S-Q-L’.
IBM subsequently produced a prototype DBMS
called System R, based on SEQUEL/2.
Roots of SQL, however, are in SQUARE
(Specifying Queries as Relational Expressions),
which predates System R project.
10
Pearson Education © 2009
History of SQL
In late 70s, ORACLE appeared and was probably first
commercial RDBMS based on SQL.
In 1987, ANSI and ISO published an initial standard for
SQL.
In 1989, ISO published an addendum that defined an
‘Integrity Enhancement Feature’.
In 1992, first major revision to ISO standard occurred,
referred to as SQL2 or SQL/92.
In 1999, SQL:1999 was released with support for object-
oriented data management.
In late 2003, SQL:2003 was released.
11
Pearson Education © 2009
Importance of SQL
SQL has become part of application architectures
such as IBM’s Systems Application Architecture.
It is strategic choice of many large and influential
organizations (e.g. X/OPEN).
SQL is Federal Information Processing Standard
(FIPS) to which conformance is required for all
sales of databases to American Government.
12
Pearson Education © 2009
Importance of SQL
SQL is used in other standards and even
influences development of other standards as a
definitional tool. Examples include:
13
Pearson Education © 2009
Writing SQL Commands
SQL statement consists of reserved words and user-
defined words.
14
Pearson Education © 2009
Writing SQL Commands
Most components of an SQL statement are case
insensitive, except for literal character data.
More readable with indentation and lineation:
– Each clause should begin on a new line.
– Start of a clause should line up with start of
other clauses.
– If clause has several parts, should each appear
on a separate line and be indented under start
of clause.
15
Pearson Education © 2009
Writing SQL Commands
Use extended form of BNF notation:
16
Pearson Education © 2009
Literals
Literals are constants used in SQL statements.
17
Pearson Education © 2009
SELECT Statement
SELECT [DISTINCT | ALL]
{* | [columnExpression [AS newName]] [,...] }
FROM TableName [alias] [, ...]
[WHERE condition]
[GROUP BY columnList] [HAVING condition]
[ORDER BY columnList]
18
Pearson Education © 2009
SELECT Statement
FROM Specifies table(s) to be used.
WHERE Filters rows.
GROUP BY Forms groups of rows with same
column value.
HAVING Filters groups subject to some
condition.
SELECT Specifies which columns are to
appear in output.
ORDER BY Specifies the order of the output.
19
Pearson Education © 2009
SELECT Statement
Order of the clauses cannot be changed.
20
Pearson Education © 2009
Example 6.1 All Columns, All Rows
List full details of all staff.
SELECT *
FROM Staff;
21
Pearson Education © 2009
Example 6.1 All Columns, All Rows
22
Pearson Education © 2009
Example 6.2 Specific Columns, All Rows
Produce a list of salaries for all staff, showing only
staff number, first and last names, and salary.
23
Pearson Education © 2009
Example 6.2 Specific Columns, All Rows
24
Pearson Education © 2009
Example 6.3 Use of DISTINCT
List the property numbers of all properties that
have been viewed.
SELECT propertyNo
FROM Viewing;
25
Pearson Education © 2009
Example 6.3 Use of DISTINCT
Use DISTINCT to eliminate duplicates:
26
Pearson Education © 2009
Example 6.4 Calculated Fields
Produce list of monthly salaries for all staff,
showing staff number, first/last name, and salary.
SELECT staffNo, fName, lName, salary/12
FROM Staff;
27
Pearson Education © 2009
Example 6.4 Calculated Fields
To name column, use AS clause:
28
Pearson Education © 2009
Example 6.5 Comparison Search Condition
List all staff with a salary greater than 10,000.
SELECT staffNo, fName, lName, position, salary
FROM Staff
WHERE salary > 10000;
29
Pearson Education © 2009
Example 6.6 Compound Comparison Search
Condition
List addresses of all branch offices in London or
Glasgow.
SELECT *
FROM Branch
WHERE city = ‘London’ OR city = ‘Glasgow’;
30
Pearson Education © 2009
Example 6.7 Range Search Condition
List all staff with a salary between 20,000 and
30,000.
31
Pearson Education © 2009
Example 6.7 Range Search Condition
32
Pearson Education © 2009
Example 6.7 Range Search Condition
Also a negated version NOT BETWEEN.
BETWEEN does not add much to SQL’s
expressive power. Could also write:
33
Pearson Education © 2009
Example 6.8 Set Membership
List all managers and supervisors.
SELECT staffNo, fName, lName, position
FROM Staff
WHERE position IN (‘Manager’, ‘Supervisor’);
34
Pearson Education © 2009
Example 6.8 Set Membership
There is a negated version (NOT IN).
IN does not add much to SQL’s expressive power.
Could have expressed this as:
35
Pearson Education © 2009
Example 6.9 Pattern Matching
Find all owners with the string ‘Glasgow’ in their
address.
SELECT ownerNo, fName, lName, address, telNo
FROM PrivateOwner
WHERE address LIKE ‘%Glasgow%’;
36
Pearson Education © 2009
Example 6.9 Pattern Matching
SQL has two special pattern matching symbols:
– %: sequence of zero or more characters;
– _ (underscore): any single character.
LIKE ‘%Glasgow%’ means a sequence of
characters of any length containing ‘Glasgow’.
37
Pearson Education © 2009
Example 6.10 NULL Search Condition
List details of all viewings on property PG4 where a
comment has not been supplied.
There are 2 viewings for property PG4, one with and one
without a comment.
Have to test for null explicitly using special keyword IS
NULL:
SELECT clientNo, viewDate
FROM Viewing
WHERE propertyNo = ‘PG4’ AND
comment IS NULL;
38
Pearson Education © 2009
Example 6.10 NULL Search Condition
39
Pearson Education © 2009
Example 6.11 Single Column Ordering
List salaries for all staff, arranged in descending
order of salary.
40
Pearson Education © 2009
Example 6.11 Single Column Ordering
41
Pearson Education © 2009
Example 6.12 Multiple Column Ordering
Produce abbreviated list of properties in order of
property type.
42
Pearson Education © 2009
Example 6.12 Multiple Column Ordering
43
Pearson Education © 2009
Example 6.12 Multiple Column Ordering
Four flats in this list - as no minor sort key
specified, system arranges these rows in any order
it chooses.
To arrange in order of rent, specify minor order:
44
Pearson Education © 2009
Example 6.12 Multiple Column Ordering
45
Pearson Education © 2009
SELECT Statement - Aggregates
ISO standard defines five aggregate functions:
46
Pearson Education © 2009
SELECT Statement - Aggregates
Each operates on a single column of a table and
returns a single value.
COUNT, MIN, and MAX apply to numeric and
non-numeric fields, but SUM and AVG may be
used on numeric fields only.
Apart from COUNT(*), each function eliminates
nulls first and operates only on remaining non-
null values.
47
Pearson Education © 2009
SELECT Statement - Aggregates
COUNT(*) counts all rows of a table, regardless
of whether nulls or duplicate values occur.
Can use DISTINCT before column name to
eliminate duplicates.
DISTINCT has no effect with MIN/MAX, but
may have with SUM/AVG.
48
Pearson Education © 2009
SELECT Statement - Aggregates
Aggregate functions can be used only in
SELECT list and in HAVING clause.
49
Pearson Education © 2009
Example 6.13 Use of COUNT(*)
How many properties cost more than £350 per
month to rent?
SELECT COUNT(*) AS myCount
FROM PropertyForRent
WHERE rent > 350;
50
Pearson Education © 2009
Example 6.14 Use of COUNT(DISTINCT)
How many different properties viewed in May ‘04?
SELECT COUNT(DISTINCT propertyNo) AS myCount
FROM Viewing
WHERE viewDate BETWEEN ‘1-May-04’
AND ‘31-May-04’;
51
Pearson Education © 2009
Example 6.15 Use of COUNT and SUM
Find number of Managers and sum of their
salaries.
SELECT COUNT(staffNo) AS myCount,
SUM(salary) AS mySum
FROM Staff
WHERE position = ‘Manager’;
52
Pearson Education © 2009
Example 6.16 Use of MIN, MAX, AVG
Find minimum, maximum, and average staff
salary.
SELECT MIN(salary) AS myMin,
MAX(salary) AS myMax,
AVG(salary) AS myAvg
FROM Staff;
53
Pearson Education © 2009
SELECT Statement - Grouping
Use GROUP BY clause to get sub-totals.
SELECT and GROUP BY closely integrated:
each item in SELECT list must be single-valued
per group, and SELECT clause may only contain:
– column names
– aggregate functions
– constants
– expression involving combinations of the above.
54
Pearson Education © 2009
SELECT Statement - Grouping
All column names in SELECT list must appear in
GROUP BY clause unless name is used only in an
aggregate function.
If WHERE is used with GROUP BY, WHERE is
applied first, then groups are formed from
remaining rows satisfying predicate.
ISO considers two nulls to be equal for purposes
of GROUP BY.
55
Pearson Education © 2009
Example 6.17 Use of GROUP BY
Find number of staff in each branch and their
total salaries.
SELECT branchNo,
COUNT(staffNo) AS myCount,
SUM(salary) AS mySum
FROM Staff
GROUP BY branchNo
ORDER BY branchNo;
56
Pearson Education © 2009
Example 6.17 Use of GROUP BY
57
Pearson Education © 2009
Restricted Groupings – HAVING clause
HAVING clause is designed for use with GROUP
BY to restrict groups that appear in final result
table.
Similar to WHERE, but WHERE filters
individual rows whereas HAVING filters groups.
Column names in HAVING clause must also
appear in the GROUP BY list or be contained
within an aggregate function.
58
Pearson Education © 2009
Example 6.18 Use of HAVING
For each branch with more than 1 member of staff,
find number of staff in each branch and sum of
their salaries.
SELECT branchNo,
COUNT(staffNo) AS myCount,
SUM(salary) AS mySum
FROM Staff
GROUP BY branchNo
HAVING COUNT(staffNo) > 1
ORDER BY branchNo;
59
Pearson Education © 2009
Example 6.18 Use of HAVING
60
Pearson Education © 2009
Subqueries
Some SQL statements can have a SELECT
embedded within them.
A subselect can be used in WHERE and
HAVING clauses of an outer SELECT, where it
is called a subquery or nested query.
Subselects may also appear in INSERT,
UPDATE, and DELETE statements.
61
Pearson Education © 2009
Example 6.19 Subquery with Equality
List staff who work in branch at ‘163 Main St’.
62
Pearson Education © 2009
Example 6.19 Subquery with Equality
Inner SELECT finds branch number for branch
at ‘163 Main St’ (‘B003’).
Outer SELECT then retrieves details of all staff
who work at this branch.
Outer SELECT then becomes:
63
Pearson Education © 2009
Example 6.19 Subquery with Equality
64
Pearson Education © 2009
Example 6.20 Subquery with Aggregate
List all staff whose salary is greater than the average
salary, and show by how much.
65
Pearson Education © 2009
Example 6.20 Subquery with Aggregate
Cannot write ‘WHERE salary > AVG(salary)’
Instead, use subquery to find average salary
(17000), and then use outer SELECT to find those
staff with salary greater than this:
66
Pearson Education © 2009
Example 6.20 Subquery with Aggregate
67
Pearson Education © 2009
Subquery Rules
ORDER BY clause may not be used in a subquery
(although it may be used in outermost SELECT).
68
Pearson Education © 2009
Subquery Rules
When subquery is an operand in a comparison,
subquery must appear on right-hand side.
69
Pearson Education © 2009
Example 6.21 Nested subquery: use of IN
List properties handled by staff at ‘163 Main St’.
SELECT propertyNo, street, city, postcode, type, rooms, rent
FROM PropertyForRent
WHERE staffNo IN
(SELECT staffNo
FROM Staff
WHERE branchNo =
(SELECT branchNo
FROM Branch
WHERE street = ‘163 Main St’));
70
Pearson Education © 2009
Example 6.21 Nested subquery: use of IN
71
Pearson Education © 2009
ANY and ALL
ANY and ALL may be used with subqueries that
produce a single column of numbers.
With ALL, condition will only be true if it is
satisfied by all values produced by subquery.
With ANY, condition will be true if it is satisfied
by any values produced by subquery.
If subquery is empty, ALL returns true, ANY
returns false.
SOME may be used in place of ANY.
72
Pearson Education © 2009
Example 6.22 Use of ANY/SOME
Find staff whose salary is larger than salary of at
least one member of staff at branch B003.
SELECT staffNo, fName, lName, position, salary
FROM Staff
WHERE salary > SOME
(SELECT salary
FROM Staff
WHERE branchNo = ‘B003’);
73
Pearson Education © 2009
Example 6.22 Use of ANY/SOME
Inner query produces set {12000, 18000, 24000}
and outer query selects those staff whose salaries
are greater than any of the values in this set.
74
Pearson Education © 2009
Example 6.23 Use of ALL
Find staff whose salary is larger than salary of
every member of staff at branch B003.
75
Pearson Education © 2009
Example 6.23 Use of ALL
76
Pearson Education © 2009
Multi-Table Queries
Can use subqueries provided result columns come from
same table.
If result columns come from more than one table must use
a join.
77
Pearson Education © 2009
Multi-Table Queries
Also possible to use an alias for a table named in
FROM clause.
78
Pearson Education © 2009
Example 6.24 Simple Join
List names of all clients who have viewed a
property along with any comment supplied.
79
Pearson Education © 2009
Example 6.24 Simple Join
Only those rows from both tables that have
identical values in the clientNo columns
(c.clientNo = v.clientNo) are included in result.
Equivalent to equi-join in relational algebra.
80
Pearson Education © 2009
Alternative JOIN Constructs
SQL provides alternative ways to specify joins:
81
Pearson Education © 2009
Example 6.25 Sorting a join
For each branch, list numbers and names of
staff who manage properties, and properties
they manage.
82
Pearson Education © 2009
Example 6.25 Sorting a join
83
Pearson Education © 2009
Example 6.26 Three Table Join
For each branch, list staff who manage
properties, including city in which branch is
located and properties they manage.
84
Pearson Education © 2009
Example 6.26 Three Table Join
86
Pearson Education © 2009
Example 6.27 Multiple Grouping Columns
87
Pearson Education © 2009
Computing a Join
Procedure for generating results of a join are:
89
Pearson Education © 2009
Outer Joins
If one row of a joined table is unmatched,
row is omitted from result table.
Outer join operations retain rows that do
not satisfy the join condition.
Consider following tables:
90
Pearson Education © 2009
Outer Joins
The (inner) join of these two tables:
91
Pearson Education © 2009
Outer Joins
Result table has two rows where cities are same.
There are no rows corresponding to branches in
Bristol and Aberdeen.
To include unmatched rows in result table, use
an Outer join.
92
Pearson Education © 2009
Example 6.28 Left Outer Join
List branches and properties that are in same
city along with any unmatched branches.
93
Pearson Education © 2009
Example 6.28 Left Outer Join
Includes those rows of first (left) table unmatched
with rows from second (right) table.
Columns from second table are filled with
NULLs.
94
Pearson Education © 2009
Example 6.29 Right Outer Join
List branches and properties in same city and any
unmatched properties.
95
Pearson Education © 2009
Example 6.29 Right Outer Join
Right Outer join includes those rows of second
(right) table that are unmatched with rows from
first (left) table.
Columns from first table are filled with NULLs.
96
Pearson Education © 2009
Example 6.30 Full Outer Join
List branches and properties in same city and
any unmatched branches or properties.
97
Pearson Education © 2009
Example 6.30 Full Outer Join
Includes rows that are unmatched in both tables.
Unmatched columns are filled with NULLs.
98
Pearson Education © 2009
EXISTS and NOT EXISTS
EXISTS and NOT EXISTS are for use only with subqueries.
True if and only if there exists at least one row in result table
returned by subquery.
99
Pearson Education © 2009
EXISTS and NOT EXISTS
As (NOT) EXISTS check only for existence or non-
existence of rows in subquery result table,
subquery can contain any number of columns.
(SELECT * ...)
100
Pearson Education © 2009
Example 6.31 Query using EXISTS
Find all staff who work in a London branch.
101
Pearson Education © 2009
Example 6.31 Query using EXISTS
102
Pearson Education © 2009
Example 6.31 Query using EXISTS
Note, search condition s.branchNo = b.branchNo is
necessary to consider correct branch record for each
member of staff.
If omitted, would get all staff records listed out because
subquery:
103
Pearson Education © 2009
Example 6.31 Query using EXISTS
104
Pearson Education © 2009
Union, Intersect, and Difference (Except)
Can use normal set operations of Union,
Intersection, and Difference to combine results of
two or more queries into a single result table.
Union of two tables, A and B, is table containing all
rows in either A or B or both.
Intersection is table containing all rows common to
both A and B.
Difference is table containing all rows in A but not
in B.
Two tables must be union compatible.
105
Pearson Education © 2009
Union, Intersect, and Difference (Except)
Format of set operator clause in each case is:
106
Pearson Education © 2009
Union, Intersect, and Difference (Except)
107
Pearson Education © 2009
Example 6.32 Use of UNION
List all cities where there is either a branch office
or a property.
(SELECT city
FROM Branch
WHERE city IS NOT NULL) UNION
(SELECT city
FROM PropertyForRent
WHERE city IS NOT NULL);
108
Pearson Education © 2009
Example 6.32 Use of UNION
Or
(SELECT *
FROM Branch
WHERE city IS NOT NULL)
UNION CORRESPONDING BY city
(SELECT *
FROM PropertyForRent
WHERE city IS NOT NULL);
109
Pearson Education © 2009
Example 6.32 Use of UNION
Produces result tables from both queries and
merges both tables together.
110
Pearson Education © 2009
Example 6.33 Use of INTERSECT
List all cities where there is both a branch office
and a property.
111
Pearson Education © 2009
Example 6.33 Use of INTERSECT
Or
112
Pearson Education © 2009
Example 6.33 Use of INTERSECT
Could rewrite this query without INTERSECT operator:
SELECT b.city
FROM Branch b PropertyForRent p
WHERE b.city = p.city;
Or:
SELECT DISTINCT city FROM Branch b
WHERE EXISTS
(SELECT * FROM PropertyForRent p
WHERE p.city = b.city);
113
Pearson Education © 2009
Example 6.34 Use of EXCEPT
List of all cities where there is a branch office but no
properties.
114
Pearson Education © 2009
Example 6.34 Use of EXCEPT
Could rewrite this query without EXCEPT:
115
Pearson Education © 2009
INSERT
INSERT INTO TableName [ (columnList) ]
VALUES (dataValueList)
116
Pearson Education © 2009
INSERT
dataValueList must match columnList as follows:
– number of items in each list must be same;
– must be direct correspondence in position of
items in two lists;
– data type of each item in dataValueList must
be compatible with data type of
corresponding column.
117
Pearson Education © 2009
Example 6.35 INSERT … VALUES
Insert a new row into Staff table supplying data
for all columns.
118
Pearson Education © 2009
Example 6.36 INSERT using Defaults
Insert a new row into Staff table supplying data for
all mandatory columns.
INSERT INTO Staff (staffNo, fName, lName,
position, salary, branchNo)
VALUES (‘SG44’, ‘Anne’, ‘Jones’,
‘Assistant’, 8100, ‘B003’);
Or
INSERT INTO Staff
VALUES (‘SG44’, ‘Anne’, ‘Jones’, ‘Assistant’, NULL,
NULL, 8100, ‘B003’);
119
Pearson Education © 2009
INSERT … SELECT
Second form of INSERT allows multiple rows to
be copied from one or more tables to another:
120
Pearson Education © 2009
Example 6.37 INSERT … SELECT
Assume there is a table StaffPropCount that
contains names of staff and number of properties
they manage:
121
Pearson Education © 2009
Example 6.37 INSERT … SELECT
INSERT INTO StaffPropCount
(SELECT s.staffNo, fName, lName, COUNT(*)
FROM Staff s, PropertyForRent p
WHERE s.staffNo = p.staffNo
GROUP BY s.staffNo, fName, lName)
UNION
(SELECT staffNo, fName, lName, 0
FROM Staff
WHERE staffNo NOT IN
(SELECT DISTINCT staffNo
FROM PropertyForRent));
122
Pearson Education © 2009
Example 6.37 INSERT … SELECT
123
Pearson Education © 2009
UPDATE
UPDATE TableName
SET columnName1 = dataValue1
[, columnName2 = dataValue2...]
[WHERE searchCondition]
TableName can be name of a base table or an
updatable view.
SET clause specifies names of one or more
columns that are to be updated.
124
Pearson Education © 2009
UPDATE
WHERE clause is optional:
– if omitted, named columns are updated for all
rows in table;
– if specified, only those rows that satisfy
searchCondition are updated.
New dataValue(s) must be compatible with data
type for corresponding column.
125
Pearson Education © 2009
Example 6.38/39 UPDATE All Rows
Give all staff a 3% pay increase.
UPDATE Staff
SET salary = salary*1.03;
UPDATE Staff
SET salary = salary*1.05
WHERE position = ‘Manager’;
126
Pearson Education © 2009
Example 6.40 UPDATE Multiple Columns
Promote David Ford (staffNo=‘SG14’) to
Manager and change his salary to £18,000.
UPDATE Staff
SET position = ‘Manager’, salary = 18000
WHERE staffNo = ‘SG14’;
127
Pearson Education © 2009
DELETE
DELETE FROM TableName
[WHERE searchCondition]
TableName can be name of a base table or an
updatable view.
searchCondition is optional; if omitted, all rows
are deleted from table. This does not delete table.
If search_condition is specified, only those rows
that satisfy condition are deleted.
128
Pearson Education © 2009
Example 6.41/42 DELETE Specific Rows
Delete all viewings that relate to property PG4.
129
Pearson Education © 2009