Data Structures - Python 3.9.6 Documentation
Data Structures - Python 3.9.6 Documentation
5. Data Structures
This chapter describes some things you’ve learned about already in more detail,
and adds some new things as well.
list. append(x)
Add an item to the end of the list. Equivalent to a[len(a):] = [x] .
list. extend(iterable)
Extend the list by appending all the items from the iterable. Equivalent to
a[len(a):] = iterable .
list. insert(i, x)
Insert an item at a given position. The first argument is the index of the ele-
ment before which to insert, so a.insert(0, x) inserts at the front of the list,
and a.insert(len(a), x) is equivalent to a.append(x) .
list. remove(x)
Remove the first item from the list whose value is equal to x. It raises a
ValueError if there is no such item.
list. pop([i])
Remove the item at the given position in the list, and return it. If no index is
specified, a.pop() removes and returns the last item in the list. (The square
brackets around the i in the method signature denote that the parameter is
optional, not that you should type square brackets at that position. You will
see this notation frequently in the Python Library Reference.)
list. clear()
Remove all items from the list. Equivalent to del a[:] .
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 1 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
The optional arguments start and end are interpreted as in the slice notation
and are used to limit the search to a particular subsequence of the list. The re-
turned index is computed relative to the beginning of the full sequence rather
than the start argument.
list. count(x)
Return the number of times x appears in the list.
list. reverse()
Reverse the elements of the list in place.
list. copy()
Return a shallow copy of the list. Equivalent to a[:] .
>>>
>>> fruits = ['orange', 'apple', 'pear', 'banana', 'kiwi', 'apple', 'banana'
>>> fruits.count('apple')
2
>>> fruits.count('tangerine')
0
>>> fruits.index('banana')
3
>>> fruits.index('banana', 4) # Find next banana starting a position 4
6
>>> fruits.reverse()
>>> fruits
['banana', 'apple', 'kiwi', 'banana', 'pear', 'apple', 'orange']
>>> fruits.append('grape')
>>> fruits
['banana', 'apple', 'kiwi', 'banana', 'pear', 'apple', 'orange', 'grape']
>>> fruits.sort()
>>> fruits
['apple', 'apple', 'banana', 'banana', 'grape', 'kiwi', 'orange', 'pear']
>>> fruits.pop()
'pear'
You might have noticed that methods like insert , remove or sort that only modi-
fy the list have no return value printed – they return the default None . [1] This is a
design principle for all mutable data structures in Python.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 2 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
Another thing you might notice is that not all data can be sorted or compared. For
instance, [None, 'hello', 10] doesn’t sort because integers can’t be compared
to strings and None can’t be compared to other types. Also, there are some types
that don’t have a defined ordering relation. For example, 3+4j < 5+7j isn’t a valid
comparison.
>>>
>>> stack = [3, 4, 5]
>>> stack.append(6)
>>> stack.append(7)
>>> stack
[3, 4, 5, 6, 7]
>>> stack.pop()
7
>>> stack
[3, 4, 5, 6]
>>> stack.pop()
6
>>> stack.pop()
5
>>> stack
[3, 4]
It is also possible to use a list as a queue, where the first element added is the first
element retrieved (“first-in, first-out”); however, lists are not e!cient for this pur-
pose. While appends and pops from the end of list are fast, doing inserts or pops
from the beginning of a list is slow (because all of the other elements have to be
shifted by one).
>>>
>>> from collections import deque
>>> queue = deque(["Eric", "John", "Michael"])
>>> queue.append("Terry") # Terry arrives
>>> queue.append("Graham") # Graham arrives
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 3 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>>
>>> squares = []
>>> for x in range(10):
... squares.append(x**2)
...
>>> squares
[0, 1, 4, 9, 16, 25, 36, 49, 64, 81]
Note that this creates (or overwrites) a variable named x that still exists after the
loop completes. We can calculate the list of squares without any side e"ects using:
or, equivalently:
>>>
>>> [(x, y) for x in [1,2,3] for y in [3,1,4] if x != y]
[(1, 3), (1, 4), (2, 3), (2, 1), (2, 4), (3, 1), (3, 4)]
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 4 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>>
>>> combs = []
>>> for x in [1,2,3]:
... for y in [3,1,4]:
... if x != y:
... combs.append((x, y))
...
>>> combs
[(1, 3), (1, 4), (2, 3), (2, 1), (2, 4), (3, 1), (3, 4)]
Note how the order of the for and if statements is the same in both these
snippets.
If the expression is a tuple (e.g. the (x, y) in the previous example), it must be
parenthesized.
>>>
>>> vec = [-4, -2, 0, 2, 4]
>>> # create a new list with the values doubled
>>> [x*2 for x in vec]
[-8, -4, 0, 4, 8]
>>> # filter the list to exclude negative numbers
>>> [x for x in vec if x >= 0]
[0, 2, 4]
>>> # apply a function to all the elements
>>> [abs(x) for x in vec]
[4, 2, 0, 2, 4]
>>> # call a method on each element
>>> freshfruit = [' banana', ' loganberry ', 'passion fruit ']
>>> [weapon.strip() for weapon in freshfruit]
['banana', 'loganberry', 'passion fruit']
>>> # create a list of 2-tuples like (number, square)
>>> [(x, x**2) for x in range(6)]
[(0, 0), (1, 1), (2, 4), (3, 9), (4, 16), (5, 25)]
>>> # the tuple must be parenthesized, otherwise an error is raised
>>> [x, x**2 for x in range(6)]
File "<stdin>", line 1, in <module>
[x, x**2 for x in range(6)]
^
SyntaxError: invalid syntax
>>> # flatten a list using a listcomp with two 'for'
>>> vec = [[1,2,3], [4,5,6], [7,8,9]]
>>> [num for elem in vec for num in elem]
[1, 2, 3, 4, 5, 6, 7, 8, 9]
>>>
>>> from math import pi
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 5 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>>
>>> matrix = [
... [1, 2, 3, 4],
... [5, 6, 7, 8],
... [9, 10, 11, 12],
... ]
>>>
>>> [[row[i] for row in matrix] for i in range(4)]
[[1, 5, 9], [2, 6, 10], [3, 7, 11], [4, 8, 12]]
As we saw in the previous section, the nested listcomp is evaluated in the context
of the for that follows it, so this example is equivalent to:
>>>
>>> transposed = []
>>> for i in range(4):
... transposed.append([row[i] for row in matrix])
...
>>> transposed
[[1, 5, 9], [2, 6, 10], [3, 7, 11], [4, 8, 12]]
>>>
>>> transposed = []
>>> for i in range(4):
... # the following 3 lines implement the nested listcomp
... transposed_row = []
... for row in matrix:
... transposed_row.append(row[i])
... transposed.append(transposed_row)
...
>>> transposed
[[1, 5, 9], [2, 6, 10], [3, 7, 11], [4, 8, 12]]
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 6 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
In the real world, you should prefer built-in functions to complex flow statements.
The zip() function would do a great job for this use case:
>>>
>>> list(zip(*matrix))
[(1, 5, 9), (2, 6, 10), (3, 7, 11), (4, 8, 12)]
See Unpacking Argument Lists for details on the asterisk in this line.
>>>
>>> a = [-1, 1, 66.25, 333, 333, 1234.5]
>>> del a[0]
>>> a
[1, 66.25, 333, 333, 1234.5]
>>> del a[2:4]
>>> a
[1, 66.25, 1234.5]
>>> del a[:]
>>> a
[]
>>>
>>> del a
Referencing the name a hereafter is an error (at least until another value is as-
signed to it). We’ll find other uses for del later.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 7 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>>
>>> t = 12345, 54321, 'hello!'
>>> t[0]
12345
>>> t
(12345, 54321, 'hello!')
>>> # Tuples may be nested:
... u = t, (1, 2, 3, 4, 5)
>>> u
((12345, 54321, 'hello!'), (1, 2, 3, 4, 5))
>>> # Tuples are immutable:
... t[0] = 88888
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
TypeError: 'tuple' object does not support item assignment
>>> # but they can contain mutable objects:
... v = ([1, 2, 3], [3, 2, 1])
>>> v
([1, 2, 3], [3, 2, 1])
As you see, on output tuples are always enclosed in parentheses, so that nested
tuples are interpreted correctly; they may be input with or without surrounding
parentheses, although often parentheses are necessary anyway (if the tuple is part
of a larger expression). It is not possible to assign to the individual items of a tu-
ple, however it is possible to create tuples which contain mutable objects, such as
lists.
Though tuples may seem similar to lists, they are often used in di"erent situations
and for di"erent purposes. Tuples are immutable, and usually contain a heteroge-
neous sequence of elements that are accessed via unpacking (see later in this sec-
tion) or indexing (or even by attribute in the case of namedtuples ). Lists are muta-
ble, and their elements are usually homogeneous and are accessed by iterating
over the list.
>>>
>>> empty = ()
>>> singleton = 'hello', # <-- note trailing comma
>>> len(empty)
0
>>> len(singleton)
1
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 8 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>> singleton
('hello',)
>>>
>>> x, y, z = t
This is called, appropriately enough, sequence unpacking and works for any se-
quence on the right-hand side. Sequence unpacking requires that there are as
many variables on the left side of the equals sign as there are elements in the se-
quence. Note that multiple assignment is really just a combination of tuple pack-
ing and sequence unpacking.
5.4. Sets
Python also includes a data type for sets. A set is an unordered collection with no
duplicate elements. Basic uses include membership testing and eliminating dupli-
cate entries. Set objects also support mathematical operations like union, inter-
section, di"erence, and symmetric di"erence.
Curly braces or the set() function can be used to create sets. Note: to create an
empty set you have to use set() , not {} ; the latter creates an empty dictionary, a
data structure that we discuss in the next section.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 9 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>>
>>> a = {x for x in 'abracadabra' if x not in 'abc'}
>>> a
{'r', 'd'}
5.5. Dictionaries
Another useful data type built into Python is the dictionary (see Mapping Types —
dict). Dictionaries are sometimes found in other languages as “associative memo-
ries” or “associative arrays”. Unlike sequences, which are indexed by a range of
numbers, dictionaries are indexed by keys, which can be any immutable type;
strings and numbers can always be keys. Tuples can be used as keys if they con-
tain only strings, numbers, or tuples; if a tuple contains any mutable object either
directly or indirectly, it cannot be used as a key. You can’t use lists as keys, since
lists can be modified in place using index assignments, slice assignments, or
methods like append() and extend() .
It is best to think of a dictionary as a set of key: value pairs, with the requirement
that the keys are unique (within one dictionary). A pair of braces creates an empty
dictionary: {} . Placing a comma-separated list of key:value pairs within the braces
adds initial key:value pairs to the dictionary; this is also the way dictionaries are
written on output.
The main operations on a dictionary are storing a value with some key and ex-
tracting the value given the key. It is also possible to delete a key:value pair with
del . If you store using a key that is already in use, the old value associated with
that key is forgotten. It is an error to extract a value using a non-existent key.
Performing list(d) on a dictionary returns a list of all the keys used in the dictio-
nary, in insertion order (if you want it sorted, just use sorted(d) instead). To
check whether a single key is in the dictionary, use the in keyword.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 10 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
>>>
>>> tel = {'jack': 4098, 'sape': 4139}
>>> tel['guido'] = 4127
>>> tel
{'jack': 4098, 'sape': 4139, 'guido': 4127}
>>> tel['jack']
4098
>>> del tel['sape']
>>> tel['irv'] = 4127
>>> tel
{'jack': 4098, 'guido': 4127, 'irv': 4127}
>>> list(tel)
['jack', 'guido', 'irv']
>>> sorted(tel)
['guido', 'irv', 'jack']
>>> 'guido' in tel
True
>>> 'jack' not in tel
False
>>>
>>> dict([('sape', 4139), ('guido', 4127), ('jack', 4098)])
{'sape': 4139, 'guido': 4127, 'jack': 4098}
>>>
>>> {x: x**2 for x in (2, 4, 6)}
{2: 4, 4: 16, 6: 36}
When the keys are simple strings, it is sometimes easier to specify pairs using
keyword arguments:
>>>
>>> dict(sape=4139, guido=4127, jack=4098)
{'sape': 4139, 'guido': 4127, 'jack': 4098}
>>>
>>> knights = {'gallahad': 'the pure', 'robin': 'the brave'}
>>> for k, v in knights.items():
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 11 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
... print(k, v)
...
gallahad the pure
robin the brave
When looping through a sequence, the position index and corresponding value can
be retrieved at the same time using the enumerate() function.
>>>
>>> for i, v in enumerate(['tic', 'tac', 'toe']):
... print(i, v)
...
0 tic
1 tac
2 toe
To loop over two or more sequences at the same time, the entries can be paired
with the zip() function.
>>>
>>> questions = ['name', 'quest', 'favorite color']
>>> answers = ['lancelot', 'the holy grail', 'blue']
>>> for q, a in zip(questions, answers):
... print('What is your {0}? It is {1}.'.format(q, a))
...
What is your name? It is lancelot.
What is your quest? It is the holy grail.
What is your favorite color? It is blue.
To loop over a sequence in reverse, first specify the sequence in a forward direc-
tion and then call the reversed() function.
>>>
>>> for i in reversed(range(1, 10, 2)):
... print(i)
...
9
7
5
3
1
To loop over a sequence in sorted order, use the sorted() function which returns
a new sorted list while leaving the source unaltered.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 12 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
...
apple
apple
banana
orange
orange
pear
It is sometimes tempting to change a list while you are looping over it; however, it
is often simpler and safer to create a new list instead.
>>>
>>> import math
>>> raw_data = [56.2, float('NaN'), 51.7, 55.3, 52.5, float('NaN'), 47.8
>>> filtered_data = []
>>> for value in raw_data:
... if not math.isnan(value):
... filtered_data.append(value)
...
>>> filtered_data
[56.2, 51.7, 55.3, 52.5, 47.8]
The comparison operators in and not in check whether a value occurs (does not
occur) in a sequence. The operators is and is not compare whether two objects
are really the same object. All comparison operators have the same priority, which
is lower than that of all numerical operators.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 13 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
Comparisons may be combined using the Boolean operators and and or , and the
outcome of a comparison (or of any other Boolean expression) may be negated
with not . These have lower priorities than comparison operators; between them,
not has the highest priority and or the lowest, so that A and not B or C is
equivalent to (A and (not B)) or C . As always, parentheses can be used to ex-
press the desired composition.
The Boolean operators and and or are so-called short-circuit operators: their ar-
guments are evaluated from left to right, and evaluation stops as soon as the out-
come is determined. For example, if A and C are true but B is false, A and B and
C does not evaluate the expression C . When used as a general value and not as a
Boolean, the return value of a short-circuit operator is the last evaluated
argument.
>>>
>>> string1, string2, string3 = '', 'Trondheim', 'Hammer Dance'
>>> non_null = string1 or string2 or string3
>>> non_null
'Trondheim'
Note that in Python, unlike C, assignment inside expressions must be done explic-
itly with the walrus operator := . This avoids a common class of problems encoun-
tered in C programs: typing = in an expression when == was intended.
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 14 of 15
5. Data Structures — Python 3.9.6 documentation 01/08/21, 2:13 PM
Note that comparing objects of di"erent types with < or > is legal provided that
the objects have appropriate comparison methods. For example, mixed numeric
types are compared according to their numeric value, so 0 equals 0.0, etc. Other-
wise, rather than providing an arbitrary ordering, the interpreter will raise a
TypeError exception.
Footnotes
[1] Other languages may return the mutated object, which allows method chain-
ing, such as d->insert("a")->remove("b")->sort(); .
https://docs.python.org/3/tutorial/datastructures.html#more-on-list Page 15 of 15