What's New in Python 3.5 - Python 3.5.9 Documentation
What's New in Python 3.5 - Python 3.5.9 Documentation
9 documentation
This article explains the new features in Python 3.5, compared to 3.4. Python 3.5 was
released on September 13, 2015. See the changelog for a full list of changes.
bytes % args , bytearray % args : PEP 461 – Adding % formatting to bytes and
bytearray.
New bytes.hex() , bytearray.hex() and memoryview.hex() methods. (Contributed
by Arnon Yaari in bpo-9951.)
memoryview now supports tuple indexing (including multi-dimensional). (Contributed by
Antoine Pitrou in bpo-23632.)
Generators have a new gi_yieldfrom attribute, which returns the object being iterated
by yield from expressions. (Contributed by Benno Leslie and Yury Selivanov in bpo-
24450.)
A new RecursionError exception is now raised when maximum recursion depth is
reached. (Contributed by Georg Brandl in bpo-19235.)
When the LC_TYPE locale is the POSIX locale ( C locale), sys.stdin and sys.stdout
now use the surrogateescape error handler, instead of the strict error handler.
(Contributed by Victor Stinner in bpo-19977.)
.pyo files are no longer used and have been replaced by a more flexible scheme that
includes the optimization level explicitly in .pyc name. (See PEP 488 overview.)
Builtin and extension modules are now initialized in a multi-phase process, which is
similar to how Python modules are loaded. (See PEP 489 overview.)
https://docs.python.org/3.5/whatsnew/3.5.html 1/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
The ssl module gained support for Memory BIO, which decouples SSL protocol
handling from network IO.
The new os.scandir() function provides a better and significantly faster way of
directory traversal.
functools.lru_cache() has been mostly reimplemented in C, yielding much better
performance.
The new subprocess.run() function provides a streamlined way to run subprocesses.
The traceback module has been significantly enhanced for improved performance and
developer convenience.
Security improvements:
SSLv3 is now disabled throughout the standard library. It can still be enabled by
instantiating a ssl.SSLContext manually. (See bpo-22638 for more details; this change
was backported to CPython 3.4 and 2.7.)
HTTP cookie parsing is now stricter, in order to protect against potential injection
attacks. (Contributed by Antoine Pitrou in bpo-22796.)
Windows improvements:
A new installer for Windows has replaced the old MSI. See Using Python on Windows
for more information.
Windows builds now use Microsoft Visual C++ 14.0, and extension modules should use
the same.
Please read on for a comprehensive list of user-facing changes, including many other smaller
improvements, CPython optimizations, deprecations, and potential porting issues.
New Features
PEP 492 - Coroutines with async and await syntax
PEP 492 greatly improves support for asynchronous programming in Python by adding
awaitable objects, coroutine functions, asynchronous iteration, and asynchronous context
managers.
Coroutine functions are declared using the new async def syntax:
>>>
>>> async def coro():
... return 'spam'
Inside a coroutine function, the new await expression can be used to suspend coroutine
execution until the result is available. Any object can be awaited, as long as it implements the
awaitable protocol by defining the __await__() method.
PEP 492 also adds async for statement for convenient iteration over asynchronous
iterables.
https://docs.python.org/3.5/whatsnew/3.5.html 2/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
import asyncio
writer.write(b'\r\n'.join([
b'GET / HTTP/1.1',
b'Host: %b' % domain.encode('latin-1'),
b'Connection: close',
b'', b''
]))
writer.close()
loop = asyncio.get_event_loop()
try:
loop.run_until_complete(http_get('example.com'))
finally:
loop.close()
import asyncio
loop = asyncio.get_event_loop()
lock = asyncio.Lock()
coros = asyncio.gather(coro(1, lock), coro(2, lock))
try:
loop.run_until_complete(coros)
finally:
loop.close()
will output:
Note that both async for and async with can only be used inside a coroutine function
declared with async def .
https://docs.python.org/3.5/whatsnew/3.5.html 3/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
Coroutine functions are intended to be run inside a compatible event loop, such as the
asyncio loop.
Note:
Changed in version 3.5.2: Starting with CPython 3.5.2, __aiter__ can directly return
asynchronous iterators. Returning an awaitable object will result in a
PendingDeprecationWarning .
See also:
instead of:
>>>
>>> import numpy
>>> x = numpy.ones(3)
>>> x
array([ 1., 1., 1.])
>>> m = numpy.eye(3)
>>> m
array([[ 1., 0., 0.],
[ 0., 1., 0.],
[ 0., 0., 1.]])
>>> x @ m
array([ 1., 1., 1.])
https://docs.python.org/3.5/whatsnew/3.5.html 4/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
See also:
>>>
>>> print(*[1], *[2], 3, *[4, 5])
1 2 3 4 5
Similarly, tuple, list, set, and dictionary displays allow multiple unpackings (see Expression
lists and Dictionary displays):
>>>
>>> *range(4), 4
(0, 1, 2, 3, 4)
>>> [*range(4), 4]
[0, 1, 2, 3, 4]
See also:
While interpolation is usually thought of as a string operation, there are cases where
interpolation on bytes or bytearrays makes sense, and the work needed to make up for this
missing functionality detracts from the overall readability of the code. This issue is particularly
https://docs.python.org/3.5/whatsnew/3.5.html 5/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
important when dealing with wire format protocols, which are often a mixture of binary and
ASCII compatible text.
Examples:
>>>
>>> b'Hello %b!' % b'World'
b'Hello World!'
>>>
>>> b'Hello %b!' % 'World'
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
TypeError: %b requires bytes, or an object that implements __bytes__, not 'str
Note that %s and %r conversion types, although supported, should only be used in codebases
that need compatibility with Python 2.
See also:
Experience has shown that the majority of function annotation uses were to provide type hints
to function parameters and return values. It became evident that it would be beneficial for
Python users, if the standard library included the base definitions and tools for type
annotations.
PEP 484 introduces a provisional module to provide these standard definitions and tools,
along with some conventions for situations where annotations are not available.
For example, here is a simple function whose argument and return type are declared in the
annotations:
https://docs.python.org/3.5/whatsnew/3.5.html 6/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
While these annotations are available at runtime through the usual __annotations__
attribute, no automatic type checking happens at runtime. Instead, it is assumed that a
separate off-line type checker (e.g. mypy) will be used for on-demand source code analysis.
The type system supports unions, generic types, and a special type named Any which is
consistent with (i.e. assignable to and from) all types.
See also:
Additionally, scandir returns an iterator, as opposed to returning a list of file names, which
improves memory efficiency when iterating over very large directories.
The following example shows a simple use of os.scandir() to display all the files (excluding
directories) in the given path that don’t start with '.' . The entry.is_file() call will
generally not make an additional system call:
See also:
https://docs.python.org/3.5/whatsnew/3.5.html 7/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
The first option makes an application fail intermittently. The second option adds a large
amount of boilerplate that makes the code nearly unreadable. Compare:
print("Hello World")
and:
while True:
try:
print("Hello World")
break
except InterruptedError:
continue
PEP 475 implements automatic retry of system calls on EINTR . This removes the burden of
dealing with EINTR or InterruptedError in user code in most situations and makes Python
programs, including the standard library, more robust. Note that the system call is only retried
if the signal handler does not raise an exception.
Below is a list of functions which are now retried when interrupted by a signal:
See also:
https://docs.python.org/3.5/whatsnew/3.5.html 8/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
inside a generator function was interpreted as the end of the iteration by the loop construct
driving the generator.
PEP 479 changes the behavior of generators: when a StopIteration exception is raised
inside a generator, it is replaced with a RuntimeError before it exits the generator frame. The
main goal of this change is to ease debugging in the situation where an unguarded next()
call raises StopIteration and causes the iteration controlled by the generator to terminate
silently. This is particularly pernicious in combination with the yield from construct.
This is a backwards incompatible change, so to enable the new behavior, a __future__ import
is necessary:
>>>
>>> from __future__ import generator_stop
The above exception was the direct cause of the following exception:
See also:
>>>
>>> import math
>>> a = 5.0
>>> b = 4.99998
>>> math.isclose(a, b, rel_tol=1e-5)
True
https://docs.python.org/3.5/whatsnew/3.5.html 9/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
It is also possible to compare two values using absolute tolerance, which must be a non-
negative value:
>>>
>>> import math
>>> a = 5.0
>>> b = 4.99998
>>> math.isclose(a, b, abs_tol=0.00003)
True
>>> math.isclose(a, b, abs_tol=0.00001)
False
See also:
PEP 486 makes the Windows launcher (see PEP 397) aware of an active virtual environment.
When the default interpreter would be used and the VIRTUAL_ENV environment variable is set,
the interpreter in the virtual environment will be used.
See also:
See also:
PEP 489 updates extension module initialization to take advantage of the two step module
loading mechanism introduced by PEP 451 in Python 3.4.
This change brings the import semantics of extension modules that opt-in to using the new
mechanism much closer to those of Python source and bytecode modules, including the
ability to use any valid identifier as a module name, rather than being restricted to ASCII.
See also:
New Modules
typing
The new typing provisional module provides standard definitions and tools for function type
annotations. See Type Hints for more information.
zipapp
The new zipapp module (specified in PEP 441) provides an API and command line tool for
creating executable Python Zip Applications, which were introduced in Python 2.6 in bpo-
1739468, but which were not well publicized, either at the time or since.
With the new module, bundling your application is as simple as putting all the files, including a
__main__.py file, into a directory myapp and running:
https://docs.python.org/3.5/whatsnew/3.5.html 11/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
Improved Modules
argparse
The ArgumentParser class now allows disabling abbreviated usage of long options by setting
allow_abbrev to False . (Contributed by Jonathan Paugh, Steven Bethard, paul j3 and Daniel
Eriksson in bpo-14910.)
asyncio
Since the asyncio module is provisional, all changes introduced in Python 3.5 have also
been backported to Python 3.4.x.
Updates in 3.5.1:
The ensure_future() function and all functions that use it, such as
loop.run_until_complete() , now accept all kinds of awaitable objects. (Contributed
by Yury Selivanov.)
New run_coroutine_threadsafe() function to submit coroutines to event loops from
other threads. (Contributed by Vincent Michel.)
New Transport.is_closing() method to check if the transport is closing or closed.
(Contributed by Yury Selivanov.)
https://docs.python.org/3.5/whatsnew/3.5.html 12/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
Updates in 3.5.2:
bz2
The BZ2Decompressor.decompress method now accepts an optional max_length argument to
limit the maximum size of decompressed data. (Contributed by Nikolaus Rath in bpo-15955.)
cgi
The FieldStorage class now supports the context manager protocol. (Contributed by Berker
Peksag in bpo-20289.)
cmath
A new function isclose() provides a way to test for approximate equality. (Contributed by
Chris Barker and Tal Einat in bpo-24270.)
code
collections
The OrderedDict class is now implemented in C, which makes it 4 to 100 times faster.
(Contributed by Eric Snow in bpo-16991.)
The deque class now defines index() , insert() , and copy() , and supports the + and *
operators. This allows deques to be recognized as a MutableSequence and improves their
https://docs.python.org/3.5/whatsnew/3.5.html 13/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
collections.abc
The Sequence.index() method now accepts start and stop arguments to match the
corresponding methods of tuple , list , etc. (Contributed by Devin Jeanpierre in bpo-23086.)
For earlier Python versions, a backport of the new ABCs is available in an external PyPI
package.
compileall
Another new option, -r , allows controlling the maximum recursion level for subdirectories.
(Contributed by Claudiu Popa in bpo-19628.)
The -q command line option can now be specified more than once, in which case all output,
including errors, will be suppressed. The corresponding quiet parameter in compile_dir() ,
compile_file() , and compile_path() can now accept an integer value indicating the level
of output suppression. (Contributed by Thomas Kluyver in bpo-21338.)
concurrent.futures
The Executor.map() method now accepts a chunksize argument to allow batching of tasks
to improve performance when ProcessPoolExecutor() is used. (Contributed by Dan O’Reilly
in bpo-11271.)
https://docs.python.org/3.5/whatsnew/3.5.html 14/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
The number of workers in the ThreadPoolExecutor constructor is optional now. The default
value is 5 times the number of CPUs. (Contributed by Claudiu Popa in bpo-21527.)
configparser
configparser now provides a way to customize the conversion of values by specifying a
dictionary of converters in the ConfigParser constructor, or by defining them as methods in
ConfigParser subclasses. Converters defined in a parser instance are inherited by its
section proxies.
Example:
>>>
>>> import configparser
>>> conv = {}
>>> conv['list'] = lambda v: [e.strip() for e in v.split() if e.strip()]
>>> cfg = configparser.ConfigParser(converters=conv)
>>> cfg.read_string("""
... [s]
... list = a b c d e f g
... """)
>>> cfg.get('s', 'list')
'a b c d e f g'
>>> cfg.getlist('s', 'list')
['a', 'b', 'c', 'd', 'e', 'f', 'g']
>>> section = cfg['s']
>>> section.getlist('list')
['a', 'b', 'c', 'd', 'e', 'f', 'g']
contextlib
>>>
>>> import contextlib, io, logging
>>> f = io.StringIO()
>>> with contextlib.redirect_stderr(f):
... logging.warning('warning')
...
>>> f.getvalue()
'WARNING:root:warning\n'
csv
The writerow() method now supports arbitrary iterables, not just sequences. (Contributed by
Serhiy Storchaka in bpo-23171.)
https://docs.python.org/3.5/whatsnew/3.5.html 15/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
curses
The new update_lines_cols() function updates the LINES and COLS environment variables.
This is useful for detecting manual screen resizing. (Contributed by Arnon Yaari in bpo-4254.)
dbm
dumb.open always creates a new database when the flag has the value "n" . (Contributed by
Claudiu Popa in bpo-18039.)
difflib
The charset of HTML documents generated by HtmlDiff.make_file() can now be
customized by using a new charset keyword-only argument. The default charset of HTML
document changed from "ISO-8859-1" to "utf-8" . (Contributed by Berker Peksag in bpo-
2052.)
The diff_bytes() function can now compare lists of byte strings. This fixes a regression
from Python 2. (Contributed by Terry J. Reedy and Greg Ward in bpo-17445.)
distutils
Both the build and build_ext commands now accept a -j option to enable parallel building
of extension modules. (Contributed by Antoine Pitrou in bpo-5309.)
The distutils module now supports xz compression, and can be enabled by passing xztar
as an argument to bdist --format . (Contributed by Serhiy Storchaka in bpo-16314.)
doctest
A new policy option Policy.mangle_from_ controls whether or not lines that start with "From
" in email bodies are prefixed with a ">" character by generators. The default is True for
compat32 and False for all other policies. (Contributed by Milan Oberkirch in bpo-20098.)
A new policy option EmailPolicy.utf8 can be set to True to encode email headers using the
UTF-8 charset instead of using encoded words. This allows Messages to be formatted
according to RFC 6532 and used with an SMTP server that supports the RFC 6531 SMTPUTF8
extension. (Contributed by R. David Murray in bpo-24211.)
https://docs.python.org/3.5/whatsnew/3.5.html 16/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
enum
The Enum callable has a new parameter start to specify the initial number of enum values if
only names are provided:
>>>
>>> Animal = enum.Enum('Animal', 'cat dog', start=10)
>>> Animal.cat
<Animal.cat: 10>
>>> Animal.dog
<Animal.dog: 11>
faulthandler
functools
Most of the lru_cache() machinery is now implemented in C, making it significantly faster.
(Contributed by Matt Joiner, Alexey Kachayev, and Serhiy Storchaka in bpo-14373.)
glob
The iglob() and glob() functions now support recursive search in subdirectories, using the
"**" pattern. (Contributed by Serhiy Storchaka in bpo-13968.)
gzip
The mode argument of the GzipFile constructor now accepts "x" to request exclusive
creation. (Contributed by Tim Heaney in bpo-19222.)
heapq
Element comparison in merge() can now be customized by passing a key function in a new
optional key keyword argument, and a new optional reverse keyword argument can be used
to reverse element comparison:
>>>
>>> import heapq
>>> a = ['9', '777', '55555']
>>> b = ['88', '6666']
>>> list(heapq.merge(a, b, key=len))
https://docs.python.org/3.5/whatsnew/3.5.html 17/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
http
A new HTTPStatus enum that defines a set of HTTP status codes, reason phrases and long
descriptions written in English. (Contributed by Demian Brecht in bpo-21793.)
http.client
import http.client
conn = http.client.HTTPConnection('www.python.org')
for retries in range(3):
try:
conn.request('GET', '/')
resp = conn.getresponse()
except http.client.RemoteDisconnected:
pass
imaplib
The IMAP4 class now supports the context manager protocol. When used in a with
statement, the IMAP4 LOGOUT command will be called automatically at the end of the block.
(Contributed by Tarek Ziadé and Serhiy Storchaka in bpo-4972.)
The imaplib module now supports RFC 5161 (ENABLE Extension) and RFC 6855 (UTF-8
Support) via the IMAP4.enable() method. A new IMAP4.utf8_enabled attribute tracks
whether or not RFC 6855 support is enabled. (Contributed by Milan Oberkirch, R. David
Murray, and Maciej Szulik in bpo-21800.)
The imaplib module now automatically encodes non-ASCII string usernames and passwords
using UTF-8, as recommended by the RFCs. (Contributed by Milan Oberkirch in bpo-21800.)
https://docs.python.org/3.5/whatsnew/3.5.html 18/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
imghdr
The what() function now recognizes the OpenEXR format (contributed by Martin Vignali and
Claudiu Popa in bpo-20295), and the WebP format (contributed by Fabrice Aneche and
Claudiu Popa in bpo-20197.)
importlib
The util.LazyLoader class allows for lazy loading of modules in applications where startup
time is important. (Contributed by Brett Cannon in bpo-17621.)
The new util.module_from_spec() function is now the preferred way to create a new
module. As opposed to creating a types.ModuleType instance directly, this new function will
set the various import-controlled attributes based on the passed-in spec object. (Contributed
by Brett Cannon in bpo-20383.)
inspect
Both the Signature and Parameter classes are now picklable and hashable. (Contributed by
Yury Selivanov in bpo-20726 and bpo-20334.)
>>>
>>> def foo(a, b='ham', *args): pass
>>> ba = inspect.signature(foo).bind('spam')
>>> ba.apply_defaults()
>>> ba.arguments
OrderedDict([('a', 'spam'), ('b', 'ham'), ('args', ())])
The signature() function now accepts a follow_wrapped optional keyword argument, which,
when set to False , disables automatic following of __wrapped__ links. (Contributed by Yury
Selivanov in bpo-20691.)
A set of new functions to inspect coroutine functions and coroutine objects has been added:
iscoroutine() , iscoroutinefunction() , isawaitable() , getcoroutinelocals() , and
getcoroutinestate() . (Contributed by Yury Selivanov in bpo-24017 and bpo-24400.)
io
A new BufferedIOBase.readinto1() method, that uses at most one call to the underlying
raw stream’s RawIOBase.read() or RawIOBase.readinto() methods. (Contributed by
Nikolaus Rath in bpo-20578.)
ipaddress
Both the IPv4Network and IPv6Network classes now accept an (address, netmask) tuple
argument, so as to easily construct network objects from existing addresses:
>>>
>>> import ipaddress
>>> ipaddress.IPv4Network(('127.0.0.0', 8))
IPv4Network('127.0.0.0/8')
>>> ipaddress.IPv4Network(('127.0.0.0', '255.0.0.0'))
IPv4Network('127.0.0.0/8')
A new reverse_pointer attribute for the IPv4Network and IPv6Network classes returns the
name of the reverse DNS PTR record:
>>>
>>> import ipaddress
>>> addr = ipaddress.IPv4Address('127.0.0.1')
>>> addr.reverse_pointer
'1.0.0.127.in-addr.arpa'
>>> addr6 = ipaddress.IPv6Address('::1')
>>> addr6.reverse_pointer
'1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.ip6.arpa'
json
The json.tool command line interface now preserves the order of keys in JSON objects
passed in input. The new --sort-keys option can be used to sort the keys alphabetically.
(Contributed by Berker Peksag in bpo-21650.)
JSON decoder now raises JSONDecodeError instead of ValueError to provide better context
information about the error. (Contributed by Serhiy Storchaka in bpo-19361.)
linecache
https://docs.python.org/3.5/whatsnew/3.5.html 20/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
locale
A new delocalize() function can be used to convert a string into a normalized number
string, taking the LC_NUMERIC settings into account:
>>>
>>> import locale
>>> locale.setlocale(locale.LC_NUMERIC, 'de_DE.UTF-8')
'de_DE.UTF-8'
>>> locale.delocalize('1.234,56')
'1234.56'
>>> locale.setlocale(locale.LC_NUMERIC, 'en_US.UTF-8')
'en_US.UTF-8'
>>> locale.delocalize('1,234.56')
'1234.56'
logging
All logging methods ( Logger log() , exception() , critical() , debug() , etc.), now accept
exception instances as an exc_info argument, in addition to boolean values and exception
tuples:
>>>
>>> import logging
>>> try:
... 1/0
... except ZeroDivisionError as ex:
... logging.error('exception', exc_info=ex)
ERROR:root:exception
lzma
The LZMADecompressor.decompress() method now accepts an optional max_length
argument to limit the maximum size of decompressed data. (Contributed by Martin Panter in
bpo-15955.)
math
https://docs.python.org/3.5/whatsnew/3.5.html 21/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
Two new constants have been added to the math module: inf and nan . (Contributed by Mark
Dickinson in bpo-23185.)
A new function isclose() provides a way to test for approximate equality. (Contributed by
Chris Barker and Tal Einat in bpo-24270.)
A new gcd() function has been added. The fractions.gcd() function is now deprecated.
(Contributed by Mark Dickinson and Serhiy Storchaka in bpo-22486.)
multiprocessing
sharedctypes.synchronized() objects now support the context manager protocol.
(Contributed by Charles-François Natali in bpo-21565.)
operator
os
The new scandir() function returning an iterator of DirEntry objects has been added. If
possible, scandir() extracts file attributes while scanning a directory, removing the need to
perform subsequent system calls to determine file type or attributes, which may significantly
improve performance. (Contributed by Ben Hoyt with the help of Victor Stinner in bpo-22524.)
The urandom() function now uses the getrandom() syscall on Linux 3.17 or newer, and
getentropy() on OpenBSD 5.6 and newer, removing the need to use /dev/urandom and
avoiding failures due to potential file descriptor exhaustion. (Contributed by Victor Stinner in
bpo-22181.)
New get_blocking() and set_blocking() functions allow getting and setting a file
descriptor’s blocking mode ( O_NONBLOCK .) (Contributed by Victor Stinner in bpo-22054.)
The truncate() and ftruncate() functions are now supported on Windows. (Contributed by
Steve Dower in bpo-23668.)
https://docs.python.org/3.5/whatsnew/3.5.html 22/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
>>>
>>> os.path.commonprefix(['/usr/lib', '/usr/local/lib'])
'/usr/l'
pathlib
The new Path.samefile() method can be used to check whether the path points to the
same file as another path, which can be either another Path object, or a string:
>>>
>>> import pathlib
>>> p1 = pathlib.Path('/etc/hosts')
>>> p2 = pathlib.Path('/etc/../etc/hosts')
>>> p1.samefile(p2)
True
The Path.mkdir() method now accepts a new optional exist_ok argument to match mkdir -
p and os.makedirs() functionality. (Contributed by Berker Peksag in bpo-21539.)
A new Path.home() class method can be used to get a Path instance representing the user’s
home directory. (Contributed by Victor Salgado and Mayank Tripathi in bpo-19777.)
The following code snippet will create or rewrite existing file ~/spam42 :
>>>
>>> import pathlib
>>> p = pathlib.Path('~/spam42')
>>> p.expanduser().write_text('ham')
3
pickle
Nested objects, such as unbound methods or nested classes, can now be pickled using pickle
protocols older than protocol version 4. Protocol version 4 already supports these cases.
(Contributed by Serhiy Storchaka in bpo-23611.)
poplib
https://docs.python.org/3.5/whatsnew/3.5.html 23/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
A new POP3.utf8() command enables RFC 6856 (Internationalized Email) support, if a POP
server supports it. (Contributed by Milan OberKirch in bpo-21804.)
re
References and conditional references to groups with fixed length are now allowed in
lookbehind assertions:
>>>
>>> import re
>>> pat = re.compile(r'(a|b).(?<=\1)c')
>>> pat.match('aac')
<_sre.SRE_Match object; span=(0, 3), match='aac'>
>>> pat.match('bbc')
<_sre.SRE_Match object; span=(0, 3), match='bbc'>
The sub() and subn() functions now replace unmatched groups with empty strings instead
of raising an exception. (Contributed by Serhiy Storchaka in bpo-1519638.)
The re.error exceptions have new attributes, msg , pattern , pos , lineno , and colno , that
provide better context information about the error:
>>>
>>> re.compile("""
... (?x)
... .++
... """)
Traceback (most recent call last):
...
sre_constants.error: multiple repeat at position 16 (line 3, column 7)
readline
selectors
The new DevpollSelector supports efficient /dev/poll polling on Solaris. (Contributed by
Giampaolo Rodola’ in bpo-18931.)
shutil
https://docs.python.org/3.5/whatsnew/3.5.html 24/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
The move() function now accepts a copy_function argument, allowing, for example, the
copy() function to be used instead of the default copy2() if there is a need to ignore file
metadata when moving. (Contributed by Claudiu Popa in bpo-19840.)
The make_archive() function now supports the xztar format. (Contributed by Serhiy
Storchaka in bpo-5411.)
signal
On Windows, the set_wakeup_fd() function now also supports socket handles. (Contributed
by Victor Stinner in bpo-22018.)
Various SIG* constants in the signal module have been converted into Enums . This allows
meaningful names to be printed during debugging, instead of integer “magic numbers”.
(Contributed by Giampaolo Rodola’ in bpo-21076.)
smtpd
Both the SMTPServer and SMTPChannel classes now accept a decode_data keyword
argument to determine if the DATA portion of the SMTP transaction is decoded using the
"utf-8" codec or is instead provided to the SMTPServer.process_message() method as a
byte string. The default is True for backward compatibility reasons, but will change to False
in Python 3.6. If decode_data is set to False , the process_message method must be
prepared to accept keyword arguments. (Contributed by Maciej Szulik in bpo-19662.)
The SMTPServer class now advertises the 8BITMIME extension (RFC 6152) if decode_data
has been set True . If the client specifies BODY=8BITMIME on the MAIL command, it is passed
to SMTPServer.process_message() via the mail_options keyword. (Contributed by Milan
Oberkirch and R. David Murray in bpo-21795.)
The SMTPServer class now also supports the SMTPUTF8 extension (RFC 6531:
Internationalized Email). If the client specified SMTPUTF8 BODY=8BITMIME on the MAIL
command, they are passed to SMTPServer.process_message() via the mail_options
keyword. It is the responsibility of the process_message method to correctly handle the
SMTPUTF8 data. (Contributed by Milan Oberkirch in bpo-21725.)
It is now possible to provide, directly or via name resolution, IPv6 addresses in the
SMTPServer constructor, and have it successfully connect. (Contributed by Milan Oberkirch in
bpo-14758.)
smtplib
A new SMTP.auth() method provides a convenient way to implement custom authentication
mechanisms. (Contributed by Milan Oberkirch in bpo-15014.)
Both the SMTP.sendmail() and SMTP.send_message() methods now support RFC 6531
(SMTPUTF8). (Contributed by Milan Oberkirch and R. David Murray in bpo-22027.)
sndhdr
The what() and whathdr() functions now return a namedtuple() . (Contributed by Claudiu
Popa in bpo-18615.)
socket
Functions with timeouts now use a monotonic clock, instead of a system clock. (Contributed
by Victor Stinner in bpo-22043.)
A new socket.sendfile() method allows sending a file over a socket by using the high-
performance os.sendfile() function on UNIX, resulting in uploads being from 2 to 3 times
faster than when using plain socket.send() . (Contributed by Giampaolo Rodola’ in bpo-
17552.)
The socket.sendall() method no longer resets the socket timeout every time bytes are
received or sent. The socket timeout is now the maximum total duration to send all data.
(Contributed by Victor Stinner in bpo-23853.)
The backlog argument of the socket.listen() method is now optional. By default it is set to
SOMAXCONN or to 128 , whichever is less. (Contributed by Charles-François Natali in bpo-
21455.)
ssl
Memory BIO Support
The new SSLObject class has been added to provide SSL protocol support for cases when
the network I/O capabilities of SSLSocket are not necessary or are suboptimal. SSLObject
represents an SSL protocol instance, but does not implement any network I/O methods, and
instead provides a memory buffer interface. The new MemoryBIO class can be used to pass
data between Python and an SSL protocol instance.
The memory BIO SSL support is primarily intended to be used in frameworks implementing
asynchronous I/O for which SSLSocket ’s readiness model (“select/poll”) is inefficient.
Where OpenSSL support is present, the ssl module now implements the Application-Layer
Protocol Negotiation TLS extension as described in RFC 7301.
https://docs.python.org/3.5/whatsnew/3.5.html 26/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
Other Changes
There is a new SSLSocket.version() method to query the actual protocol version in use.
(Contributed by Antoine Pitrou in bpo-20421.)
The cert_time_to_seconds() function now interprets the input time as UTC and not as local
time, per RFC 5280. Additionally, the return value is always an int . (Contributed by Akira Li in
bpo-19940.)
sqlite3
The Row class now fully supports the sequence protocol, in particular reversed() iteration
and slice indexing. (Contributed by Claudiu Popa in bpo-10203; by Lucas Sinclair, Jessica
McKellar, and Serhiy Storchaka in bpo-13583.)
subprocess
The new run() function has been added. It runs the specified command and returns a
CompletedProcess object, which describes a finished process. The new API is more
consistent and is the recommended approach to invoking subprocesses in Python code that
does not need to maintain compatibility with earlier Python versions. (Contributed by Thomas
Kluyver in bpo-23342.)
Examples:
https://docs.python.org/3.5/whatsnew/3.5.html 27/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
>>>
>>> subprocess.run(["ls", "-l"]) # doesn't capture output
CompletedProcess(args=['ls', '-l'], returncode=0)
sys
A new set_coroutine_wrapper() function allows setting a global hook that will be called
whenever a coroutine object is created by an async def function. A corresponding
get_coroutine_wrapper() can be used to obtain a currently set wrapper. Both functions are
provisional, and are intended for debugging purposes only. (Contributed by Yury Selivanov in
bpo-24017.)
A new is_finalizing() function can be used to check if the Python interpreter is shutting
down. (Contributed by Antoine Pitrou in bpo-22696.)
sysconfig
The name of the user scripts directory on Windows now includes the first two components of
the Python version. (Contributed by Paul Moore in bpo-23437.)
tarfile
The mode argument of the open() function now accepts "x" to request exclusive creation.
(Contributed by Berker Peksag in bpo-21717.)
The TarFile.list() now accepts an optional members keyword argument that can be set to
a subset of the list returned by TarFile.getmembers() . (Contributed by Serhiy Storchaka in
bpo-21549.)
threading
Both the Lock.acquire() and RLock.acquire() methods now use a monotonic clock for
timeout management. (Contributed by Victor Stinner in bpo-22043.)
https://docs.python.org/3.5/whatsnew/3.5.html 28/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
time
The monotonic() function is now always available. (Contributed by Victor Stinner in bpo-
22043.)
timeit
A new command line option -u or --unit=U can be used to specify the time unit for the timer
output. Supported options are usec , msec , or sec . (Contributed by Julian Gindi in bpo-18983.)
The timeit() function has a new globals parameter for specifying the namespace in which
the code will be running. (Contributed by Ben Roberts in bpo-2527.)
tkinter
The tkinter._fix module used for setting up the Tcl/Tk environment on Windows has been
replaced by a private function in the _tkinter module which makes no permanent changes
to environment variables. (Contributed by Zachary Ware in bpo-20035.)
traceback
New walk_stack() and walk_tb() functions to conveniently traverse frame and traceback
objects. (Contributed by Robert Collins in bpo-17911.)
Both the print_tb() and print_stack() functions now support negative values for the limit
argument. (Contributed by Dmitry Kazakov in bpo-22619.)
types
A new type called CoroutineType , which is used for coroutine objects created by async def
functions. (Contributed by Yury Selivanov in bpo-24400.)
unicodedata
unittest
https://docs.python.org/3.5/whatsnew/3.5.html 29/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
checked for load_tests regardless of whether their path matches pattern, because it is
impossible for a package name to match the default pattern. (Contributed by Robert Collins
and Barry A. Warsaw in bpo-16662.)
Unittest discovery errors now are exposed in the TestLoader.errors attribute of the
TestLoader instance. (Contributed by Robert Collins in bpo-19746.)
A new command line option --locals to show local variables in tracebacks. (Contributed by
Robert Collins in bpo-22936.)
unittest.mock
The Mock class has the following improvements:
The class constructor has a new unsafe parameter, which causes mock objects to raise
AttributeError on attribute names starting with "assert" . (Contributed by Kushal
Das in bpo-21238.)
A new Mock.assert_not_called() method to check if the mock object was called.
(Contributed by Kushal Das in bpo-21262.)
urllib
A new quote_via argument for the parse.urlencode() function provides a way to control the
encoding of query parts if needed. (Contributed by Samwyse and Arnon Yaari in bpo-13866.)
The parse.urljoin() was updated to use the RFC 3986 semantics for the resolution of
relative URLs, rather than RFC 1808 and RFC 2396. (Contributed by Demian Brecht and
Senthil Kumaran in bpo-22118.)
wsgiref
The headers argument of the headers.Headers class constructor is now optional.
(Contributed by Pablo Torres Navarrete and SilentGhost in bpo-5800.)
https://docs.python.org/3.5/whatsnew/3.5.html 30/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
xmlrpc
The client.ServerProxy class now supports the context manager protocol. (Contributed by
Claudiu Popa in bpo-20627.)
xml.sax
zipfile
ZIP output can now be written to unseekable streams. (Contributed by Serhiy Storchaka in
bpo-23252.)
The mode argument of ZipFile.open() method now accepts "x" to request exclusive
creation. (Contributed by Serhiy Storchaka in bpo-21717.)
Optimizations
The os.walk() function has been sped up by 3 to 5 times on POSIX systems, and by 7 to 20
times on Windows. This was done using the new os.scandir() function, which exposes file
information from the underlying readdir or FindFirstFile / FindNextFile system calls.
(Contributed by Ben Hoyt with help from Victor Stinner in bpo-23605.)
Construction of bytes(int) (filled by zero bytes) is faster and uses less memory for large
objects. calloc() is used instead of malloc() to allocate memory for these objects.
(Contributed by Victor Stinner in bpo-21233.)
Some operations on ipaddress IPv4Network and IPv6Network have been massively sped
up, such as subnets() , supernet() , summarize_address_range() ,
collapse_addresses() . The speed up can range from 3 to 15 times. (Contributed by Antoine
Pitrou, Michel Albert, and Markus in bpo-21486, bpo-21487, bpo-20826, bpo-23266.)
Many operations on io.BytesIO are now 50% to 100% faster. (Contributed by Serhiy
Storchaka in bpo-15381 and David Wilson in bpo-22003.)
The marshal.dumps() function is now faster: 65–85% with versions 3 and 4, 20–25% with
versions 0 to 2 on typical data, and up to 5 times in best cases. (Contributed by Serhiy
Storchaka in bpo-20416 and bpo-23344.)
The UTF-32 encoder is now 3 to 7 times faster. (Contributed by Serhiy Storchaka in bpo-
15027.)
Regular expressions are now parsed up to 10% faster. (Contributed by Serhiy Storchaka in
bpo-19380.)
The json.dumps() function was optimized to run with ensure_ascii=False as fast as with
ensure_ascii=True . (Contributed by Naoki Inada in bpo-23206.)
Objects from the random module now use 50% less memory on 64-bit builds. (Contributed by
Serhiy Storchaka in bpo-23488.)
The property() getter calls are up to 25% faster. (Contributed by Joe Jevnik in bpo-23910.)
String methods find() , rfind() , split() , partition() and the in string operator are now
significantly faster for searching 1-character substrings. (Contributed by Serhiy Storchaka in
bpo-23573.)
PyMem_RawCalloc() ,
PyMem_Calloc() ,
PyObject_Calloc() ,
_PyObject_GC_Calloc() .
https://docs.python.org/3.5/whatsnew/3.5.html 32/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
Windows builds now require Microsoft Visual C++ 14.0, which is available as part of Visual
Studio 2015.
Extension modules now include a platform information tag in their filename on some platforms
(the tag is optional, and CPython will import extensions without it, although if the tag is
present and mismatched, the extension won’t be loaded):
Deprecated
https://docs.python.org/3.5/whatsnew/3.5.html 33/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
New Keywords
async and await are not recommended to be used as variable, class, function or module
names. Introduced by PEP 492 in Python 3.5, they will become proper keywords in Python
3.7.
Raising the StopIteration exception inside a generator will now generate a silent
PendingDeprecationWarning , which will become a non-silent deprecation warning in Python
3.6 and will trigger a RuntimeError in Python 3.7. See PEP 479: Change StopIteration
handling inside generators for details.
The formatter module has now graduated to full deprecation and is still slated for removal in
Python 3.6.
The smtpd module has in the past always decoded the DATA portion of email messages
using the utf-8 codec. This can now be controlled by the new decode_data keyword to
SMTPServer . The default value is True , but this default is deprecated. Specify the
decode_data keyword with an appropriate value to avoid the deprecation warning.
Passing a format string as keyword argument format_string to the format() method of the
string.Formatter class has been deprecated. (Contributed by Serhiy Storchaka in bpo-
23671.)
Use of re.LOCALE flag with str patterns or re.ASCII is now deprecated. (Contributed by
Serhiy Storchaka in bpo-22407.)
Use of unrecognized special sequences consisting of '\' and an ASCII letter in regular
expression patterns and replacement patterns now raises a deprecation warning and will be
forbidden in Python 3.6. (Contributed by Serhiy Storchaka in bpo-23622.)
Removed
API and Feature Removals
The following obsolete and previously deprecated APIs and features have been removed:
The __version__ attribute has been dropped from the email package. The email code
hasn’t been shipped separately from the stdlib for a long time, and the __version__
string was not updated in the last few releases.
The internal Netrc class in the ftplib module was deprecated in 3.4, and has now
been removed. (Contributed by Matt Chaput in bpo-6623.)
The concept of .pyo files has been removed.
The JoinableQueue class in the provisional asyncio module was deprecated in 3.4.4
and is now removed. (Contributed by A. Jesse Jiryu Davis in bpo-23464.)
Due to an oversight, earlier Python versions erroneously accepted the following syntax:
Python 3.5 now correctly raises a SyntaxError , as generator expressions must be put
in parentheses if not a sole argument to a function.
https://docs.python.org/3.5/whatsnew/3.5.html 35/37
8/16/2020 What’s New In Python 3.5 — Python 3.5.9 documentation
debug_override parameter of the function is now deprecated. .pyo files are also no
longer supported as a file argument to the Python interpreter and thus serve no purpose
when distributed on their own (i.e. sourcless code distribution). Due to the fact that the
magic number for bytecode has changed in Python 3.5, all old .pyo files from previous
versions of Python are invalid regardless of this PEP.
The socket module now exports the CAN_RAW_FD_FRAMES constant on linux 3.6 and
greater.
The ssl.cert_time_to_seconds() function now interprets the input time as UTC and
not as local time, per RFC 5280. Additionally, the return value is always an int .
(Contributed by Akira Li in bpo-19940.)
The pygettext.py Tool now uses the standard +NNNN format for timezones in the
POT-Creation-Date header.
The smtplib module now uses sys.stderr instead of the previous module-level
stderr variable for debug output. If your (test) program depends on patching the
module-level variable to capture the debug output, you will need to update it to capture
sys.stderr instead.
The str.startswith() and str.endswith() methods no longer return True when
finding the empty string and the indexes are completely out of range. (Contributed by
Serhiy Storchaka in bpo-24284.)
The inspect.getdoc() function now returns documentation strings inherited from base
classes. Documentation strings no longer need to be duplicated if the inherited
documentation is appropriate. To suppress an inherited string, an empty string must be
specified (or the documentation may be filled in). This change affects the output of the
pydoc module and the help() function. (Contributed by Serhiy Storchaka in bpo-
15582.)
Nested functools.partial() calls are now flattened. If you were relying on the
previous behavior, you can now either add an attribute to a functools.partial()
object or you can create a subclass of functools.partial() . (Contributed by
Alexander Belopolsky in bpo-7830.)
https://docs.python.org/3.5/whatsnew/3.5.html 37/37