Distributing Python Modules: Release 3.5.2rc1
Distributing Python Modules: Release 3.5.2rc1
Distributing Python Modules: Release 3.5.2rc1
Release 3.5.2rc1
CONTENTS
Key terms
How do I...?
5.1 ... choose a name for my project? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.2 ... create and distribute binary extensions? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
11
11
11
A Glossary
13
23
23
25
25
25
28
D Copyright
41
Index
43
ii
Email [email protected]
As a popular open source development project, Python has an active supporting community of contributors and
users that also make their software available for other Python developers to use under open source license terms.
This allows Python users to share and collaborate effectively, benefiting from the solutions others have already
created to common (and sometimes even rare!) problems, as well as potentially contributing their own solutions
to the common pool.
This guide covers the distribution part of the process. For a guide to installing other Python projects, refer to the
installation guide.
Note: For corporate and other institutional users, be aware that many organisations have their own policies around
using and contributing to open source software. Please take such policies into account when making use of the
distribution and installation tools provided with Python.
CONTENTS
CONTENTS
CHAPTER
ONE
KEY TERMS
the Python Packaging Index is a public repository of open source licensed packages made available for use
by other Python users
the Python Packaging Authority are the group of developers and documentation authors responsible for the
maintenance and evolution of the standard packaging tools and the associated metadata and file format standards. They maintain a variety of tools, documentation and issue trackers on both GitHub and BitBucket.
distutils is the original build and distribution system first added to the Python standard library in
1998. While direct use of distutils is being phased out, it still laid the foundation for the current
packaging and distribution infrastructure, and it not only remains part of the standard library, but its name
lives on in other ways (such as the name of the mailing list used to coordinate Python packaging standards
development).
setuptools is a (largely) drop-in replacement for distutils first published in 2004. Its most notable
addition over the unmodified distutils tools was the ability to declare dependencies on other packages.
It is currently recommended as a more regularly updated alternative to distutils that offers consistent
support for more recent packaging standards across a wide range of Python versions.
wheel (in this context) is a project that adds the bdist_wheel command to distutils/setuptools. This
produces a cross platform binary packaging format (called wheels or wheel files and defined in PEP
427) that allows Python libraries, even those including binary extensions, to be installed on a system without
needing to be built locally.
CHAPTER
TWO
In most parts of the world, software is automatically covered by copyright. This means that other developers
require explicit permission to copy, use, modify and redistribute the software.
Open source licensing is a way of explicitly granting such permission in a relatively consistent way, allowing
developers to share and collaborate efficiently by making common solutions to various problems freely available.
This leaves many developers free to spend more time focusing on the problems that are relatively unique to their
specific situation.
The distribution tools provided with Python are designed to make it reasonably straightforward for developers to
make their own contributions back to that common pool of software if they choose to do so.
The same distribution tools can also be used to distribute software within an organisation, regardless of whether
that software is published as open source software or not.
CHAPTER
THREE
The standard library does not include build tools that support modern Python packaging standards, as the core
development team has found that it is important to have standard tools that work consistently, even on older
versions of Python.
The currently recommended build and distribution tools can be installed by invoking the pip module at the
command line:
python -m pip install setuptools wheel twine
Note: For POSIX users (including Mac OS X and Linux users), these instructions assume the use of a virtual
environment.
For Windows users, these instructions assume that the option to adjust the system PATH environment variable was
selected when installing Python.
The Python Packaging User Guide includes more details on the currently recommended tools.
CHAPTER
FOUR
The Python Packaging User Guide covers the various key steps and elements involved in creating a project:
Project structure
Building and packaging the project
Uploading the project to the Python Packaging Index
10
CHAPTER
FIVE
HOW DO I...?
11
12
APPENDIX
GLOSSARY
>>> The default Python prompt of the interactive shell. Often seen for code examples which can be executed
interactively in the interpreter.
... The default Python prompt of the interactive shell when entering code for an indented code block or within
a pair of matching left and right delimiters (parentheses, square brackets or curly braces).
2to3 A tool that tries to convert Python 2.x code to Python 3.x code by handling most of the incompatibilities
which can be detected by parsing the source and traversing the parse tree.
2to3 is available in the standard library as lib2to3; a standalone entry point is provided as
Tools/scripts/2to3. See 2to3-reference.
abstract base class Abstract base classes complement duck-typing by providing a way to define interfaces when
other techniques like hasattr() would be clumsy or subtly wrong (for example with magic methods).
ABCs introduce virtual subclasses, which are classes that dont inherit from a class but are still recognized
by isinstance() and issubclass(); see the abc module documentation. Python comes with many
built-in ABCs for data structures (in the collections.abc module), numbers (in the numbers module), streams (in the io module), import finders and loaders (in the importlib.abc module). You can
create your own ABCs with the abc module.
argument A value passed to a function (or method) when calling the function. There are two kinds of argument:
keyword argument: an argument preceded by an identifier (e.g. name=) in a function call or passed
as a value in a dictionary preceded by **. For example, 3 and 5 are both keyword arguments in the
following calls to complex():
complex(real=3, imag=5)
complex(**{'real': 3, 'imag': 5})
positional argument: an argument that is not a keyword argument. Positional arguments can appear
at the beginning of an argument list and/or be passed as elements of an iterable preceded by *. For
example, 3 and 5 are both positional arguments in the following calls:
complex(3, 5)
complex(*(3, 5))
Arguments are assigned to the named local variables in a function body. See the calls section for the rules
governing this assignment. Syntactically, any expression can be used to represent an argument; the evaluated
value is assigned to the local variable.
See also the parameter glossary entry, the FAQ question on the difference between arguments and parameters, and PEP 362.
asynchronous context manager An object which controls the environment seen in an async with statement
by defining __aenter__() and __aexit__() methods. Introduced by PEP 492.
asynchronous iterable An object, that can be used in an async for statement. Must return an asynchronous
iterator from its __aiter__() method. Introduced by PEP 492.
asynchronous iterator An object that implements __aiter__() and __anext__() methods. __anext__
must return an awaitable object. async for resolves awaitable returned from asynchronous iterators
__anext__() method until it raises StopAsyncIteration exception. Introduced by PEP 492.
13
attribute A value associated with an object which is referenced by name using dotted expressions. For example,
if an object o has an attribute a it would be referenced as o.a.
awaitable An object that can be used in an await expression. Can be a coroutine or an object with an
__await__() method. See also PEP 492.
BDFL Benevolent Dictator For Life, a.k.a. Guido van Rossum, Pythons creator.
binary file A file object able to read and write bytes-like objects.
See also:
A text file reads and writes str objects.
bytes-like object An object that supports the bufferobjects and can export a C-contiguous buffer. This includes
all bytes, bytearray, and array.array objects, as well as many common memoryview objects.
Bytes-like objects can be used for various operations that work with binary data; these include compression,
saving to a binary file, and sending over a socket.
Some operations need the binary data to be mutable. The documentation often refers to these as readwrite bytes-like objects. Example mutable buffer objects include bytearray and a memoryview of
a bytearray. Other operations require the binary data to be stored in immutable objects (read-only
bytes-like objects); examples of these include bytes and a memoryview of a bytes object.
bytecode Python source code is compiled into bytecode, the internal representation of a Python program in
the CPython interpreter. The bytecode is also cached in .pyc and .pyo files so that executing the same
file is faster the second time (recompilation from source to bytecode can be avoided). This intermediate
language is said to run on a virtual machine that executes the machine code corresponding to each bytecode.
Do note that bytecodes are not expected to work between different Python virtual machines, nor to be stable
between Python releases.
A list of bytecode instructions can be found in the documentation for the dis module.
class A template for creating user-defined objects. Class definitions normally contain method definitions which
operate on instances of the class.
coercion The implicit conversion of an instance of one type to another during an operation which involves two
arguments of the same type. For example, int(3.15) converts the floating point number to the integer 3,
but in 3+4.5, each argument is of a different type (one int, one float), and both must be converted to the
same type before they can be added or it will raise a TypeError. Without coercion, all arguments of even
compatible types would have to be normalized to the same value by the programmer, e.g., float(3)+4.5
rather than just 3+4.5.
complex number An extension of the familiar real number system in which all numbers are expressed as a sum
of a real part and an imaginary part. Imaginary numbers are real multiples of the imaginary unit (the square
root of -1), often written i in mathematics or j in engineering. Python has built-in support for complex
numbers, which are written with this latter notation; the imaginary part is written with a j suffix, e.g., 3+1j.
To get access to complex equivalents of the math module, use cmath. Use of complex numbers is a fairly
advanced mathematical feature. If youre not aware of a need for them, its almost certain you can safely
ignore them.
context manager An object which controls the environment seen in a with statement by defining
__enter__() and __exit__() methods. See PEP 343.
contiguous A buffer is considered contiguous exactly if it is either C-contiguous or Fortran contiguous. Zerodimensional buffers are C and Fortran contiguous. In one-dimensional arrays, the items must be laid out
in memory next to each other, in order of increasing indexes starting from zero. In multidimensional Ccontiguous arrays, the last index varies the fastest when visiting items in order of memory address. However,
in Fortran contiguous arrays, the first index varies the fastest.
coroutine Coroutines is a more generalized form of subroutines. Subroutines are entered at one point and exited
at another point. Coroutines can be entered, exited, and resumed at many different points. They can be
implemented with the async def statement. See also PEP 492.
14
Appendix A. Glossary
coroutine function A function which returns a coroutine object. A coroutine function may be defined with the
async def statement, and may contain await, async for, and async with keywords. These were
introduced by PEP 492.
CPython The canonical implementation of the Python programming language, as distributed on python.org. The
term CPython is used when necessary to distinguish this implementation from others such as Jython or
IronPython.
decorator A function returning another function, usually applied as a function transformation using the
@wrapper syntax. Common examples for decorators are classmethod() and staticmethod().
The decorator syntax is merely syntactic sugar, the following two function definitions are semantically
equivalent:
def f(...):
...
f = staticmethod(f)
@staticmethod
def f(...):
...
The same concept exists for classes, but is less commonly used there. See the documentation for function
definitions and class definitions for more about decorators.
descriptor Any object which defines the methods __get__(), __set__(), or __delete__(). When a
class attribute is a descriptor, its special binding behavior is triggered upon attribute lookup. Normally,
using a.b to get, set or delete an attribute looks up the object named b in the class dictionary for a, but
if b is a descriptor, the respective descriptor method gets called. Understanding descriptors is a key to a
deep understanding of Python because they are the basis for many features including functions, methods,
properties, class methods, static methods, and reference to super classes.
For more information about descriptors methods, see descriptors.
dictionary An associative array, where arbitrary keys are mapped to values. The keys can be any object with
__hash__() and __eq__() methods. Called a hash in Perl.
dictionary view The objects returned from dict.keys(), dict.values(), and dict.items() are
called dictionary views. They provide a dynamic view on the dictionarys entries, which means that when
the dictionary changes, the view reflects these changes. To force the dictionary view to become a full list
use list(dictview). See dict-views.
docstring A string literal which appears as the first expression in a class, function or module. While ignored
when the suite is executed, it is recognized by the compiler and put into the __doc__ attribute of the
enclosing class, function or module. Since it is available via introspection, it is the canonical place for
documentation of the object.
duck-typing A programming style which does not look at an objects type to determine if it has the right interface; instead, the method or attribute is simply called or used (If it looks like a duck and quacks like
a duck, it must be a duck.) By emphasizing interfaces rather than specific types, well-designed code improves its flexibility by allowing polymorphic substitution. Duck-typing avoids tests using type() or
isinstance(). (Note, however, that duck-typing can be complemented with abstract base classes.)
Instead, it typically employs hasattr() tests or EAFP programming.
EAFP Easier to ask for forgiveness than permission. This common Python coding style assumes the existence
of valid keys or attributes and catches exceptions if the assumption proves false. This clean and fast style
is characterized by the presence of many try and except statements. The technique contrasts with the
LBYL style common to many other languages such as C.
expression A piece of syntax which can be evaluated to some value. In other words, an expression is an accumulation of expression elements like literals, names, attribute access, operators or function calls which
all return a value. In contrast to many other languages, not all language constructs are expressions. There
are also statements which cannot be used as expressions, such as if. Assignments are also statements, not
expressions.
15
extension module A module written in C or C++, using Pythons C API to interact with the core and with user
code.
file object An object exposing a file-oriented API (with methods such as read() or write()) to an underlying
resource. Depending on the way it was created, a file object can mediate access to a real on-disk file or to
another type of storage or communication device (for example standard input/output, in-memory buffers,
sockets, pipes, etc.). File objects are also called file-like objects or streams.
There are actually three categories of file objects: raw binary files, buffered binary files and text files. Their
interfaces are defined in the io module. The canonical way to create a file object is by using the open()
function.
file-like object A synonym for file object.
finder An object that tries to find the loader for a module that is being imported.
Since Python 3.3, there are two types of finder: meta path finders for use with sys.meta_path, and path
entry finders for use with sys.path_hooks.
See PEP 302, PEP 420 and PEP 451 for much more detail.
floor division Mathematical division that rounds down to nearest integer. The floor division operator is //. For
example, the expression 11 // 4 evaluates to 2 in contrast to the 2.75 returned by float true division.
Note that (-11) // 4 is -3 because that is -2.75 rounded downward. See PEP 238.
function A series of statements which returns some value to a caller. It can also be passed zero or more arguments
which may be used in the execution of the body. See also parameter, method, and the function section.
function annotation An arbitrary metadata value associated with a function parameter or return value. Its syntax is explained in section function. Annotations may be accessed via the __annotations__ special
attribute of a function object.
Python itself does not assign any particular meaning to function annotations. They are intended to be
interpreted by third-party libraries or tools. See PEP 3107, which describes some of their potential uses.
__future__ A pseudo-module which programmers can use to enable new language features which are not compatible with the current interpreter.
By importing the __future__ module and evaluating its variables, you can see when a new feature was
first added to the language and when it becomes the default:
>>> import __future__
>>> __future__.division
_Feature((2, 2, 0, 'alpha', 2), (3, 0, 0, 'alpha', 0), 8192)
garbage collection The process of freeing memory when it is not used anymore. Python performs garbage
collection via reference counting and a cyclic garbage collector that is able to detect and break reference
cycles.
generator A function which returns a generator iterator. It looks like a normal function except that it contains
yield expressions for producing a series of values usable in a for-loop or that can be retrieved one at a
time with the next() function.
Usually refers to a generator function, but may refer to a generator iterator in some contexts. In cases where
the intended meaning isnt clear, using the full terms avoids ambiguity.
generator iterator An object created by a generator function.
Each yield temporarily suspends processing, remembering the location execution state (including local
variables and pending try-statements). When the generator iterator resumes, it picks-up where it left-off (in
contrast to functions which start fresh on every invocation).
generator expression An expression that returns an iterator. It looks like a normal expression followed by a
for expression defining a loop variable, range, and an optional if expression. The combined expression
generates values for an enclosing function:
>>> sum(i*i for i in range(10))
285
16
Appendix A. Glossary
generic function A function composed of multiple functions implementing the same operation for different
types. Which implementation should be used during a call is determined by the dispatch algorithm.
See also the single dispatch glossary entry, the functools.singledispatch() decorator, and PEP
443.
GIL See global interpreter lock.
global interpreter lock The mechanism used by the CPython interpreter to assure that only one thread executes
Python bytecode at a time. This simplifies the CPython implementation by making the object model (including critical built-in types such as dict) implicitly safe against concurrent access. Locking the entire
interpreter makes it easier for the interpreter to be multi-threaded, at the expense of much of the parallelism
afforded by multi-processor machines.
However, some extension modules, either standard or third-party, are designed so as to release the GIL when
doing computationally-intensive tasks such as compression or hashing. Also, the GIL is always released
when doing I/O.
Past efforts to create a free-threaded interpreter (one which locks shared data at a much finer granularity) have not been successful because performance suffered in the common single-processor case. It is
believed that overcoming this performance issue would make the implementation much more complicated
and therefore costlier to maintain.
hashable An object is hashable if it has a hash value which never changes during its lifetime (it needs a
__hash__() method), and can be compared to other objects (it needs an __eq__() method). Hashable objects which compare equal must have the same hash value.
Hashability makes an object usable as a dictionary key and a set member, because these data structures use
the hash value internally.
All of Pythons immutable built-in objects are hashable, while no mutable containers (such as lists or dictionaries) are. Objects which are instances of user-defined classes are hashable by default; they all compare
unequal (except with themselves), and their hash value is derived from their id().
IDLE An Integrated Development Environment for Python. IDLE is a basic editor and interpreter environment
which ships with the standard distribution of Python.
immutable An object with a fixed value. Immutable objects include numbers, strings and tuples. Such an object
cannot be altered. A new object has to be created if a different value has to be stored. They play an important
role in places where a constant hash value is needed, for example as a key in a dictionary.
import path A list of locations (or path entries) that are searched by the path based finder for modules to import.
During import, this list of locations usually comes from sys.path, but for subpackages it may also come
from the parent packages __path__ attribute.
importing The process by which Python code in one module is made available to Python code in another module.
importer An object that both finds and loads a module; both a finder and loader object.
interactive Python has an interactive interpreter which means you can enter statements and expressions at the
interpreter prompt, immediately execute them and see their results. Just launch python with no arguments
(possibly by selecting it from your computers main menu). It is a very powerful way to test out new ideas
or inspect modules and packages (remember help(x)).
interpreted Python is an interpreted language, as opposed to a compiled one, though the distinction can be
blurry because of the presence of the bytecode compiler. This means that source files can be run directly
without explicitly creating an executable which is then run. Interpreted languages typically have a shorter
development/debug cycle than compiled ones, though their programs generally also run more slowly. See
also interactive.
interpreter shutdown When asked to shut down, the Python interpreter enters a special phase where it gradually
releases all allocated resources, such as modules and various critical internal structures. It also makes several
calls to the garbage collector. This can trigger the execution of code in user-defined destructors or weakref
callbacks. Code executed during the shutdown phase can encounter various exceptions as the resources it
relies on may not function anymore (common examples are library modules or the warnings machinery).
17
The main reason for interpreter shutdown is that the __main__ module or the script being run has finished
executing.
iterable An object capable of returning its members one at a time. Examples of iterables include all sequence
types (such as list, str, and tuple) and some non-sequence types like dict, file objects, and objects
of any classes you define with an __iter__() or __getitem__() method. Iterables can be used in
a for loop and in many other places where a sequence is needed (zip(), map(), ...). When an iterable
object is passed as an argument to the built-in function iter(), it returns an iterator for the object. This
iterator is good for one pass over the set of values. When using iterables, it is usually not necessary to call
iter() or deal with iterator objects yourself. The for statement does that automatically for you, creating
a temporary unnamed variable to hold the iterator for the duration of the loop. See also iterator, sequence,
and generator.
iterator An object representing a stream of data. Repeated calls to the iterators __next__() method (or
passing it to the built-in function next()) return successive items in the stream. When no more data are
available a StopIteration exception is raised instead. At this point, the iterator object is exhausted and
any further calls to its __next__() method just raise StopIteration again. Iterators are required to
have an __iter__() method that returns the iterator object itself so every iterator is also iterable and may
be used in most places where other iterables are accepted. One notable exception is code which attempts
multiple iteration passes. A container object (such as a list) produces a fresh new iterator each time you
pass it to the iter() function or use it in a for loop. Attempting this with an iterator will just return the
same exhausted iterator object used in the previous iteration pass, making it appear like an empty container.
More information can be found in typeiter.
key function A key function or collation function is a callable that returns a value used for sorting or ordering.
For example, locale.strxfrm() is used to produce a sort key that is aware of locale specific sort
conventions.
A number of tools in Python accept key functions to control how elements are ordered or grouped. They
include min(), max(), sorted(), list.sort(), heapq.merge(), heapq.nsmallest(),
heapq.nlargest(), and itertools.groupby().
There are several ways to create a key function. For example. the str.lower() method can serve
as a key function for case insensitive sorts. Alternatively, a key function can be built from a lambda
expression such as lambda r: (r[0], r[2]). Also, the operator module provides three key
function constructors: attrgetter(), itemgetter(), and methodcaller(). See the Sorting
HOW TO for examples of how to create and use key functions.
keyword argument See argument.
lambda An anonymous inline function consisting of a single expression which is evaluated when the function is
called. The syntax to create a lambda function is lambda [arguments]: expression
LBYL Look before you leap. This coding style explicitly tests for pre-conditions before making calls or lookups.
This style contrasts with the EAFP approach and is characterized by the presence of many if statements.
In a multi-threaded environment, the LBYL approach can risk introducing a race condition between the looking and the leaping. For example, the code, if key in mapping: return
mapping[key] can fail if another thread removes key from mapping after the test, but before the lookup.
This issue can be solved with locks or by using the EAFP approach.
list A built-in Python sequence. Despite its name it is more akin to an array in other languages than to a linked
list since access to elements are O(1).
list comprehension A compact way to process all or part of the elements in a sequence and return a list
with the results. result = [{:#04x}.format(x) for x in range(256) if x % 2
== 0] generates a list of strings containing even hex numbers (0x..) in the range from 0 to 255. The
if clause is optional. If omitted, all elements in range(256) are processed.
loader An object that loads a module. It must define a method named load_module(). A loader is typically
returned by a finder. See PEP 302 for details and importlib.abc.Loader for an abstract base class.
mapping A container object that supports arbitrary key lookups and implements the methods specified in the Mapping or MutableMapping abstract base classes.
Examples include dict,
18
Appendix A. Glossary
19
object Any data with state (attributes or value) and defined behavior (methods). Also the ultimate base class of
any new-style class.
package A Python module which can contain submodules or recursively, subpackages. Technically, a package
is a Python module with an __path__ attribute.
See also regular package and namespace package.
parameter A named entity in a function (or method) definition that specifies an argument (or in some cases,
arguments) that the function can accept. There are five kinds of parameter:
positional-or-keyword: specifies an argument that can be passed either positionally or as a keyword
argument. This is the default kind of parameter, for example foo and bar in the following:
def func(foo, bar=None): ...
positional-only: specifies an argument that can be supplied only by position. Python has no syntax for
defining positional-only parameters. However, some built-in functions have positional-only parameters (e.g. abs()).
keyword-only: specifies an argument that can be supplied only by keyword. Keyword-only parameters
can be defined by including a single var-positional parameter or bare * in the parameter list of the
function definition before them, for example kw_only1 and kw_only2 in the following:
def func(arg, *, kw_only1, kw_only2): ...
var-positional: specifies that an arbitrary sequence of positional arguments can be provided (in addition to any positional arguments already accepted by other parameters). Such a parameter can be
defined by prepending the parameter name with *, for example args in the following:
def func(*args, **kwargs): ...
var-keyword: specifies that arbitrarily many keyword arguments can be provided (in addition to any
keyword arguments already accepted by other parameters). Such a parameter can be defined by
prepending the parameter name with **, for example kwargs in the example above.
Parameters can specify both optional and required arguments, as well as default values for some optional
arguments.
See also the argument glossary entry, the FAQ question on the difference between arguments and parameters, the inspect.Parameter class, the function section, and PEP 362.
path entry A single location on the import path which the path based finder consults to find modules for importing.
path entry finder A finder returned by a callable on sys.path_hooks (i.e. a path entry hook) which knows
how to locate modules given a path entry.
See importlib.abc.PathEntryFinder for the methods that path entry finders implement.
path entry hook A callable on the sys.path_hook list which returns a path entry finder if it knows how to
find modules on a specific path entry.
path based finder One of the default meta path finders which searches an import path for modules.
portion A set of files in a single directory (possibly stored in a zip file) that contribute to a namespace package,
as defined in PEP 420.
positional argument See argument.
provisional API A provisional API is one which has been deliberately excluded from the standard librarys
backwards compatibility guarantees. While major changes to such interfaces are not expected, as long as
they are marked provisional, backwards incompatible changes (up to and including removal of the interface)
may occur if deemed necessary by core developers. Such changes will not be made gratuitously they will
occur only if serious fundamental flaws are uncovered that were missed prior to the inclusion of the API.
Even for provisional APIs, backwards incompatible changes are seen as a solution of last resort - every
attempt will still be made to find a backwards compatible resolution to any identified problems.
20
Appendix A. Glossary
This process allows the standard library to continue to evolve over time, without locking in problematic
design errors for extended periods of time. See PEP 411 for more details.
provisional package See provisional API.
Python 3000 Nickname for the Python 3.x release line (coined long ago when the release of version 3 was
something in the distant future.) This is also abbreviated Py3k.
Pythonic An idea or piece of code which closely follows the most common idioms of the Python language,
rather than implementing code using concepts common to other languages. For example, a common idiom
in Python is to loop over all elements of an iterable using a for statement. Many other languages dont
have this type of construct, so people unfamiliar with Python sometimes use a numerical counter instead:
for i in range(len(food)):
print(food[i])
As opposed to the cleaner, Pythonic method:
for piece in food:
print(piece)
qualified name A dotted name showing the path from a modules global scope to a class, function or method
defined in that module, as defined in PEP 3155. For top-level functions and classes, the qualified name is
the same as the objects name:
>>> class C:
...
class D:
...
def meth(self):
...
pass
...
>>> C.__qualname__
'C'
>>> C.D.__qualname__
'C.D'
>>> C.D.meth.__qualname__
'C.D.meth'
When used to refer to modules, the fully qualified name means the entire dotted path to the module, including
any parent packages, e.g. email.mime.text:
>>> import email.mime.text
>>> email.mime.text.__name__
'email.mime.text'
reference count The number of references to an object. When the reference count of an object drops to zero,
it is deallocated. Reference counting is generally not visible to Python code, but it is a key element of the
CPython implementation. The sys module defines a getrefcount() function that programmers can
call to return the reference count for a particular object.
regular package A traditional package, such as a directory containing an __init__.py file.
See also namespace package.
__slots__ A declaration inside a class that saves memory by pre-declaring space for instance attributes and
eliminating instance dictionaries. Though popular, the technique is somewhat tricky to get right and is best
reserved for rare cases where there are large numbers of instances in a memory-critical application.
sequence An iterable which supports efficient element access using integer indices via the __getitem__()
special method and defines a __len__() method that returns the length of the sequence. Some built-in
sequence types are list, str, tuple, and bytes. Note that dict also supports __getitem__()
and __len__(), but is considered a mapping rather than a sequence because the lookups use arbitrary
immutable keys rather than integers.
The collections.abc.Sequence abstract base class defines a much richer interface that goes beyond just __getitem__() and __len__(), adding count(), index(), __contains__(), and
21
__reversed__(). Types that implement this expanded interface can be registered explicitly using
register().
single dispatch A form of generic function dispatch where the implementation is chosen based on the type of a
single argument.
slice An object usually containing a portion of a sequence. A slice is created using the subscript notation, []
with colons between numbers when several are given, such as in variable_name[1:3:5]. The bracket
(subscript) notation uses slice objects internally.
special method A method that is called implicitly by Python to execute a certain operation on a type, such as
addition. Such methods have names starting and ending with double underscores. Special methods are
documented in specialnames.
statement A statement is part of a suite (a block of code). A statement is either an expression or one of several
constructs with a keyword, such as if, while or for.
struct sequence A tuple with named elements. Struct sequences expose an interface similar to named tuple
in that elements can either be accessed either by index or as an attribute. However, they do not have
any of the named tuple methods like _make() or _asdict(). Examples of struct sequences include
sys.float_info and the return value of os.stat().
text encoding A codec which encodes Unicode strings to bytes.
text file A file object able to read and write str objects. Often, a text file actually accesses a byte-oriented
datastream and handles the text encoding automatically.
See also:
A binary file reads and write bytes objects.
triple-quoted string A string which is bound by three instances of either a quotation mark () or an apostrophe
(). While they dont provide any functionality not available with single-quoted strings, they are useful for a
number of reasons. They allow you to include unescaped single and double quotes within a string and they
can span multiple lines without the use of the continuation character, making them especially useful when
writing docstrings.
type The type of a Python object determines what kind of object it is; every object has a type. An objects type
is accessible as its __class__ attribute or can be retrieved with type(obj).
universal newlines A manner of interpreting text streams in which all of the following are recognized as ending
a line: the Unix end-of-line convention \n, the Windows convention \r\n, and the old Macintosh
convention \r. See PEP 278 and PEP 3116, as well as bytes.splitlines() for an additional use.
virtual environment A cooperatively isolated runtime environment that allows Python users and applications
to install and upgrade Python distribution packages without interfering with the behaviour of other Python
applications running on the same system.
See also scripts-pyvenv.
virtual machine A computer defined entirely in software. Pythons virtual machine executes the bytecode emitted by the bytecode compiler.
Zen of Python Listing of Python design principles and philosophies that are helpful in understanding and using
the language. The listing can be found by typing import this at the interactive prompt.
22
Appendix A. Glossary
APPENDIX
These documents are generated from reStructuredText sources by Sphinx, a document processor specifically written for the Python documentation.
Development of the documentation and its toolchain is an entirely volunteer effort, just like Python itself. If you
want to contribute, please take a look at the reporting-bugs page for information on how to do so. New volunteers
are always welcome!
Many thanks go to:
Fred L. Drake, Jr., the creator of the original Python documentation toolset and writer of much of the
content;
the Docutils project for creating reStructuredText and the Docutils suite;
Fredrik Lundh for his Alternative Python Reference project from which Sphinx got many good ideas.
23
24
APPENDIX
Derived from
n/a
1.2
1.5.2
1.6
1.6
2.0+1.6.1
2.0+1.6.1
2.1+2.0.1
2.1.1
2.1.2
2.1.1
Year
1991-1995
1995-1999
2000
2000
2001
2001
2001
2001
2002
2002
2001-now
Owner
CWI
CNRI
CNRI
BeOpen.com
CNRI
PSF
PSF
PSF
PSF
PSF
PSF
GPL compatible?
yes
yes
no
no
no
no
yes
yes
yes
yes
yes
Note: GPL-compatible doesnt mean that were distributing Python under the GPL. All Python licenses, unlike
the GPL, let you distribute a modified version without making your changes open source. The GPL-compatible
licenses make it possible to combine Python with other software that is released under the GPL; the others dont.
Thanks to the many outside volunteers who have worked under Guidos direction to make these releases possible.
25
2. Subject to the terms and conditions of this License Agreement, PSF hereby
grants Licensee a nonexclusive, royalty-free, world-wide license to reproduce,
analyze, test, perform and/or display publicly, prepare derivative works,
distribute, and otherwise use Python 3.5.2rc1 alone or in any derivative
version, provided, however, that PSF's License Agreement and PSF's notice of
copyright, i.e., ``Copyright 2001-2016 Python Software Foundation; All Rights
Reserved'' are retained in Python 3.5.2rc1 alone or in any derivative version
prepared by Licensee.
3. In the event Licensee prepares a derivative work that is based on or
incorporates Python 3.5.2rc1 or any part thereof, and wants to make the
derivative work available to others as provided herein, then Licensee hereby
agrees to include in any such work a brief summary of the changes made to Python
3.5.2rc1.
4. PSF is making Python 3.5.2rc1 available to Licensee on an ``AS IS'' basis.
PSF MAKES NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR IMPLIED. BY WAY OF
EXAMPLE, BUT NOT LIMITATION, PSF MAKES NO AND DISCLAIMS ANY REPRESENTATION OR
WARRANTY OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE
USE OF PYTHON 3.5.2rc1 WILL NOT INFRINGE ANY THIRD PARTY RIGHTS.
5. PSF SHALL NOT BE LIABLE TO LICENSEE OR ANY OTHER USERS OF PYTHON 3.5.2rc1
FOR ANY INCIDENTAL, SPECIAL, OR CONSEQUENTIAL DAMAGES OR LOSS AS A RESULT OF
MODIFYING, DISTRIBUTING, OR OTHERWISE USING PYTHON 3.5.2rc1, OR ANY DERIVATIVE
THEREOF, EVEN IF ADVISED OF THE POSSIBILITY THEREOF.
6. This License Agreement will automatically terminate upon a material breach of
its terms and conditions.
7. Nothing in this License Agreement shall be deemed to create any relationship
of agency, partnership, or joint venture between PSF and Licensee. This License
Agreement does not grant permission to use PSF trademarks or trade name in a
trademark sense to endorse or promote products or services of Licensee, or any
third party.
8. By copying, installing or otherwise using Python 3.5.2rc1, Licensee agrees
to be bound by the terms and conditions of this License Agreement.
2. Subject to the terms and conditions of this BeOpen Python License Agreement,
BeOpen hereby grants Licensee a non-exclusive, royalty-free, world-wide license
to reproduce, analyze, test, perform and/or display publicly, prepare derivative
works, distribute, and otherwise use the Software alone or in any derivative
version, provided, however, that the BeOpen Python License is retained in the
Software, alone or in any derivative version prepared by Licensee.
3. BeOpen is making the Software available to Licensee on an "AS IS" basis.
BEOPEN MAKES NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR IMPLIED. BY WAY OF
EXAMPLE, BUT NOT LIMITATION, BEOPEN MAKES NO AND DISCLAIMS ANY REPRESENTATION OR
26
27
TO
OR
OR
OF
28
C.3.2 Sockets
The socket module uses the functions, getaddrinfo(), and getnameinfo(), which are coded in separate
source files from the WIDE Project, http://www.wide.ad.jp/.
Copyright (C) 1995, 1996, 1997, and 1998 WIDE Project.
All rights reserved.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
1. Redistributions of source code must retain the above copyright
29
---------------------------------------------------------------------
31
Permission to use, copy, modify, and distribute this Python software and
its associated documentation for any purpose without fee is hereby
granted, provided that the above copyright notice appears in all copies,
and that both that copyright notice and this permission notice appear in
supporting documentation, and that the name of neither Automatrix,
Bioreason or Mojam Media be used in advertising or publicity pertaining to
distribution of the software without specific, written prior permission.
32
C.3.9 test_epoll
The test_epoll contains the following notice:
Copyright (c) 2001-2006 Twisted Matrix Laboratories.
Permission is hereby granted, free of charge, to any person obtaining
a copy of this software and associated documentation files (the
"Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to
permit persons to whom the Software is furnished to do so, subject to
the following conditions:
The above copyright notice and this permission notice shall be
included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
33
C.3.11 SipHash24
The file Python/pyhash.c contains Marek Majkowski implementation of Dan Bernsteins SipHash24 algorithm. The contains the following note:
<MIT License>
Copyright (c) 2013
34
C.3.13 OpenSSL
The modules hashlib, posix, ssl, crypt use the OpenSSL library for added performance if made available
by the operating system. Additionally, the Windows and Mac OS X installers for Python may include a copy of
the OpenSSL libraries, so we include a copy of the OpenSSL license here:
LICENSE ISSUES
==============
The OpenSSL toolkit stays under a dual license, i.e. both the conditions of
the OpenSSL License and the original SSLeay license apply to the toolkit.
See below for the actual license texts. Actually both licenses are BSD-style
Open Source licenses. In case of any license issues related to OpenSSL
please contact [email protected].
OpenSSL License
--------------/*
*
*
*
*
*
*
*
*
*
*
*
*
*
====================================================================
Copyright (c) 1998-2008 The OpenSSL Project. All rights reserved.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
1. Redistributions of source code must retain the above copyright
notice, this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright
notice, this list of conditions and the following disclaimer in
the documentation and/or other materials provided with the
distribution.
35
*
* 3. All advertising materials mentioning features or use of this
software must display the following acknowledgment:
*
"This product includes software developed by the OpenSSL Project
*
for use in the OpenSSL Toolkit. (http://www.openssl.org/)"
*
*
* 4. The names "OpenSSL Toolkit" and "OpenSSL Project" must not be used to
endorse or promote products derived from this software without
*
prior written permission. For written permission, please contact
*
[email protected].
*
*
* 5. Products derived from this software may not be called "OpenSSL"
nor may "OpenSSL" appear in their names without prior written
*
permission of the OpenSSL Project.
*
*
* 6. Redistributions of any form whatsoever must retain the following
acknowledgment:
*
"This product includes software developed by the OpenSSL Project
*
for use in the OpenSSL Toolkit (http://www.openssl.org/)"
*
*
* THIS SOFTWARE IS PROVIDED BY THE OpenSSL PROJECT ``AS IS'' AND ANY
* EXPRESSED OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE OpenSSL PROJECT OR
* ITS CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
* SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT
* NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
* LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
* HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
* STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
* ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
* OF THE POSSIBILITY OF SUCH DAMAGE.
* ====================================================================
*
* This product includes cryptographic software written by Eric Young
* ([email protected]). This product includes software written by Tim
* Hudson ([email protected]).
*
*/
Original SSLeay License
----------------------/*
*
*
*
*
*
*
*
*
*
*
*
*
*
*
36
C.3.14 expat
The pyexpat extension is built using an included copy of the expat sources unless the build is configured
--with-system-expat:
Copyright (c) 1998, 1999, 2000 Thai Open Source Software Center Ltd
and Clark Cooper
Permission is hereby granted, free of charge, to any person obtaining
a copy of this software and associated documentation files (the
"Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to
permit persons to whom the Software is furnished to do so, subject to
the following conditions:
37
The above copyright notice and this permission notice shall be included
in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
C.3.15 libffi
The _ctypes extension is built using an included copy of the libffi sources unless the build is configured
--with-system-libffi:
Copyright (c) 1996-2008
C.3.16 zlib
The zlib extension is built using an included copy of the zlib sources if the zlib version found on the system is
too old to be used for the build:
Copyright (C) 1995-2011 Jean-loup Gailly and Mark Adler
This software is provided 'as-is', without any express or implied
warranty. In no event will the authors be held liable for any damages
arising from the use of this software.
Permission is granted to anyone to use this software for any purpose,
including commercial applications, and to alter it and redistribute it
freely, subject to the following restrictions:
1. The origin of this software must not be misrepresented; you must not
claim that you wrote the original software. If you use this software
in a product, an acknowledgment in the product documentation would be
appreciated but is not required.
38
2. Altered source versions must be plainly marked as such, and must not be
misrepresented as being the original software.
3. This notice may not be removed or altered from any source distribution.
Jean-loup Gailly
[email protected]
Mark Adler
[email protected]
C.3.17 cfuhash
The implementation of the hash table used by the tracemalloc is based on the cfuhash project:
Copyright (c) 2005 Don Owens
All rights reserved.
This code is released under the BSD license:
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
* Redistributions of source code must retain the above copyright
notice, this list of conditions and the following disclaimer.
* Redistributions in binary form must reproduce the above
copyright notice, this list of conditions and the following
disclaimer in the documentation and/or other materials provided
with the distribution.
* Neither the name of the author nor the names of its
contributors may be used to endorse or promote products derived
from this software without specific prior written permission.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS
FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT,
INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
OF THE POSSIBILITY OF SUCH DAMAGE.
C.3.18 libmpdec
The _decimal Module is built using an included copy of the libmpdec library unless the build is configured
--with-system-libmpdec:
Copyright (c) 2008-2016 Stefan Krah. All rights reserved.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
39
40
APPENDIX
COPYRIGHT
See History and License for complete license and permissions information.
41
42
Appendix D. Copyright
INDEX
Symbols
..., 13
__future__, 16
__slots__, 21
>>>, 13
2to3, 13
file object, 16
file-like object, 16
finder, 16
floor division, 16
Fortran contiguous, 14
function, 16
function annotation, 16
A
abstract base class, 13
argument, 13
asynchronous context manager, 13
asynchronous iterable, 13
asynchronous iterator, 13
attribute, 14
awaitable, 14
B
BDFL, 14
binary file, 14
bytecode, 14
bytes-like object, 14
G
garbage collection, 16
generator, 16, 16
generator expression, 16, 16
generator iterator, 16
generic function, 17
GIL, 17
global interpreter lock, 17
H
hashable, 17
C-contiguous, 14
class, 14
coercion, 14
complex number, 14
context manager, 14
contiguous, 14
coroutine, 14
coroutine function, 15
CPython, 15
IDLE, 17
immutable, 17
import path, 17
importer, 17
importing, 17
interactive, 17
interpreted, 17
interpreter shutdown, 17
iterable, 18
iterator, 18
decorator, 15
descriptor, 15
dictionary, 15
dictionary view, 15
docstring, 15
duck-typing, 15
key function, 18
keyword argument, 18
E
EAFP, 15
expression, 15
extension module, 16
L
lambda, 18
LBYL, 18
list, 18
list comprehension, 18
loader, 18
M
mapping, 18
43
N
named tuple, 19
namespace, 19
namespace package, 19
nested scope, 19
new-style class, 19
single dispatch, 22
slice, 22
special method, 22
statement, 22
struct sequence, 22
T
text encoding, 22
text file, 22
triple-quoted string, 22
type, 22
U
universal newlines, 22
object, 20
virtual environment, 22
virtual machine, 22
package, 20
parameter, 20
path based finder, 20
path entry, 20
path entry finder, 20
path entry hook, 20
portion, 20
positional argument, 20
provisional API, 20
provisional package, 21
Python 3000, 21
Python Enhancement Proposals
PEP 238, 16
PEP 278, 22
PEP 302, 16, 18
PEP 3107, 16
PEP 3116, 22
PEP 3155, 21
PEP 343, 14
PEP 362, 13, 20
PEP 411, 21
PEP 420, 16, 19, 20
PEP 427, 3
PEP 443, 17
PEP 451, 16
PEP 492, 1315
Pythonic, 21
Zen of Python, 22
Q
qualified name, 21
R
reference count, 21
regular package, 21
S
sequence, 21
44
Index