---
jupytext:
  text_representation:
    extension: .md
    format_name: myst
    format_version: 0.13
    jupytext_version: 1.11.1
kernelspec:
  display_name: Python 3
  language: python
  name: python3
---

# Saving and sharing your NumPy arrays

## What you'll learn

You'll save your NumPy arrays as zipped files and human-readable
comma-delimited files i.e. \*.csv. You will also learn to load both of these
file types back into NumPy workspaces.

## What you'll do

You'll learn two ways of saving and reading files--as compressed and as
text files--that will serve most of your storage needs in NumPy.

* You'll create two 1D arrays and one 2D array
* You'll save these arrays to files
* You'll remove variables from your workspace
* You'll load the variables from your saved file
* You'll compare zipped binary files to human-readable delimited files
* You'll finish with the skills of saving, loading, and sharing NumPy arrays


## What you'll need

* NumPy
* read-write access to your working directory

Load the necessary functions using the following command.

```{code-cell}
import numpy as np
```

In this tutorial, you will use the following Python, IPython magic, and NumPy functions:

* [`np.arange`](https://numpy.org/doc/stable/reference/generated/numpy.arange.html)
* [`np.savez`](https://numpy.org/doc/stable/reference/generated/numpy.savez.html)
* [`del`](https://docs.python.org/3/reference/simple_stmts.html#del)
* [`whos`](https://ipython.readthedocs.io/en/stable/interactive/magics.html#magic-whos)
* [`np.load`](https://numpy.org/doc/stable/reference/generated/numpy.load.html)
* [`np.block`](https://numpy.org/doc/stable/reference/generated/numpy.block.html)
* [`np.newaxis`](https://numpy.org/doc/stable/reference/constants.html?highlight=newaxis#numpy.newaxis)
* [`np.savetxt`](https://numpy.org/doc/stable/reference/generated/numpy.savetxt.html)
* [`np.loadtxt`](https://numpy.org/doc/stable/reference/generated/numpy.loadtxt.html)

+++

---

## Create your arrays

Now that you have imported the NumPy library, you can make a couple of
arrays; let's start with two 1D arrays, `x` and `y`, where `y =
x**2`.You
will assign `x` to the integers from 0 to 9 using
[`np.arange`](https://numpy.org/doc/stable/reference/generated/numpy.arange.html).

```{code-cell}
x = np.arange(10)
y = x ** 2
print(x)
print(y)
```

## Save your arrays with NumPy's [`savez`](https://numpy.org/doc/stable/reference/generated/numpy.savez.html?highlight=savez#numpy.savez)

Now you have two arrays in your workspace,

`x: [0 1 2 3 4 5 6 7 8 9]`

`y: [ 0  1  4  9 16 25 36 49 64 81]`

The first thing you will do is save them to a file as zipped arrays
using
[`savez`](https://numpy.org/doc/stable/reference/generated/numpy.savez.html?highlight=savez#numpy.savez).
You will use two options to label the arrays in the file,

1. `x_axis = x`: this option is assigning the name `x_axis` to the variable `x`
2. `y_axis = y`: this option is assigning the name `y_axis` to the variable `y`

```{code-cell}
np.savez("x_y-squared.npz", x_axis=x, y_axis=y)
```

## Remove the saved arrays and load them back with NumPy's [`load`](https://numpy.org/doc/stable/reference/generated/numpy.load.html#numpy.load)

In your current working directory, you should have a new file with the
name `x_y-squared.npz`. This file is a zipped binary of the two arrays,
`x` and `y`. Let's clear the workspace and load the values back in. This
`x_y-squared.npz` file contains two [NPY
format](https://numpy.org/doc/stable/reference/generated/numpy.lib.format.html#module-numpy.lib.format)
files. The NPY format is a [native binary
format](https://en.wikipedia.org/wiki/Binary_file). You cannot read
the numbers in a standard text editor or spreadsheet.

1. remove `x` and `y` from the workspaec with [`del`](https://docs.python.org/3/reference/simple_stmts.html#del)
2. load the arrays into the workspace in a dictionary with [`np.load`](https://numpy.org/doc/stable/reference/generated/numpy.load.html#numpy.load)

To see what variables are in the workspace, use the Jupyter/IPython
"magic" command
[`whos`](https://ipython.readthedocs.io/en/stable/interactive/magics.html#magic-whos).

```{code-cell}
del x, y
```

```{code-cell}
%whos
```

```{code-cell}
load_xy = np.load("x_y-squared.npz")

print(load_xy.files)
```

```{code-cell}
%whos
```

## Reassign the NpzFile arrays to `x` and `y`

You've now created the dictionary with an `NpzFile`-type. The
included files are `x_axis` and `y_axis` that you defined in your
`savez` command. You can reassign `x` and `y` to the `load_xy` files.

```{code-cell}
x = load_xy["x_axis"]
y = load_xy["y_axis"]
print(x)
print(y)
```

## Success
You have created, saved, deleted, and loaded the variables `x` and `y` using `savez` and `load`. Nice work.

## Another option: saving to human-readable csv
Let's consider another scenario, you want to share `x` and `y` with
other people or other programs. You may need human-readable text file
that is easier to share. Next, you use the
[`savetxt`](https://numpy.org/doc/stable/reference/generated/numpy.savetxt.html#numpy.savetxt)
to save `x` and `y` in a comma separated value file, `x_y-squared.csv`.
The resulting csv is composed of ASCII characters. You can load the file
back into NumPy or read it with other programs.

## Rearrange the data into a single 2D array
First, you have to create a single 2D array from your two 1D arrays. The
csv-filetype is a spreadsheet-style dataset. The csv arranges numbers in
rows--separated by new lines--and columns--separated by commas. If the
data is more complex e.g. multiple 2D arrays or higher dimensional
arrays, it is better to use `savez`. Here, you use
two NumPy functions to format the data:

1. [`np.block`](https://numpy.org/doc/stable/reference/generated/numpy.block.html?highlight=block#numpy.block): this function appends arrays together into a 2D array

2. [`np.newaxis`](https://numpy.org/doc/stable/reference/constants.html?highlight=newaxis#numpy.newaxis): this function forces the 1D array into a 2D column vector with 10 rows and 1 column.

```{code-cell}
array_out = np.block([x[:, np.newaxis], y[:, np.newaxis]])
print("the output array has shape ", array_out.shape, " with values:")
print(array_out)
```

## Save the data to csv file using [`savetxt`](https://numpy.org/doc/stable/reference/generated/numpy.savetxt.html#numpy.savetxt)

You use `savetxt` with a three options to make your file easier to read:

* `X = array_out`: this option tells `savetxt` to save your 2D array, `array_out`, to the file `x_y-squared.csv`
* `header = 'x, y'`: this option writes a header before any data that labels the columns of the csv
* `delimiter = ','`: this option tells `savetxt` to place a comma between each column in the file

```{code-cell}
np.savetxt("x_y-squared.csv", X=array_out, header="x, y", delimiter=",")
```

Open the file, `x_y-squared.csv`, and you'll see the following:

```{code-cell}
!head x_y-squared.csv
```

## Our arrays as a csv file

There are two features that you shoud notice here:

1. NumPy uses `#` to ignore headings when using `loadtxt`. If you're using
[`loadtxt`](https://numpy.org/doc/stable/reference/generated/numpy.loadtxt.html)
with other csv files, you can skip header rows with `skiprows =
<number_of_header_lines>`.
2. The integers were written in scientific notation. _You can_ specify
the format of the text using the `savetxt` option, [`fmt =
`](https://docs.python.org/3/library/string.html#formatstrings), but it
will still be written with ASCII characters. In general, you cannot
preserve the type of ASCII numbers as `float` or `int`.


Now, delete `x` and `y` again and assign them to your columns in `x-y_squared.csv`.

```{code-cell}
del x, y
```

```{code-cell}
load_xy = np.loadtxt("x_y-squared.csv", delimiter=",")
```

```{code-cell}
load_xy.shape
```

```{code-cell}
x = load_xy[:, 0]
y = load_xy[:, 1]
print(x)
print(y)
```

## Success, but remember your types

When you saved the arrays to the csv file, you did not preserve the
`int` type. When loading the arrays back into your workspace the default process will be to load the csv file as a 2D floating point array e.g. `load_xy.dtype == 'float64'` and `load_xy.shape == (10, 2)`.

+++

## Wrapping up

In conclusion, you can create, save, and load arrays in NumPy. Saving arrays makes sharing your work and collaboration much easier. There are other ways Python can save data to files, such as [pickle](https://docs.python.org/3/library/pickle.html), but `savez` and `savetxt` will serve most of your storage needs for future NumPy work and sharing with other people, respectively.

__Next steps__: you can import data with missing values from [Importing with genfromtext](https://numpy.org/devdocs/user/basics.io.genfromtxt.html) or learn more about general NumPy IO with [Reading and Writing Files](https://numpy.org/devdocs/user/how-to-io.html).