Memmap pickle
This Python 3 module enables to store large structure in a python pickle, in such a way that the array can be memory-mapped instead of being copied in memory. This module is licensed under the LGPL3 license.
Currently, the container has to be a dictionnary (mmappickle.dict), which keys are strings of less than 256 bytes.
It supports any values, but it is only possible to memory-map numpy arrays and numpy masked arrays.
It also supports concurrent access (i.e. you can pass a mmappickle.dict as an argument which is called using the multiprocessing Python module).
Documentation
Documentation is available at http://mmappickle.readthedocs.io/
Citation
Fasnacht, (2018). mmappickle: Python 3 module to store memory-mapped numpy array in pickle format . Journal of Open Source Software, 3(26), 651, https://doi.org/10.21105/joss.00651
Contributing
Please post issues and pull requests on github. Alternatively, you can also send your patches by email.
The following tools are used to ensure good code quality:
| Tool | Status |
|---|---|
| travis-ci |  |
| AppVeyor | |
| Coveralls |  |