Theres A Lot
Theres A Lot
🤗
Why shouldn't I use Accelerate?
🤗
You shouldn't use Accelerate if you don't want to write a training loop yourself. There are
plenty of high-level libraries above PyTorch that will offer you that, Accelerate is not one of
them.
🤗
🤗
Frameworks using Accelerate
🤗
If you like the simplicity of Accelerate but would prefer a higher-level abstraction around its
capabilities, some frameworks and libraries that are built on top of Accelerate are listed
below:
Amphion is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support
reproducible research and help junior researchers and engineers get started in the field of
audio, music, and speech generation research and development.
Animus is a minimalistic framework to run machine learning experiments. Animus highlights
common "breakpoints" in ML experiments and provides a unified interface for them within
IExperiment.
Catalyst is a PyTorch framework for Deep Learning Research and Development. It focuses on
reproducibility, rapid experimentation, and codebase reuse so you can create something new
rather than write yet another train loop. Catalyst provides a Runner to connect all parts of the
experiment: hardware backend, data transformations, model training, and inference logic.
fastai is a PyTorch framework for Deep Learning that simplifies training fast and accurate neural
nets using modern best practices. fastai provides a Learner to handle the training, fine-tuning,
and inference of deep learning algorithms.
Finetuner is a service that enables models to create higher-quality embeddings for semantic
search, visual similarity search, cross-modal text<->image search, recommendation systems,
clustering, duplication detection, anomaly detection, or other uses.
InvokeAI is a creative engine for Stable Diffusion models, offering industry-leading WebUI,
terminal usage support, and serves as the foundation for many commercial products.
Kornia is a differentiable library that allows classical computer vision to be integrated into deep
learning models. Kornia provides a Trainer with the specific purpose to train and fine-tune the
supported deep learning algorithms within the library.
Open Assistant is a chat-based assistant that understands tasks, can interact with their party
systems, and retrieve information dynamically to do so.
pytorch-accelerated is a lightweight training library, with a streamlined feature set centered
around a general-purpose Trainer, that places a huge emphasis on simplicity and transparency;
enabling users to understand exactly what is going on under the hood, but without having to
write and maintain the boilerplate themselves!
Stable Diffusion web UI is an open-source browser-based easy-to-use interface based on the
Gradio library for Stable Diffusion.
torchkeras is a simple tool for training pytorch model just in a keras style, a dynamic and
beautiful plot is provided in notebook to monitor your loss or metric.
transformers as a tool for helping train state-of-the-art machine learning models in PyTorch,
Tensorflow, and JAX. (Accelerate is the backend for the PyTorch side).
Installation
This repository is tested on Python 3.8+ and PyTorch 1.10.0+
You should install 🤗Accelerate in a virtual environment. If you're unfamiliar with Python virtual
environments, check out the user guide.
First, create a virtual environment with the version of Python you're going to use and activate it.
🤗
Then, you will need to install PyTorch: refer to the official installation page regarding the specific
install command for your platform. Then Accelerate can be installed using pip as follows: