Code Llama vs. StarCoder vs. Wing Python IDE vs. tox Comparison Chart

StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub, including from 80+ programming languages, Git commits, GitHub issues, and Jupyter notebooks. Similar to LLaMA, we trained a ~15B parameter model for 1 trillion tokens. We fine-tuned StarCoderBase model for 35B Python tokens, resulting in a new model that we call StarCoder. We found that StarCoderBase outperforms existing open Code LLMs on popular programming benchmarks and matches or surpasses closed models such as code-cushman-001 from OpenAI (the original Codex model that powered early versions of GitHub Copilot). With a context length of over 8,000 tokens, the StarCoder models can process more input than any other open LLM, enabling a wide range of interesting applications. For example, by prompting the StarCoder models with a series of dialogues, we enabled them to act as a technical assistant.

tox aims to automate and standardize testing in Python. It is part of a larger vision of easing the packaging, testing and release process of Python software. tox is a generic virtualenv management and test command-line tool you can use for checking that your package installs correctly with different Python versions and interpreters, running your tests in each of the environments, configuring your test tool of choice, and acting as a frontend to continuous integration servers, greatly reducing boilerplate and merging CI and shell-based testing. First, install tox with pip install tox. Then put basic information about your project and the test environments you want your project to run in into a tox.ini file residing right next to your setup.py file. You can also try generating a tox.ini file automatically, by running tox-quickstart and then answering a few simple questions. Install and test your project against Python2.7 and Python3.6.