The Wayback Machine - https://web.archive.org/web/20240425222325/https://medium.

com/geekculture/install-cuda-and-cudnn-on-windows-linux-52d1501a8805

Search Write Sign up Sign in

Install CUDA and CUDNN on

Windows & Linux
Techzizou · Follow
Published in Geek Culture · 8 min read · Aug 24, 2021

-- 1

CONTENTS

CUDA & CUDNN FOR WINDOWS

CUDA & CUDNN FOR LINUX

( But first ✅Subscribe to my YouTube channel 👉🏻 https://bit.ly/3Ap3sdi 😁

😜)

CUDA & CUDNN FOR WINDOWS

STEP 1) Download and install CUDA Toolkit

Go to https://developer.nvidia.com/cuda-downloads to download the

latest CUDA Toolkit.
You can also download previous versions from the Archive of Previous CUDA
Releases under the Resources section on the same page given above.

( For this Tutorial, I will download and install CUDA 11.0. You can the latest
CUDA toolkit and its corresponding cuDNN file. This is just for
demonstration )

Go to Archive of Previous CUDA Releases and click on CUDA Toolkit 11.0

Update1.

On the next page, first, choose your operating system as Windows.

Next, choose your Architecture and version. For my system, the

architecture is x86_64 as I have a 64-bit system, and the version of
windows is 10. ( To know your system’s architecture, in Windows, go to
Control Panel -> System and Security -> System. It will be mentioned as
system type )

Next, choose any installer type to download. I have downloaded the exe
(local) type installer.

You will then see the installation instructions using the base installer
which is 2.7 GB in size. Once downloaded, click on the exe file and follow
on-screen prompts.

When the setup starts, select a location to extract the installer. Once that is
done the CUDA installer will start. Over there, choose Express installation
and click on Next. This will install the CUDA Toolkit on your system in the
location C:\Program Files\NVIDIA GPU Computing Toolkit.

Next, make sure to check if your Environment variables have the path to
CUDA as shown in the image. (It should automatically add the second path)
If it doesnt then manually add them to the System variables.

CUDA_PATH — -> C:\Program Files\NVIDIA GPU Computing

Toolkit\CUDA\v11.0

CUDA_PATH_V11_0 — → C:\Program Files\NVIDIA GPU Computing

Toolkit\CUDA\v11.0

STEP 2) Download and setup CUDNN

Go to https://developer.nvidia.com/cudnn to download the latest version of
CUDNN for the latest CUDA toolkit version OR go to
https://developer.nvidia.com/rdp/cudnn-archive to download a previous
version of CUDNN that is compatible with your CUDA toolkit.

NOTE: You have to be signed in using your Nvidia account to download

CUDNN. If you do not have an account, create one.

Since I have CUDA 11.0.1, I will download cuDNN 8.0.5 for CUDA 11.0

Click on cuDNN 8.0.5 and select cuDNN Library for Windows (x86).
Next, it will ask you to log in. Create an Nvidia account or sign in using
Google or Facebook. Once logged in you can download the cuDNN.
Download and extract it.

Copy the contents of the cuda folder inside the cuDNN folder to the path
where we installed CUDA in step 1 above. (We need the contents of the bin,
include & lib folders from cuDNN to be inside the bin, include and lib
folders of the CUDA directory)

COPY CONTENTS FROM THIS FOLDER

TO THIS FOLDER

Finally, just like we did for CUDA, we have to set the Environment variable
for cuDNN as well. See pic below.

Set System variable with the name CUDNN to point to the bin, include and
lib folders which we copied into the CUDA directory. Also, add these same
paths to the Path System variable.

The paths to add are mentioned below:

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0;

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0\bin;

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0\include;

C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0\lib;

NOTE: Make sure to add these paths to both the CUDNN and Path System
variables.

That’s it. We have successfully set up CUDA and cuDNN on our Windows
System.

CUDA & CUDNN FOR LINUX

LET’S BEGIN

STEP 1) Download and install CUDA Toolkit

Go to https://developer.nvidia.com/cuda-downloads to download the

latest CUDA Toolkit.
You can also download previous versions from the Archive of Previous CUDA
Releases under the Resources section on the same page given above.

(For this Tutorial, I will download and install CUDA 11.0. You can the latest
CUDA toolkit and its corresponding cuDNN file. This is just for
demonstration.)

Go to Archive of Previous CUDA Releases and click on CUDA Toolkit 11.0

Update1.

On the next page, first, choose your operating system as Linux.

Next, choose your Architecture, distribution, and version. For my system,

the architecture is x86_64 as I have a 64-bit Ubuntu system, and the
version of Ubuntu is 18.04.

Next, choose any installer type to download. I have downloaded the

runfile (local) type installer.

You will then see a few commands in the installation instructions for the
base installer.
 Next, open a terminal.

Firstly, run the following commands to update and upgrade all the
packages on your Ubuntu.

sudo apt-get update

sudo apt-get upgrade

Next, install all the necessary dependencies

sudo apt-get install build-essential cmake unzip pkg-config

sudo apt-get install gcc-6 g++-6
sudo apt-get install libxmu-dev libxi-dev libglu1-mesa libglu1-mesa-
dev
sudo apt-get install libjpeg-dev libpng-dev libtiff-dev
sudo apt-get install libavcodec-dev libavformat-dev libswscale-dev
libv4l-dev
sudo apt-get install libxvidcore-dev libx264-dev
sudo apt-get install libopenblas-dev libatlas-base-dev liblapack-dev
gfortran
sudo apt-get install libhdf5-serial-dev
sudo apt-get install python3-dev python3-tk python-imaging-tk
sudo apt-get install libgtk-3-dev

Next, add the ppa:graphics-drivers/ppa repository into your system.

sudo add-apt-repository ppa:graphics-drivers/ppa

sudo apt update

Next, install the NVidia driver compatible with your CUDA version. For
CUDA 11.0 the minimum driver version for Linux is >= 450.36.06.

sudo apt-get install nvidia-driver-450

(You can read about the minimum driver versions required here on the links
given below.)

https://web.archive.org/web/20240425222325/https://docs.nvidia.com/deploy/
cuda-compatibility/index.html

https://web.archive.org/web/20240425222325/https://docs.nvidia.com/cuda/c
uda-toolkit-release-notes/index.html

Next, create a folder and run the commands from the installation
instructions for the base installer.

cd ~
mkdir installers
cd installers/
wget
https://developer.download.nvidia.com/compute/cuda/11.0.3/local_insta
llers/cuda_11.0.3_450.51.06_linux.run
sudo sh cuda_11.0.3_450.51.06_linux.run

When the setup starts accept the EULA agreement, then on the next
screen uncheck the NVidia driver option since we have already installed
it manually earlier, and finally press Enter to install CUDA.

You’ll see a summary at the end of the CUDA installation as shown below.

Next, open the bashrc script file using the following command.

nano ~/.bashrc

Add the following lines at the end of the bashrc file.

# NVIDIA CUDA TOOLKIT

export PATH=/usr/local/cuda-11.0/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-
11.0/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

The bashrc file looks like below:

Press Ctrl + x, y, and Enter to save changes.

Next, run the source command to update your current shell

environment.

source ~/.bashrc

That’s it! We have successfully installed CUDA on our system. Run sudo
reboot to restart your system for the new changes to take effect. After
ubuntu restarts, you can confirm your CUDA installation by running nvcc -V
and nvidia-smi commands.

STEP 2) Download and setup CUDNN

Go to https://developer.nvidia.com/cudnn to download the latest version of
CUDNN for the latest CUDA toolkit version OR go to
https://developer.nvidia.com/rdp/cudnn-archive to download a previous
version of CUDNN that is compatible with your CUDA toolkit.

NOTE: You have to be signed in using your Nvidia account to download

CUDNN. If you do not have an account, create one.

Since I have CUDA 11.0.1, I will download cuDNN 8.0.5 for CUDA 11.0

Click on cuDNN 8.0.5 and select cuDNN Library for Linux (x86_64).

NOTE: You can check your architecture using the command uname -m in a
terminal.

Next, it will ask you to log in. Create an Nvidia account or sign in using
Google or Facebook. Once logged in you can download the cuDNN file.

Copy the downloaded cuDNN zip file to the installers folder.

Unzip the cuDNN zip file using the following command. You will see a
folder named cuda with include and lib64 sub-folders in it after unzipping
this.

tar -zxf cudnn-11.0-linux-x64-v8.0.5.39.tgz

Next, we have to copy the contents of these sub-folders to the path where
we installed CUDA in step 1 above.

COPY CONTENTS FROM THE CUDA FOLDER UNZIPPED FROM CUDNN TO

THE MAIN CUDA DIRECTORY

We need the contents of the include & lib64 folders from cuDNN to be
inside the include and lib64 folders of the CUDA directory (where we
installed CUDA shown in step 1 above). Run the following commands:

cd cuda
sudo cp -P lib64/* /usr/local/cuda/lib64/
sudo cp -P include/* /usr/local/cuda/include/

That’s it. We have successfully set up CUDA and cuDNN on our Linux Ubuntu
18.04 system.

References
https://web.archive.org/web/20240425222325/https://developer.nvidia.com/
 Cuda Cudnn Machine Learning AI

Written by Techzizou Follow

321 Followers · Writer for Geek Culture

Data Scientist, AI & ML enthusiast (More tutorials at https://www.techzizou.in )

Help Status About Careers Blog Privacy Terms Text to speech Teams