NVIDIA AI Enterprise

Product Support Matrix

PSM-10616-001 _v2.0 | June 2022

 Table of Contents
Chapter 1. Product Support Matrix......................................................................................1
Chapter 2. NVIDIA AI Enterprise Supported Cloud Services...............................................4
2.1. Amazon Web Services Elastic Compute Cloud (AWS EC2).....................................................4
2.2. Google Cloud Platform (GCP)...................................................................................................5
2.3. Microsoft Azure......................................................................................................................... 5
2.4. NVIDIA GPU Optimized VMI on CSP Marketplace...................................................................6
Chapter 3. CPU Only Server Support...................................................................................7

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | ii

Chapter 1. Product Support Matrix

Software
Hypervisor or Product Hardware Guest OS
1
Driver Package Bare-Metal OS Deployment Supported Support
NVIDIA AI ‣ VMware ‣ NVIDIA vGPU ‣ NVIDIA V100 ‣ Ubuntu 20.04
Enterprise 2.0 vSphere 6.7 LTS
‣ GPU pass ‣ NVIDIA T4
through ‣ Red Hat
Enterprise
Linux 8.4
‣ Red Hat
OpenShift
4.9 and later
using Red Hat
Linux CoreOS
(RHCOS)

‣ VMware ‣ NVIDIA vGPU ‣ NVIDIA A100X ‣ Ubuntu 20.04

vSphere LTS
Hypervisor ‣ GPU pass ‣ NVIDIA A100
through PCIe 40GB ‣ Red Hat
(ESXi) Enterprise
Enterprise ‣ NVIDIA A100
Linux 8.4
Plus Edition HGX 40GB
7.0 Update 3 ‣ NVIDIA A100 ‣ Red Hat
OpenShift
PCIe 80GB
‣ VMware 4.9 and later
vCenter Server ‣ NVIDIA A100 using Red Hat
7.0 Update 3 HGX 80GB Linux CoreOS
‣ VMware ‣ NVIDIA A40 (RHCOS)
vSphere
Hypervisor
‣ NVIDIA A30X
(ESXi) ‣ NVIDIA A30
Enterprise
‣ NVIDIA A10
Plus Edition
7.0 Update 2 ‣ NVIDIA A16
‣ VMware ‣ NVIDIA A2
vCenter Server
7.0 Update 2
‣ NVIDIA RTX
A6000
‣ NVIDIA RTX
A5500

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 1

 Product Support Matrix

Software
Hypervisor or Product Hardware Guest OS
1
Driver Package Bare-Metal OS Deployment Supported Support
‣ NVIDIA RTX
A5000
‣ NVIDIA T4
‣ NVIDIA V100

‣ Ubuntu 20.04 ‣ Bare-Metal OS ‣ NVIDIA A100X ‣ N/A

LTS
‣ NVIDIA A100
‣ Red Hat PCIe 40GB
Enterprise
Linux 8.4 ‣ NVIDIA A100
HGX 40GB
‣ Red Hat
‣ NVIDIA A100
OpenShift
PCIe 80GB
4.9 and later
using Red Hat ‣ NVIDIA A100
Linux CoreOS HGX 80GB
(RHCOS) ‣ NVIDIA A40
‣ NVIDIA A30X
‣ NVIDIA A30
‣ NVIDIA A10
‣ NVIDIA A16
‣ NVIDIA A2
‣ NVIDIA RTX
A6000
‣ NVIDIA RTX
A5500
‣ NVIDIA RTX
A5000
‣ NVIDIA T4
‣ NVIDIA V100

NVIDIA AI ‣ Since 1.1: ‣ NVIDIA vGPU ‣ NVIDIA V100 ‣ Ubuntu 20.04

Enterprise 1.x LTS
VMware ‣ GPU pass ‣ NVIDIA T4
vSphere 6.7 through ‣ Red Hat
Enterprise
Linux 8.4

‣ Since 1.1: ‣ NVIDIA vGPU ‣ NVIDIA A100 ‣ Ubuntu 20.04

PCIe 40GB LTS
VMware ‣ GPU pass
vSphere through ‣ NVIDIA A100 ‣ Since 1.1:
Hypervisor HGX 40GB
Red Hat
(ESXi) ‣ NVIDIA A100 Enterprise
Enterprise PCIe 80GB Linux 8.4

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 2

 Product Support Matrix

Software
Hypervisor or Product Hardware Guest OS
1
Driver Package Bare-Metal OS Deployment Supported Support
Plus Edition ‣ NVIDIA A100
7.0 Update 3 HGX 80GB
‣ Since 1.1: ‣ NVIDIA A40
VMware ‣ NVIDIA A30
vCenter Server
7.0 Update 3
‣ NVIDIA A10

‣ VMware ‣ NVIDIA A16

vSphere ‣ NVIDIA RTX
Hypervisor A6000
(ESXi)
‣ NVIDIA RTX
Enterprise A5000
Plus Edition
7.0 Update 2 ‣ NVIDIA T4

‣ VMware ‣ Since 1.1:

vCenter Server NVIDIA V100
7.0 Update 2

‣ Since 1.1: ‣ Since 1.1: ‣ NVIDIA A100 ‣ N/A

PCIe 40GB
Ubuntu 20.04 Bare-Metal OS
LTS ‣ NVIDIA A100
HGX 40GB
‣ Since 1.1:
‣ NVIDIA A100
Red Hat PCIe 80GB
Enterprise
Linux 8.4 ‣ NVIDIA A100
HGX 80GB
‣ NVIDIA A40
‣ NVIDIA A30
‣ NVIDIA A10
‣ NVIDIA A16
‣ NVIDIA RTX
A6000
‣ NVIDIA RTX
A5000
‣ NVIDIA T4
‣ NVIDIA V100

Notes
1
These GPUs are only supported with NVIDIA AI Enterprise compatible servers.

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 3

Chapter 2. NVIDIA AI Enterprise
Supported Cloud Services

NVIDIA AI Enterprise is supported on several cloud services with bring-your-own-license

(BYOL) licensing.

‣ Amazon Web Services Elastic Compute Cloud (AWS EC2)

‣ Google Cloud Platform (GCP)
‣ Microsoft Azure

2.1. Amazon Web Services Elastic

Compute Cloud (AWS EC2)
Supported AWS EC2 Supported Guest Operating
GPU Instances Systems
g4dn.xlarge
g4dn.2xlarge
g4dn.4xlarge
NVIDIA T4
g4dn.8xlarge
g4dn.12xlarge
g4dn.16xlarge
Red Hat Enterprise Linux 8.4
P3.2xlarge
Ubuntu 20.04
NVIDIA V100 P3.8xlarge
P3.16xlarge

g5.xlarge
g5.2xlarge
NVIDIA A10G
g5.4xlarge
g5.8xlarge

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 4

 NVIDIA AI Enterprise Supported Cloud Services

Supported AWS EC2 Supported Guest Operating

GPU Instances Systems
g5.12xlarge
g5.16xlarge
g5.24xlarge
g5.48xlarge

NVIDIA A100 p4d.24xlarge

2.2. Google Cloud Platform (GCP)

Supported Guest Operating
GPU Supported GCP Instances Systems
Tesla T4 Any predefined machine type.

Tesla V100 Any custom machine type that

can be created in a zone.

a2-highgpu-1g Red Hat Enterprise Linux 8.4

a2-highgpu-2g Ubuntu 20.04
Tesla A100 a2-highgpu-4g
a2-highgpu-8g
a2-megagpu-16g

2.3. Microsoft Azure

Supported Guest Operating
GPU Supported Azure Instances Systems
NC6s_v3
NC12s_v3
NVIDIA V100 NC24s_v3
NC24rs_v3
Red Hat Enterprise Linux 8.4
ND40rs_v2
Ubuntu 20.04
NC4asT4_v3
NC8asT4_v3
NVIDIA T4
NC16asT4_v3
NC64asT4_v3

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 5

 NVIDIA AI Enterprise Supported Cloud Services

Supported Guest Operating

GPU Supported Azure Instances Systems
ND96asr_v4
NVIDIA A100
ND96amsr_A100_v4

2.4. NVIDIA GPU Optimized VMI on CSP

Marketplace
For ease of use in the cloud, NVIDIA will also provide compute optimized and validated base
Virtual Machine Instances (VMI) through CSP marketplaces. The VMI includes key technologies
and software from NVIDIA for rapid deployment, management, and scaling of AI workloads in
the modern hybrid cloud.
The VMI will have the following software pre-installed:

‣ Ubuntu Server 20.04

‣ NVIDIA driver 470TRD - 470.103.01
‣ Docker-ce 20.10.12
‣ NVIDIA Container Toolkit 1.8.1
‣ NVIDIA Container Runtime 3.8.1

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 6

Chapter 3. CPU Only Server Support

NVIDIA AI Enterprise supports deployments on CPU only servers that are part of the NVIDIA
Certfied Systems list. Customers can deploy both GPU and CPU Only systems with VMware
vSphere or Red Hat Enterprise Linux.
NVIDIA AI Enterprise will support the following CPU enabled frameworks:

‣ TensorFlow
‣ PyTorch
‣ Triton Inference Server with FIL backend
‣ NVIDIA RAPIDS with XGBoost and Dask

NVIDIA AI Enterprise PSM-10616-001 _v2.0 | 7

Notice
This document is provided for information purposes only and shall not be regarded as a warranty of a certain functionality, condition, or quality of a product. NVIDIA
Corporation (“NVIDIA”) makes no representations or warranties, expressed or implied, as to the accuracy or completeness of the information contained in this
document and assumes no responsibility for any errors contained herein. NVIDIA shall have no liability for the consequences or use of such information or for any
infringement of patents or other rights of third parties that may result from its use. This document is not a commitment to develop, release, or deliver any Material
(defined below), code, or functionality.

NVIDIA reserves the right to make corrections, modifications, enhancements, improvements, and any other changes to this document, at any time without notice.

Customer should obtain the latest relevant information before placing orders and should verify that such information is current and complete.

NVIDIA products are sold subject to the NVIDIA standard terms and conditions of sale supplied at the time of order acknowledgement, unless otherwise agreed
in an individual sales agreement signed by authorized representatives of NVIDIA and customer (“Terms of Sale”). NVIDIA hereby expressly objects to applying any
customer general terms and conditions with regards to the purchase of the NVIDIA product referenced in this document. No contractual obligations are formed
either directly or indirectly by this document.

NVIDIA products are not designed, authorized, or warranted to be suitable for use in medical, military, aircraft, space, or life support equipment, nor in applications
where failure or malfunction of the NVIDIA product can reasonably be expected to result in personal injury, death, or property or environmental damage. NVIDIA
accepts no liability for inclusion and/or use of NVIDIA products in such equipment or applications and therefore such inclusion and/or use is at customer’s own risk.

NVIDIA makes no representation or warranty that products based on this document will be suitable for any specified use. Testing of all parameters of each product
is not necessarily performed by NVIDIA. It is customer’s sole responsibility to evaluate and determine the applicability of any information contained in this document,
ensure the product is suitable and fit for the application planned by customer, and perform the necessary testing for the application in order to avoid a default of
the application or the product. Weaknesses in customer’s product designs may affect the quality and reliability of the NVIDIA product and may result in additional
or different conditions and/or requirements beyond those contained in this document. NVIDIA accepts no liability related to any default, damage, costs, or problem
which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.

No license, either expressed or implied, is granted under any NVIDIA patent right, copyright, or other NVIDIA intellectual property right under this document.
Information published by NVIDIA regarding third-party products or services does not constitute a license from NVIDIA to use such products or services or a warranty
or endorsement thereof. Use of such information may require a license from a third party under the patents or other intellectual property rights of the third party,
or a license from NVIDIA under the patents or other intellectual property rights of NVIDIA.

Reproduction of information in this document is permissible only if approved in advance by NVIDIA in writing, reproduced without alteration and in full compliance
with all applicable export laws and regulations, and accompanied by all associated conditions, limitations, and notices.

THIS DOCUMENT AND ALL NVIDIA DESIGN SPECIFICATIONS, REFERENCE BOARDS, FILES, DRAWINGS, DIAGNOSTICS, LISTS, AND OTHER DOCUMENTS
(TOGETHER AND SEPARATELY, “MATERIALS”) ARE BEING PROVIDED “AS IS.” NVIDIA MAKES NO WARRANTIES, EXPRESSED, IMPLIED, STATUTORY, OR
OTHERWISE WITH RESPECT TO THE MATERIALS, AND EXPRESSLY DISCLAIMS ALL IMPLIED WARRANTIES OF NONINFRINGEMENT, MERCHANTABILITY, AND
FITNESS FOR A PARTICULAR PURPOSE. TO THE EXTENT NOT PROHIBITED BY LAW, IN NO EVENT WILL NVIDIA BE LIABLE FOR ANY DAMAGES, INCLUDING
WITHOUT LIMITATION ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES, HOWEVER CAUSED AND REGARDLESS OF
THE THEORY OF LIABILITY, ARISING OUT OF ANY USE OF THIS DOCUMENT, EVEN IF NVIDIA HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Notwithstanding any damages that customer might incur for any reason whatsoever, NVIDIA’s aggregate and cumulative liability towards customer for the products
described herein shall be limited in accordance with the Terms of Sale for the product.

VESA DisplayPort
DisplayPort and DisplayPort Compliance Logo, DisplayPort Compliance Logo for Dual-mode Sources, and DisplayPort Compliance Logo for Active Cables are
trademarks owned by the Video Electronics Standards Association in the United States and other countries.

HDMI
HDMI, the HDMI logo, and High-Definition Multimedia Interface are trademarks or registered trademarks of HDMI Licensing LLC.

OpenCL
OpenCL is a trademark of Apple Inc. used under license to the Khronos Group Inc.

Trademarks
NVIDIA, the NVIDIA logo, NVIDIA Maxwell, NVIDIA Pascal, NVIDIA Turing, NVIDIA Volta, Quadro, and Tesla are trademarks or registered trademarks of NVIDIA
Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated.

Copyright
© 2022 NVIDIA Corporation & affiliates. All rights reserved.

NVIDIA Corporation | 2788 San Tomas Expressway, Santa Clara, CA 95051

http://www.nvidia.com