ThinkSystem NVIDIA A800 PCIe 4.0 GPUs

The NVIDIA A800 Tensor Core GPU, for customers in China, Hong Kong and Macau, delivers outstanding acceleration and flexibility to power the highest-performing elastic data centers for AI, data analytics, and HPC applications. As the engine of the NVIDIA data center platform, A800 provide up to significantly higher performance over V100 GPUs and can efficiently scale up to thousands of GPUs, or be partitioned into seven isolated GPU instances to accelerate workloads of all sizes.

The A800 is offered in China, Hong Kong and Macau, however the A100 is not offered in these markets. The only difference between the A100 and A800 is the speed of the NVLink interface: The NVLink on the A100 operates at 600 GB/s, where as the NVLink on the A800 operates at 400 GB/s.

The third-generation Tensor Core technology supports a broad range of math precisions providing a unified workload accelerator for data analytics, AI training, AI inference, and HPC. Accelerating both scale-up and scale-out workloads on one platform enables elastic data centers that can dynamically adjust to shifting application workload demands. This simultaneously boosts throughput and drives down the cost of data centers.

Figure 1. ThinkSystem NVIDIA A800 PCIe 4.0 GPU

The NVIDIA A800 is available in both double-wide PCIe adapter form factor and in SXM form factor. SXM is used in Lenovo's Neptune direct-water-cooled ThinkSystem SD650-N V2 server for the ultimate in GPU performance and heat management.

The following table shows the part numbers for the A800 GPUs.

The PCIe option part numbers includes the following:

• One NVIDIA A800 GPU with full-height (3U) adapter bracket attached
• Documentation

The following figure shows the NVIDIA HGX A800 4-GPU Board in the water-cooled ThinkSystem SD650-N V2 server

Figure 2. NVIDIA HGX A800 4-GPU Board in the water-cooled ThinkSystem SD650-N V2 server

The ThinkSystem NVIDIA A800 PCIe 4.0 GPU delivers unprecedented acceleration—at every scale—to power the world’s highest-performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. The NVIDIA A800 GPU can efficiently scale up or be partitioned into seven isolated GPU instances with Multi-Instance GPU (MIG), providing a unified platform that enables elastic data centers to dynamically adjust to shifting workload demands.

NVIDIA A800 Tensor Core technology supports a broad range of math precisions, providing a single accelerator for every workload. The latest generation A800 80GB doubles GPU memory and debuts the world’s fastest memory bandwidth at 2 terabytes per second (TB/s), speeding time to solution for the largest models and most massive datasets.

A800 is part of the complete NVIDIA data center solution that incorporates building blocks across hardware, networking, software, libraries, and optimized AI models and applications from the NVIDIA NGC™ catalog. Representing the most powerful end-to-end AI and HPC platform for data centers, it allows researchers to deliver real-world results and deploy solutions into production at scale.

• NVIDIA Ampere Architecture

  Whether using MIG to partition an A800 GPU into smaller instances or NVLink to connect multiple GPUs to speed large-scale workloads, A800 can readily handle different-sized acceleration needs, from the smallest job to the biggest multi-node workload. A800’s versatility means IT managers can maximize the utility of every GPU in their data center, around the clock.

• Third-Generation Tensor Cores

  NVIDIA A800 delivers 312 teraFLOPS (TFLOPS) of deep learning performance. That’s 20X the Tensor floating-point operations per second (FLOPS) for deep learning training and 20X the Tensor tera operations per second (TOPS) for deep learning inference compared to NVIDIA Volta GPUs.

• Next-Generation NVLink

  NVIDIA NVLink in A800 delivers higher throughput compared to the previous generation. When combined with NVIDIA NVSwitch, A800 GPUs can be interconnected at up to 400 gigabytes per second (GB/sec), unleashing the highest application performance possible on a single server. NVLink is available in SXM GPUs via HGX server boards and in PCIe GPUs via an NVLink Bridge for up to 2 GPUs.

• Multi-Instance GPU (MIG)

  An A800 GPU can be partitioned into as many as seven GPU instances, fully isolated at the hardware level with their own high-bandwidth memory, cache, and compute cores. MIG gives developers access to breakthrough acceleration for all their applications, and IT administrators can offer right-sized GPU acceleration for every job, optimizing utilization and expanding access to every user and application.

• High-Bandwidth Memory (HBM2E)

  With up to 80 GB of HBM2e, A800 delivers the world’s fastest GPU memory bandwidth of over 2TB/s, as well as a DRAM utilization efficiency of 95%. A800 delivers 1.7X higher memory bandwidth over the previous generation.

• Structural Sparsity

  AI networks have millions to billions of parameters. Not all of these parameters are needed for accurate predictions, and some can be converted to zeros, making the models “sparse” without compromising accuracy. Tensor Cores in A800 can provide up to 2X higher performance for sparse models. While the sparsity feature more readily benefits AI inference, it can also improve the performance of model training.

The following table lists the NVIDIA A800 GPU specifications.

The following tables list the ThinkSystem servers that are compatible.

The following tables list the supported operating systems.

This section lists the NVIDIA software that is available from Lenovo.

• NVIDIA vGPU Software (vApps, vPC, RTX vWS, and vCS)
• NVIDIA Omniverse Software (OVE)
• NVIDIA AI Enterprise Software
• NVIDIA HPC Compiler Software

• Virtual PC (vPC)

  This product is ideal for users who want a virtual desktop but need great user experience leveraging PC Windows® applications, browsers and high-definition video. NVIDIA Virtual PC delivers a native experience to users in a virtual environment, allowing them to run all their PC applications at full performance.

• NVIDIA RTX Virtual Workstation (RTX vWS)

  NVIDIA RTX vWS is the only virtual workstation that supports NVIDIA RTX technology, bringing advanced features like ray tracing, AI-denoising, and Deep Learning Super Sampling (DLSS) to a virtual environment. Supporting the latest generation of NVIDIA GPUs unlocks the best performance possible, so designers and engineers can create their best work faster. IT can virtualize any application from the data center with an experience that is indistinguishable from a physical workstation — enabling workstation performance from any device.

• Virtual Compute Server (vCS)

  NVIDIA Virtual Compute Server (vCS) enables data centers running on Red Hat Enterprise Linux, Red Hat Virtualization, and other supported KVM-based hypervisors to accelerate server virtualization with the latest NVIDIA data center GPUs, so that the most compute-intensive workloads, such as artificial intelligence, deep learning, and data science, can be run in a virtual machine (VM) powered by NVIDIA vGPU technology.

The following license types are offered:

• Perpetual license

  A non-expiring, permanent software license that can be used on a perpetual basis without the need to renew. Each Lenovo part number includes a fixed number of years of Support, Upgrade and Maintenance (SUMS).

• Annual subscription

  A software license that is active for a fixed period as defined by the terms of the subscription license, typically yearly. The subscription includes Support, Upgrade and Maintenance (SUMS) for the duration of the license term.

• Concurrent User (CCU)

  A method of counting licenses based on active user VMs. If the VM is active and the NVIDIA GRID vGPU software is running, then this counts as one CCU. A vGPU CCU is independent of the connection to the VM.

The following table lists the ordering part numbers and feature codes.

NVIDIA Omniverse Software (OVE)

Lenovo offers the following NVIDIA Omniverse Software software. 3D workflows are now an essential component of every industry. Efficient design collaboration between teams is crucial. NVIDIA Omniverse™ Enterprise is an end-to-end collaboration and simulation platform that fundamentally transforms complex design workflows, creating a more harmonious environment for creative teams.

• NVIDIA Omniverse Enterprise Nucleus

  Collaboration service which enables a variety of Omniverse Enterprise-enabled client applications (Apps, Connectors, and others) to share and modify authoritative representations of virtual worlds in USD. Omniverse Nucleus is built for collaboration across multiple users. Omniverse Nucleus is the database and collaboration engine of Omniverse.

  Includes:

  • Collaboration and scalable core microservices deployed on servers and/or workstations.
  • Nucleus Workstation
  • Enterprise Nucleus Server
  • NVIDIA Enterprise Support

  Note: The Omniverse Enterprise Nucleus Subscription is priced and licensed per named user.

• NVIDIA Omniverse Enterprise Creator

  App for accelerated advanced scene composition and world building. Creator enables scene composition, simulation, and rendering on workstations and virtual workstations.

  Includes:

  • Omniverse Create
  • Omniverse Kit
  • Omniverse Extensions
  • Batch microservices (on up to 64 GPUs)
  • NVIDIA Enterprise Support

  Note: Collaboration via Nucleus requires a Nucleus subscription.

• NVIDIA Omniverse Enterprise Reviewer

  Simple app designed to visualize projects in stunning, physically accurate photorealism and enable minor editing and comment permissions. Reviewer enables review and approval for workstations and virtual workstations.

  Includes:

  • Omniverse View
  • NVIDIA Enterprise Support

  Note: Editing and commenting via Nucleus requires a Nucleus subscription.

The following license types are offered:

• Concurrent User (CCU) License

  A method of allocating licenses based on the number of users that are concurrently using the software. As an example, one CCU license allows only one concurrent user to use the software. 

• Floating User License

  For licensing, same as Concurrent User License.

• Named User License

  A method of licensing based on the number of named authorized users who may not re-assign or share the license with any other person.

• Subscription

  A software license that is active for a fixed period as defined by the terms of the subscription. An annual subscription includes SUMS for the duration of the license term.

The following table lists the ordering part numbers and feature codes.

NVIDIA AI Enterprise Software

Lenovo offers the NVIDIA AI Enterprise (NVAIE) cloud-native enterprise software. NVIDIA AI Enterprise is an end-to-end, cloud-native suite of  AI and data analytics software, optimized, certified, and supported by NVIDIA to run on VMware vSphere and bare-metal  with NVIDIA-Certified  Systems™.  It includes key enabling technologies from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud.

NVIDIA AI Enterprise is licensed on a per-GPU basis. NVIDIA AI Enterprise products can be purchased as either a perpetual license with support services, or as an annual or multi-year subscription.

The features of NVIDIA AI Enterprise Software are listed in the following table.

Note: Maximum 10 concurrent VMs per product license

The following table lists the ordering part numbers and feature codes.

Find more information in the NVIDIA AI Enterprise Sizing Guide.

NVIDIA HPC Compiler Software

The power cables needed for the NVIDIA A800 GPU are included with the supported servers.

The PCIe adapter option part number do not ship with auxiliary power cables. Cables are server-specific due to length requirements. For CTO orders, auxiliary power cables are derived by the configurator. For field upgrades, cables will need to be ordered separately as listed in the table below.

The NVIDIA A800 GPU has the following regulatory approvals:

• RCM
• BSMI
• CE
• FCC
• ICES
• KCC
• cUL, UL
• VCCI

The NVIDIA A800 GPU has the following operating characteristics:

• Ambient temperature
  • Operational: 0°C to 50°C (-5°C to 55°C for short term*)
  • Storage: -40°C to 75°C
• Relative humidity:
  • Operational: 5-85% (5-93% short term*)
  • Storage: 5-95%

* A period not more than 96 hours consecutive, not to exceed 15 days per year.

One year limited warranty. When installed in a Lenovo server, the GPU assumes the server’s base warranty and any warranty upgrades.

For more information, refer to these documents:

• ThinkSystem and ThinkAgile GPU Summary:
  https://lenovopress.lenovo.com/lp0768-thinksystem-thinkagile-gpu-summary
• ServerProven compatibility:
  https://serverproven.lenovo.com/
• NVIDIA Ampere Architecture page
  https://www.nvidia.com/en-us/data-center/ampere-architecture/