Author
Published
28 May 2025Form Number
LP2226PDF size
21 pages, 303 KBAbstract
The NVIDIA Blackwell B200 HGX platform propels the data center into a new era of accelerating computing and generative AI, integrating NVIDIA Blackwell GPUs with high-speed interconnect to accelerate AI performance at scale.
This product guide provides essential presales information to understand the NVIDIA B200 GPU and their key features, specifications, and compatibility. This guide is intended for technical specialists, sales specialists, sales engineers, IT architects, and other IT professionals who want to learn more about the GPUs and consider their use in IT solutions.
Introduction
The NVIDIA Blackwell HGX B200 platform propels the data center into a new era of accelerating computing and generative AI, integrating NVIDIA Blackwell GPUs with high-speed interconnect to accelerate AI performance at scale. As a premier accelerated scale-up x86 platform with up to 15X faster real-time inference performance compared to NVIDIA H100, with 12X lower cost and 12X less energy, the B200 platform is designed for the most demanding AI, data analytics, and high-performance computing (HPC) workloads.
The NVIDIA B200 180GB 1000W GPU is offered in the SXM6 form factor, where GPU modules are implemented with a fully-connected NVLink topology in supported ThinkSystem servers. In the ThinkSystem SR780a V3, the HGX B200 GPUs are water-cooled using Lenovo Neptune water cooling.
Figure 1. ThinkSystem NVIDIA HGX B200 1000W 180GB 8-GPU Liquid-Cooled Board
Did you know?
HGX B200 supports NVIDIA advanced networking options to deliver the highest AI performance. In the Lenovo ThinkSystem SR780a V3, the B200 GPUs can be paired with 8x NVIDIA BlueField-3 B3140H VPI 400GbE adapters or 8x NVIDIA ConnectX-7 NDR OSFP400 InfiniBand adapters.
Part number information
The following table shows the ordering information.
The NVIDIA B200 GPU is Controlled which means the GPU is not offered in certain markets, as determined by the US Government.
Features
Real-Time Large Language Model Inference
As part of HGX, the Blackwell GPU’s cutting-edge capabilities with the second generation Transformer Engine mark a massive leap forward in accelerating inference workloads, making real-time performance a possibility for resource-intensive multi-trillion-parameter language models. HGX B200 achieves 15X acceleration, 12X lower cost, and 12X less energy than the H100 HGX GPU for massive models such as the GPT-MoE-1.8T. This advancement is made possible with a new generation of Tensor Cores, which introduce new precisions including FP4.
Supercharged AI Training
Blackwell GPUs include a faster second generation Transformer Engine featuring FP8 precision, enabling a remarkable 3X faster training for large language models like GPT-MoE-1.8T compared to the H100 HGX GPU. This breakthrough is complemented by the fifth-generation NVLink, which provides 1.8TB/s of GPU-to-GPU interconnect, InfiniBand networking, and Magnum IO software. Together, these ensure efficient scalability for enterprises and extensive GPU computing clusters.
Advancing Data Analytics
Databases and Apache Spark play critical roles in handling, processing, and analyzing large volumes of data for data analytics. Blackwell’s new dedicated Decompression Engine accelerates the full pipeline of database queries for the highest performance in data analytics and data science. With support for the latest compression formats such as LZ4, Snappy, and Deflate, HGX B200 GPU performs 6X faster than CPUs and 2X faster than H100 for query benchmarks.
Sustainable Computing
By adopting sustainable computing practices, data centers can lower their carbon footprint and energy consumption while improving their bottom line. The goal of sustainable computing can be realized with efficiency gains using accelerated computing with HGX. For LLM inference performance, HGX B200 improves energy efficiency by 12X and lowers costs by 12X compared to H100.
Technical specifications
The following table lists the NVIDIA B200 GPU specifications.
Specification | NVIDIA B200 |
---|---|
Form Factor | SXM6 |
FP64 | 40 teraFLOPS |
FP64 Tensor Core | 40 teraFLOPS |
FP32 | 80 teraFLOPS |
TF32 Tensor Core | 1.1 / 2.2 petaFLOPS* |
BFLOAT16 Tensor | 2.25 / 4.5 petaFLOPS* |
FP16 Tensor Core | 2.25 / 4.5 petaFLOPS* |
FP8 Tensor Core | 4.5 / 9 petaFLOPS* |
INT8 Tensor Core | 4.5 / 9 petaOPS* |
GPU Memory | 180 GB HBM3e |
GPU Memory Bandwidth | 8 TB/s |
Total Graphics Power (TGP) | 1000W |
Multi-Instance GPUs | Up to 7 MIGs @ 23 GB |
Interconnect | NVLink: 900 GB/s PCIe Gen5: 128 GB/s |
* Without / with structural sparsity enabled
Server support
The following tables list the ThinkSystem servers that are compatible.
Operating system support
For SXM GPUs, operating system support is based on that of the supported servers.
See the SR780a V3 server product guide for details: https://lenovopress.lenovo.com/lp1980-thinksystem-sr780a-v3-server
NVIDIA GPU software
This section lists the NVIDIA software that is available from Lenovo.
As listed in Table 1 in the Part number information section, the PCIe adapter version of the H200 includes a 5-year subscription to NVIDIA AI Enterprise Software (NVAIE).
NVIDIA AI Enterprise Software
Lenovo offers the NVIDIA AI Enterprise (NVAIE) cloud-native enterprise software. NVIDIA AI Enterprise is an end-to-end, cloud-native suite of AI and data analytics software, optimized, certified, and supported by NVIDIA to run on VMware vSphere and bare-metal with NVIDIA-Certified Systems™. It includes key enabling technologies from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud.
NVIDIA AI Enterprise is licensed on a per-GPU basis. NVIDIA AI Enterprise products can be purchased as either a perpetual license with support services, or as an annual or multi-year subscription.
- The perpetual license provides the right to use the NVIDIA AI Enterprise software indefinitely, with no expiration. NVIDIA AI Enterprise with perpetual licenses must be purchased in conjunction with one-year, three-year, or five-year support services. A one-year support service is also available for renewals.
- The subscription offerings are an affordable option to allow IT departments to better manage the flexibility of license volumes. NVIDIA AI Enterprise software products with subscription includes support services for the duration of the software’s subscription license
The features of NVIDIA AI Enterprise Software are listed in the following table.
Note: Maximum 10 concurrent VMs per product license
The following table lists the ordering part numbers and feature codes.
Find more information in the NVIDIA AI Enterprise Sizing Guide.
NVIDIA HPC Compiler Software
Regulatory approvals
The NVIDIA B200 GPU has the following regulatory approvals:
- RCM
- BSMI
- CE
- FCC
- ICES
- KCC
- cUL, UL
- VCCI
Seller training courses
The following sales training courses are offered for employees and partners (login required). Courses are listed in date order.
-
VTT AI: Introducing the Lenovo Hybrid AI 285 Platform April 2025
2025-04-30 | 60 minutes | Employees Only
DetailsVTT AI: Introducing the Lenovo Hybrid AI 285 Platform April 2025The Lenovo Hybrid AI 285 Platform enables enterprises of all sizes to quickly deploy AI infrastructures supporting use cases as either new greenfield environments or as an extension to current infrastructures. The 285 Platform enables the use of the NVIDIA AI Enterprise software stack. The AI Hybrid 285 platform is the perfect foundation supporting Lenovo Validated Designs.
Published: 2025-04-30
• Technical overview of the Hybrid AI 285 platform
• AI Hybrid platforms as infrastructure frameworks for LVDs addressing data center-based AI solutions.
• Accelerate AI adoption and reduce deployment risks
Tags: Artificial Intelligence (AI), Nvidia, Technical Sales, Lenovo Hybrid AI 285
Length: 60 minutesStart the training:
Employee link: Grow@Lenovo -
Lenovo Cloud Architecture VTT: Supercharge Your Enterprise AI with NVIDIA AI Enterprise on Lenovo Hybrid AI Platform
2025-04-17 | 75 minutes | Employees Only
DetailsLenovo Cloud Architecture VTT: Supercharge Your Enterprise AI with NVIDIA AI Enterprise on Lenovo Hybrid AI PlatformJoin us for an in-depth webinar with Justin King, Principal Product Marketing Manager for Enterprise AI exploring the power of NVIDIA AI Enterprise, delivering Generative and Agentic AI outcomes deployed with Lenovo Hybrid AI platform environments.
Published: 2025-04-17
In today’s data-driven landscape, AI is evolving at high speed, with new techniques delivering more accurate responses. Enterprises are seeking not just an understanding but also how they can achieve AI-driven business outcomes.
With this, the demand for secure, scalable, and high-performing AI operations-and the skills to deliver them-is top of mind for many. Learn how NVIDIA AI Enterprise, a comprehensive software suite optimized for NVIDIA GPUs, provides the tools and frameworks, including NVIDIA NIM, NeMo, and Blueprints, to accelerate AI development and deployment while reducing risk-all within the control and security of your Lenovo customer’s hybrid AI environment.
Tags: Artificial Intelligence (AI), Cloud, Data Management, Nvidia, Technical Sales
Length: 75 minutesStart the training:
Employee link: Grow@Lenovo -
AI VTT: GTC Update and The Lenovo LLM Sizing Guide
2025-03-12 | 86 minutes | Employees Only
DetailsAI VTT: GTC Update and The Lenovo LLM Sizing GuidePlease view this session that is two parts. Part one is Robert Daigle, Director, Global AI Solutions and Hande Sahin-Bahceci, AI Solutions Marketing Leader explaining the upcoming announcements for NVIDIA GTC. Part Two is Sachin Wani, AI Data Scientist explaining the Lenovo LLM Sizing Guide with these topics:
Published: 2025-03-12
• Minimum GPU requirements for fine-tuning/training and inference
• Gathering requirements for the customer's use case
• LLMs from a technical perspective
Tags: Artificial Intelligence (AI), Technical Sales
Length: 86 minutesStart the training:
Employee link: Grow@Lenovo -
Partner Technical Webinar - NVIDIA Portfolio
2024-11-06 | 60 minutes | Employees and Partners
DetailsPartner Technical Webinar - NVIDIA PortfolioIn this 60-minute replay, Jason Knudsen of NVIDIA presented the NVIDIA Computing Platform. Jason talked about the full portfolio from GPUs to Networking to AI Enterprise and NIMs.
Published: 2024-11-06
Tags: Artificial Intelligence (AI), Nvidia
Length: 60 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
NVIDIA Data Center GPU Portfolio
2024-09-26 | 11 minutes | Employees and Partners
DetailsNVIDIA Data Center GPU PortfolioThis course equips Lenovo and partner technical sellers with the knowledge to effectively communicate the positioning of NVIDIA's data center GPU portfolio, enhancing your ability to showcase its key advantages to clients.
Published: 2024-09-26
Upon completion of this training, you will be familiar with the following:
•Data Center GPUs for AI and HPC
•Data Center GPUs for Graphics
•GPU comparisons
Tags: Artificial Intelligence (AI), High-Performance Computing (HPC), Nvidia
Length: 11 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Q2 Solutions Launch TruScale GPU Next Generation Management in the AI Era Quick Hit
2024-09-10 | 6 minutes | Employees and Partners
DetailsQ2 Solutions Launch TruScale GPU Next Generation Management in the AI Era Quick HitThis Quick Hit focuses on Lenovo announcing additional ways to help you build, scale, and evolve your customer’s private AI faster for improved ROI with TruScale GPU as a Service, AI-driven systems management, and infrastructure transformation services.
Published: 2024-09-10
Tags: Artificial Intelligence (AI), Services, TruScale
Length: 6 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
VTT AI: The NetApp AIPod with Lenovo for NVIDIA OVX
2024-08-13 | 38 minutes | Employees and Partners
DetailsVTT AI: The NetApp AIPod with Lenovo for NVIDIA OVXAI, for some organizations, is out of reach, due to cost, integration complexity, and time to deployment. Previously, organizations relied on frequently retraining their LLMs with the latest data, a costly and time-consuming process. The NetApp AIPod with Lenovo for NVIDIA OVX combines NVIDIA-Certified OVX Lenovo ThinkSystem SR675 V3 servers with validated NetApp storage to create a converged infrastructure specifically designed for AI workloads. Using this solution, customers will be able to conduct AI RAG and inferencing operations for use cases like chatbots, knowledge management, and object recognition.
Published: 2024-08-13
Topics covered in this VTT session include:
•Where Lenovo fits in the solution
•NetApp AIPod with Lenovo for NVIDIA OVX Solution Overview
•Challenges/pain points that this solution solves for enterprises deploying AI
•Solution value/benefits of the combined NetApp, Lenovo, and NVIDIA OVX-Certified Solution
Tags: Artificial Intelligence (AI), Nvidia, Sales, Technical Sales, ThinkSystem
Length: 38 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Retrieval Augmented Generation
2024-08-02 | 15 minutes | Employees and Partners
DetailsRetrieval Augmented GenerationIMPORTANT: If you receive the following error message:
Published: 2024-08-02
"There is an issue with this slide content. Please contact your administrator”, please change your VPN location setting and try again. We are actively working on fixing this issue. Thank you for your understanding!
In this NVIDIA course, Dave Barry, Senior Solutions Architect, talks about a technique known as Retrieval Augmented Generation (RAG). It is a powerful tool for enhancing the accuracy and reliability of Generative AI models with facts fetched from external sources.
This course requires prior knowledge of Generative AI concepts, such as the difference between model training and inference. Please refer to relevant courses within this curriculum.
Course Objectives:
By the end of this training, you should be able to:
1. Explain the limitations of large language models to customers
2. Articulate the value of RAG to enterprises
3. Demo an NVIDIA RAG workflow with a video
4. Drive TCO conversations using an authentic use case
Tags: Nvidia
Length: 15 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
AI Industry Use Cases & Solutions
2024-08-02 | 25 minutes | Employees and Partners
DetailsAI Industry Use Cases & SolutionsIMPORTANT: If you receive the following error message:
Published: 2024-08-02
"There is an issue with this slide content. Please contact your administrator”, please change your VPN location setting and try again. We are actively working on fixing this issue. Thank you for your understanding!
This NVIDIA course aims to answer the question:
• How does NVIDIA bring AI solutions to market with and through the partner ecosystem?
Course Objectives:
By the end of this training, you should be able to:
1. Think of solutions in terms of an industry and use case approach
2. Develop solutions that address the industry-specific challenges (with FSI as the illustrative model)
3. Engage customers with their conversations and advance deals with stakeholder’s concerns in mind
4. Replicate NVIDIA’s best practices and ecosystem engagement strategies appropriately
Tags: Nvidia
Length: 25 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
GPU Fundamentals
2024-08-02 | 10 minutes | Employees and Partners
DetailsGPU FundamentalsIMPORTANT: If you receive the following error message:
Published: 2024-08-02
"There is an issue with this slide content. Please contact your administrator”,
please change your VPN location setting and try again. We are actively working on fixing this issue. Thank you for your understanding.
This NVIDIA course introduces you to two devices that a computer typically uses to process information – the CPU and the GPU. We’ll discuss their differences and look at how the GPU overcomes the limitations of the CPU. We will also talk about the value GPUs bring to modern-day enterprise computing.
Course Objectives:
By the end of this training, you should be able to:
1.Distinguish between serial and parallel processing
2.Explain what a GPU is and what it does at a high level
3.Articulate the value of GPU computing for enterprises
4.List three typical GPU-accelerated workloads and a few uses cases
5.Recommend the appropriate NVIDIA GPU for its corresponding enterprise computing workloads
Tags: Nvidia
Length: 10 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Generative AI Overview
2024-08-02 | 17 minutes | Employees and Partners
DetailsGenerative AI OverviewIMPORTANT: If you receive the following error message:
Published: 2024-08-02
"There is an issue with this slide content. Please contact your administrator”, please change your VPN location setting and try again. We are actively working on fixing this issue. Thank you for your understanding!
Since ChatGPTs debut in November of 2022, it has become clear that Generative AI has the potential to revolutionize many aspects of our personal and professional lives. This NVIDIA course aims to answer questions such as:
• What are the Generative AI market trends?
• What is generative AI and how does it work?
Course Objectives:
By the end of this training, you should be able to:
1. Discuss the Generative AI market trends and the challenges in this space with your customers.
2. Explain what Generative AI is and how the technology works to help enterprises to unlock new opportunities for the business.
3. Present a high-level overview of the steps involved in building a Generative AI application.
Tags: Nvidia
Length: 17 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Key NVIDIA Use Cases for Industry Verticals
2024-08-02 | 32 minutes | Employees and Partners
DetailsKey NVIDIA Use Cases for Industry VerticalsIMPORTANT: If you receive the following error message:
Published: 2024-08-02
"There is an issue with this slide content. Please contact your administrator”,
please change your VPN location setting and try again. We are actively working on fixing this issue. Thank you for your understanding.
In this NVIDIA course, you will learn about key AI use cases driving innovation and change across Automotive, Financial Services, Energy, Healthcare, Higher Education, Manufacturing, Retail and Telco industries.
Course Objectives:
By the end of this training, you should be able to:
1. Discuss common AI use cases across a broad range of industry verticals
2. Explain how NVIDIA’s AI software stack speeds up time to production for AI projects in multiple industry verticals
Tags: Nvidia
Length: 32 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Introduction to Artificial Intelligence
2024-08-02 | 11 minutes | Employees and Partners
DetailsIntroduction to Artificial IntelligenceIMPORTANT: If you receive the following error message:
Published: 2024-08-02
"There is an issue with this slide content. Please contact your administrator”, please change your VPN location setting and try again. We are actively working on fixing this issue. Thank you for your understanding!
This NVIDIA course aims to answer questions such as:
• What is AI?
• Why are enterprises so interested in it?
• How does AI happen?
• Why are GPUs so important for it?
• What does a good AI solution look like?
Course Objectives:
By the end of this training, you should be able to:
1. Describe AI on a high level and list a few common enterprise use cases
2. List how enterprises benefit from AI
3. Distinguish between Training and Inference
4. Say how GPUs address known bottlenecks in a typical AI pipeline
5. Tell a customer why NVIDIA’s AI solutions are well-respected in the market
Tags: Nvidia
Length: 11 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Partner Technical Webinar - NVIDIA Smart Spaces
2024-07-24 | 60 minutes | Employees and Partners
DetailsPartner Technical Webinar - NVIDIA Smart SpacesIn this 60-minute replay, Alex Pazos, NVIDIA BDM for Smart Spaces, reviewed the NVIDIA AI for Smart Spaces framework and use cases. Alex reviewed the Metropolus Framework and the Smart Spaces ecosystem. Then he reviewed several use cases including sports stadiums, warehouses, airports, and roadways.
Published: 2024-07-24
Tags: Artificial Intelligence (AI)
Length: 60 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Guidance for Selling NVIDIA Products at Lenovo for ISG
2024-07-01 | 25 minutes | Employees and Partners
DetailsGuidance for Selling NVIDIA Products at Lenovo for ISGThis course gives key talking points about the Lenovo and NVIDIA partnership in the Data Center. Details are included on where to find the products that are included in the partnership and what to do if NVIDIA products are needed that are not included in the partnership. Contact information is included if help is needed in choosing which product is best for your customer. At the end of this session sellers should be able to explain the Lenovo and NVIDIA partnership, describe the products Lenovo can sell through the partnership with NVIDIA, help a customer purchase other NVIDIA product, and get assistance with choosing NVIDIA products to fit customer needs.
Published: 2024-07-01
Tags: Artificial Intelligence (AI), Nvidia
Length: 25 minutesStart the training:
Employee link: Grow@Lenovo
Partner link: Lenovo Partner Learning -
Think AI Weekly: Lenovo AI PCs & AI Workstations
2024-05-23 | 60 minutes | Employees Only
DetailsThink AI Weekly: Lenovo AI PCs & AI WorkstationsJoin Mike Leach, Sr. Manager, Workstations Solutions and Pooja Sathe, Director Commercial AI PCs as they discuss why Lenovo AI Developer Workstations and AI PCs are the most powerful, where they fit into the device to cloud ecosystem, and this week’s Microsoft announcement, Copilot+PC
Published: 2024-05-23
Tags: Artificial Intelligence (AI), ThinkStation
Length: 60 minutesStart the training:
Employee link: Grow@Lenovo -
VTT Cloud Architecture: NVIDIA Using Cloud for GPUs and AI
2024-05-22 | 60 minutes | Employees Only
DetailsVTT Cloud Architecture: NVIDIA Using Cloud for GPUs and AIJoin JD Dupont, NVIDIA Head of Americas Sales, Lenovo partnership and Veer Mehta, NVIDIA Solution Architect on an interactive discussion about cloud to edge, designing cloud Solutions with NVIDIA GPUs and minimizing private\hybrid cloud OPEX with GPUs. Discover how you can use what is done at big public cloud providers for your customers. We will also walk through use cases and see a demo you can use to help your customers.
Published: 2024-05-22
Tags: Artificial Intelligence (AI), Cloud, Nvidia, Software Defined Infrastruture (SDI), Technical Sales
Length: 60 minutesStart the training:
Employee link: Grow@Lenovo
1-10 of 17 courses.
Related links
For more information, refer to these documents:
- ThinkSystem and ThinkAgile GPU Summary:
https://lenovopress.lenovo.com/lp0768-thinksystem-thinkagile-gpu-summary - ServerProven compatibility:
https://serverproven.lenovo.com/ - NVIDIA HGX Platform product page:
https://www.nvidia.com/en-us/data-center/hgx// - ThinkSystem SR780a V3 product guide
https://lenovopress.lenovo.com/lp1980-thinksystem-sr780a-v3-server
Trademarks
Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.
The following terms are trademarks of Lenovo in the United States, other countries, or both:
Lenovo®
Neptune®
ServerProven®
ThinkAgile®
ThinkSystem®
The following terms are trademarks of other companies:
AMD is a trademark of Advanced Micro Devices, Inc.
Intel® is a trademark of Intel Corporation or its subsidiaries.
Linux® is the trademark of Linus Torvalds in the U.S. and other countries.
Windows® is a trademark of Microsoft Corporation in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.
Configure and Buy
Full Change History
Course Detail
Employees Only Content
The content in this document with a is only visible to employees who are logged in. Logon using your Lenovo ITcode and password via Lenovo single-signon (SSO).
The author of the document has determined that this content is classified as Lenovo Internal and should not be normally be made available to people who are not employees or contractors. This includes partners, customers, and competitors. The reasons may vary and you should reach out to the authors of the document for clarification, if needed. Be cautious about sharing this content with others as it may contain sensitive information.
Any visitor to the Lenovo Press web site who is not logged on will not be able to see this employee-only content. This content is excluded from search engine indexes and will not appear in any search results.
For all users, including logged-in employees, this employee-only content does not appear in the PDF version of this document.
This functionality is cookie based. The web site will normally remember your login state between browser sessions, however, if you clear cookies at the end of a session or work in an Incognito/Private browser window, then you will need to log in each time.
If you have any questions about this feature of the Lenovo Press web, please email David Watts at dwatts@lenovo.com.