Lenovo

Lenovo Press

Lenovo ThinkSystem Servers Continue to Lead the Industry in Performance and Customer ValuePositioning Information

Author
  • Barbora Osuska
Updated
27 Jul 2022
Form Number
LP1145
PDF size
29 pages, 637 KB
Full Change History
Rate & Provide Feedback
Download PDF

Abstract

Lenovo ThinkSystem servers continue to dominate the benchmarks for data center performance with a total of 328 current world record benchmark results spanning a wide range of industry benchmarks.

This total of 328 includes:

  • 162 world records set on systems equipped with third-generation Intel Xeon Scalable processors
  • 42 world records for servers equipped with second-generation Intel Xeon Scalable processors
  • 90 operating the newly launched third-generation AMD EPYC processors
  • 9 using second-generation AMD EPYC processors
  • 25 using first-generation Xeon Scalable processors

These results are current as of July 1, 2022. They were achieved with systems ranging from single-socket (1S) to eight-socket (8S) and workloads ranging from general business applications and infrastructure to Big Data/Analytics, software development/testing/ AI and engineering/technical computing.

Change History

Changes on the July 27, 2022 update:

  • Records as of July 1, 2022
    • Added 49 new MLPerf benchmark results for SR650 V2, SD650 V2, SR670 V2, SE450 with Ice Lake
    • 32 previous MLperf v0.7 and v1.0 WRs were replaced by the new MLperf v2.0 WRs
    • Total benchmarks now 328 current world records

Introduction

For many customers, the performance of their servers is paramount, and as a result Lenovo strives to design its systems to maximize performance. The proof points to show the success we have achieved doing this are the #1 benchmarks we have achieved. We produce systems that cater across all workloads that our customers require, achieving #1 benchmarks across a broad range of applications types.

As of July 1, 2022 we currently hold a total of 328 world records for performance. This number consists of:

  • 162 #1 results set on systems equipped with third-generation Intel Xeon Scalable processors
  • 42 utilizing second-generation Intel Xeon Scalable processors
  • 90 operating the newly launched third-generation AMD EPYC processors
  • 9 using second-generation AMD EPYC processors
  • 25 using first-generation Xeon Scalable processors

These results were achieved on a wide variety of workloads that include Applications, Data Management, Application Development and Testing, Infrastructure, and Engineering/Technical computing. Lenovo achieved these world-records across multiple ThinkSystem platforms ranging from single-socket to 8-socket, spanning Intel and AMD architectures. This demonstrates Lenovo's ability to design systems that create value for customers across architectures, workloads, and industries.

While specific ThinkSystem models were used for these benchmark tests, much of the same technology and attention to detail is prevalent throughout the ThinkSystem product line, providing exceptional performance and reliability across the product line.

This article summarizes the outstanding performance of the world record ThinkSystem servers.

Applications current world records

Lenovo ThinkSystem SR950, SR860 V2, SR850 V2, SR655 and SR645 servers achieved 26 current world records in benchmarks designed to test system performance across a range of application workload types. Application types include Collaboration, Enterprise Resource Management, Supply Chain, Customer Resource Management, and other typical data center applications.

SAP Sales and Distribution (SAP SD 2T) Benchmark

The 2 ThinkSystem world record result on the SAP Sales and Distribution Benchmark is:

Performance

ThinkSystem SR860 (1 current world record):

  • 4-Socket (Windows)

ThinkSystem SR655 (1 current world record)

  • 1-Socket

About this benchmark: SAP Sales and Distribution (SD) Standard Application Benchmarks test the hardware and database performance of SAP applications and components. SAP Application Performance Standard (SAPS) is a hardware-independent unit of measurement that describes the performance of a system in creating the order, creating a delivery note for the order, displaying the order, changing the delivery, posting a goods issue, listing orders, and creating an invoice.

Why it matters: If you are running SAP Business Suite applications, a leadership benchmark score means this system is the highest-performing server in the industry for processing your business transaction workflows in an SAP environment.

For more information see the Performance Benchmark Reports section.

SPEC CPU 2017 Benchmark

The 24 ThinkSystem world record results on the SPEC CPU 2017 benchmark include:

SPEC CPU 2017 Performance

ThinkSystem SR950:

  • 6-Socket — 1 current world record
  • 3-Socket — 4 current world records

ThinkSystem SR860 V2

  • 4-Socket – 4 current world record

ThinkSystem SR645:

  • 2-Socket — 8 current world records 

ThinkSystem SR655:

  • 1-Socket — 7 current world records

About this benchmark: SPEC CPU 2017 contains SPEC's next-generation, industry-standardized, CPU intensive suites for measuring and comparing compute intensive-performance, stressing a system's processor, memory subsystem and compiler. CPU 2017 has 43 sub-benchmarks, organized into four suites. SPEC designed these suites to provide a comparative measure of compute-intensive performance across the widest practical range of hardware using workloads developed from real user applications. 

Why it matters: If you are running compute-intensive workloads, a world-record benchmark score means this server is the highest performing server in its class in terms of how fast a server completes a CPU-intensive task (speed) and/or how much a server can accomplish in a certain amount of time (throughput or rate measurement).

For more information see the Performance Benchmark Reports section.

Data Management current world records

Lenovo ThinkSystem SR860 V2, SR950, SR665, SR655 and SR650 servers delivered 95 current world records on benchmarks designed to test the performance of servers performing Structured Data Management analysis, Structured Data Analytics, and Unstructured Data Analytics.

SAP HANA (BWoH) Benchmark

The 7 ThinkSystem world record results on the HANA BWoH benchmark in a single-node setup include:

Performance

ThinkSystem SR950:

  • 4-Socket (10.4B Records v3) — 1 current world record

ThinkAgile HX7821:

  • 4 Socket – 1 current world record

ThinkSystem SR860 V2

  • 4 Socket (1.3B Records v3) – 1 current world record
  • 4 Socket (5.2B Records v3) – 1 current world record
  • 4 Socket (7.8B Records v3) – 1 current world record

ThinkAgile SR650 V2

  • 4 Socket (1.3B Records v3) – 1 current world record
  • 4 Socket (5.2B Records v3) – 1 current world record

About this benchmark: The SAP BW Edition for SAP HANA (BW/HANA) Standard Application Benchmark is the latest addition to the list of SAP BW benchmarks and goes well beyond the scope and features used in the BW-AML benchmark. The benchmark is designed to fully utilize the new capabilities of SAP HANA to process the benchmark workload. The benchmark consists of three phases: data load, query throughput, and query runtime.

* The current SAP BW edition for SAP HANA benchmark is version 3. Existing v1 and v2 results are still valid; however, SAP will no longer accept new benchmark results for versions v1 and v2.

Why it matters: If you are running SAP HANA, a #1 benchmark score means this server is the highest performing server in its class for processing SAP HANA memory-intensive database and analytics workloads.

For more information see the Performance Benchmark Reports section.

STAC-M3 Benchmarks

The 79 ThinkSystem world record results on the STAC-M3 benchmark include:

STAC-M3

ThinkSystem SR950 (21 current world records):

  • 4-Socket (1 Antuco & Kanaga Suites)
  • 4-Socket (16 Shasta suite)
  • 4-Socket (4 Kanaga suite, with a two-year data set size)

ThinkSystem SR860 V2 (41 current world records)

  • 4-Socket (14 Antuco suite)
  • 4-Socket (8 Kanaga suite, with a two-year data set size)
  • 4-Socket 2 node (Antuco 10 records, 3 yr Kanaga 9 records)

ThinkSystem SR650 (3 current world records):

  • 2-Socket (Antuco suite)

ThinkSystem SR650 V2 (14 current world records)

  • 2-Socket (Antuco suite)

About this benchmark: The STAC-M3 Benchmark suite is the industry standard for testing solutions that enable high-speed analytics on time series data. The STAC-M3 benchmarks measures challenging areas such as time-series analytics, risk simulations, and processing of very-high-speed data. The key metric is query response time. In particular, STAC benchmarks test high-speed analytics on time-series data — tick-by-tick market data. The benchmark is used by large global banks, brokerage houses, exchanges, hedge funds, proprietary trading shops, and other market participants.

Why it matters: If you are running high-speed financial services or securities workloads, a #1 benchmark score means this server is the highest performing server in its class for processing high-speed analytics and financial transactions.

For more information see the Performance Benchmark Reports section.

TPC-E Benchmark

The 6 ThinkSystem world record results on the TPC-E benchmark include:

TPC-E Performance

ThinkSystem SR860 V2 (1 current world records):

  • 4-Socket

ThinkSystem SR665 (2 current world record):

  • 2-Socket

ThinkSystem SR655 (1 current world record):

  • 1-Socket

TPC-E Price/Performance

ThinkSystem SR860 V2 (1 current world record): 

  • 4-Socket

ThinkSystem SR655 (1 current world record):

  • 1-Socket

About this benchmark: The TPC-E benchmark is designed to enable users to more objectively measure and compare the performance and price of various OLTP systems. The TPC-E benchmark uses a database to model a brokerage firm with customers who generate transactions related to trades, account inquiries, and market research. Although the underlying business model of TPC-E is that of a brokerage firm, the database schema, data population, transactions, and implementation rules have been designed to be broadly representative of modern OLTP systems in general.

Why it matters: If you are running On-Line Transaction Processing (OLTP) or decision-support workloads and databases, a #1 benchmark score means this server is the highest-performing server in its class for data-intensive OLTP transactions and data-intensive queries.

For more information see the Performance Benchmark Reports section.

TPC-x BB

The 2 ThinkSystem world record results on the TPC-x BB benchmark:

Performance

ThinkSystem SR650 (2 current world records at SF30000):

  • 2-Socket (36+3 nodes)

About this benchmark: The TPCx-BB Express Benchmark BB (TPCx-BB) measures the hardware and software performance of systems running Hadoop. It runs 30 frequently performed analytical queries in the manner of retailers with physical and online store presences. It uses machine learning algorithms for semi-structured and unstructured data queries, and SQL queries for structured data. 

Why it matters: If your data center runs Hadoop, a world-record benchmark score means the system is the highest performing server in its class for complex Big Data processing needs.

For more information see the Performance Benchmark Reports section.

TPC- H

The 1 ThinkSystem world record results on the TPC- H benchmark:

Price / Performance

ThinkSystem SR665 (1 current world record at 3000 GB):

  • 2-Socket

About this benchmark: TPC-H is a decision support benchmark. It consists of a suite of business-oriented ad hoc queries and concurrent data modifications. The queries and the data populating the database have been chosen to have broad industry-wide relevance. This benchmark illustrates decision support systems that examine large volumes of data, execute queries with a high degree of complexity, and give answers to critical business questions.

Why it matters: You can often see how well the same database runs on different hardware.

For more information see the Performance Benchmark Reports section.

Application Development & Testing current world records

Lenovo ThinkSystem SR950, SR860 V2, SR665, SR655 and SN550 V2 servers hold 34 current world records in benchmarks designed to test server performance in a Java development and testing environment.

SPECjbb2015

The 34 ThinkSystem world record results on the SPECjbb2015 benchmark include:

Performance

ThinkSystem SR950:

  • 8-Socket — 2 current world records (Windows)
  • 6-Socket — 6 current world records (4 Linux / 2 Windows)
  • 3-Socket — 6 current world records (Linux)

ThinkSystem SR860 V2

  • 4-Socket – 4 current world record (Windows)
  • 4-Socket – 2 current world record (Linux)

ThinkSystem SR665:

  • 2-Socket — 4 current world record (Windows)

ThinkSystem SR655:

  • 1-Socket — 6 current world record (Windows)

ThinkSystem SN550 V2:

  • 2-Socket (14 nodes) — 4 current world record (2 Linux / 2 Windows)

About this benchmark: The SPECjbb 2015 benchmark has been developed from the ground up to measure performance based on the latest Java application features. It is relevant to all audiences interested in Java server performance, including JVM vendors, hardware developers, Java application developers, researchers and members of the academic community.

Why it matters: If you are interested Java server performance, a world-record benchmark score means this server is the highest performing server in its class for Java application response time and throughput needs.

For more information see the Performance Benchmark Reports section.

Infrastructure current world records

Lenovo ThinkSystem SR950, SR860 V2, SR850, SR655, SR665, SR645, SR635, SN850, SN550, SN550 V2 servers earned 28 current world records on benchmarks designed to test the performance of servers utilized in an IT/Web infrastructure/AI role. Workload types include Networking, Systems Management, Virtual Desktop, File & Print, Media Streaming, and Web Serving.

SPEC Power

The 15 ThinkSystem world record results on the SPECpower_ssj2008 benchmark include:

Performance

ThinkSystem SR950 (2 current world records):

  • 8-Socket (1 Linux / 1 Windows)

ThinkSystem SR860 V2 (1 current world record)

  • 4-Socket (Linux)

ThinkSystem SR850 (1 current world record):

  • 4-Socket (Linux)

ThinkSystem SN850 (2 current world records):

  • 4-Socket/7-node (4S/7N, 1 Linux, 1 Windows)

ThinkSystem SN550 (1 current world record):

  • 14-node (14N, Windows)

ThinkSystem SN550 V2 (1 current world record):

  • 14-node (14N, Linux)

ThinkSystem SR665 (2 current world records):

  • 2-Socket/2U (1 Linux / 1 Windows)

ThinkSystem SR645 (2 current world records):

  • 2-Socket/1U (1 Linux / 1 Windows)

ThinkSystem SR655 (2 current world record):

  • 1-Socket (1 Linux / 2 Windows)

ThinkSystem SR635 (1 current world record)

  • 1-Socket (Windows)

About this benchmark: The SPECpower_ssj 2008 benchmark suite measures the power and performance characteristics of server-class computer equipment. It is used to compare power and performance among different servers and serves as a tool set for use in improving server efficiency.

Why it matters: The IT industry, computer manufacturers, and governments are increasingly concerned with the energy use of servers. This benchmark provides a means to measure power (at the AC input) in conjunction with a performance metric. This helps IT managers consider power characteristics along with other selection criteria to increase the efficiency of data centers. For those concerned about energy savings, a world-record benchmark score means the server provides the best performance in its class relative to power consumption.

For more information see the Performance Benchmark Reports section.

SPEC VIRT_SC 2013

The 8 ThinkSystem world record results on the SPEC virt_sc 2013 benchmark include:

Performance

ThinkSystem SR950 (2 current world records):

  • 8-Socket
  • 4-Socket

Performance-per-watt

ThinkSystem SR950 (2 current world records):

  • 8-Socket
  • 4-Socket

ThinkSystem SR650 (1 current world record):

  • 2-Socket

Server Performance-per-watt

ThinkSystem SR950 (2 current world records):

  • 8-Socket
  • 4-Socket

ThinkSystem SR650 (1 current world record):

  • 2-Socket

About this benchmark: The SPEC virt_sc 2013 benchmark measures the end-to-end performance of all system components including the hardware, virtualization platform, and the virtualized guest operating system and application software. SPEC virt_sc 2013 is the second-generation SPEC VIRT benchmark for evaluating the virtualization performance of datacenter server consolidation, including enterprise-class workloads.

Why it matters: If you virtualize multiple workloads, a world-record benchmark score means this system is the highest performing server in its class for memory-intensive virtualized environments.

For more information see the Performance Benchmark Reports section.

SPECvirt Datacenter 2021

1 ThinkSystem world record results on the SPECvirt Datacenter 2021 benchmark is:

ThinkSystem SR665 (1 current world record):

  • 2-socket

About this benchmark: The SPECvirt® Datacenter 2021 benchmark is the next generation of virtualization benchmarking for measuring performance of a scaled-out datacenter. The SPECvirt Datacenter 2021 benchmark is a multi-host benchmark using simulated and real-life workloads to measure the overall efficiency of virtualization solutions and their management environments.

The SPECvirt Datacenter 2021 benchmark differs from the SPEC VIRT_SC® 2013 benchmark in that SPEC VIRT_SC benchmark measures single host performance and provides interesting host-level information. However, most of today's datacenters use clusters for reliability, availability, serviceability, and security. Adding virtualization to a clustered solution enhances server optimization, flexibility, and application availability while reducing costs through server and datacenter consolidation.

Why it matters: If you virtualize multiple workloads, a world-record benchmark score means this system is the highest performing server in its class for memory-intensive virtualized environments.

For more information see the Performance Benchmark Reports section.

VMmark 3.1

The 2 ThinkSystem world record result on the VMmark 3.1 benchmark:

Performance

ThinkSystem SR655 (2 current world record):

  • 1-Socket/2-node (1S/2N)
  • 2-Socket/2-node (2S/2N)

About this benchmark: The VMmark 3.1 benchmark measures the performance, scalability, and power consumption of multi-server virtualization platforms. It tests using real-world complex workloads, such as clone and deploy, virtual machine migration, storage migration operations, shared nothing migration, and snapshotting, as well as traditional application-level workloads.

Why it matters: Knowing how effectively and efficiently your servers operate is essential to maximizing performance and scalability while reducing energy costs. A world-record benchmark score means a system is the highest performing server in its class for cloud, OLTP, and other virtualization platform workloads.

For more information see the Performance Benchmark Reports section.

TPC-x IoT

The 2 ThinkSystem world record results on the TPC-x IoT benchmark include:

Performance

ThinkSystem SR655 (1 current world record):

  • 1-Socket (4+1 nodes)

Price/Performance

ThinkSystem SR655 (1 current world record):

  • 1-Socket (4+1 nodes)

About this benchmark: The TPCx-IoT benchmark enables direct comparison of different software and hardware solutions for IoT gateways. TPCx-IoT measures the performance, price/performance, and availability IoT gateway systems that receive vast quantities of data from many devices and run real-time analytic queries on that data. The benchmark workload represents typical IoT gateway systems running on standard hardware and software platforms.  

Why it matters: If you gather and process massive amounts of data via IoT devices and need to perform real-time analysis of that data, a world-record benchmark score means the system is the highest performing server in its class for performing analytic queries on IoT data.

For more information see the Performance Benchmark Reports section.

Engineering/Technical current world records

Lenovo ThinkSystem SD650-N V2, SD650 V2, SR950, SR860 V2, SR670, SR 670 V2, SR665, SR655, SR650, SR650 V2 and SE450 servers earned 145 current world records in benchmarks designed to test a system's performance running various Engineering/Technical/HPC/ AI workloads.

SPEC OMP 2012

The 6 ThinkSystem world record results on the SPEC OMP 2012 benchmark include:

Performance

ThinkSystem SR950 (1 current world record):

  • 3-Socket

 ThinkSystem SR860 V2 (1 current world record)
•    4-Socket

ThinkSystem SR665 (2 current world record):

  • 2-Socket

ThinkSystem SR655 (2 current world record):

  • 1-Socket

About this benchmark: The SPECompG 2012 benchmark is designed for measuring performance using applications based on the OpenMP 3.1 standard for shared-memory parallel processing. The benchmark includes 14 scientific and engineering application codes, covering everything from computational fluid dynamics (CFD) to molecular modeling to image manipulation.

Why it matters: If you are running scientific or engineering applications, a leadership benchmark score means this system is the highest performing server in its class for these workloads.

For more information see the Performance Benchmark Reports section.

SPECmpiM 2007

The 45 ThinkSystem world record results on the SPECmpiM 2007 benchmark include:

Performance

ThinkSystem SR950 (3 current world records):

  • 8-Socket (Medium Metric 1-node)
  • 6-Socket (Medium Metric 1-node)
  • 3-Socket (Medium Metric 1-node)

ThinkSystem SR860 V2 (16 current world records)

  • 4-Socket (Medium Metric 1-node) 
  • 4-Socket (Medium Metric1-node)
  • 4-Socket (Medium Metric 2-node)
  • 4-Socket (Medium Metric 2-node)
  • 4-Socket (Medium Metric 3-node)
  • 4-Socket (Medium Metric 3-node)
  • 4-Socket (Medium Metric 4-node)
  • 4-Socket (Medium Metric 4-node)
  • 4-Socket (Large Metric 1-node)
  • 4 Socket (Large Metric 1-node)
  • 4-Socket (Large Metric 2-node)
  • 4 Socket (Large Metric 2-node)
  • 4-Socket (Large Metric 3-node)
  • 4 Socket (Large Metric 3-node)
  • 4-Socket (Large Metric 4-node)
  • 4 Socket (Large Metric 4-node)

ThinkSystem SR665 (18 current world records):

  • 2-Socket (Large Metric 6-node 33.1)
  • 2-Socket (Large Metric 5-node 29.1)
  • 2-Socket (Large Metric 4-node 24.8)
  • 2-Socket (Large Metric 3-node 18.9)
  • 2-Socket (Large Metric 2-node 13.6)
  • 2-Socket (Large Metric 1-node 6.52) peak
  • 2-Socket (Large Metric 1-node 6.52) base
  • 2-Socket (Medium Metric 6-node 74.0) base
  • 2-Socket (Medium Metric 6-node 72.3) peak
  • 2-Socket (Medium Metric 5-node 74.5) base
  • 2-Socket (Medium Metric 5-node 74.5) peak
  • 2-Socket (Medium Metric 5-node 74.3) peak
  • 2-Socket (Medium Metric 3-node 62.1) peak
  • 2-Socket (Medium Metric 3-node 62.1) base
  • 2-Socket (Medium Metric 2-node 52.6) base
  • 2-Socket (Medium Metric 2-node 52.6) peak
  • 2-Socket (Medium Metric 1-node 35.0) base
  • 2-Socket (Medium Metric 1-node 35.0) peak

ThinkSystem SR655 (8 current world records):

  • 1-Socket (2 records Large Metric 2-node)
  • 1-Socket (2 records Large Metric 1-node)
  • 1-Socket (2 records Medium Metric 1-node)
  • 1-Socket (2 records Medium Metric 2-node)

About this benchmark: The SPECmpiM 2007 benchmark suite is used to evaluate MPI-parallel, floating point, compute-intensive performance across a wide range of cluster and SMP hardware. This suite gives users the most objective and representative benchmark suite for measuring and comparing high-performance computer systems.

Why it matters: If you are running compute-intensive technical workloads, a leadership benchmark score means this server is the highest performing server in its class, taking into account the CPUs, MPI library, communication interconnect, memory architecture, compilers, and file system performance.

For more information see the Performance Benchmark Reports section.

SPEC ACCEL

The 18 ThinkSystem world record results on the SPEC ACCEL benchmark include:

ThinkSystem SR665 (6 current world records):

  • 2-Socket/1-Node (2S/1N)

ThinkSystem SR655 (6 current world record):

  • 1-Socket/1-Node (1S/1N)

Think System SR860 V2 (6 records)

  • SR860V2 4S (1 record)
  • SR860V2 4S (1 record)
  • SR860V2 4S (1 record)
  • SR860V2 4S (1 record)
  • SR860V2 4S (1 record)
  • SR860V2 4S (1 record)
     

About this benchmark: The SPEC ACCEL benchmark suite tests performance with computationally intensive parallel applications running under the OpenCL, OpenACC, and OpenMP 4 target offloading APIs. The suite exercises the performance of the accelerator, host CPU, memory transfer between host and accelerator, support libraries and drivers, and compilers.

Why it matters: If you are running servers with accelerators (GPUs, coprocessors), a #1 benchmark score means a solution incorporating this server (equipped with a specific accelerator and supporting software) is the highest performing solution in its class.

For more information see the Performance Benchmark Reports section.

MLPerf

Lenovo ThinkSystem SR650 V2, SR670 V2, SD650 V2, SD650-N V2 and SE450 servers delivered 49 current world records on MLPerf Inference v0.2 benchmarks designed to test Artificial Intelligence inference performance, that is, to measure how fast systems can process inputs and produce results using a trained model.

MLPerf is a consortium of industry-leading Artificial Intelligence organizations who share the goal of creating fair and meaningful benchmarks for measuring performance of Machine Learning hardware, software and services. Due to it’s extensive support, MLPerf is fast becoming the machine learning benchmark of choice for the industry.

The world record results on the MLPerf benchmark include:

MLPerf v0.2 Inference Closed Datacenter Division: https://mlcommons.org/en/inference-datacenter-20/ 

SR670 V2 2S with 8x80GB A100 PCIe (#2.0-066) Fence by Accelerator type and number  (5 records)

  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object Detection (large), 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Offline Scenario
  • Natural Language Processing, 99.0% Accuracy, Server Scenario

SR670 V2 2S with 4x80GB A100 SXM (#2.0-067) Fence by Accelerator type and number  (5 records)

  • Image Classification, 99.0% Accuracy, Offline Scenario
  • Medical Imaging, 99.0% Accuracy, Offline Scenario
  • Medical Imaging, 99.9% Accuracy, Offline Scenario
  • Speech-to-Text, 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Offline Scenario

SR650 V2 2S with 2xA16 GPU (2 physical GPUs, but 8 logical ones) (#2.0-068) Fence by Accelerator type and number  (10 records)

  • Image Classification, 99.0% Accuracy, Offline Scenario
  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object Detection (large), 99.0% Accuracy, Offline Scenario
  • Object Detection (large), 99.0% Accuracy, Server Scenario
  • Medical Imaging, 99.0% Accuracy, Offline Scenario
  • Medical Imaging, 99.9% Accuracy, Offline Scenario
  • Speech-to-Text, 99.0% Accuracy, Server Scenario
  • Speech-to-Text, 99.0% Accuracy, Offline Scenario
  • Natural Language Processing, 99.0% Accuracy, Offline Scenario
  • Natural Language Processing, 99.0% Accuracy, Server Scenario

SD650 V2  with 2xIntel(R) Xeon(R) Platinum 8380 CPU (no accelerator) (#2.0-070) Fence by No accelerator and 2xCPU (5 records)

  • Image Classification, 99.0% Accuracy, Offline Scenario
  • Image Classification, 99.0% Accuracy, Server Scenario
  • Object Detection (large), 99.0% Accuracy, Offline Scenario
  • Object Detection (large), 99.0% Accuracy, Server Scenario
  • Natural Language Processing, 99.0% Accuracy, Offline Scenario

 

MLPerf v2.0 Inference Closed Edge Division: https://mlcommons.org/en/inference-edge-20/ 

SE450 2S with 2x80GB A100 PCIe (#2.0-071) Fence by Accelerator type and number  (5 records)

  • Image Classification, 99.0% Accuracy, Single Stream; 
  • Object Detection (small), 99.0% accuracy, Single Stream
  • Object Detection (small), 99.0% accuracy, Offline
  • Object Detection (large), 99.0% accuracy, Single Stream
  • Speech-to-text, 99.0% accuracy, Single Stream

SE450 2S with 2xA30 (#2.0-072) Fence by Accelerator type and number  (17 records)

  • Image Classification, 99.0% Accuracy, Single Stream; 
  • Image Classification, 99.0% Accuracy, Multi Stream; 
  • Image Classification, 99.0% Accuracy, Offline Stream;
  • Object Detection (small), 99.0% accuracy, Single Stream
  • Object Detection (small), 99.0% accuracy, Multi Stream
  • Object Detection (small), 99.0% accuracy, Offline
  • Object Detection (large), 99.0% accuracy, Single Stream
  • Object Detection (large), 99.0% accuracy, Multi Stream
  • Object Detection (large), 99.0% accuracy, Offline
  • Medical Imaging, 99.0% accuracy, Single Stream
  • Medical Imaging, 99.0% accuracy, Offline Stream
  • Medical Imaging, 99.9% accuracy, Single Stream
  • Medical Imaging, 99.9% accuracy, Offline Stream
  • Speech-to-text, 99.0% accuracy, Single Stream
  • Speech-to-text, 99.0% accuracy, Offline
  • Natural Language Processing, 99.0% accuracy, Single Stream
  • Natural Language Processing, 99.0% accuracy, Offline
     

MLPerf v2.0 Training: https://mlcommons.org/en/training-normal-20/

SR670 V2 2S with 4x80GB A100 SXM (#2.0-2076) Fence by Accelerator type and number  (1 records)

  • Image Segmentation

SD650 V2-N  with 4x80GB A100 SXM (#2.0-2077) Fence by Accelerator type and number  (1 records)

  • Object detection, heavy-weight

About this benchmark: The MLPerf inference benchmark measures how fast a system can perform machine learning (ML) inference using a trained model. The MLPerf inference benchmark is intended for a wide range of systems from mobile devices to servers. MLPerf Inference is a benchmark suite for measuring how fast systems can process inputs and produce results using a trained model.

Why it matters: If you are running machine learning (ML) or artificial intelligence (AI) workloads using trained models, a #1 benchmark score means this server is the highest performing server in its class for how fast systems can train models to a target quality metric.

For more information see the Performance Benchmark Reports section.

SPEChpc 2021

The 27 ThinkSystem world record results on the SPEChpc 2021 benchmark include:

Tiny Suite (17 records)

  • ThinkSystem SR670 V2 2S 1-node 1GPU
  • ThinkSystem SR670 V2 2S 1-node 2GPU
  • ThinkSystem SR670 V2 2S 1-node 3GPU
  • ThinkSystem SD650-N V2 2S 1-node 4GPU
  • ThinkSystem SR670 V2 2S 1-node 5GPU
  • ThinkSystem SR670 V2 2S 1-node 6GPU
  • ThinkSystem SR670 V2 2S 1-node 7GPU
  • ThinkSystem SR670 V2 2S 1-node 8GPU
  • ThinkSystem SD650-N V2 2S 2-node 4GPU
  • ThinkSystem SR665 2S 1-node 2CPU
  • ThinkSystem SR665 2S 1-node 2CPU (peak)
  • ThinkSystem SR665 2S 2-node 2CPU
  • ThinkSystem SR665 2S 3-node 2CPU
  • ThinkSystem SR665 2S 4-node 2CPU
  • ThinkSystem SR665 2S 5-node 2CPU
  • ThinkSystem SR665 2S 6-node 2CPU
  • ThinkSystem SR950 8S 1-node 8 CPU

Small Suite (10 records)

  • SR670 V2 2S 1-node 7GPU
  • SD670 V2 2S 1-node 8GPU

  • SR665 2S 1-node 2CPU

  • SR665 2S 1-node 2CPU (peak)

  • SR665 2S 2-node 2CPU

  • SR665 2S 3-node 2CPU

  • SR665 2S 4-node 2CPU

  • SR665 2S 5-node 2CPU

  • SR665 2S 6-node 2CPU

  • SR950 8S 1-node 8 CPU

About this benchmark: The SPEChpc 2021 benchmark was designed to provide a comprehensive measure of real-world performance for High Performance Computing (HPC) systems. Offering science and engineering codes that are representative of HPC workloads and are portable across CPU and accelerators, the benchmark includes four suites, Tiny, Small, Medium, and Large, enabling fair vendor-neutral comparisons of the performance of different HPC systems, ranging from a single node to hundreds of nodes with support multiple programming models, including MPI, MPI+OpenACC, MPI+OpenMP, and MPI+OpenMP with target offload.

Why it matters: HPC systems are getting built with an increased level of heterogeneity. The numerous types of accelerators bring in tremendous extra computing power, while at the same time introduce big challenges in performance evaluation and characterization. More complications are added to the problem when multiple parallel and accelerator programming models have been developed with each only supporting a subset of the computing devices.

The SPEChpc 2021 Benchmark Suites address these challenges by providing a set of application benchmark suites using a comprehensive measure of real-world performance for the state-of-the-art HPC systems. They offer well-selected science and engineering codes that are representative of HPC workloads and are portable across CPU and accelerators, along with certain fair comparative performance metrics.

For more information see the Performance Benchmark Reports section.

Conclusion

The portfolio of Lenovo ThinkSystem servers continues its dominance of data center performance, with 311 world record benchmarks (as of June 1, 2022). This outstanding performance was achieved across multiple configurations and a variety of workloads and industry benchmarks.

To learn more about ThinkSystem servers, go to

Performance Benchmark Reports

Each ThinkSystem benchmark has a Lenovo Performance Benchmark Report. These Performance Benchmark Reports detail the specific benchmark, benchmark result, and hardware/software configuration used for that benchmark result. The reports also provide a link to the specific benchmark results page (e.g., SPEC, TPC, SAP, etc.). View all Performance Benchmark Reports.

The following Lenovo ThinkSystem benchmark world records are current as of July 1, 2022.

SAP SD 2T Reports

SAP BWoH Reports

1 The current SAP BW edition for SAP HANA benchmark is version 3. SAP will no longer accept new benchmark results for versions 1 and 2.

TPC-H Reports

  • SR665 2S - http://tpc.org/3355 (1 record - price/performance world record non-clustered @3000GB, V3)

TPC-E Reports

SPECvirt Datacenter 2021 Reports

SPECvirt_sc2013 Reports

Performance

Performance Per Watt

Server Performance Per Watt

VMmark 3.1 Reports

SPEC CPU 2017 Reports

SPECpower_ssj2008 Reports

STAC-M3 Reports

TPCx-IOT Reports

TPCx-BB Reports

  • SR650 2S 36+3 nodes - http://www.tpc.org/3512 (2 world records for performance @ SF30000; fence claim by Software = Cloudera and 78 CPUs)

SPEC ACCEL Reports

SPEC OMP2012 Reports

SPEC MPI2007 Reports

SPECjbb2015 (Linux) Reports

SPECjbb2015 (Windows) Reports

MLPerf Reports

SPEChpc2021 Reports

Tiny Suite

Small Suite

Trademarks

Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.

The following terms are trademarks of Lenovo in the United States, other countries, or both:
Lenovo®
ThinkAgile
ThinkSystem

The following terms are trademarks of other companies:

Intel® and Xeon® are trademarks of Intel Corporation or its subsidiaries.

Linux® is the trademark of Linus Torvalds in the U.S. and other countries.

Windows® is a trademark of Microsoft Corporation in the United States, other countries, or both.

TPC, TPC-E, and TPC-H are trademarks of Transaction Processing Performance Council.

SPEC®, SPEC ACCEL®, SPEC CPU®, SPEC MPI®, SPEC OMP®, SPEC VIRT_SC®, SPEC VIRT®, SPEChpc™, SPECjbb®, and SPECpower_ssj® are trademarks of the Standard Performance Evaluation Corporation (SPEC).

Other company, product, or service names may be trademarks or service marks of others.