Top
Author
Published
7 Apr 2023Form Number
LP1714PDF size
5 pages, 165 KBSubscribed to LP1714.
Thank you for your feedback.
Abstract
Lenovo’s MLPerf Inference v3.0 showcase industry leading benchmarks against the competition.
Lenovo AI is building momentum
Achieving success at the highest standards is not simply measured by achieving one single goal and riding off into the sunset on that merit alone. Success is measured by constant improvement and enhancements, which in the world of Artificial Intelligence (AI) means everything to the end user. AI requires significant processing power for its tasks and proving such capabilities requires a respected and establish partner to benchmark.
MLCommons has been a partner of Lenovo AI for 2 years now with a mission to “build fair and useful benchmarks” creating unbiased evaluations on the inference and training of hardware, software, and services. The benchmarking is known as MLPerf, which is becoming an industry standard for performance qualification.
Lenovo AI has continually improved their results quarter after quarter by improving the performance results of their submissions. Through this partnership Lenovo can confidently showcase industry setting standards of their hardware and software, which in return helps customers identify the best solutions for their environments.
MLPerf Inference v3.0 highlights
The highlights for MLPerf Inference v3.0 include the following:
- Support for NVIDIA A100 GPUs on MLPerf Inference v3.0 AI Benchmark
- Optimized Lenovo Server for AI:
- Lenovo ThinkSystem SR670 V2 with 8x NVIDIA A100 80GB PCle GPUs
Figure 1. Lenovo ThinkSystem SR670 V2 configured to support eight double-wide GPUs
MLPerf results
Lenovo AI achieved astounding results in the MLPerf Inference v3.0 benchmarking results, winning 7 out of 10 scenarios in that category.
- Resnet50 Server – Queries 275,034.00 (Category Leader)
- 3D-Unet 99 – Offline Samples 28.5854 (Category Leader)
- 3D-Unet 99.9 – Offline Samples 28.5854 (Category Leader)
- RNNT
- Server Queries - 98,598.90 (Category Leader)
- Offline Samples – 106,757.00 (Category Leader)
- BERT 99 Server – Queries 24,305.00 (Category Leader)
- BERT 99.9 Server – Queries 11,798.40 (Category Leader)
Lenovo collaborates with NVIDIA
Lenovo demonstrated AI performance across various infrastructure configurations, running on Lenovo ThinkSystem platforms We showcased the efficiency and performance of our air-cooled systems, providing both PCIe and HGX deployment options in a standard data center platform that enterprises of all sizes can quickly deploy.
Lenovo collaborates extensively with NVIDIA in the AI realm. Through our Lenovo AI Innovation Centers, we’re working with NVIDIA to ensure the success of our mutual customers AI initiatives. This provides customers with access to Lenovo and NVIDIA AI experts to aid with consulting on projects, the proper infrastructure to run a proof of concept, and proof of ROI before deployment. As the AI world continues to evolve, collaborations make coming to market an easier and more effective process.
For more information
For more information, see the following resources:
Explore Lenovo AI solutions:
https://www.lenovo.com/us/en/servers-storage/solutions/analytics-ai/
Engage the Lenovo AI Center of Excellence:
https://lenovoaicodelab.atlassian.net/servicedesk/customer/portal/3
MLCommons®, the open engineering consortium and leading force behind MLPerf, has now released new results for MLPerf benchmark suites:
- Benchmark results: https://mlcommons.org/en/inference-datacenter-30/
- MLCommons: https://mlcommons.org/en/news/mlperf-inference-1q2023/
Author
David Ellison is the Chief Data Scientist for Lenovo ISG. Through Lenovo’s US and European AI Discover Centers, he leads a team that uses cutting-edge AI techniques to deliver solutions for external customers while internally supporting the overall AI strategy for the World Wide Infrastructure Solutions Group. Before joining Lenovo, he ran an international scientific analysis and equipment company and worked as a Data Scientist for the US Postal Service. Previous to that, he received a PhD in Biomedical Engineering from Johns Hopkins University. He has numerous publications in top tier journals including two in the Proceedings of the National Academy of the Sciences.
Trademarks
Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.
The following terms are trademarks of Lenovo in the United States, other countries, or both:
Lenovo®
ThinkSystem®
Other company, product, or service names may be trademarks or service marks of others.
Configure and Buy
Please select a locale
Full Change History
Course Detail
Employees Only Content
The content in this document with a is only visible to employees who are logged in. Logon using your Lenovo ITcode and password via Lenovo single-signon (SSO).
The author of the document has determined that this content is classified as Lenovo Internal and should not be normally be made available to people who are not employees or contractors. This includes partners, customers, and competitors. The reasons may vary and you should reach out to the authors of the document for clarification, if needed. Be cautious about sharing this content with others as it may contain sensitive information.
Any visitor to the Lenovo Press web site who is not logged on will not be able to see this employee-only content. This content is excluded from search engine indexes and will not appear in any search results.
For all users, including logged-in employees, this employee-only content does not appear in the PDF version of this document.
This functionality is cookie based. The web site will normally remember your login state between browser sessions, however, if you clear cookies at the end of a session or work in an Incognito/Private browser window, then you will need to log in each time.
If you have any questions about this feature of the Lenovo Press web, please email David Watts at dwatts@lenovo.com.
