Top
Author
Updated
17 Nov 2021Form Number
LP0550PDF size
15 pages, 207 KBSubscribed to LP0550.
Thank you for your feedback.
Table of Contents
Abstract
Intel Omni-Path Architecture (OPA) is a family of PCIe adapters, switches, cables, and management software that provides high-performance connectivity between servers. This product guide describes the PCIe adapters, known as Omni-Path Host Fabric Adapters (HFAs).
This product guide provides essential presales information to understand the OPA 100 Series Host Fabric Adapters and their key features, specifications, and compatibility. This guide is intended for technical specialists, sales specialists, sales engineers, IT architects, and other IT professionals who want to learn more about HFAs and consider their use in IT solutions.
Change History
Changes in the November 17, 2021 update:
- The following cables are withdrawn from marketing - Supported cables section:
- 15m Intel OPA 100 Series Active Optical QSFP28 Cable, 00WE067
- 20m Intel OPA 100 Series Active Optical QSFP28 Cable, 00WE071
Introduction
Intel Omni-Path Architecture (OPA) is a family of PCIe adapters, switches, cables, and management software that provides high-performance connectivity between servers. It is designed for high performance computing (HPC) workloads and has the ability to scale to thousands of nodes.
The PCIe adapters, known as Omni-Path Host Fabric Adapters (HFAs) use an advanced connectionless "on-load" design that uses the processing capacity of Intel Xeon processors in the server to automatically scale fabric performance as server processor core counts increase.
The following figure shows the Intel OPA 100 Series Single-port PCIe 3.0 x16 HFA.
Figure 1. Intel OPA 100 Series Single-port PCIe 3.0 x16 HFA
Did you know?
Omni-Path Architecture is a new networking topology that was designed specifically to scale cost-effectively from entry level HPC clusters to larger clusters with 10,000 nodes or more. The Intel OPA adapters, in conjunction with a switching fabric, help enable the progression towards Exascale computing while cost-effectively supporting clusters of all sizes with optimization for HPC applications at both the host and fabric levels.
Part number information
The following table shows the part numbers and feature codes for the Omni-Path 100 Series adapters.
The part numbers include the following:
- One adapter with a full-height (3U) bracket attached
- Additional low-profile (2U) bracket included in the box
- Installation and warranty information
Supported cables
The Intel Omni-Path host fabric adapters support the copper and fiber optic cables listed in the following table.
Features
The Omni-Fabric Architecture 100 Series adapters have the following features:
- Available in PCIe x8 and PCI x16 host interfaces
The PCIe 3.0 x16 adapter supports the full 100 Gb/s link speed, whereas the PCIe 3.0 x8 adapter operates at a lower speed (~58 Gb/s) due to the reduced host interface. The choice of two adapters lets system designers select the best adapter for available slots and cost constraints.
- Advanced data transfer and Quality of Service (QoS)
With OPA, data is segmented into 65-bit Flow Control Digits (FLITs) which are assembled into larger Link Transfer Packets (LTPs) for efficient wire transfer. By managing traffic at the FLIT level, OPA edge and director switches can more effectively optimize latency, throughput and resiliency for all types of traffic.
- Scalable performance
The on-load architecture provides investment protection by allowing fabric performance to scale along with the increased performance of Intel Xeon processors and Intel Xeon Phi coprocessor adapters.
- Open Fabrics Alliance software
The OPA adapters are compatible with software from the Open Fabrics Alliance (OFA) which means that many existing HPC applications will be able to operate over an OPA fabric.
- Enhanced reliability
The advanced design in these adapter means there is no need for data path firmware or external memory, which enhances reliability. The Intel OPA adapters have ECC protection on all internal SRAMs and parity checking on all internal buses. Equally important, the stateless design is inherently more resilient to adapter and fabric failures as it minimizes its reliance on the connection state. Passive heat sinks eliminate the risk of fan failures.
Technical specifications
- Single Intel Omni-Path 4X port with QSFP28 connector, delivers up to 100 Gbps (4 x 25 Gbps) in each direction
- PCIe 3.0 host interface - maximum data rate:
- PCIe 3.0 x16 adapter: 100 Gb/s (Gigabits per second)
- PCIe 3.0 x8 adapter: ~58 Gb/s
- Total network bandwidth:
- PCIe 3.0 x16 adapter: 25 GB/s (Gigabytes per second) (100Gb link speed)
- PCIe 3.0 x8 adapter: 15 GB/s (100Gb link speed)
- Multi-core scaling with support for up to 160 contexts
- Large MTU support (4 KB, 8 KB, and 10KB) for reduced per-packet processing overheads. Improved packet-level interfaces to improve utilization of on-chip resources.
- 16 Send DMA engines (M2IO usage)
- Receive DMA engine arrival notification
- Advanced interrupts
- MSI-X
- INTx
- ASIC: Single Intel OPA ASIC
- Up to 160M messages/second
- Up to 300M bidirectional messages/second
- Virtual lanes: configurable from 1 to 8 VLs plus 1 management VL
- Dimensions: 2.7 inches x 6.6 inches (low-profile PCIe adapter)
- Weight: 240 g
- Typical power consumption:
- PCIe 3.0 x16 adapter:
- Copper cable: 7.4 W typical, 11.7 W maximum
- Fiber optic cable (Class 4 Optics, 3W maximum): 10.6 W typical, 14.9 W maximum
- PCIe 3.0 x8 adapter:
- Copper cable: 6.3 W typical, 8.3 W maximum
- Fiber optic cable: 9.5 W typical, 11.5 W maximum
- PCIe 3.0 x16 adapter:
Server support - ThinkSystem
The following tables list the ThinkSystem servers that are compatible.
Server support - System x
The following tables list the System x servers that are compatible.
Support for System x and dense servers with Xeon E5/E7 v4 and E3 v5 processors
Support for System x and dense servers with Intel Xeon v3 processors
Support for servers with Intel Xeon v2 processors
Operating system support
The adapters support the following operating systems:
- Intel OPA 100 Series Single-port PCIe 3.0 x8 HFA, 00WE023
- Intel OPA 100 Series Single-port PCIe 3.0 x16 HFA, 00WE027
Tip: These tables are automatically generated based on data from Lenovo ServerProven.
1 Bug97685 [PA_2017A_SDV_Lenovo_Draco_Storage] Can not get Intel OPA device in Network in UEFI when enable secure boot in Red Draco.
1 Bug97685 [PA_2017A_SDV_Lenovo_Draco_Storage] Can not get Intel OPA device in Network in UEFI when enable secure boot in Red Draco.
Regulatory approvals
The adapters are compliant with the following regulations:
- FCC Part 15, Subpart B, Class A
- CAN ICES-3 (A)
- CISPR22
- CISPR32/EN55032
- EN55024
- EN61000-3-2
- EN61000-3-3
- VCCI, Class A
- AS/NZS CISPR 22, Class A
- RRA/KC (KN22, KN24), Class A
- BSMI (CNS 13438), Class A
- GOST R IEC 60950-1
- GOST R 51318.22
- GOST 30804.24
- GOST R 51317.3.2 (Section 6, 7)
- GOST R 51317.33
- TUV NRTL: 60950-1, CSA 22.1.No. 60950-1
- TUV SUD EN60950-1
- CB Scheme: IEC 60950-1
- RoHS II Directive 2011/65/EU
- REACH 1907/2006
Operating environment
- Temperature:
- Operating 0 to 40° C
- Storage -40 to 70° C
- Humidity:
- Operating: 5% to 85% non-condensing
- Storage: 5% to 95% non-condensing
- Altitude:
- Operating: 0 to 10,000 ft (derate 1° C for every 575 m about 3000 ft)
- Storage: 0 to 40,000 ft
- Airflow requirement:
- 200 LFM at 55° C local ambient
Warranty
One year limited warranty. When installed in a supported Lenovo server, these cards assume the server base warranty and any warranty upgrades.
Edge switch support
The adapters support connectivity to the following edge switches available from Lenovo.
Related publications
For more information, refer to these documents and web pages:
- Networking Options for ThinkSystem Servers
https://lenovopress.com/lp0765-networking-options-for-thinksystem-servers - Intel Omni-Path Fabric home page:
http://www.intel.com/content/www/us/en/high-performance-computing-fabrics/omni-path-architecture-fabric-overview.html - Lenovo Scalable Infrastructure home page:
https://www3.lenovo.com/us/en/data-center/servers/high-density/Lenovo-Scalable-Infrastructure/p/WMD00000276
Trademarks
Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.
The following terms are trademarks of Lenovo in the United States, other countries, or both:
Lenovo®
ServerProven®
System x®
ThinkSystem®
The following terms are trademarks of other companies:
AMD is a trademark of Advanced Micro Devices, Inc.
Intel® and Xeon® are trademarks of Intel Corporation or its subsidiaries.
Linux® is the trademark of Linus Torvalds in the U.S. and other countries.
Other company, product, or service names may be trademarks or service marks of others.
Configure and Buy
Please select a locale
Full Change History
Changes in the November 17, 2021 update:
- The following cables are withdrawn from marketing - Supported cables section:
- 15m Intel OPA 100 Series Active Optical QSFP28 Cable, 00WE067
- 20m Intel OPA 100 Series Active Optical QSFP28 Cable, 00WE071
Changes in the February 27, 2021 update:
- The server support tables are now automatically updated - Server support section
Changes in the October 13, 2020 update:
- Added the SR850 V2 and SR860 V2 servers - Server support section (no support)
Changes in the May 12, 2020 update:
- Added a note regarding CTO orders - Part number information section
Changes in the May 5, 2020 update:
- Added SR645 and SR665 to the server support table - Server support section (no support)
Changes in the January 7, 2020 update:
- Added SR850P to the server support table - Server support section
Changes in the September 12, 2019 update:
- Added SE350, SR635 and SR655 to the server table - Server support section
Changes in the July 9, 2019 update:
- The 10m cable is now withdrawn from marketing:
- 10m Intel OPA 100 Series Active Optical QSFP28 Cable, 00WE063
Changes in the March 18, 2019 update:
- Operating system support information is now listed as a set of tables which are automatically generated from ServerProven data - Operating system support section
Changes in the January 22, 2019 update:
- The PCIe 3.0 x16 adapter is supported in the ThinkSystem SR670 server - Server support section
Changes in the November 5, 2018 update:
- Added new servers: ThinkSystem ST50, ST250, SR150 and SR250 (not supported)
- Updated the list of supported operating systems
Changes in the February 27, 2018 update:
- Additional server support - ThinkSystem server support table
- Added new ThinkSystem SD650 DWC Intel OPA 100 Series Single-port PCIe 3.0 x16 HFA
Changes in the November 21, 2017 update:
- Added Active Optical Cables - Supported cables section:
- 10m Intel OPA 100 Series Active Optical QSFP28 Low Power Cable
- 15m Intel OPA 100 Series Active Optical QSFP28 Low Power Cable
- 5m Intel OPA 100 Series Active Optical QSFP28 Low Power Cable
- 20m, Intel OPA 100 Series Active Optical QSFP28 Low Power Cable
- Updated the ThinkSystem server support table
Changes in the July 11, 2017 update:
- Added ThinkSystem server support - Server support - ThinkSystem section
Changes in the May 23, 2017 update:
- The OPA adapters are now supported on these systems:
- System x3850 X6 / x3950 X6
- ThinkServer sd350
First published: 30 August 2016
Course Detail
Employees Only Content
The content in this document with a is only visible to employees who are logged in. Logon using your Lenovo ITcode and password via Lenovo single-signon (SSO).
The author of the document has determined that this content is classified as Lenovo Internal and should not be normally be made available to people who are not employees or contractors. This includes partners, customers, and competitors. The reasons may vary and you should reach out to the authors of the document for clarification, if needed. Be cautious about sharing this content with others as it may contain sensitive information.
Any visitor to the Lenovo Press web site who is not logged on will not be able to see this employee-only content. This content is excluded from search engine indexes and will not appear in any search results.
For all users, including logged-in employees, this employee-only content does not appear in the PDF version of this document.
This functionality is cookie based. The web site will normally remember your login state between browser sessions, however, if you clear cookies at the end of a session or work in an Incognito/Private browser window, then you will need to log in each time.
If you have any questions about this feature of the Lenovo Press web, please email David Watts at dwatts@lenovo.com.
