* Only available in selected markets
- Introduction
- Did you know?
- Key features
- Comparing the SR665 V3 to the SR665
- Components and connectors
- System architecture
- Standard specifications
- Models
- Processors
- Memory options
- Internal storage
- Controllers for internal storage
- Internal drive options
- Internal backup units
- Optical drives
- I/O expansion
- Network adapters
- Fibre Channel host bus adapters
- SAS adapters for external storage
- Flash storage adapters
- GPU adapters
- Cooling
- Power supplies
- Systems management
- Security
- Rack installation
- Operating system support
- Physical and electrical specifications
- Operating environment
- Water infrastructure for the Lenovo Neptune Processor DWC Module
- RM100 In-Rack Coolant Distribution Unit
- Warranty and Support
- Services
- Regulatory compliance
- External drive enclosures
- External storage systems
- External backup units
- Fibre Channel SAN switches
- Uninterruptible power supply units
- Power distribution units
- Rack cabinets
- KVM console options
- Lenovo Financial Services
- Seller training courses
- Related publications and links
- Related product families
- Trademarks
Abstract
The Lenovo ThinkSystem SR665 V3 is a 2-socket 2U server that features the AMD EPYC 9004 "Genoa" family of processors. With up to 128 cores per processor and support for the new PCIe 5.0 standard for I/O, the SR665 V3 offers the ultimate in two-socket server performance in a 2U form factor.
This product guide provides essential pre-sales information to understand the ThinkSystem SR665 V3 server, its key features and specifications, components and options, and configuration guidelines. This guide is intended for technical specialists, sales specialists, sales engineers, IT architects, and other IT professionals who want to learn more about the SR665 V3 and consider its use in IT solutions.
Change History
Changes in the September 10, 2024 update:
- New preconfigured model for customers in EMEA - Models section:
- 7D9AA02XEA, 7D9AA02YEA
- Storage configurations using the ThinkSystem 2U 12x3.5" SAS/SATA with Rear 4-Bay Expander Backplane with a mid or rear backplane, when configured with a 440-8i or 440-16i HBA, are not supported with Windows Server or Windows 10/11 - Front drive bays section and 3.5-inch front bays configurations table
Introduction
The Lenovo ThinkSystem SR665 V3 is a 2-socket 2U server that features the AMD EPYC 9004 "Genoa" family of processors. With up to 128 cores per processor and support for the new PCIe 5.0 standard for I/O, the SR665 V3 offers the ultimate in two-socket server performance in a 2U form factor. The server is ideal for dense workloads that can take advantage of GPU processing and high-performance NVMe drives.
Suggested uses: Inference, virtualization, VDI, HPC, Hyperconverged infrastructure
Did you know?
The SR665 V3 server is a very configuration-rich offering, supporting 30 different drive bay configurations in the front, middle and rear of the server and 6 different slot configurations at the rear of the server. This level of flexibility ensures that you can configure the server exactly the way your workload requires.
Key features
Combining performance and flexibility, the SR665 V3 server is a great choice for enterprises of all sizes. The server offers a broad selection of drive and slot configurations and offers high performance features that industries such as finance, healthcare and telco need. Outstanding reliability, availability, and serviceability (RAS) and high-efficiency design can improve your business environment and can help save operational costs.
Scalability and performance
The following features boost performance, improve scalability and reduce costs:
- Supports one or two fourth-generation AMD EPYC 9004 processors
- Up to 128 cores and 256 threads
- Core speed of up to 4.1 GHz
- TDP rating of up to 400 W
- Support for DDR5 memory DIMMs to maximize the performance of the memory subsystem:
- Up to 24 DDR5 memory DIMMs, 12 DIMMs per processor
- 12 memory channels per processor (1 DIMM per channel)
- DIMM speeds up to 4800 MHz
- Using 256GB 3DS RDIMMs, the server supports up to 6TB of system memory
- Supports up to eight single-width GPUs or three double-wide GPUs, for substantial processing power in a 2U system.
- The server is Compute Express Link (CXL) v1.1 Ready. With CXL 1.1 for next-generation workloads, you can reduce compute latency in the data center and lower TCO. CXL is a protocol that runs across the standard PCIe physical layer and can support both standard PCIe devices as well as CXL devices on the same link.
- Supports up to 40x 2.5-inch hot-swap drive bays, by using combinations of front-accessible (up to 24 bays), mid bays (8 bays) and rear-accessible (8 bays).
- Supports 20x 3.5-inch drive bays for lower-cost high-capacity HDD storage. 2.5-inch and 3.5-inch drive bays can be mixed if desired.
- Supports up to 32x NVMe drives without oversubscription of PCIe lanes (1:1 connectivity). The use of NVMe drives maximizes drive I/O performance, in terms of throughput, bandwidth, and latency.
- Supports up to 20x SATA drives using the onboard SATA controller (no additional adapter needed), enabling lower cost, high capacity storage solution for cold storage workloads.
- Supports high-speed RAID controllers from Lenovo and Broadcom providing 12 Gb SAS connectivity to the drive backplanes. A variety of PCIe 3.0 and PCIe 4.0 RAID adapters are available.
- Supports two externally accessible 7mm hot-swap drives for operating system boot functions or data storage. Optional RAID with the addition of a RAID adapter installed in a slot.
- Supports M.2 drives for convenient operating system boot functions or data storage. Available M.2 adapters support either one M.2 drive or two M.2 drives. Optional RAID with the addition of a RAID adapter installed in a slot.
- Up to 12x PCIe slots (10x rear, 2x front), plus a slot dedicated to an OCP 3.0 adapter. 2.5-inch drive configurations also support an additional internal bay for a cabled RAID adapter or HBA.
- The server has a dedicated industry-standard OCP 3.0 small form factor (SFF) slot, with a PCIe 5.0 x16 interface, supporting a variety of Ethernet network adapters. Simple-swap mechanism with thumbscrews and pull-tab enables tool-less installation and removal of the adapter. Supports shared BMC network sideband connectivity to enable out-of-band systems management.
- The server offers PCI Express 5.0 (PCIe Gen 5) I/O expansion capabilities that doubles the theoretical maximum bandwidth of PCIe 4.0 (32GT/s in each direction for PCIe 5.0, compared to 16 GT/s with PCIe 4.0). A PCIe 5.0 x16 slot provides 128 GB/s bandwidth, enough to support a 400GbE network connection.
Availability and serviceability
The server provides many features to simplify serviceability and increase system uptime:
- Designed to run 24 hours a day, 7 days a week
- The server uses ECC memory and supports memory RAS features including Single Device Data Correction (SDDC, also known as Chipkill), Patrol/Demand Scrubbing, Bounded Fault, DRAM Address Command Parity with Replay, DRAM Uncorrected ECC Error Retry, On-die ECC, ECC Error Check and Scrub (ECS), and Post Package Repair.
- The server offers hot-swap drives, supporting RAID redundancy for data protection and greater system uptime.
- Available M.2 configuration with RAID support which can enable two SATA or two NVMe M.2 drives to be configured as a redundant pair.
- The server has up to two hot-swap redundant power supplies and up to six hot-swap redundant fans to provide availability for business-critical applications.
- Optional front-accessible slots and drives so that most major components and cables (except power) are located at the front of the server
- The power-source-independent light path diagnostics uses LEDs to lead the technician to failed (or failing) components, which simplifies servicing, speeds up problem resolution, and helps improve system availability.
- Solid-state drives (SSDs) offer more reliability than traditional mechanical HDDs for greater uptime.
- Proactive Platform Alerts (including PFA and SMART alerts): Processors, voltage regulators, memory, internal storage (SAS/SATA HDDs and SSDs, NVMe SSDs, M.2 storage, flash storage adapters), fans, power supplies, RAID controllers, server ambient and subcomponent temperatures. Alerts can be surfaced through the XClarity Controller to managers such as Lenovo XClarity Administrator, VMware vCenter, and Microsoft System Center. These proactive alerts let you take appropriate actions in advance of possible failure, thereby increasing server uptime and application availability.
- The built-in XClarity Controller 2 continuously monitors system parameters, triggers alerts, and performs recovery actions in case of failures to minimize downtime.
- Built-in diagnostics in UEFI, using Lenovo XClarity Provisioning Manager, speed up troubleshooting tasks to reduce service time.
- Lenovo XClarity Provisioning Manager supports diagnostics and can save service data to a USB key drive or remote CIFS share folder for troubleshooting and reduce service time.
- Auto restart in the event of a momentary loss of AC power (based on power policy setting in the XClarity Controller service processor)
- Offers a diagnostics port on the front of the server to allow you to attach an external diagnostics handset for enhanced systems management capabilities.
- Support for the XClarity Administrator Mobile app running on a supported smartphone and connected to the server through the service-enabled USB port, enables additional local systems management functions.
- Three-year or one-year customer-replaceable unit and onsite limited warranty, 9 x 5 next business day. Optional service upgrades are available.
Manageability and security
Systems management features simplify local and remote management:
- The server includes an XClarity Controller 2 (XCC2) to monitor server availability. Optional upgrade to XCC Platinum to provide remote control (keyboard video mouse) functions, support for the mounting of remote media files, FIPS 140-3 security, enhanced NIST 800-193 support, boot capture, and other management and security features.
- Lenovo XClarity Administrator offers comprehensive hardware management tools that help to increase uptime, reduce costs and improve productivity through advanced server management capabilities.
- UEFI-based Lenovo XClarity Provisioning Manager, accessible from F1 during boot, provides system inventory information, graphical UEFI Setup, platform update function, RAID Setup wizard, operating system installation function, and diagnostic functions.
- Support for Lenovo XClarity Energy Manager which captures real-time power and temperature data from the server and provides automated controls to lower energy costs.
- An integrated industry-standard Unified Extensible Firmware Interface (UEFI) enables improved setup, configuration, and updates, and simplifies error handling.
- Support for industry standard management protocols, IPMI 2.0, SNMP 3.0, Redfish REST API, serial console via IPMI
- An integrated hardware Trusted Platform Module (TPM) supporting TPM 2.0 enables advanced cryptographic functionality, such as digital signatures and remote attestation.
- Administrator and power-on passwords help protect from unauthorized access to the server.
- Supports AMD Secure Root-of-Trust, Secure Run and Secure Move features to minimize potential attacks and protect data as the OS is booted, as applications are run and as applications are migrated from server to server.
- Supports Secure Boot to ensure only a digitally signed operating system can be used.
- Industry-standard Advanced Encryption Standard (AES) NI support for faster, stronger encryption.
- Additional physical security features are a chassis intrusion switch and a lockable front bezel.
Energy efficiency
The following energy-efficiency features help save energy, reduce operational costs, and increase energy availability:
- Energy-efficient planar components help lower operational costs.
- High-efficiency power supplies with 80 PLUS Titanium certifications
- Low-voltage 1.1V DDR5 memory offers energy savings compared to 1.2V DDR4 DIMMs, an approximately 20% decrease in power consumption
- Solid-state drives (SSDs) consume as much as 80% less power than traditional spinning 2.5-inch HDDs.
- The server uses hexagonal ventilation holes, which can be grouped more densely than round holes, providing more efficient airflow through the system and thus keeping your system cooler.
- Optional Lenovo XClarity Energy Manager provides advanced data center power notification and analysis to help achieve lower heat output and reduced cooling needs.
Comparing the SR665 V3 to the SR665
The ThinkSystem SR665 V3 improves on the previous generation SR665, as summarized in the following table.
Components and connectors
The following figure shows the front of the server. The server supports either 2.5-inch or 3.5-inch hot-swap drives at the front, and configurations with 16x 2.5-inch drive bays optionally support 3 front-accessible PCIe slots.
For details on the front ports, including the optional front VGA port and front external diagnostic port, see the Local management section.
The following figure shows the components visible from the rear of the server. The figure shows one configuration, with eight full-height PCIe slots, however there are additional rear configurations which include 10 PCIe slots (6x full-height, 4x low-profile), or include 3.5-inch drive bays or 2.5-inch drive bays. The server also supports two rear-accessible 7mm hot-swap drive bays.
Figure 3. Rear view of the ThinkSystem SR665 V3 (configuration with eight full-height PCIe slots)
System architecture
The following figure shows the architectural block diagram of the SR665 V3, showing the major components and their connections.
Note that one of the xGMI links between the processors can be used instead as two PCIe 5.0 x16 connections. These PCIe connections can be used for additional NVMe drive support.
Standard specifications
The following table lists the standard specifications.
Components | Specification |
---|---|
Machine types | 7D9B - 1 year warranty 7D9A - 3 year warranty |
Form factor | 2U rack. |
Processor | One or two AMD EPYC 9004 Series processors (formerly codenamed "Genoa"). Supports processors up to 128 cores, core speeds of up to 4.1 GHz, and TDP ratings of up to 360W. Supports PCIe 5.0 for high performance I/O. |
Chipset | Not applicable (platform controller hub functions are integrated into the processor) |
Memory | 24 DIMM slots with two processors (12 DIMM slots per processor). Each processor has 12 memory channels, with 1 DIMM per channel (DPC). Lenovo TruDDR5 RDIMMs, 3DS RDIMMs, and 9x4 RDIMMs are supported, up to 4800 MHz |
Memory maximum | Up to 6TB with 24x 256GB 3DS RDIMMs |
Persistent memory | Not supported. |
Memory protection | ECC, SDDC, Patrol/Demand Scrubbing, Bounded Fault, DRAM Address Command Parity with Replay, DRAM Uncorrected ECC Error Retry, On-die ECC, ECC Error Check and Scrub (ECS), Post Package Repair |
Disk drive bays |
Up to 20x 3.5-inch or 40x 2.5-inch hot-swap drive bays:
The server also supports these drives for OS boot or drive storage:
See Storage configurations for details. |
Maximum internal storage |
|
Storage controller |
|
Optical drive bays | No internal optical drive |
Tape drive bays | No internal backup drive |
Network interfaces | Dedicated OCP 3.0 SFF slot with PCIe 5.0 x16 host interface, either at the rear of the server (rear-accessible) or the front of the server (front-accessible). Supports a variety of 2-port and 4-port adapters with 1GbE, 10GbE and 25GbE network connectivity. One port can optionally be shared with the XClarity Controller 2 (XCC2) management processor for Wake-on-LAN and NC-SI support. Additional PCIe network adapters supported in PCIe slots. |
PCI Expansion slots |
Up to 12x PCIe slots (10x rear, 2x front), plus a slot dedicated to an OCP 3.0 adapter. 2.5-inch drive configurations also support an additional internal bay for a cabled RAID adapter or HBA. Rear: Up to 10x PCIe slots, plus a slot dedicated to the OCP adapter. Slot are either PCIe 5.0 or 4.0 depending on riser selection and rear drive bay selection. The use of some slots requires two processors. Slots are configured using three riser cards. Riser 1 (slots 1-3) and Riser 2 (slots 4-6) are installed in slots in the system board, Riser 3 (slots 7-8) and Riser 4 (9-10) are cabled to ports on the system board. A variety of riser cards are available. See the I/O expansion for details. Front: The server also supports slots at the front of the server (configurations with up to 16 drive bays): 2x PCIe x16 full-height half-length slots, plus 1x OCP 3.0 slot Internal: For 2.5-inch front drive configurations, the server supports the installation of a RAID adapter or HBA in a dedicated area that does not consume any of the PCIe slots. |
Ports |
Front: 1x USB 3.2 G1 (5 Gb/s) port, 1x USB 2.0 port (also for XCC local management), External diagnostics port, optional VGA port. Rear: 3x USB 3.2 G1 (5 Gb/s) ports, 1x VGA video port, 1x RJ-45 1GbE systems management port for XCC remote management. Optional 2nd XCC remote management port (installs in OCP slot). Optional DB-9 COM serial port (installs in slot 3). Internal: 1x USB 3.2 G1 (5 Gb/s) connector for operating system or license key purposes. |
Cooling | Up to 6x N+1 redundant hot swap 60 mm fans, configuration dependent. One fan integrated in each power supply. |
Power supply | Up to two hot-swap redundant AC power supplies, 80 PLUS Platinum or 80 PLUS Titanium certification. 750 W, 1100 W, 1800 W, 2400 W, and 2600 W AC, supporting 220 V AC. 750 W and 1100 W options also support 110V input supply. In China only, all power supply options support 240 V DC. Also available is a 1100W power supply with a -48V DC input. |
Video | Embedded video graphics with 16 MB memory with 2D hardware accelerator, integrated into the XClarity Controller. Maximum resolution is 1920x1200 32bpp at 60Hz. |
Hot-swap parts | Drives, power supplies, and fans. |
Systems management | Operator panel with status LEDs. Optional External Diagnostics Handset with LCD display. Models with 16x 2.5-inch front drive bays can optionally support an Integrated Diagnostics Panel. XClarity Controller 2 (XCC2) embedded management based on the ASPEED AST2600 baseboard management controller (BMC). Dedicated rear Ethernet port for XCC2 remote access for management. Optional 2nd redundant XCC2 remote port supported, installs in the OCP slot. XClarity Administrator for centralized infrastructure management, XClarity Integrator plugins, and XClarity Energy Manager centralized server power management. Optional XCC Platinum to enable remote control functions and other features. |
Security features | Chassis intrusion switch, Power-on password, administrator's password, Root of Trust module supporting TPM 2.0 and Platform Firmware Resiliency (PFR). Optional lockable front security bezel. |
Operating systems supported | Microsoft Windows Server, Microsoft Windows 10 & 11, Red Hat Enterprise Linux, SUSE Linux Enterprise Server, VMware ESXi, Ubuntu Server. See the Operating system support section for specifics. |
Limited warranty | Three-year or one-year (model dependent) customer-replaceable unit and onsite limited warranty with 9x5 next business day (NBD). |
Service and support | Optional service upgrades are available through Lenovo Services: 4-hour or 2-hour response time, 6-hour fix time, 1-year or 2-year warranty extension, software support for Lenovo hardware and some third-party applications. |
Dimensions | Width: 445 mm (17.5 in.), height: 87 mm (3.4 in.), depth: 766 mm (30.1 in.). See Physical and electrical specifications for details. |
Weight | Maximum: 38.8 kg (85.5 lb) |
Models
ThinkSystem SR665 V3 models can be configured by using the Lenovo Data Center Solution Configurator (DCSC).
Topics in this section:
CTO models
ThinkSystem SR665 V3 models can be configured by using the Lenovo Data Center Solution Configurator (DCSC).
Configure-to-order (CTO) models are used to create models with factory-integrated server customizations. For CTO models, two types of base CTO models are available for the SR665 V3 as listed in the columns in the following table:
- General purpose base CTO models are for general business (non-HPC) and is selectable by choosing General Purpose mode in DCSC.
- AI and HPC base models are intended for Artificial Intelligence (AI) and High Performance Computing (HPC) configurations and solutions are enabled using the AI & HPC Hardware - ThinkSystem Hardware mode in DCSC. These configurations, along with Lenovo EveryScale Solutions, can also be built using System x and Cluster Solutions Configurator (x-config). Tip: Some HPC and AI models are not listed in DCSC and can only be configured in x-config.
Controlled GPU models: The "Controlled GPU" base CTO models listed in the table are the only models that support high-performance GPUs and accelerators. These models are classified under US Government ECCN regulations and have limited market and customer availability. All other base models do not support high-performance GPUs.
Preconfigured server models may also be available for the SR665 V3, however these are region-specific; that is, each region may define their own server models, and not all server models are available in every region.
The following table lists the base CTO models of the ThinkSystem SR665 V3 server.
CTO models for Windows 10 and Windows 11
The SR665 V3 can run Windows 10 and Windows 11, however only a subset of adapters and drives can be installed. For ease of configuration, the following Base CTO models have been announced to assist building a configuration that can be used with the client operating systems. For more information, see the Windows 10 and Windows 11 section.
Base feature codes
Models of the SR665 V3 are defined based on whether the server has 2.5-inch drive bays at the front (called the 2.5-inch chassis) or whether it has 3.5-inch drive bays at the front (called the 3.5-inch chassis). For models, the feature codes for these chassis bases are as listed in the following table.
Preconfigured models
The following tables list the available preconfigured models, grouped by region.
- Models for Asia Pacific region
- Models for Australia and New Zealand
- Models for EMEA region
- Models for India
- Models for Latin American countries (except Brazil)
Refer to the Specifications section for information about standard features of the server.
Common to all models:
- Power supplies are Platinum unless otherwise stated
- All models include a Toolless Slide Rail Kit
Models for Asia Pacific region
The following table lists the models for the Asia Pacific region: Australia, Bangladesh, Brunei, Hong Kong, India, Japan, Korea, Sri Lanka, Malaysia, New Zealand, Philippines, Singapore, Thailand, Taiwan, Vietnam
† Processor description: Processor model, number of cores, thermal design power (TDP), core frequency
Models for Australia and New Zealand
AP models: Customers in Australia and New Zealand also have access to the Asia Pacific region models.
Common to all Australia and New Zealand models:
- All models include a Toolless Slide Rail Kit and Cable Management Arm
† Processor description: Processor model, number of cores, thermal design power (TDP), core frequency
Models for EMEA region
† Processor description: Processor model, number of cores, thermal design power (TDP), core frequency
Models for India
Common to all India models:
- All models include a Toolless Slide Rail Kit with Cable Management Arm (CMA)
AP models: Customers in India also have access to the Asia Pacific region models.
† Processor description: Processor model, number of cores, thermal design power (TDP), core frequency
Models for Latin American countries (except Brazil)
† Processor description: Processor model, number of cores, thermal design power (TDP), core frequency
Processors
The SR665 V3 supports processors in the fourth-generation AMD EPYC family of processors. The server supports one or two processors.
Topics in this section:
Processor options
The table below lists the AMD processors that are currently supported by the SR665 V3.
All supported processors have the following characteristics:
- Fourth-generation AMD EPYC processors (formerly codenamed "Genoa")
- 12 DDR5 memory channels
- 128 PCIe 5.0 I/O lanes, 64 lanes available for PCIe and NVMe devices
The SR665 V3 also supports the new 4th Gen AMD EPYC processors with "Zen 4c" architecture (formerly codenamed "Bergamo"). These processors have higher core counts, up to 128 cores, targeted at cloud native applications that are designed to exploit the scale, elasticity, resiliency, and flexibility of private & public clouds.
* Processors with a P suffix are single-socket capable processors and are only available in configure-to-order builds or in preconfigured models. Not available as option part numbers.
Configuration notes:
- Processor options include a heatsink but do not include a system fan
† The maximum single-core frequency that the processor is capable of operating
** Processors with a P suffix are single-socket capable processors
xGMI cabled connection
As shown in the System architecture section, the server has four xGMI links between the two processors. By default, three xGMI links are used for inter-processor communications, and the fourth xGMI connection is used to provide two PCIe x16 connections for additional PCIe and NVMe devices. However, to maximize CPU-to-CPU performance, the two xGMI connectors can be joined using a cable.
Ordering information for this xGMI cable is listed in the following table.
Part number | Feature code | Description |
---|---|---|
4X97A87125 | BR65 | SR665 V3 CPU interconnection Cable Kit* |
* In DCSC, this cable may be labeled "Cable126"
Configuration notes:
- The following configurations do not support the use of this xGMI cable:
- Configurations with 16 or more onboard connections to NVMe drives
- Configurations with front PCIe slots + front OCP slot + front onboard NVMe
- Configurations with 12 PCIe slots (10x rear, 2x front)
One-processor configurations
The SR665 V3 can be used with only one processor installed. Most core functions of the server (including the XClarity Controller) are connected to processor 1 as shown in the System architecture section.
With only one processor, the server has the following capabilities:
- 12 memory DIMMs
- Slot 1-3 are available; Slot 4-8 are not available
- 16 onboard SATA connections
- 8 onboard NVMe connections
Drive support and controller support is as listed in the Storage configurations section - see the rows for 1 processor installed in the tables.
Thermal requirements by processor
For thermal requirements for processors, see the Thermal Rules section in the Information Center for the SR665 V3:
https://pubs.lenovo.com/sr665-v3/thermal_rules
Additional ambient temperature restrictions may apply. See the Operating environment section for details.
Lenovo Processor Neptune Core Module - Open-loop liquid cooling
The SR665 V3 also supports advanced direct-water cooling (DWC) capability with the Lenovo Processor Neptune Core Module. This module implements a liquid cooling solution where heat from the processors is removed from the rack and the data center using an open loop and coolant distrubution units.
With the Processor Neptune Core Module, all heat generated by the processors is removed from the server using water. This means that the server fans and data center air conditioning units only need to remove the heat generated by the other components. This results in lower air conditioning costs and it enables the use of slower fans which results in lower overall power consumption.
The following figure shows the Lenovo Processor Neptune Core Module.
Figure 6. Lenovo Processor Neptune Core Module
The Processor Neptune Core Module also includes a leak detection module which can detect a leakage of more than 0.5ml (about 10 drops) along the length of the tube and then issue an event to the XClarity Controller. XCC will then post an error to the System Event Log and enable further actions. Once the liquid evaporates, a further event is issue to XCC.
The Processor Neptune Core Module is only available in CTO orders, not as a field upgrade. Ordering information is listed in the following table.
Part number | Feature code | Description |
---|---|---|
CTO only | BZGM* | ThinkSystem V3 Neptune Processor Direct Water Cooling Solution |
* In DCSC, this feature code is listed in the Processor tab
Configuration notes:
- The Processor Neptune Core Module requires water infrastructure be available in the rack cabinet and data center, as described in the Water infrastructure section.
- All processor SKUs are supported
- Two CPUs are required; Configurations with one processor are not supported
- All front drive bay configurations are supported
- Slot 6 is not available for adapters - the water loop is routed through the space otherwise occupied by slot 6
- Rear drive bays are supported
- 7mm drive bays are supported only in slot 3
- M.2 adapters are supported based on the configurations in the Storage configurations section
- Standard fans can be configured in most configurations
- The use of a cable management arm (CMA) is not supported
For more information, see the Thermal Rules page:
https://pubs.lenovo.com/sr665-v3/thermal_rules
The following figure shows the Lenovo Neptune Processor DWC Module installed in the SR665 V3 (risers removed to show internal components).
Figure 7. Lenovo Neptune Processor DWC Module installed in the SR665 V3
UEFI operating modes
The SR665 V3 offers preset operating modes that affect energy consumption and performance. These modes are a collection of predefined low-level UEFI settings that simplify the task of tuning the server to suit your business and workload requirements.
The following table lists the feature codes that allow you to specify the mode you wish to preset in the factory for CTO orders.
Feature code | Description |
---|---|
BFYA | Operating mode selection for: "Maximum Efficiency Mode" |
BFYB | Operating mode selection for: "Maximum Performance Mode" |
The preset modes for the SR665 V3 are as follows:
- Maximum Efficiency Mode (feature BFYA): Maximizes performance/watt efficiency while maintaining reasonable performance
- Maximum Performance Mode (feature BFYB): Achieves maximum performance but with higher power consumption and lower energy efficiency.
For details about these preset modes, and all other performance and power efficiency UEFI settings offered in the SR665 V3, see the paper "Tuning UEFI Settings for Performance and Energy Efficiency on AMD Processor-Based ThinkSystem Servers", available from https://lenovopress.lenovo.com/lp1267.
Platform Secure Boot
Platform Secure Boot (PSB) is a feature of AMD EPYC processors that helps defend against threats to firmware. It is designed to provide protection in response to growing firmware-level remote attacks being seen across the industry. AMD Secure Boot extends the AMD silicon root of trust to help protect the system by establishing an unbroken chain of trust from the AMD silicon root of trust to the BIOS. The UEFI secure boot helps continue the chain of trust from the system BIOS to the OS Bootloader. This feature helps defend against remote attackers seeking to embed malware into firmware.
With PSB enabled, the processor is cryptographically bound to the server firmware code signing key once the processors are installed in the server and the server is powered on. From that point on, that processor can only be used with motherboards that use the same code signing key.
Disabling PSB will stop the protection against remote and local attackers seeking to embed malware into a platform’s firmware, BIOS and even UEFI functions. Disabling PSB also allows you to install the processor in another server that you purchased from Lenovo, however, we do not recommend you do this by yourself. Please contact the Lenovo service team for further assistance.
By default, the server has Platform Secure Boot enabled on the installed processors, however for factory orders, you can choose to have the server with PSB disabled. To do this, select feature code C18D as listed in the following table. PSB can be later enabled in System Setup if desired.
Cannot be disabled once enabled: Once you enable PSB in a server, it cannot be disabled on those processors.
If you add a second processor as a field upgrade and your server has PSB enabled, then as soon as you install the processor and power the server on, the processor is then cryptographically bound to the server, and can only be used in that server going forward.
Note: Platform Secure Boot (PSB) is different from the Secure Boot security feature described in the Platform Firmware Resiliency section.
Memory options
The SR665 V3 uses Lenovo TruDDR5 memory operating at up to 4800 MHz. The server supports up to 24 DIMMs with 2 processors. The processors have 12 memory channels and support 1 DIMM per channel. The server supports up to 6TB of memory using 24x 256GB 3DS RDIMMs and two processors.
The following table lists the memory options that are available for the server.
Lenovo TruDDR5 memory uses the highest quality components that are sourced from Tier 1 DRAM suppliers and only memory that meets the strict requirements of Lenovo is selected. It is compatibility tested and tuned to maximize performance and reliability. From a service and support standpoint, Lenovo TruDDR5 memory automatically assumes the system warranty, and Lenovo provides service and support worldwide.
9x4 RDIMMs (also known as Optimized or EC4 RDIMMs) are a new lower-cost DDR5 memory option supported in ThinkSystem V3 servers. 9x4 DIMMs offer the same performance as standard RDIMMs (known as 10x4 or EC8 modules), however they support lower fault-tolerance characteristics. Standard RDIMMs and 3DS RDIMMs support two 40-bit subchannels (that is, a total of 80 bits), whereas 9x4 RDIMMs support two 36-bit subchannels (a total of 72 bits). The extra bits in the subchannels allow standard RDIMMs and 3DS RDIMMs to support Single Device Data Correction (SDDC), however 9x4 RDIMMs do not support SDDC. Note, however, that all DDR5 DIMMs, including 9x4 RDIMMs, support Bounded Fault correction, which enables the server to correct most common types of DRAM failures.
For more information on DDR5 memory, see the Lenovo Press paper, Introduction to DDR5 Memory, available from https://lenovopress.com/lp1618.
The following rules apply when selecting the memory configuration:
- The SR665 V3 supports quantities 1, 2, 4, 6, 8, 10, 12 DIMMs per processor; other quantities not supported
- The server supports four types of DIMMs: 9x4 RDIMMs, 10x4 RDIMMs, x8 RDIMMs and 3DS RDIMMs
- UDIMMs and LRDIMMs are not supported
- Mixing of DIMM types is not supported (for example, 9x4 DIMMs with 10x4 RDIMMs)
- Mixing of DRAM technology (16Gb, 24Gb, 32Gb) is not supported. See the column in the above table.
- Mixing of 128GB 3DS RDIMMs and 256GB 3DS RDIMMs is not supported
- Mixing of 128GB 3DS RDIMMs (features BYEE and BQ3A) is not supported
- Mixing of 256GB 3DS RDIMMs (features BZPN and BQ3B) is not supported
- Mixing x4 and x8 DIMMs is not supported
- Mixing of DIMM rank counts is supported. Follow the required installation order installing the DIMMs with the higher rank counts first.
- Mixing of DIMM capacities is supported, however only two different capacities are supported across all channels of the processor (eg 16GB and 32GB). Follow the required installation order installing the larger DIMMs first.
- Memory operates at the speed of the memory bus of the processor - see the Processor features section for specifics
- The use of the 128GB 3D RDIMM feature BYEE has the following requirements for thermal reasons:
- If CPU TDP > 240W, the combination of GPUs and 24x 2.5-inch drive bays is not supported
- Additional ambient temperature requirements - see https://pubs.lenovo.com/sr665-v3/thermal_rules for information
Note: Memory mirroring and memory rank sparing are not supported.
For best performance, consider the following:
- Ensure the memory installed is at least the same speed as the memory bus of the selected processor.
- Populate all 12 memory channels with identical DIMMs (same Lenovo part number)
The following memory protection technologies are supported:
- ECC detection/correction
- Bounded Fault detection/correction
- SDDC (for x4-based memory DIMMs; look for "x4" in the DIMM description. Not supported with 9x4 RDIMMs)
- Patrol/Demand Scrubbing
- DRAM Address Command Parity with Replay
- DRAM Uncorrected ECC Error Retry
- On-die ECC
- ECC Error Check and Scrub (ECS)
- Post Package Repair
Internal storage
The SR665 V3 has three drive bay zones and supports up to 20x 3.5-inch or 40x 2.5-inch hot-swap drive bays or a combination of drive bays, depending on the selected chassis and backplane configuration. The server also supports configurations without any drive bays if desired.
The three drive bay zones are as follows:
- Front:
- Up to 12x 3.5-inch hot-swap bays, or
- Up to 24x 2.5-inch hot-swap bays
- Middle:
- 4x 3.5-inch hot-swap bays, or
- 8x 2.5-inch hot-swap bays
- Rear:
- Up to 4x 3.5-inch hot-swap bays, or
- Up to 8x 2.5-inch hot-swap bays
- Also supports 2x 7mm hot-swap drives bays
All drives are hot-swap and are accessible from the front, from the rear, or from drive bays that are located in the middle of the server (accessible when you remove the top cover of the server).
The server also supports one or two M.2 drives, installed in an M.2 adapter internal to the server.
In this section:
NVMe drive support
The SR665 V3 supports NVMe drives to maximize storage performance.
- Up to 32 NVMe drives in a 2.5-inch drive configuration, without oversubscription (that is, each x4 drive has a dedicated x4 (4 lanes) connection to the processor, either direct to the processor or via a retimer adapter)
- Up to 24 installed in front bays
- Up to 32 installed in front and mid bays
- Up to 8 NVMe drives in a 3.5-inch drive configuration, without oversubscription
- All installed in mid bays
Riser 3 support: The use of the onboard NVMe ports is mutually exclusive with Riser 3, as these use the same PCIe connectors. See the System architecture section.
The specifics of these configurations are covered in the Storage configurations section. The tables in those sections indicate the number of NVMe drives in each configuration.
In addition, the SR665 V3 supports two 7mm NVMe drives for use as boot drives. These two drives optionally support RAID via a separate RAID adapter installed in a PCIe slot.
The RAID 940-8i and RAID 940-16i adapters also support NVMe through a feature named Tri-Mode support (or Trimode support). This feature enables the use of NVMe U.3 drives at the same time as SAS and SATA drives. Tri-Mode requires an AnyBay backplane. Cabling of the controller to the backplanes is the same as with SAS/SATA drives, and the NVMe drives are connected via a PCIe x1 link to the controller.
NVMe drives connected using Tri-Mode support provide better performance than SAS or SATA drives: A SATA SSD has a data rate of 6Gbps, a SAS SSD has a data rate of 12Gbps, whereas an NVMe U.3 Gen 4 SSD with a PCIe x1 link will have a data rate of 16Gbps. NVMe drives typically also have lower latency and higher IOPS compared to SAS and SATA drives. Tri-Mode is supported with U.3 NVMe drives and requires an AnyBay backplane.
Tri-Mode requires U.3 drives: Only NVMe drives with a U.3 interface are supported. U.2 drives are not supported. See the Internal drive options section for the U.3 drives supported by the server.
Front drive bays
The front drive bay zone supports the following configurations:
- 8x or 12x 3.5-inch drive bays (all hot-swap)
- 8x, 16x or 24x 2.5-inch drive bays (all hot-swap)
- No backplanes and no drives (supports field upgrades)
Figure 8. SR665 V3 front drive bay configurations - 3.5-inch drive bays
Figure 9. SR665 V3 front drive bay configurations - 2.5-inch drive bays, all the same drive type
Figure 10. SR665 V3 front drive bay configurations - 2.5-inch drive bays, combinations
Figure 11. SR665 V3 front drive bay configurations - 2.5-inch drive bays with front PCIe slots
The backplanes used to provide these drive bays are listed in the following table.
Field upgrades: All front backplanes are available as part numbers for field upgrades along with require cable option kits, as described in the Field upgrades section below.
* Backplane has an onboard SAS expander that provides connectivity to SAS/SATA drive bays in a separate rear backplane (order the rear backplane separately). See also note below for BQ2T.
The use of front drive bays has the following configuration rules:
- The SR665 V3 also supports configurations without any drive bays, allowing for drive bay upgrades as described in the field upgrades section.
- If 3.5-inch front drive bays are used, an internal (CFF) RAID adapter or HBA is not supported as the adapter and bays occupy the same physical space
- Any 8x 2.5-inch and 16x 2.5-inch drive configuration (SAS/SATA, AnyBay, or NVMe) can optionally be configured for use with the Integrated Diagnostics Panel as described in the Local management section. 3.5-inch drive configurations do not support the Integrated Diagnostics Panel. With the Integrated Diagnostics Display, 8-bay configurations can be upgrade to 16 bays, however 16-bay configurations cannot be upgrade to 24 bays.
- If you are building a server configuration that includes the ThinkSystem 2U 24x2.5" SAS/SATA with Rear 4-Bay Expander Backplane (feature BQ2T) and the order also includes a rack cabinet, then you can configure at most 6 drives to be installed in the factory. The remaining drives must be ordered separately using the option part numbers for the drives. This requirement does not apply if the order does not include a rack cabinet. The requirement is due to the shock/vibration limits of the 24x 2.5-inch backplane.
- The use of ThinkSystem 2U 12x3.5" SAS/SATA with Rear 4-Bay Expander Backplane (BQ2S, 4XH7A86133) is not supported with Windows Server or Windows 10/11 when used with the following:
- Any of these mid or rear backplanes:
- ThinkSystem 2U 4x3.5" SAS/SATA Middle Backplane (BCQK)
- ThinkSystem 2U 2x3.5" SAS/SATA Rear Backplane (BAG7)
- ThinkSystem 1U/2U 4x3.5" SAS/SATA Backplane (B8L3)
- ThinkSystem V3 1U/2U 4x2.5" AnyBay Backplane (BQ2U)
- Any of these SAS HBAs:
- ThinkSystem 440-8i SAS/SATA PCIe Gen4 12Gb HBA (BM51)
- ThinkSystem 440-16i SAS/SATA PCIe Gen4 12Gb HBA (BM50)
- ThinkSystem 440-16i SAS/SATA PCIe Gen4 12Gb Internal HBA (B8P1)
- Any of these mid or rear backplanes:
Mid drive bays
The SR665 V3 supports hot-swap drives installed in the middle of the server chassis. The drive bays are accessible by removing the top lid of the server and levering the mid drive chassis up at the front.
The following configurations are supported:
- 4x 3.5-inch hot-swap SAS/SATA drive bays
- 8x 2.5-inch hot-swap SAS/SATA drive bays
- 8x 2.5-inch hot-swap NVMe drive bays
The drive bays in the open position are shown in the following figure.
M.2 support: When mid drive bays are configured, the M.2 adapter is installed on the mid drive bay mechanical as shown in the images.
Figure 12. Mid-chassis drive bays
The backplanes used to provide these drive bays are listed in the following table.
‡ 2.5-inch drive backplanes for the mid-chassis area must be installed in pairs. NVMe and SAS/SATA cannot be mixed.
Field upgrades: Backplanes are available as part numbers for field upgrades along with require cable option kits, as described in the Field upgrades section below.
The use of drive bays in the mid-chassis area has the following configuration rules:
- All processors are supported. Higher TDP processors will require the performance heatsinks.
- Full-length adapter cards are not supported
- GPUs (including low profile GPUs such as the NVIDIA A2) are not supported
- The use of mid drive bays requires Riser 1 be installed, since power for the mid bay backplanes comes from Riser 1
Rear drive bays
The SR665 V3 supports hot-swap drives installed at the rear of the server chassis. Supported configurations are as follows:
- 3.5-inch hot-swap drives
- 2x SAS/SATA drive bays
- 4x SAS/SATA drive bays
- 2.5-inch hot-swap drives
- 4x SAS/SATA drive bays
- 4x AnyBay drive bays
- 8x SAS/SATA drive bays
The configurations are shown in the following figure.
Figure 13. Rear 2.5-inch and 3.5-inch drive bay configurations
The backplanes used to provide these drive bays are listed in the following table.
7mm drives: The SR665 V3 supports two 7mm drives. See the 7mm drives section for details.
Field upgrades: Backplanes are available as part numbers for field upgrades along with require cable option kits, as described in the Field upgrades section below.
The use of rear drive bays has the following configuration rules:
- The use of rear bays restricts the number of slots and the choice of risers that are supported. See the I/O expansion section for details.
- The use of rear drive bays may require that Riser 1 or Riser 2 be installed, since power for the rear backplane comes from that riser.
Storage configurations
This section describes the various combinations of front and rear drives that the server supports, as well as M.2 support.
Tip: These tables are based on Config Matrix V1.6A in TRD 6.1.
In this section:
- Overview of configurations - 3.5-inch front drive bays
- Overview of configurations - 2.5-inch front drives supporting rear slots (no front slots)
- Overview of configurations - 2.5-inch front drives supporting front slots (no rear slots)
- Overview of configurations - 2.5-inch front drives supporting 12 slots (front & rear)
- Details - 3.5-inch front drive bays
- Details - 2.5-inch front drives supporting rear slots (no front slots)
- Details - 2.5-inch front drives supporting front slots (no rear slots)
- Details - 2.5-inch front drives supporting 12 slots (front & rear)
The following tables summarize the storage configurations for the SR665 V3. For details, including processor requirements, M.2 and 7mm support, and controller selections, see each of the Details tables.
Overview - 3.5-inch front drives
The following table summarizes the configurations that use 3.5-inch front drive bays.
Click to jump down to the details of the 3.5-inch front drive configurations.
Return to Storage configurations.
Overview - 2.5-inch front drives supporting rear slots (no front slots)
The following table summarizes the configurations that use 2.5-inch front drives supporting rear slots (no front slots).
Click to jump down to the details of the 2.5-inch front drive configurations.
Return to Storage configurations.
Overview - 2.5-inch front drives supporting front slots (no rear slots)
The following table summarizes the configurations that use 2.5-inch front drives supporting front slots (no rear slots).
Click to jump down to the details of the 2.5-inch front drive configurations.
Return to Storage configurations.
Overview - 2.5-inch front drives supporting 12 slots (front & rear)
The following table summarizes the configurations that use 2.5-inch front drives supporting 12 slots (front & rear).
Click to jump down to the details of the 2.5-inch front drive configurations.
Return to Storage configurations.
Details - 3.5-inch front bays
The following table details the configurations that use 3.5-inch front drive bays.
Click to go to the overview of the 3.5-inch front drive configurations.
Return to Storage configurations.
In the table below, the M.2 and 7mm columns have the following meanings:
- M.2 Non-RAID (SATA) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with SATA drives. No RAID support.
- M.2 Non-RAID (NVMe) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with NVMe drives. No RAID support.
- M.2 + RAID adapter means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- M.2 RAID means an M.2 adapter with integrated RAID, either 4Y37A09750 (Marvell) or 4Y37A90063 (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
- 7mm Non-RAID (SATA) means the 7mm SATA/NVMe kit (BU0N) with SATA drives. No RAID support.
- 7mm Non-RAID (NVMe) means the 7mm SATA/NVMe kit (BU0N) with NVMe drives. No RAID support.
- 7mm + RAID adapter means the 7mm SATA/NVMe kit (BU0N) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- 7mm RAID means the 7mm kit with integrated RAID, either B8P3 (Marvell) or BYFG (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
* These storage configurations, when configured with a 440-8i or 440-16i HBA, are not supported with Windows Server or Windows 10/11
Details - 2.5-inch front bays supporting rear slots (no front slots)
The following table details the configurations that use 2.5-inch front bays supporting rear slots (no front slots).
Click to go to the overview of the 2.5-inch front drive configurations.
Return to Storage configurations.
In the table below, the M.2 and 7mm columns have the following meanings:
- M.2 Non-RAID (SATA) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with SATA drives. No RAID support.
- M.2 Non-RAID (NVMe) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with NVMe drives. No RAID support.
- M.2 + RAID adapter means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- M.2 RAID means an M.2 adapter with integrated RAID, either 4Y37A09750 (Marvell) or 4Y37A90063 (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
- 7mm Non-RAID (SATA) means the 7mm SATA/NVMe kit (BU0N) with SATA drives. No RAID support.
- 7mm Non-RAID (NVMe) means the 7mm SATA/NVMe kit (BU0N) with NVMe drives. No RAID support.
- 7mm + RAID adapter means the 7mm SATA/NVMe kit (BU0N) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- 7mm RAID means the 7mm kit with integrated RAID, either B8P3 (Marvell) or BYFG (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
Details - 2.5-inch front bays supporting front slots (no rear slots)
The following table details the configurations that use 2.5-inch front bays supporting front slots (no rear slots).
Click to go to the overview of the 2.5-inch front drive configurations.
Return to Storage configurations.
In the table below, the M.2 and 7mm columns have the following meanings:
- M.2 Non-RAID (SATA) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with SATA drives. No RAID support.
- M.2 Non-RAID (NVMe) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with NVMe drives. No RAID support.
- M.2 + RAID adapter means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- M.2 RAID means an M.2 adapter with integrated RAID, either 4Y37A09750 (Marvell) or 4Y37A90063 (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
- 7mm Non-RAID (SATA) means the 7mm SATA/NVMe kit (BU0N) with SATA drives. No RAID support.
- 7mm Non-RAID (NVMe) means the 7mm SATA/NVMe kit (BU0N) with NVMe drives. No RAID support.
- 7mm + RAID adapter means the 7mm SATA/NVMe kit (BU0N) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- 7mm RAID means the 7mm kit with integrated RAID, either B8P3 (Marvell) or BYFG (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
Details - 2.5-inch front drives supporting 12 slots (front & rear)
The following table details the configurations that use 2.5-inch front drives supporting 12 slots (front & rear).
Click to go to the overview of the 2.5-inch front drive configurations.
Return to Storage configurations.
In the table below, the M.2 and 7mm columns have the following meanings:
- M.2 Non-RAID (SATA) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with SATA drives. No RAID support.
- M.2 Non-RAID (NVMe) means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with NVMe drives. No RAID support.
- M.2 + RAID adapter means the M.2 SATA/x4 NVMe adapter (4Y37A79663) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- M.2 RAID means an M.2 adapter with integrated RAID, either 4Y37A09750 (Marvell) or 4Y37A90063 (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
- 7mm Non-RAID (SATA) means the 7mm SATA/NVMe kit (BU0N) with SATA drives. No RAID support.
- 7mm Non-RAID (NVMe) means the 7mm SATA/NVMe kit (BU0N) with NVMe drives. No RAID support.
- 7mm + RAID adapter means the 7mm SATA/NVMe kit (BU0N) with either a RAID 5350-8i adapter (supporting SATA drives) or a RAID 540-8i (supporting NVMe drives). Adapter installs in a rear PCIe slot.
- 7mm RAID means the 7mm kit with integrated RAID, either B8P3 (Marvell) or BYFG (Broadcom). RAID-0 and RAID-1 are supported with the integrated RAID controller.
Field upgrades
The SR665 V3 is orderable without drive bays, allowing you to add a backplane, cabling and controllers as field upgrades. The server also supports upgrading some configurations by adding additional front drive bays (for example, upgrading from 8 to 16x 2.5-inch drive bays).
To add drive bays you will need to order both drive backplanes and cable kits. Backplane kits do not include cables.
The upgrades are listed as follows:
- 3.5-inch chassis drive bay upgrades
- 2.5-inch chassis drive bay upgrades
- Upgrades to Retimer adapters
- Upgrades to an Internal (CFF) HBA/RAID adapter
https://serveroption.lenovo.com/cable_kit_options/
3.5-inch chassis drive bay upgrades
The table below lists the backplane kits and cable kits needed to build one of the supported 3.5-inch chassis configurations.
Tip: The configurations each have a letter that matches the configurations listed in the Storage configurations section.
When adding drive bays, you will also need to add the appropriate storage controller(s). Consult the tables in the Storage configurations section to determine what controller sections are supported and what additional controllers you will need. Controllers are described in the Controllers for internal storage section.
2.5-inch chassis drive bay upgrades
The table below lists the backplane kits and cable kits needed to build one of the supported 2.5-inch chassis configurations.
Tip: The configurations each have a letter that matches the configurations listed in the Storage configurations section.
Note: Front drive cable kits are based on the location of the backplane in the server. The three backplane locations are BP1, BP2 and BP3 as shown in the following figure.
Figure 14. Backplane numbering
When adding drive bays, you will also need to add the appropriate storage controller(s). Consult the tables in the Storage configurations section to determine what controller sections are supported and what additional controllers you will need. Controllers are described in the Controllers for internal storage section.
Upgrades to Retimer adapters
If you are upgrading to a configuration that includes a Retimer adapter (see the Detailed tables in the Storage configurations section), then you will need to also order one of the following cable kits.
Upgrades to an Internal (CFF) HBA/RAID adapter
If you want to add an internal (CFF) storage adapter (HBA, RAID adapter or SAS expander) to a configuration, you will need to order the cable kit as listed in the following table. Suitable upgrades are either replacing an existing adapter in a rear PCIe slot, or adding the CFF adapter to a server without any storage adapter installed.
The cable kit to order is listed in the following table.
RAID flash power module (supercap) support
If you plan to add one of the RAID adapters that includes a RAID flash power module (supercap) as a field upgrade, then you may also need to order a Supercap installation kit for the supercap, depending on the location where the supercap will be installed. For CTO orders, the components needed are automatically derived when you select the RAID adapter.
The adapters that this applies to are as follows:
- Any supported RAID 9350 adapter
- Any supported RAID 940 adapter
The location of the supercaps depends on the mid-chassis drive cage used in the server, as shown in the following table.
For 3.5-inch drive bay configurations, if the server already has 3.5-inch mid-chassis drive bays, then the supercap holder is already present under the system fan cages. If you plan to add 3.5-inch mid-chassis drive bays by adding ThinkSystem SR665 V3 Middle 4x3.5" SAS/SATA Backplane Option Kit (4XH7A85892), then the supercap holder is part of the option kit.
7mm drives
The SR665 V3 supports two 7mm drives, either both SATA or both NVMe, at the rear of the server. These drives go in place of either PCIe slot 3 (Riser 1) or PCIe slot 6 (Riser 2) as shown in the following figure.
Figure 15. Rear 7mm drive bay configurations
For CTO orders, the configuration includes the drive bays and the cage the the drive bays are mounted on to.The cage required depends on where the 7mm drives are located (Riser 1 or Riser 2) and whether there are PCIe slots above the 7mm drive bays. The following table lists the ordering information.
Tip for 4x 3.5-inch rear drives: If you wish to configure 4x 3.5-inch rear drives plus 7mm drives in a CTO configuration, the 7mm drives will install in slot 6. You should specify riser card BLKP for Riser 1 and then leave Riser 2 without a riser selected.
The following table lists the PCIe RAID adapters that can be used to add RAID functionality to ThinkSystem 7mm SATA/NVMe 2-Bay Rear Enablement Kit v2 (BU0N)
The use of the 7mm rear drive bays has the following configuration rules:
- The 7mm rear drive kit is supported in either slot 3 or slot 6 but not both at the same time.
- M.2 and 7mm are mutually exclusive: they are not supported together in the same configuration
- For ThinkSystem 7mm SATA/NVMe 2-Bay Rear Enablement Kit v2 (feature BU0N):
- The 7mm drive bays support either SATA drives or NVMe drives but not both. You specify SATA or NVMe in the configurator using feature codes BTTV (SATA) or BTTW (NVMe).
- If RAID support is required, select feature code BS7A in the configurator to enable RAID
- The support of RAID-1 with the 7mm drives requires an additional RAID adapter that is installed in PCIe slot 2 or slot 3:
- RAID support for 7mm SATA drives requires a RAID 5350-8i adapter (feature BT7N)
- RAID support for 7mm NVMe drives requires a RAID 540-8i adapter operating in Tri-Mode (feature BT7P)
- The RAID adapter used for 7mm drive support cannot be configured for use with other drive bays (not even with M.2)
- If RAID support is not required, the 7mm drives connect to an onboard port; No additional adapter is required
- For ThinkSystem 2U 7mm Drive Kit w/ NVMe RAID (feature B8P3)
- The adapter only supports NVMe drives
- RAID functionality is integrated into the 7mm adapter using a Marvell 88NR2241 NVMe RAID Controller
- For ThinkSystem 7mm SATA/NVMe 2-Bay Rear Hot-Swap RAID Enablement Kit (feature BYFG)
- The adapter supports either SATA or NVMe drives
- RAID functionality is integrated into the 7mm adapter using a Broadcom RAID Controller
7mm drive field upgrades
For field upgrades, using the following ordering information. The kits include two cages for use depending on your PCIe slot configuration. The cages are for either Riser 1 or Riser 2. The part numbers also include the cables necessary to connect the 7mm backplane to either the system board or RAID adapter.
M.2 drives
The SR665 V3 supports one or two M.2 form-factor SATA or NVMe drives for use as an operating system boot solution or as additional storage.
The M.2 drives install into an M.2 module which is mounted horizontally in the server:
- In servers without mid-chassis drives, the M.2 module is mounted on the air baffle
- With a mid-chassis drive cage (2.5-inch or 3.5-inch), the M.2 module is mounted on the drive cage, as shown in the Mid drive bays section.
The supported M.2 modules are listed in the following table. For field upgrades see the M.2 field upgrades section below.
The ThinkSystem M.2 SATA/x4 NVMe 2-Bay Adapter optionally supports RAID with the addition of a separate RAID adapter is required. For CTO orders, ordering information is listed in the following table to derive the required RAID adapter.
Configuration notes:
- M.2 is not supported with all storage configurations - see Storage configurations for details.
- M.2 and 7mm are mutually exclusive: they are not supported together in the same configuration
- For field upgrades, an additional cable is needed as described in the M.2 field upgrades section below
- For ThinkSystem M.2 SATA/x4 NVMe 2-Bay Adapter (4Y37A79663, feature BM8X):
- RAID support is implemented with the use of an additional RAID adapter installed in a slot
- The adapter is not supported with Riser 3 or front PCIe slots
- If RAID support is not required, the M.2 adapter connects to an onboard port. No additional adapter is required
- The support of RAID-1 with the M.2 drives requires an additional RAID adapter that is installed in PCIe slot 2 or slot 3:
- RAID support for M.2 SATA drives requires a RAID 5350-8i adapter (feature BT7N)
- RAID support for M.2 NVMe drives requires a RAID 540-8i adapter operating in Tri-Mode (feature BT7P)
- The RAID adapter used for M.2 drive support cannot be configured for use with other drive bays (not even with 7mm)
- For ThinkSystem M.2 NVMe 2-Bay RAID Adapter (4Y37A09750):
- RAID is implemented using an onboard Marvell 88NR2241 NVMe RAID controller
- For ThinkSystem M.2 RAID B540i-2i SATA/NVMe Adapter (4Y37A90063):
- RAID is implemented using an onboard Broadcom RAID controller
Supported drives are listed in the Internal drive options section.
The ThinkSystem M.2 SATA/NVMe 2-Bay Enablement Kit has the following features:
- Supports one or two M.2 drives, either SATA or NVMe
- When two drives installed, they must be either both SATA or both NVMe
- Support 42mm, 60mm, 80mm and 110mm drive form factors (2242, 2260, 2280 and 22110)
- On the SR665 V3, no RAID support
- Either 6Gbps SATA or PCIe 3.0 x1 interface to the drives depending on the drives installed
- Supports monitoring and reporting of events and temperature through I2C
- Firmware update via Lenovo firmware update tools
The ThinkSystem M.2 SATA/x4 NVMe 2-Bay Adapter has the following features:
- Supports one or two M.2 drives, either SATA or NVMe
- When two drives installed, they must be either both SATA or both NVMe
- Support 42mm, 60mm, 80mm and 110mm drive form factors (2242, 2260, 2280 and 22110)
- No onboard RAID; RAID functionality is provided by a separate adapter (SATA or NVMe, however NVMe is only available as a field upgrade)
- Either 6Gbps SATA or PCIe 4.0 x4 interface to the drives depending on the drives installed
- Supports monitoring and reporting of events and temperature through I2C
- Firmware update via Lenovo firmware update tools
- When connected to a separate PCIe RAID adapter, supports SED drive encryption via the RAID adapter, otherwise no SED support
The ThinkSystem M.2 NVMe 2-Bay RAID Adapter (4Y37A09750) has the following features:
- Supports one or two NVMe M.2 drives
- Support 42mm, 60mm, 80mm and 110mm drive form factors (2242, 2260, 2280 and 22110)
- RAID support via an onboard Marvell 88NR2241 NVMe RAID Controller
- With 1 drive, supports single-drive RAID-0
- With 2 drives, supports 2-drive RAID-0, 2-drive RAID-1, or two single-drive RAID-0 arrays
- PCIe 3.0 x2 host interface; PCIe 3.0 x1 connection to each drive
- Management and configuration support via UEFI and OS-based tools
- Supports monitoring and reporting of events and temperature through I2C
- Firmware update via Lenovo firmware update tools
- No support for SED drive encryption
The ThinkSystem M.2 RAID B540i-2i SATA/NVMe Adapter (4Y37A90063) has the following features:
- Supports one or two M.2 drives, either SATA or NVMe
- Support 42mm, 60mm, 80mm and 110mm drive form factors (2242, 2260, 2280 and 22110)
- RAID support via an onboard Broadcom SAS3808N RAID Controller
- With 1 drive, supports JBOD
- With 2 drives, supports 2-drive RAID-0, 2-drive RAID-1, or JBOD
- PCIe 4.0 x2 host interface; PCIe 4.0 x1 connection to each drive
- Management and configuration support via UEFI and OS-based tools
- Supports monitoring and reporting of events and temperature
- Firmware update via Lenovo firmware update tools
- Supports SED drive encryption
M.2 field upgrades
For field upgrades, the SR665 V3 also requires additional cables necessary to connect the M.2 to either the system board or RAID adapter. Ordering information is listed in the following table.
SED encryption key management with SKLM
The server supports self-encrypting drives (SEDs) as listed in the Internal drive options section. To effectively manage a large deployment of these drives in Lenovo servers, IBM Security Key Lifecycle Manager (SKLM) offers a centralized key management solution.
The IBM Security Key Lifecycle Manager software is available from Lenovo using the ordering information listed in the following table.
Controllers for internal storage
The SR665 V3 offers a variety of controller options for internal drives:
- For 2.5-inch and 3.5-inch drives:
- Onboard SATA ports (feature AVUX)
- Onboard NVMe ports (feature BC4V)
- NVMe switch and retimer adapters (PCIe slot-based)
- RAID adapters and HBAs for SAS/SATA drives (PCIe slot-based)
- RAID adapters, SAS Expander, and HBAs for SAS/SATA drives (cabled in a dedicated space)
- For 7mm drive bays in the rear of the server (see the 7mm drives section)
- SATA controller integrated into the 7mm drive bay enclosure
- NVMe controller integrated into the 7mm drive bay enclosure
- For M.2 drives internal to the server (see M.2 drives section)
- SATA controller integrated on the M.2 SATA 2-Bay RAID Enablement Kit
- NVMe controller integrated on the M.2 NVMe 2-Bay RAID Enablement Kit
As well as supporting RAID adapters and HBAs that install in a PCIe slot, the SR665 V3 with 2.5-inch front drive bays supports a custom form factor (CFF) adapter that is mounted in the server and cabled to one of the onboard NVMe ports. These Internal Adapters are not supported with 3.5-inch front drives due to a lack of physical space.
The following table lists the adapters used for the internal storage of the server.
‡ These custom form factor (CFF) adapters are only supported with 2.5-inch front drive bays. Not supported in configurations with 3.5-inch front drive bays.
† Adapter also supports PCIe 4.0 x1 connectivity to NVMe drives (requires NVMe drives with U.3 interface)
** This adapter is currently not available for CTO orders; it is only available as an option part number for field upgrades
Configuration notes:
- Supercap support limits the number of RAID adapters installable: The table lists whether the adapter includes a power module (supercap) to power the flash memory. The server supports between 1 and 4 supercaps depending on the server configuration as described in the RAID flash power module (supercap) support section. The number of supercaps supported also determines the maximum number of RAID adapters with flash that can be installed in the server.
- Field upgrades: If you are adding a RAID adapter with supercap to the server as a field upgrade, you may need a supercap holder as described in the RAID flash power module (supercap) support section.
- 7mm drive support: The storage adapters listed in the table below do not provide connectivity to the 7mm drive bays. The 7mm drives have their own independent RAID controller. See the 7mm drives section for details.
- E810 Ethernet and X350 RAID/HBAs: The use of both an Intel E810 network adapter and an X350 HBA/RAID adapter (9350, 5350 and 4350) is supported, however E810 firmware CVL4.3 or later is required. For details, see Support Tip HT513226.
The RAID 940-8i and RAID 940-16i adapters also support NVMe through a feature named Tri-Mode support (or Trimode support). This feature enables the use of NVMe U.3 drives at the same time as SAS and SATA drives. Tri-Mode requires an AnyBay backplane. Cabling of the controller to the backplanes is the same as with SAS/SATA drives, and the NVMe drives are connected via a PCIe x1 link to the controller.
NVMe drives connected using Tri-Mode support provide better performance than SAS or SATA drives: A SATA SSD has a data rate of 6Gbps, a SAS SSD has a data rate of 12Gbps, whereas an NVMe U.3 Gen 4 SSD with a PCIe x1 link will have a data rate of 16Gbps. NVMe drives typically also have lower latency and higher IOPS compared to SAS and SATA drives. Tri-Mode is supported with U.3 NVMe drives and requires an AnyBay backplane.
Tri-Mode requires U.3 drives: Only NVMe drives with a U.3 interface are supported. U.2 drives are not supported. See the Internal drive options section for the U.3 drives supported by the server.
The onboard SATA controller has the following features:
- Controller integrated into the AMD processor
- JBOD only; no RAID support
- Supports up to 20 SATA drives in the SR665 V3 (16 with one processor)
- Supports HDDs and SSDs; can be mixed
The onboard NVMe support has the following features:
- Controller integrated into the AMD processor
- Supports up to 20x NVMe drives direct connected to onboard ports; additional drives through retimer/switch adapters
- Each drive has PCIe 5.0 x4 host interface
- Supports JBOD - Intel and non-Intel NVMe SSDs
- No support for RAID
For specifications about the RAID adapters and HBAs supported by the SR665 V3, see the ThinkSystem RAID Adapter and HBA Reference, available from:
https://lenovopress.lenovo.com/lp1288-thinksystem-raid-adapter-and-hba-reference#sr665-v3-support=SR665%2520V3
For more information about each of the adapters, see the product guides in the RAID adapters or HBA sections of the Lenovo Press web site:
https://lenovopress.com/servers/options/raid
https://lenovopress.com/servers/options/hba
Internal drive options
The following tables list the drive options for internal storage of the server.
2.5-inch hot-swap drives:
- 2.5-inch hot-swap 12 Gb SAS HDDs
- 2.5-inch hot-swap 24 Gb SAS SSDs
- 2.5-inch hot-swap 12 Gb SAS SSDs
- 2.5-inch hot-swap 6 Gb SATA SSDs
- 2.5-inch hot-swap PCIe 5.0 NVMe SSDs
- 2.5-inch hot-swap PCIe 4.0 NVMe SSDs
2.5-inch 7mm hot-swap drives:
3.5-inch hot-swap drives:
M.2 drives:
M.2 drive support: The use of M.2 drives requires an additional adapter as described in the M.2 drives subsection.
SED support: The tables include a column to indicate which drives support SED encryption. The encryption functionality can be disabled if needed. Note: Not all SED-enabled drives have "SED" in the description.