Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x

IBM Redbooks Product Guide

Abstract

The Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x delivers high-bandwidth and industry leading low latency 10 GbE connectivity. With industry-leading performance, power-efficiency, integration and feature set, ConnectX-2 EN with RoCE (RDMA over Converged Ethernet) adapters provide an optimized, low-latency solution for high-transaction databases, financial services, cloud computing, and virtualized server and storage data center environments. The ConnectX-2 Dual-Port 10 GbE Adapter improves network performance by increasing available bandwidth to the CPU and providing enhanced performance especially in virtualized server environments. The adapter protects investments by providing in hardware support for Data Center Bridging (DCB).

Note: As of March 31, 2014, this product is withdrawn from marketing and is no longer available for ordering from IBM.

Contents


The Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x delivers high-bandwidth and industry leading low latency 10 GbE connectivity. With industry-leading performance, power-efficiency, integration and feature set, ConnectX-2 EN with RDMAoE (RDMA over Ethernet) adapters provide an optimized, low-latency solution for high-transaction databases, financial services, cloud computing, and virtualized server and storage data center environments. The ConnectX-2 Dual-Port 10 GbE Adapter improves network performance by increasing available bandwidth to the CPU and providing enhanced performance especially in virtualized server environments.

The adapter is shown in Figure 1.

Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x
Figure 1. Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x

Did you know?

The Mellanox ConnectX-2 Dual Port 10GbE Adapter for IBM System x is a a high-performance, dual-port network adapter for 10Gb/s Ethernet (10GbE) networks with performance requirements for low latency. It provides an ideal solution for all servers needing high- performance, low-latency data transfer in LAN connectivity for mission-critical applications. This network adapter provides support for 10GbE networking with optical or copper connectivity.


Part number information

The part number to order this card is shown in Table 1.

Table 1. Ordering part number and feature code
DescriptionPart numberFeature code
Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x81Y9990A1M4

The adapter has two empty SFP+ cages that support either SFP+ SR transceivers or twin-ax direct-attached copper (DAC) cables as listed in Table 2.

Table 2. Supported transceivers and direct-attach copper (DAC) cables
DescriptionPart numberFeature code
Optical Transceivers
QLogic 10Gb SFP+ SR Optical Transceiver49Y42180064
Brocade 10Gb SFP+ SR Optical Transceiver49Y42160069
IBM SFP+ SR Transceiver46C34475053
Active Direct-attach copper (DAC) cables
1m IBM Active DAC SFP+ Cable95Y0323A25A
3m IBM Active DAC SFP+ Cable95Y0326A25B
5m IBM Active DAC SFP+ Cable95Y0329A25C
Passive Direct-attach copper (DAC) cables
0.5m IBM Passive DAC SFP+ Cable00D6288A3RG
1m IBM Passive DAC SFP+ Cable90Y9427A1PH
3m IBM Passive DAC SFP+ Cable90Y9430A1PJ
5m IBM Passive DAC SFP+ Cable90Y9433A1PK
7m IBM Passive DAC SFP+ Cable00D6151A3RH


Features and benefits

The Mellanox ConnectX-2 Dual Port 10 GbE Adapter for IBM System x has the following features:

Performance:

Based on ConnectX-2 EN technology, the PCI Express 2.0 x8 adapter provides a high level of throughput performance for all network environments by removing I/O bottlenecks in mainstream servers that are limiting application performance. Servers supporting PCI Express 2.0 with 5 GTps can fully utilize both 10 Gbps ports and achieve up to 40 Gbps duplex bandwidth. Hardware-based stateless offload engines handle the TCP/UDP/IP segmentation, reassembly, and checksum calculations that would otherwise burden the host processor. These offload technologies are fully compatible with Microsoft RSS and NetDMA.

RDMA over Ethernet (RDMAoE) further accelerates application run time. The RDMAoE specification provides efficient data transfer with very low latencies on lossless Ethernet networks. RDMAoE enables lowest latency memory transaction, with less than 2µs at full bandwidth with small message size. This allows very high volume, transaction intensive applications typical of financial market firms and other industries where speed of data delivery is paramount to take advantage. With Mellanox ConnectX-2 Dual Port 10 Gbe Adapter, high frequency transaction applications are able to access trading information with shorter times, making sure the trading servers are able to respond first to any new market data and market inefficiencies, while the higher throughput enables higher volume trading, maximizing liquidity and profitability.

In data mining or web crawl applications, RDMAoE provides the needed boost in performance to search faster by solving the network latency bottleneck associated with I/O cards and the corresponding transport technology in the cloud. Various other applications that benefit from RDMAoE with ConnectX-2 EN include Web 2.0 (Content Delivery Network), Business intelligence, data base transactions and various Cloud computing applications.

Mellanox ConnectX-2 EN low power consumption, less than 3.5W per port, provides customers high bandwidth and low latency at the lowest cost of ownership.

I/O virtualization

ConnectX-2 EN with Virtual Intelligent Queuing (Virtual-IQ) technology provides dedicated adapter resources and guaranteed isolation and protection for virtual machines within the server. The adapter gives data center managers better server utilization and LAN and SAN unification while reducing cost, power, and cable complexity.

Quality of Service

Resource allocation per application or per virtual machine is provided by the advanced QoS supported by ConnectX-2 EN. Service levels for multiple traffic types can be based on IETF DiffServ or IEEE 802.1p/Q, allowing system administrators to prioritize traffic by application, virtual machine, or protocol.


Specifications

The adapter has the following specifications:
  • Low-profile adapter form factor
  • Ports: Two 10 Gigabit Ethernet ports with SFP+ connectors
  • ASIC: Mellanox ConnectX-2 EN
  • Cabling types: Direct Attached Copper, SR and LR Fiber Optic
  • Host interface: PCI Express 2.0 x8 (5.0 GT/s)
  • Features: Stateless Offload, Priority Flow Control
  • Power consumption: 6.4 W (typical)

Note: The adapter does not support FCoE.

Ethernet support and standards:
  • IEEE Std 802.3ae 10 Gigabit Ethernet
  • IEEE Std 802.3ad Link Aggregation and Failover
  • IEEE Std 802.3x Pause
  • IEEE 802.1Q, .1p VLAN tags and priority
  • IEEE P802.1au D2.0 Congestion Notification
  • IEEE P802.1az D0.2 Enhanced Transmission Selection
  • IEEE P802.1bb D1.0 Priority-based Flow Control
  • Multicast
  • Jumbo frame support (10KB)
  • 128 MAC/VLAN addresses per port

TCP/UDP/IP stateless offload:
  • TCP/UDP/IP checksum offload
  • TCP Large Send Offload (< 64KB) or Giant Send Offload (64KB-16MB) for segmentation
  • Receive Side Scaling (RSS) up to 32 queues
  • Line rate packet filtering

Additional CPU offloads:
  • RDMA over Ethernet support
  • Traffic steering across multiple cores
  • Intelligent interrupt coalescence
  • Compliant to Microsoft RSS and NetDMA

Hardware-based I/O virtualization:
  • Address translation and protection
  • Dedicated adapter resources and guaranteed isolation
  • Multiple queues per virtual machine
  • Hardware switching between guest OSs
  • Enhanced QoS for vNICs
  • VMware NetQueue support


Physical specifications

The adapter has the following physical specifications (without the bracket):
  • Length: 142 mm
  • Height: 69 mm
  • Depth: 18 mm
  • Maximum weight: 0.25 kg (0.5 lb)


Operating environment

The adapter is supported in the following environment:
  • Operating temperature: 0 to 55° C
  • Air flow: 200 LFM at 55° C


Warranty

One year limited warranty. When installed in a System x server, these cards assume your system’s base warranty and any IBM ServicePac® upgrade.


Supported servers

The adapter is supported in the IBM System x servers listed in Table 3.

Table 3. Supported System x servers (Part 1)

Adapter

x3100 M3

x3200 M2

x3200 M3

x3250 M2

x3250 M3

x3350

x3400

x3400 M2


x3455

x3500

x3500 M2


x3550

x3550 M2

Mellanox ConnectX-2 Dual Port 10 GbE Adapter

N

N

N

N

N

N

N

N

Y

N

N

N

Y

N

N

Table 3. Supported System x servers (Part 2)

Adapter

x3550 M3

x3620 M3

x3630 M3

x3650

x3650 T

x3650 M2

x3650 M3

x3655

x3690 X5

x3755

x3755 M3

x3850 M2

x3950 M2

x3850 X5

dx360 M3

Mellanox ConnectX-2 Dual Port 10 GbE Adapter

Y

Y

Y

N

N

N

Y

N

Y

N

Y

N

N

Y

Y


Supported operating systems

The adapter as part of the System x portfolio supports the following operating systems:
  • Microsoft Windows Server 2008 R2
  • Microsoft Windows Server 2008, Datacenter x64 Edition
  • Microsoft Windows Server 2008, Datacenter x86 Edition
  • Microsoft Windows Server 2008, Enterprise x64 Edition
  • Microsoft Windows Server 2008, Enterprise x86 Edition
  • Microsoft Windows Server 2008, Standard x64 Edition
  • Microsoft Windows Server 2008, Standard x86 Edition
  • Microsoft Windows Server 2008, Web x64 Edition
  • Microsoft Windows Server 2008, Web x86 Edition
  • Red Hat Enterprise Linux 5 Server Edition
  • Red Hat Enterprise Linux 5 Server x64 Edition
  • Red Hat Enterprise Linux 6 Server Edition
  • Red Hat Enterprise Linux 6 Server x64 Edition
  • SUSE LINUX Enterprise Server 10 for AMD64/EM64T
  • SUSE LINUX Enterprise Server 10 for x86
  • SUSE LINUX Enterprise Server 11 for AMD64/EM64T
  • SUSE LINUX Enterprise Server 11 for x86
  • VMware ESX 4.0
  • VMware ESX 4.1
  • VMware ESXi 4.0
  • VMware ESXi 4.1

See IBM ServerProven for the latest information about the specific versions and service packs supported: http://ibm.com/servers/eserver/serverproven/compat/us/. Click System x servers, and then click LAN to see the support matrix. Click the check mark that is associated with the System x server in question to see the details of operating system support.


Related publications

For more information refer to these documents:

Special Notices

This material has not been submitted to any formal IBM test and is published AS IS. It has not been the subject of rigorous review. IBM assumes no responsibility for its accuracy or completeness. The use of this information or the implementation of any of these techniques is a client responsibility and depends upon the client's ability to evaluate and integrate them into the client's operational environment.

Profile

Publish Date
26 May 2010

Last Update
16 July 2013


Rating: Not yet rated


Author(s)

IBM Form Number
TIPS0777