IBM System Storage SAN768B-2 and SAN384B-2 Fabric Backbones

IBM Redbooks Product Guide


Abstract

This IBM® Redbooks® Product Guide describes the IBM System Storage® SAN768B-2 and SAN384B-2 fabric backbones. IBM System Storage SAN768B-2 and SAN384B-2 fabric backbones are among the industry's most powerful Fibre Channel switching infrastructure offerings. They provide reliable, scalable, and high-performance foundations for mission-critical storage. These fabric backbones also deliver enterprise connectivity options to add support for IBM FICON® connectivity, offering a high-performing and reliable FICON infrastructure with fast and scalable IBM System z® servers.

Contents


This IBM® Redbooks® Product Guide describes the IBM System Storage® SAN768B-2 and SAN384B-2 fabric backbones. IBM System Storage SAN768B-2 and SAN384B-2 fabric backbones are among the industry's most powerful Fibre Channel switching infrastructure offerings. They provide reliable, scalable, high-performance foundations for mission-critical storage. These fabric backbones also deliver enterprise connectivity options to add support for IBM FICON® connectivity, offering a high-performing and reliable FICON infrastructure with fast and scalable IBM System z® servers.

The IBM System Storage SAN b-type family switch, which is designed to support Fibre Channel connectivity for servers and storage, introduces the next generation of fabric backbones with Gen 5 Fibre Channel technology to bring a long-term solution for mission-critical applications that require secure, high-performance, and low-latency storage networks. This enables organizations to continue leveraging their existing IT investments as they grow their businesses and solve their most difficult business challenges, unleashing the full potential of high-density server virtualization, cloud architectures, and next-generation storage.

Figure 1 shows the SAN768B-2 and SAN384B-2.

SAN768B-2 and SAN384B-2
Figure 1. SAN768B-2 and SAN384B-2


Did you know?
  • SAN768B-2 and SAN384B-2 enable simpler, flatter, and low-latency chassis connectivity to reduce network complexity, management, and costs by leveraging UltraScale chassis connectivity.
  • You can simplify and centralize end-to-end storage area network (SAN) management with comprehensive diagnostic tests, monitoring, and automation through Fabric Vision technology.


Architecture and key components

SAN768B-2 and SAN384B-2 address key customer requirements while consolidating the SAN infrastructure. These fabric backbones with Gen 5 Fibre Channel technology are available in two modular form factors.

Built for large enterprise networks and measuring 14U, SAN768B-2 has eight vertical blade slots to provide up to 384 16 Gbps universal (E, F, D, M, and EX) Fibre Channel ports using 48-port Fibre Channel blades or up to 512×8 Gbps universal (E, F, M, and EX) FC ports using 64-port 8 Gbps Fibre Channel blades.

Designed for midsize networks and measuring 8U, SAN384B-2 has four horizontal blade slots to provide up to 192 16 Gbps universal (E, F, D, M, and EX) Fibre Channel ports using 48-port Fibre Channel blades or up to 256×8 Gbps universal (E, F, M, and EX) Fibre Channel ports using 64-port 8 Gbps Fibre Channel blades. The Gen 5 Fibre Channel technology directors support 2, 4, 8, 10, and 16 Gbps Fibre Channel, FICON, and 1/10 Gbps Fibre Channel over IP (FCIP).

These Gen 5 Fibre Channel director models offer maximum investment protection by performing the following functions:
  • Interfacing with existing 2, 4, 8, or 16 Gbps Fibre Channel ports
  • Offering configurable 10 Gbps ports for metro optical connectivity
  • Offering 1/10 Fibre Channel over IP (FCIP) for global SAN extension infrastructure
  • Offering fabric-based encryption for data-at-rest to protect valuable digital assets
  • Integrating with the IBM Network Advisor unified network management solution to bridge operational gaps across server, network, and storage administrators

Built upon years of innovation and using the core technology of systems that are designed to perform at up to 99.999 percent uptime, the new generation of SAN b-type networking backbones helps minimize downtime and disruption for some of the world’s most demanding data centers.

Both of these models can do the following functions:
  • Support 2, 4, 8, and 16 Gbps Fibre Channel or FICON connections, 10 Gbps Fibre Channel Inter-Switch Link (ISL) connections in metro optical connectivity or with 10 Gbps dense wavelength division multiplexing (DWDM) devices, in-flight encryption, and compression, 64 (4×16) Gbps Inter-Chassis Link (ICL) connections and 1/10 Gbps FCIP.
  • Leverage fabric-based encryption for data-at-rest.
  • Integrate with advanced fabric services and management tools.
  • Deliver compatibility with the 8 and 4 Gbps IBM System Storage b-type SAN director, switch, and router models.

Performance

Emerging and evolving critical workloads and higher density virtualization are continuing to push the limits of SAN infrastructures. SAN768B-2 and SAN384B-2 directors feature industry-leading Gen 5 Fibre Channel technology that delivers 16 Gbps line-speed performance and outstanding bandwidth to address next-generation I/O requirements. In addition, local switching capabilities are designed to ensure that data traffic within the same port group does not consume slot bandwidth, which maximizes the number of line-rate ports.

Here are the performance capabilities:
  • SAN768B-2
    • Up to 384 ports (equivalent to 512 with UltraScale ICLs) at 16 Gbps in a single chassis
    • 8.2 Tbps chassis bandwidth
      • 6.1 Tbps Fibre Channel/FICON ports
      • 2.1 Tbps UltraScale ICL bandwidth
    • 512 Gbps bandwidth per slot
  • SAN384B-2
    • Up to 192 ports (equivalent to 256 with UltraScale ICLs) at 16 Gbps in a single chassis
    • 4.1 Tbps chassis bandwidth
      • 3.1 Tbps Fibre Channel/FICON ports
      • 1 Tbps UltraScale ICL bandwidth
    • 512 Gbps bandwidth per slot

Each SAN768B-2 and SAN384B-2 contains redundant control processor modules (active/passive) and core blades (active/active), plus slots for Fibre Channel port blades and advanced functionality. All Fibre Channel ports on the blades support full-duplex, non-blocking performance. These backbones are available with a number of selectable options. The base systems do not include any blades, but at least one blade is required for host and storage connectivity. Based on the different power consumption of each port or specialty blade, various configurations result in higher than 2000 W power usage, and the customer is required to purchase a pair of optional power supplies.

Here are the available blades for SAN768B-2 and SAN384B-2:
  • 16 Gbps 32-port and 48-port Fibre Channel blades. These port blades provide 2, 4, 8, 10, or 16 Gbps on each port, which can be configured as E, F, M, EX, or D_ports. These advanced 16 Gbps blades deliver enhanced fabric resiliency and application uptime through advanced features that are enabled by the Condor3 application-specific integrated circuit, including support for native 10 Gbps Fibre Channel, in-flight encryption and compression, ClearLink diagnostic technology (D_Ports), and increased buffers or Forward Error Correction (FEC).
  • Enhanced 8 Gbps 32-port and 48-port Fibre Channel blades. These two port blades provide 2, 4, or 8 Gbps on each port, which can be configured as E, F, M, or EX_ports. These 8 Gbps blades deliver enhanced fabric resiliency and application uptime through advanced features that are enabled by the Condor3 application-specific integrated circuit, including increased buffers and no oversubscription for traffic across the backplane. These blades do not support native 10 Gbps Fibre Channel, in-flight encryption and compression, ClearLink diagnostic technology (D_Ports), or FEC.
  • 8 Gbps 64-port Fibre Channel blade. This blade allows midsize-to-large enterprise customers to deploy high-density, chassis-based solutions to minimize a physical footprint without compromising performance. The 64-port blade does not support FICON, but may be used in the same chassis-switching FICON traffic.
  • 8 Gbps Enhanced Extension blade. This new blade is a scalable and flexible platform combining Fibre Channel and advanced FCIP technology, which is designed for building or expanding a high-performance SAN extension infrastructure for disaster recovery, data protection, and data mobility storage solutions to move more data faster and further. It proves Internet Protocol Security (IPSec) over both 10 GbE ports versus the previous blade’s support on one port. It is ideal for open systems and mainframe disk and tape extension, multi-site synchronous and asynchronous disk replication, centralized SAN backup, recovery and archiving, and global data and storage resource migration, distribution, and sharing.
  • 8 Gbps 16-port Fibre Channel Encryption blade. This blade provides fabric-based encryption for data-at-rest and compression, providing 48 - 96 Gbps of encryption processing power to help meet the needs of the most demanding environments with flexible, on-demand performance. It also provides compression services at speeds up to 48 Gbps for tape storage systems. The encryption blade is supported by IBM Security Key Lifecycle Manager for both disk and tape encryption applications. This open systems network-based solution secures data-at-rest for disk array logical unit numbers, heterogeneous tape drives, and virtual tape libraries. This encryption blade is not supported for FICON.

Scale-out network design

Networks are evolving to adapt to rapid growth and change in the server and storage infrastructure. UltraScale chassis connectivity leverages optical ICLs to connect up to ten SAN768B-2 and SAN384B-2 backbones up to 100 meters apart, enabling flatter, faster, and simpler fabrics that increase consolidation while reducing network complexity and costs.

UltraScale ICLs enable scalable core-edge and active-active mesh chassis topologies. These high-density chassis topologies reduce inter-switch cabling and free up ports for servers and storage, thus maximizing overall port density in a lower amount of rack space.

Fabric Operating System and management software

The Fabric Operating System (FOS) included with each SAN768B-2 and SAN384B-2 Gen 5 Fibre Channel base system contains all the functions that are necessary to operate a base system. These systems require FOS V7.1 or later to take advantage of the advanced functions that are delivered through Fabric Vision technology. SAN768B-2 and SAN384B-2 base systems are always enabled with the following tools:
  • Web Tools enable graphical user interface (GUI)-based administration, configuration, and maintenance of fabric switches and SANs.
  • Zoning segments a fabric into virtual private SANs to restrict device communication and apply certain policies only to members within the same zone.
  • Full Fabric enables E_Ports and allows SAN768B-2 and SAN384B-2 to connect to other switches.
  • Virtual Fabrics allow a physical switch to be partitioned into independently managed logical switches, each with its own data, control, and management paths.
  • Enhanced Group Management (EGM) enables additional device-level management functionality for SAN b-type products when it is added to the element management, and also allows large consolidated operations to groups of devices (such as firmware downloads and configuration uploads and downloads).

Enterprise software bundle

The enterprise software bundle is a bundle of FOS features on top of the base FOS functionality that is included in the hardware base for both the SAN768B-2 and the SAN384B-2. It includes the following features: Adaptive Networking, Advanced Performance Monitoring, Extended Fabrics, Fabric Watch, ISL Trunking, Server Application Optimization, and Fabric Vision.
  • The Adaptive Networking service is a set of features that provide users with tools and capabilities for incorporating network policies to ensure optimal behavior of a large SAN. The FOS V7.0 release (or later) supports two types of quality of service (QoS) features with the 16 Gbps fabric backbones: Ingress Rate Limiting and SID/DID-based prioritization.
  • Advanced Performance Monitoring helps identify end-to-end bandwidth usage by host/target pairs and provides for capacity planning.
  • Extended Fabrics extend SAN fabrics beyond the Fibre Channel standard of 10 kilometers (km) by optimizing internal switch buffers to maintain performance on ISLs that are connected at extended distances.
  • Fabric Watch constantly monitors mission-critical switch operations for potential faults and automatically alerts administrators about problems before they become costly failures. Fabric Watch includes Port Fencing capabilities.
  • ISL Trunking enables Fibre Channel frames to be distributed efficiently across multiple ISLs between two IBM b-type SAN fabric switches and directors while preserving in-order delivery. Both b-type SAN devices must have trunking activated. SAN768B-2 and SAN384B-2 add enhanced ISL Trunking support using 16 Gbps ports and enable Fibre Channel packets to be distributed across up to eight 16 Gbps-capable ISLs for a combined bandwidth of up to 128 Gbps.
  • Server Application Optimization license optimizes overall application performance for physical servers and virtual machines by extending virtual channels to the server infrastructure. Application-specific traffic flows can be configured, prioritized, and optimized throughout the entire data center infrastructure.
  • The Fabric Vision license offers a collection of breakthrough features and tools that are bundled into an optional licensed feature. It includes Flow Vision and Monitoring and Alerting Policy Suite (MAPS) advanced technologies and capabilities. It requires FOS V7.2 or later.

Advanced capabilities can be enabled with additional optional licenses that are available:
  • FICON with control unit port (CUP) activation provides in-band management of the supported SAN b-type switch and director products by system automation for IBM z/OS®, performance data for IBM Resource Measurement Facility™ (IBM RMF™), and to provide unsolicited status to IBM MVS™. This support provides a single point of control for managing connectivity in active FICON I/O configurations. To enable in-band management on multiple switches and directors, each chassis must be configured with the appropriate FICON CUP feature. Up to four CUPs per chassis can be enabled.
  • Integrated routing allows any 8 or 16 Gbps Fibre Channel port in SAN768B-2 and SAN384B-2 to be configured as an EX_Port supporting Fibre Channel Routing (FCR).
  • An Inter-chassis license with 16x4x16Gbps QSFP with 16×64 Gbps quad small form-factor pluggable (QSFP) activates ICL ports on the core blades of the 16 Gbps platforms. One ICL Ports on Demand (POD) license enables only half of the ICL ports on core blades of a SAN768B-2 platform or all of the ICL ports on the core blades of a SAN384B-2 platform. Each kit features sixteen 4×16 Gbps ICL QSFP transceivers.
  • An Inter-chassis QSFP bundle with 16× (4×16 Gbps) QSFP provides connectivity up to 100 meters from the switching backplane of one half of an eight-slot chassis to the other half, or to a 4-slot chassis.
  • Inter-chassis license conversion is used to convert an ICL activation that is transferred from an 8 Gbps model as part of the model conversion process.
  • An Enterprise ICL license supports up to 3,840×16 Gbps universal Fibre Channel ports (using 16 Gbps 48-port blades), up to 5,120×8 Gbps universal Fibre Channel ports (using 8 Gbps 64-port blades), ICL ports (32 or 16 per chassis, optical QSFP) connected up to nine chassis in a full-mesh topology or up to 10 chassis in a core-edge topology. Connecting five or more chassis through ICLs requires an Enterprise ICL license.

These optional advanced SAN Extension functionality licenses are available as well:
  • An 8 Gbps Advanced Extension activation license enables two advanced extension features, FCIP trunking, and adaptive rate limiting (ARL) on the SAN768B-2 or SAN384B-2 systems. The FCIP trunking feature allows multiple IP source and destination address pairs (defined as FCIP circuits) through multiple 1 GbE interfaces to provide a high-bandwidth FCIP tunnel and failover resiliency. The ARL feature provides a minimum bandwidth guarantee for each tunnel with full usage of the available network bandwidth without impacting throughput performance under high traffic load.
  • An 8 Gbps Extension blade 10 GbE activation license enables up to two 10 GbE ports on the 8 Gbps extension blades or 8×10 Gbps Fibre Channel ports on any eight ports of a 16 Gbps port blade. With this license, two additional operating modes, in addition to 1 GbE port mode, can be selected. Either two 10 GbE ports, or ten 1 GbE and one 10 GbE ports, can be configured on an 8 Gbps extension blade when this license is activated. One feature code should be installed and activated for each port blade to be enabled for 10 Gbps FC.
  • An 8 Gbps FICON Accelerator activation license uses advanced networking technologies, data management techniques, and protocol intelligence to accelerate FICON disk and tape read-and-write operations over geographically extended distances, while also maintaining the integrity of command and acknowledgment sequences. This is ideal for data migration, disaster recovery, and business continuity solutions beyond 300 km, and it supports emulation for IBM z/OS Global Mirror (formerly Extended Remote Copy or XRC) and tape pipelining for FICON tape and virtual tape.

This optional advanced SAN Encryption functionality license is available:
  • An encryption 96 Gbps disk performance upgrade activation license enables scalability of performance on the encryption blade features. The upgrade provides increased throughput for disk encryption applications up to 96 Gbps, effectively doubling encrypted throughput performance for disk-based storage with no disruption to operations.

IBM Network Advisor is the base management software that is required by SAN768B-2 and SAN384B-2. It enables end-to-end management of data center fabrics from storage ports on networked storage systems to host bus adapters (HBAs) that are attached to physical or virtualized servers. IBM Network Advisor V12.0 or later is required for supporting transitions to cloud environments. IBM Network Advisor V12.1 or later is required to support Fabric Vision license capabilities.

Optimized data center connectivity over distance

SAN768B-2 and SAN384B-2 connect distributed data centers for data mobility and advanced data protection. These fabric backbones include integrated metro and global SAN extension capabilities, which can provide application agility and support flexible business continuity and disaster recovery solutions.

The b-type director family with Gen 5 Fibre Channel technology provides high-speed replication and backup solutions over metro or WAN links with native Fibre Channel (10/16 Gbps) and optional FCIP (1/10 GbE) extension support. The integrated metro connectivity includes in-flight compression and encryption to optimize bandwidth, and helps reduce the risk of unauthorized access. SAN768B-2 and SAN384B-2 support port-based encryption and compression on ISL between two 16 Gbps E_Ports. The encryption and compression feature on an E_Port can be enabled by users on a per-port basis. The same port that is configured for compression can also be configured for encryption.

Benefits include the following ones:
  • Optimizes data center connectivity over distance with integrated high-performance metro and global connectivity.
  • Simplifies and centralizes end-to-end SAN management with comprehensive diagnostic tests, monitoring, and automation.
  • Enhances data security and efficient usage of bandwidth between data centers.
  • Maximizes performance for I/O- and bandwidth-intensive applications with extraordinary performance improvement when compared to competitive offerings.
  • Protects investments in existing SAN fabrics and automation tools while reducing operational costs and minimizing business disruption.

Simplified deployment and centralized management

Automating and simplifying SAN management enables data centers to quickly adapt to change and overcome disruptions in a private or hybrid cloud infrastructure. SAN768B-2 and SAN384B-2 advanced diagnostic tests, monitoring, and management help reduce end-to-end SAN management complexities and operating costs through simpler server provisioning and change management, advanced cable and optics diagnostic tests, and comprehensive management. Several technologies support these capabilities:
  • ClearLink diagnostic technology (D_Ports) helps identify and isolate optics and cable problems, reducing fabric deployment and diagnostic test times.
  • Dynamic Fabric Provisioning combines b-type backbone and Brocade adapter technology to reduce or eliminate the need to reconfigure zoning and Logical Unit Number (LUN) masking when adding or replacing servers.
  • IBM Network Advisor provides comprehensive management of data center fabrics, including configuration, monitoring, and management of b-type backbones, switches, and Brocade adapters.

Enterprise-class reliability, availability, and serviceability

SAN768B-2 and SAN384B-2 Fibre Channel backbones use Fabric Vision technology, which leverages hardware, FOS, and IBM Network Advisor integration to provide advanced functions. It features advanced monitoring, diagnostic tests, and reliability, availability, and serviceability (RAS) capabilities to minimize downtime, optimize performance, and simplify administration. SAN768B-2 and SAN384B-2 Fibre Channel backbones with Fabric Vision technology helps administrators avoid problems, maximize application performance, and reduce operational costs.

Fabric Vision technology

Fabric Vision technology, an extension of Gen 5 Fibre Channel, introduces a breakthrough hardware and software solution that maximizes uptime, simplifies SAN management, and provides increased visibility and insight across the storage network. Offering innovative diagnostic, monitoring, and management capabilities, the SAN768B-2 and SAN384B-2 fabric backbones with Fabric Vision technology help administrators avoid problems, maximize application performance, and reduce operational costs.

Fabric Vision technology includes the following features:
  • Flow Vision enables administrators to identify, monitor, and analyze specific application and data flows to maximize performance, avoid congestion, and optimize resources. Flow Vision includes the following features:
    • Flow Monitor provides comprehensive visibility into flows in the fabric, including the ability to automatically learn (discover) flows and nondisruptively monitor flow performance. Organizations can monitor all flows from a specific host to multiple targets/LUNs, from multiple hosts to a specific target/LUN, or across a specific ISL. They also can perform LUN-level monitoring of specific frame types to identify resource contention or congestion that is impacting application performance.
    • Flow Mirror provides the ability to nondisruptively create copies of specific application and data flows or frame types that can be captured for deeper analysis.
    • Flow Generator provides a built-in test traffic generator for pre-testing and validating the SAN infrastructure, including verification of routes and integrity of optics, cables, ports, and ISLs, for robustness before deploying applications.
  • Monitoring and Alerting Policy Suite (MAPS) simplifies fabric-wide threshold configuration and monitoring. MAPS allows organizations to leverage pre-built rule/policy-based templates. The result is a simple, two-step process for applying thresholds and alerts to ports and switches. Organizations can configure the entire fabric (or multiple fabrics) at one time using common rules and policies, or customize policies for specific ports or switch elements, all through a single dialog. The integrated dashboard displays an overall switch health report, along with details about out-of-policy conditions, to help administrators quickly pinpoint potential issues and easily identify trends and other behaviors occurring on a switch or fabric.
  • ClearLink diagnostic technology (D_Port) ensures optical and signal integrity for Gen 5 Fibre Channel optics and cables, simplifying deployment and support of high-performance fabrics. It leverages ClearLink Diagnostic Port (D_Port) capabilities of Gen 5 Fibre Channel platforms.
  • Bottleneck Detection identifies and alerts administrators to device or ISL congestion and abnormal levels of latency in the fabric. This feature works with IBM Network Advisor to automatically monitor and detect network congestion and latency in the fabric, providing visualization of bottlenecks in a connectivity map and product tree, and identifying exactly which devices and hosts are impacted by a bottlenecked port.
  • Integration into IBM Network Advisor provides customizable health and performance dashboard views to pinpoint problems faster, simplify SAN configuration and management, and reduce operational costs.
  • Critical diagnostic and monitoring capabilities help ensure early problem detection and recovery.
  • Non-intrusive and nondisruptive monitoring on every port provides an end-to-end view of the entire fabric using capabilities that are integrated into the hardware. This allows sophisticated monitoring without imposing an additional burden on switches with frequent polling activity.
  • Forward Error Correction (FEC) enables recovery from bit errors in ISLs, enhancing transmission reliability and performance.
  • Credit Loss Recovery helps overcome performance degradation and congestion because of buffer credit loss.
  • Real-time bandwidth consumption by hosts and applications on ISLs helps easily identify hot spots and potential network congestion.

Fabric Vision license is included with FOS V7.2 or later. After the switch is upgraded to FOS V7.2.0 or later and the Fabric Vision license is enabled, the Fabric Watch configuration and any Fabric Watch related features are no longer supported.


Specifications

This section lists the specifications for SAN768B-2 and SAN384B-2.

Product characteristics

Table 1 lists the product characteristics for SAN768B-2 and SAN384B-2.

Table 1. Product characteristics for SAN768B-2 and SAN384B-2
ItemDescription
Product numberSAN768B-2 (2499-816)
SAN384B-2 (2499-416)
Base machine
  • Single chassis: Up to 384 (SAN768B-2) or 192 (SAN384B-2) 16 Gbps universal (E, F, D, M, and EX) Fibre Channel ports using 48-port Fibre Channel blades. Up to 512 (SAN768B-2) or 256 (SAN384B-2) 8 Gbps universal (E, F, M, and EX) Fibre Channel ports using 64-port 8 Gbps Fibre Channel blades.
  • Multi-chassis with UltraScale ICL ports: Up to 3840×16 Gbps universal Fibre Channel ports (using 16 Gbps 48-port blades), up to 5120×8 Gbps universal Fibre Channel ports (using 8 Gbps 64-port blades), and UltraScale ICL ports (32 or 16 per chassis, optical QSFP) connected up to nine b-type SAN768B-2/SAN384B-2 chassis in a full-mesh topology or up to 10 chassis in a core-edge topology. Deploying five or more chassis with UltraScale ICL connections within a fabric requires an Enterprise ICL license.

The base chassis includes the following components:
  • One director chassis with s door, two vertical cable management combs, redundant (active/standby) control processor blades, redundant active/active core-switching blades, redundant power supplies, fans, and a ship group that includes an installation guide, CD-ROM (with manuals), two rack-power distribution unit (PDU) power cords, service tools and wrap tools, an RJ-45 serial cable, wrist strap, cable retainer kit, and SFP extraction tool.
  • In addition to the above components, the base chassis of SAN768B-2 includes three blower fans and the option for two additional power supplies. The ship group also includes a 14U rack-mounting kit (BR120). As for SAN384B-2, the base chassis includes two blower fans and a 1U exhaust duct kit.

The base FOS (v7.0 or later) software includes the following items:
  • Web Tools, Advanced Zoning, Full Fabric, Virtual Fabrics, EGM, and an enterprise software bundle (Fabric Watch, Extended Fabrics, ISL Trunking, Advanced Performance Monitoring, Server Application Optimization, Adaptive Networking, and Fabric Vision).

Note: No port or advanced functionality blades are included in the base. Customers must order the 48- or 32-port 16 Gbps or 8 Gbps Fibre Channel port blades, the 64-port 8 Gbps Fibre Channel port blade, or the supported specialty blades, and populate them with transceivers.
Fibre Channel interfaces16/10/8/4/2 Gbps ClearLink diagnostic technology D_Port (Clearlink diagnostic port), E_Port, EX_Port, F_Port, and M_Port (mirror port); optional port type control
FICON interfaces16/8/4/2 Gbps
FCIP interfaces1 GbE and 10 GbE
Hot-swap componentsRedundant (active/standby) control processor modules (CPs), core routing modules, power supplies, fan modules, all Fibre Channel port blades, Extension blades, Encryption blades, SFPs, and QSFPs
Transceivers
  • 16 Gbps: 32- and 48-port 16 Gbps blades require hot-pluggable SFP+ and LC connectors, 16 Gbps short-wavelength laser (SWL), long-wavelength laser (LWL), and extended long-wavelength laser (ELWL).
  • 10 Gbps: 32- and 48-port 16 Gbps blades require hot-pluggable SFP+ and LC, 10 Gbps SWL, and LWL.
  • 8 Gbps: 32- and 48-port 16 Gbps blades, 32- and 48-port 8 Gbps blades, extension, and encryption blades require hot-pluggable SFP+ and LC, 8 Gbps SWL, LWL, and extended long-wavelength laser (ELWL).
  • 8 Gbps: 64-port blades require hot-pluggable mSFP and mSFP LC connector, and 8 Gbps SWL only.
  • 4 Gbps: 8 Gbps Enhanced Extension blades need copper or SFPs to be used with IP ports and LC, and 4 Gbps SWL and LWL.
  • 1 GbE: Hot-pluggable optical SFP, SWL, and LWL, and GbE copper SFP (8 Gbps Extension blade GbE ports only).
  • UltraScale ICL QSFP: CR16-8 and CR16-4 require hot-pluggable QSFP and MTP connector, and 4×16 Gbps SWL (50 m OM3, 100 m OM4).

The Fibre Channel distance is subject to fibre-optic cable and port speed.
Fibre optic cableFibre optic cables with LC are required and available in various lengths in single-mode and multimode formats.
Power cordsJumper cables are included for installation. Country-specific power cords must be ordered for desktop/stand-alone installations.
WarrantyOne year. 24×7 same-day maintenance service options are available.
Optional featuresBlades: 32- and 48-port 16 Gbps Fibre Channel switch blades (3632 and 3648), 32- and 48-port 8 Gbps Fibre Channel switch blades (3633 and 3649), 64-port 8 Gbps Fibre Channel switch blade (3864), 22-port 8 Gbps + 2-port 10 Gbps Enhanced Extension blade (3891), and 8 Gbps Encryption blade (3895).

Licenses: Inter-chassis, FICON with CUP activation, Advanced Extension activation, Extension blade 10 GbE activation, FICON Accelerator activation, Encryption 96 Gbps disk performance upgrade activation, Integrated Routing, and Enterprise ICL.

Other: SFPs, fiber optic cables, and upgrade power supplies
ScalabilityFull fabric architecture of 239 switches
PerformanceFibre Channel: 2.125 Gbps line speed, full duplex, 4.25 Gbps line speed, full duplex, 8.5 Gbps line speed, full duplex, 10.53 Gbps line speed, full duplex, 14.025 Gbps line speed, full duplex, auto-sensing of 2, 4, 8, and 16 Gbps port speeds, and 10 Gbps and optionally programmable to fixed port speed
ISL trunkingFrame-based trunking with up to eight 16 Gbps ports per ISL trunk. Up to 128 Gbps per ISL trunk.
Exchange-based load balancing across ISLs with DPS included in Fabric OS
Chassis bandwidth
  • SAN768B-2: 8.2 Tbps per chassis (384 ports × 16 Gbps data rate + 2.048 Tbps UltraScale ICL bandwidth)
  • SAN384B-2: 4.1 Tbps per chassis (192 ports × 16 Gbps data rate + 1.024 Tbps UltraScale ICL bandwidth)
Slot bandwidth512 Gbps (data rate)
Local switching bandwidth
  • 512 Gbps for the 16 Gbps 32-port blade (3632): 32 ports × 16 Gbps (data rate)
  • 768 Gbps for the 16 Gbps 48-port blade (3648): 48 ports × 16 Gbps (data rate)
  • 256 Gbps for the 8 Gbps Enhanced 32-port blade (3633): 32 ports × 8 Gbps (data rate)
  • 384 Gbps for the 8 Gbps Enhanced 48-port blade (3649): 48 ports × 8 Gbps (data rate)
  • 512 Gbps for the 8 Gbps 64-port blade (3864): 64 ports × 8 Gbps (data rate)
UltraScale ICL bandwidth
  • SAN768B-2 (2499-816): 2.048 Tbps. 32 UltraScale ICL ports provide the equivalent of 128 16 Gbps ports. Each UltraScale ICL port provides 64 Gbps bandwidth over a QSFP (4×16 Gbps) link.
  • SAN384B-2 (2499-416): 1.024 Tbps. 16 UltraScale ICLs provide the equivalent of 64 16 Gbps ports. Each UltraScale ICL port provides 64 Gbps bandwidth over a QSFP (4×16 Gbps) link.
  • Both models: Frame-based trunking is enabled between four UltraScale ICLs. DPS distributes exchanges across all frame trunks.
Switch latencyLocally switched port latency is 700 ns. Blade-to-blade latency is 2.1 µsec. Encryption/compression is 5.5 µsec per node. Forward Error Correction (FEC) adds 400 ns between E_Ports (enabled by default).
Maximum frame size2112-byte payload
Frame buffers8192 per 16-port group on 32-port blades and up to 8192 per 24-port group on 48-port blades, dynamically allocated
Classes of serviceClass 2, Class F (inter-switch frames)
Data traffic typesFabric switches supporting unicast
USB1 USB port per control processor for firmware download, support save, and configuration upload/download
Fabric servicesAdvanced Performance Monitoring (APM) (including Top Talkers for E_Ports, F_Ports, and Fabric mode), Adaptive Networking (Ingress Rate Limiting, Traffic Isolation, and QoS), Bottleneck Detection, Advanced Zoning (default zoning, port/WWN zoning, and broadcast zoning), Dynamic Fabric Provisioning (DFP), Dynamic Path Selection (DPS), Extended Fabrics, Enhanced BB credit recovery, Fabric Watch, FDMI, Flow Vision, Frame Redirection, Frame-based Trunking, FSPF, Integrated Routing, IPoFC, ISL Trunking, Management Server, Monitoring and Alerting Policy Suite (MAPS), NPIV, NTP v3, Port Fencing; Registered State Change Notification (RSCN), Reliable Commit Service (RCS), Server Application Optimization (SAO), Simple Name Server (SNS), and Virtual Fabrics (Logical Switch, Logical Fabric)
ExtensionSupports DWDM, CWDM, and FC-SONET devices, Fibre Channel, in-flight compression (LZO), and encryption (AES-GCM-256) BB credit recovery, FCIP, Adaptive Rate Limiting (ARL), data compression, Fast Write, read/write Tape Pipelining, and QoS.
FICONFICON cascading (Fabric OS: SAN768B-2, SAN384B-2). Support for lossless DLS, FICON CUP, and Advanced Accelerator for FICON (FICON Global Mirror and XRC emulation and read/write Tape Pipelining). The 8 Gbps 64-port blade does not support FICON.
Special-purpose bladesEncryption Blade (3895) provides plug-in encryption of data on disk or tape, supporting industry-standard AES-256 and DataFort-compatible encryption mode (16 x 8 Gbps Fibre Channel ports, with up to four blades, and requires IBM Network Advisor).
Enhanced Extension Blade (3891) provides SAN extension over IP networks (12 8 Gbps Fibre Channel ports, and ten 1 GbE ports with license option for up to two 10 GbE ports per blade with up to four blades).

High availability

Table 2 lists the high availability features for SAN768B-2 and SAN384B-2.

Table 2. High availability features
ItemDescription
ArchitecturePassive backplane, redundant active/passive control processor, redundant active/active core switching blades, and redundant WWN cards
Chassis powerTwo 2000 W AC power supply modules (100 - 240 V auto-sensing) and 2N redundancy. SAN768B-2 supports two additional power modules.
CoolingSAN768B-2: Three blower assembly modules (Two are required for operation.)
SAN384B-2: Two blower assembly modules (One is required for operation.)
Solution availabilityDesigned to provide 99.999% uptime capabilities. Hot-pluggable redundant power supplies, fans, WWN cards, processors, core switching, port blades, and optics, online diagnostic tests, and nondisruptive firmware download and activation.

Management

Table 3 lists the management features for SAN768B-2 and SAN384B-2.

Table 3. Management features
ItemDescription
Management softwareHTTP, simple network management protocol (SNMP) v1/v3 (Fabric Element (FE) Management Information Base (MIB), Fibre Channel MIB), and Secure Shell (SSH), auditing and syslog, Advanced Web Tools, advanced performance monitoring, and IBM Network Advisor - Enterprise or IBM Network Advisor – Professional Plus, command-line interface (CLI), SMI-S compliant, Administrative Domains, and trial licenses for add-on capabilities
SecurityAES-GCM-256 encryption on ISLs, DH-CHAP (between switches and end devices) and FCAP switch authentication, and FIPS 140-2 L2-compliant, HTTPS, IPSec, IP filtering, LDAP with IPv6, OpenLDAP, Port Binding, RADIUS, User-defined Role-Based Access Control (RBAC), Secure Copy (SCP), Secure RPC, SFTP, SSH v2, SSL, Switch Binding, TACACS+, and Trusted Switch
Management access10/100/1000 Ethernet (RJ-45) per control processor and in-band over Fibre Channel, serial port (RJ-45) and one USB per control processor module, and call-home integration that is enabled through IBM Network Advisor
Diagnostic testsBuilt-in flow generator, ClearLink optics, and cable diagnostic tests, including electrical/optical loopback and link traffic/latency/distance, POST and embedded online/offline diagnostic tests, including environmental monitoring, FCping and Pathinfo (FC traceroute), flow mirroring, frame viewer, nondisruptive daemon restart, port mirroring, optics health monitoring, power monitoring (16 Gbps blades-only), RAStrace logging, and Rolling Reboot Detection (RRD)

Supported environments

Table 4 lists the supported environments for SAN768B-2 and SAN384B-2.

Table 4. Supported environments
ItemDescription
Servers supported
  • IBM System i®
  • IBM System x®
  • IBM Power Systems™
  • IBM System p®
  • IBM System z and IBM zSeries®
  • Other Intel processor-based servers with Linux, and Microsoft Windows 2008 and Windows 2012
  • Selected Sun and HP servers
Operating systems supported
  • Windows 2008 and Windows 2012
  • Red Hat Linux and Red Hat Linux Advanced Server
  • SUSE Linux and SUSE Linux Enterprise Server (SLES)
  • IBM AIX® storage system
  • Other selected operating systems
Storage products supported
  • IBM XIV® Storage System
  • IBM System Storage DS8000® storage servers
  • IBM Storwize® V3700, V5000, and V7000
  • IBM System Storage SAN Volume Controller
  • IBM Security Key Lifecycle Manager V2.0 or later
  • Other selected storage systems
FC switches supportedSystem Storage and TotalStorage SAN b-type and m-type directors, switches and routers, and other directors, switches, and routers that are manufactured by Brocade

For the most current information, see the product details in the IBM System Storage Interoperation Center (SSIC) at http://www.ibm.com/systems/support/storage/ssic/interoperability.wss.

Mechanical specifications

Table 5 lists the mechanical specifications for SAN768B-2 and SAN384B-2.

Table 5. Mechanical specifications
ItemDescription
EnclosureRear panel-to-door airflow. SAN384B-2 ships with a 1U exhaust shelf.
MountingRack-mountable in a standard 19-inch EIA cabinet
Size
  • SAN768B-2
    • Width: 43.74 cm (17.22 in.)
    • Height: 61.24 cm (24.11 in., 14U)
    • Depth (without door): 61.19 cm (24.09 in.)
    • Depth (with door): 73.20 cm (28.82 in.)
  • SAN384B-2
    • Width: 43.74 cm (17.22 in.)
    • Height: 35.00 cm (13.78 in., 8U) plus 4.37 cm exhaust shelf (1.72 in., 1U)
    • Depth without door: 61.19 cm (24.09 in.)
    • Depth with door: 73.20 cm (28.82 in.)
Weight
  • SAN768B-2
    • 103.50 kilogram (kg) (228.20 pounds (lbs)) for 384-port configuration fully populated
    • 39.55 kg (82.20 lbs) for chassis
  • SAN384B-2
    • 68.04 kg (150.00 lbs) for 192-port configuration fully populated
    • 25.76 kg (56.80 lbs) for chassis

Operating environment

Table 6 lists the operating environment for SAN768B-2 and SAN384B-2.

Table 6. Operating environment
ItemDescription
Temperature
  • Operating: 0° to 40°C (32° to 104°F)
  • Non-operating: –25°C to 70°C (–13°F to 158°F)
Humidity
  • Operating: 20% - 85% relative humidity (RH) noncondensing at 40°C (104°F)
  • Non-operating and storage (non-condensing): 10% - 93% at 70°C (158°F)
Altitude (operating)Up to 3000 meters (9842 feet)
Shock
  • Operating: 20 g, 6 ms, and half sine
  • Non-operating: 33 g, 11 ms, and half sine
Vibration
  • Operating: 0.5 g p-p and 5 - 500 Hz
  • Non-operating: 2.0 g p-p and 5 - 500 Hz
Heat dissipationSAN768B-2
  • Minimum: 32-port configuration (no QSFP), 986 W, and 3365 BTU/hr
  • Maximum: 384-port configuration (fully loaded with QSFPs), 2429 W, and 8283 BTU/hr

SAN384B-2
  • Minimum: 32-port configuration, 713 W and 2433 BTU/hr
  • Maximum: 192-port configuration (fully loaded with QSFPs), 1347 W, and 4592 BTU/hr
CO2 emissionsSAN768B-2
  • 7.8 metric tonnes per year (with 384 ports at 0.42 kg/kWh)
  • 0.95 kg per Gbps per year

SAN384B-2
  • 4.3 metric tonnes per year (with 256 ports at 0.42 kg/kWh)
  • 1.04 kg per Gbps per year
AirflowRear panel-to-door airflow

Power

Table 7 lists the power specifications for SAN768B-2 and SAN384B-2.

Power specifications
ItemDescription
Supported power rangeVoltage
  • Range: 85 - 264 VAC Auto-volt
  • Nominal: 100 - 240 VAC

Power
  • 85 - 132 VAC: 1000 W
  • 180 - 264 VAC: 2000 W
In-rush current20 Amps maximum, peak
Frequency47 - 63 Hertz (Hz)

Related information

For more information, see the following resources:

Special Notices

This material has not been submitted to any formal IBM test and is published AS IS. It has not been the subject of rigorous review. IBM assumes no responsibility for its accuracy or completeness. The use of this information or the implementation of any of these techniques is a client responsibility and depends upon the client's ability to evaluate and integrate them into the client's operational environment. publib-b.boulder.ibm.com

Profile

Publish Date
03 December 2013


Rating: Not yet rated


Author(s)

IBM Form Number
TIPS1127