Tips 1180
Tips 1180
Tips 1180
4 Product Guide
IBM Redbooks Product Guide
Built on over 50 years of Enterprise storage expertise, the IBM DS8000 series is the flagship storage
system within the IBM System Storage portfolio. The IBM DS8870 represents the most recent in this
series of high-performance, high-capacity, flexible, and resilient storage systems, aimed at addressing the
needs of the most demanding clients.
This IBM Redbooks Product Guide is an overview of the features and functions offered by the IBM
DS8870 with firmware Release 7.4.
The IBM DS8870 is designed to support the most demanding business applications with its exceptional
all-around performance and data throughput. The IBM DS8870 architecture is server-based. Powerful
IBM POWER7+ processor-based servers manage the cache to streamline disk input/outputs (I/Os),
maximizing performance and throughput. These capabilities are further enhanced with the availability of
High-Performance Flash Enclosures (HPFEs), and a high-performance All Flash configuration option. The
IBM DS8870 excels in supporting the IBM zEnterprise server and IBM Power server environments,
and ensures that clients are taking full advantage of the integration delivered by these high-end enterprise
systems.
Figure 1 shows the frontal view of an IBM DS8870 high-performance All Flash configuration.
The IBM DS8870 features a HPFE that provides outstanding flash performance. The HPFE is directly
attached to the Peripheral Component Interconnect Express (PCIe) fabric, enabling increased
bandwidth and transaction processing capability. This 1U storage enclosure contains a pair of
powerful flash Redundant Array of Independent Disks (RAID) adapters and up to thirty 400 gigabyte
(GB) encryption capable flash cards in each enclosure, for a maximum of 240 flash cards in the IBM
DS8870 high performance All-Flash configuration. With Release 7.4, the IBM DS8870 supports 4
HPFEs in the base frame and 4 HPFEs in the first expansion frame of hybrid configurations, for a
maximum of 240 flash cards.
The IBM Storage Driver for OpenStack is a software component that integrates with the OpenStack
cloud environment and enables usage of storage resources provided by supported IBM storage
systems. After the driver is installed on the OpenStack Cinder (OpenStack Block Storage) nodes,
storage volumes can be allocated by the Cinder nodes to the Nova-compute nodes. Virtual machines
on the Nova-compute nodes can then use these storage resources.
IBM Easy Tier, a well-proven IBM DS8870 feature, is available at no charge. It dynamically
optimizes performance for multi-tiered systems. It can also rebalance data within a single tier to help
maintain optimal performance. Now in its seventh generation, Easy Tier provides additional user
control at the pool and volume level and full support of the HPFE and associated flash cards, while
maintaining additional features like Easy Tier Server, Easy Tier Application, and Easy Tier Heat Map
Transfer. These additional features are briefly described below under the Scalability and Performance
section.
Product highlights
The IBM DS8870 Model 961 and associated IBM DS8870 Expansion Unit Model 96E can be ordered with
a one-year, two-year, three-year, or four-year support period. The IBM DS8870 is designed to meet the
biggest challenges with a unique combination of high-end scalability, performance, and reliability.
Scalability and performance
The IBM DS8870 features POWER7+ server technology to help support higher performance.
Tip: IBM proves the performance of its storage systems by publishing standardized benchmark results.
For benchmark results of the IBM DS8870, see the following website:
http://www.storageperformance.org
The IBM DS8870 has the following scalability and performance capabilities:
The IBM DS8870 is available with different processor options, which range from dual 2-core systems
up to dual 16-cores, and which cover a wide-range of performance needs. Simultaneous
multithreading (SMT) mode, SMT4, enables the POWER7+ processor to maximize the throughput of
the processor core.
Cache configurations are available that range from 16 GB up to 1 terabyte (TB) system cache. The
storage server architecture of the IBM DS8870 with its powerful POWER7+ processors makes it
possible to manage large caches with small cache segments of 4 KB (kilobytes), and hence large
segment tables, without the need to partition the cache. The POWER7+ processors have enough
processing power to implement sophisticated caching algorithms. These algorithms and the small
cache segment size optimize cache hits. Therefore, the IBM DS8870 provides excellent I/O response
times.
Write data is always protected by maintaining a copy of modified data in nonvolatile storage (NVS)
until the data is destaged to hardened storage.
The Adaptive Multi-stream Prefetching (AMP) caching algorithm can dramatically improve sequential
performance, thereby reducing times for backup, processing for business intelligence, and processing
for streaming media. Sequential Adaptive Replacement Cache is a caching algorithm that allows you
to run different workloads, such as sequential and random workloads, without negatively impacting
each other.
With the HPFE, IBM introduced the 1.8 inch encryption capable 400 GB flash cards, which outperform
the Fibre Channel (FC) flash drives (solid-state drives, or SSDs). Each HPFE can contain up to thirty
400 GB flash cards.
Using the HPFE, the internal design of the IBM DS8870 features a true flash architecture. By
bypassing the classical device adapters (DAs), the PCIe-based architecture of the HPFE enables it to
meet extreme input/output operations per second (IOPS) and response time requirements, in
ultra-dense packaging.
The IBM DS8870 scales to more than 3 petabytes (PB) of raw drive capacity, and supports multiple
storage tiers. The IBM DS8870 supports a broad range of drives using different technologies. There
are five types of drives managed in up to three different tiers (flash cards and flash drives as tier 0, FC
serial-attached Small Computer System Interface (SCSI), or FC-SAS, 15,000 and 10,000 revolutions
per minute (RPM) drives as tier 1, and near-line SAS drives as tier 2).
For the most demanding workloads, the IBM DS8870 high-performance All Flash configuration option
provides up to eight HPFEs. It also provides up to 16 FC/IBM System z FICON host adapters,
each with up to eight ports, supplying a total of up to 128 ports in a single-frame footprint.
The IBM DS8870 also provides an entry system, designated the Business Class configuration option,
which supports up to 1056 small form-factor (SFF) drives or flash drives, plus up to 240
high-performance flash cards. The Business Class configuration offers performance and scalability,
while reducing the initial cost of acquisition
The IBM DS8870 has an improved high-density frame design. The IBM DS8870 can support 1536
drives, plus 240 flash cards, in a small, high-density footprint (base frame and three expansion
frames) that helps to preserve valuable raised floor space in data center environments.
IBM Easy Tier, a no charge feature, offers capabilities such as manual volume capacity rebalance,
auto performance rebalancing in both homogeneous and hybrid pools, hot spot management, rank
depopulation, manual volume migration, and thin provisioning support (Extent Space Efficient (ESE)
volumes only). Easy Tier determines the appropriate tier of storage that is based on data access
requirements, and then automatically and nondisruptively moves data, at the volume or extent level,
to the appropriate tier in the storage system. Recent versions of Easy Tier include additional
reporting improvements, such as workload skew curve, workload categorization, and a data
movement daily report, as well as intra-tiering and micro-tiering support for storage tier with more than
one drive technology (mixed high performance flash cards and flash drives, or mixed Enterprise
15,000 and 10,000 RPM drives).
Now in its seventh generation, with Release 7.4 Easy Tier provides the ability to control its
monitoring(learning) at the pool and volume level, and also to pause and resume migration at the pool
level.
Easy Tier Server is a unified storage caching and tiering solution across IBM AIX servers and
storage area network (SAN) storage. Easy Tier Server manages the data placement across direct
attached flash within POWER servers and IBM DS8870 storage tiers by moving the hottest data
to the direct attached flash, while maintaining advanced feature functions.
Easy Tier can copy frequently accessed data from the IBM DS8870 storage tiers to an IBM Flash
Adapter 90 attached to a POWER7+ server, in addition to the EXP30 Ultra SSD that the IBM
DS8870 already supports.
Easy Tier Application enables clients to assign distinct application volumes to a particular tier in
the Easy Tier pool, disregarding Easy Tier's advanced data migration function. This provides a
flexible option for clients who want to ensure that certain applications remain on a particular tier to
meet performance and cost requirements.
Starting with DS8870 Release 7.4, DB2 applications running on System z can communicate
performance requirements for optimal dataset placement, by communicating
' hints' to the Easy Tier Application interface. Now in its seventh generation, with Release 7.4,
Easy Tier provides the ability to control its monitoring(learning) at the pool and volume level, and
also to pause and resume migration at the pool level.
Easy Tier Heat Map Transfer is able to provide whatever the data placement algorithm is on the
Metro Mirror/Global Copy/Global Mirror (MM/GC/GM) primary site, and re-apply it on the
MM/GC/GM secondary site through the Easy Tier Heat Map Transfer utility when failover occurs.
With this capability, the IBM DS8870 can maintain application-level performance at an application
on the secondary site when it takes over in supporting a workload after a failover from the primary
to secondary site.
Storage Pool Striping (rotate extents) provides a mechanism to distribute a volumes or logical unit
number's (LUNs) data across many RAID arrays. Storage Pool Striping helps maximize performance
without special tuning, and greatly reduces hot spots in arrays.
Storage Tier Advisor Tool (STAT) is a tool that is used with the Easy Tier feature to help clients
understand their current storage system workloads. The tool also provides guidance about how much
of their existing data is better-suited for the various drive types (spinning drives or flash).
I/O Priority Manager is an optional feature that provides application-level quality of service (QoS) for
workloads that share a storage pool. This feature provides a way to manage QoS for I/O operations
associated with critical workloads, and gives them priority over other I/O operations associated with
non-critical workloads. For IBM z/OS, the I/O Priority Manager allows increased interaction with the
host side.
Peripheral Component Interconnect Express (PCIe Generation 2) improve IOPS and sequential
read/write throughput. The I/O enclosures are directly connected to the DS8870 storage servers with
point-to-point PCI Express cables.
8 Gbps FC/FICON host adapters in the IBM DS8870 offer enhanced connectivity, with 4-port and
8-port host adapters in the I/O enclosures that are directly connected to the processor complexes.
The host adapters support FICON attachment to IBM zEnterprise EC12 (zEC12), IBM zEnterprise
196 (z196), IBM zEnterprise 114 (z114), and IBM System z10. You can configure each port to
operate as a Fibre Channel Protocol (FCP) port, a FICON port, or Fibre Channel Arbitrated Loop
(FC-AL).
High Performance FICON for System z (zHPF) is z/OS's new I/O architecture. Progressively, z/OSs
access methods have been converted to use the new I/O commands. zHPF is an optional feature of
the IBM DS8870. The IBM DS8870 is at the most up-to-date support level for zHPF. Enhancements
to zHPF include Extended Distance capability, zHPF Lis tpre-fetch support for IBM DB2 and utility
operations, and zHPF support for sequential access methods. All DB2 I/O is now zHPF-capable.
The IBM DS8870 provides large volume support for LUN sizes up to 16 TB. This configuration
simplifies storage management tasks. In a z/OS environment, extended address volumes (EAVs) with
sizes up to 1 TB are supported.
Performance features for System z environments are parallel access volumes (PAVs), HyperPAV,
Multiple Allegiance, I/O priority queuing, I/O Priority Manager, or zHPF.
Additionally, the DS8870 offers end-to-end I/O priorities, cooperative caching, long busy wait host
tolerance, or automatic port queues.
The IBM DS8870 provides up to 128 host adapter ports. Each port can be configured to operate as a
FC port or a FICON port. The IBM DS8870 host adapters (two host adapters per I/O enclosure) can
have four or eight ports, and support 2 gigabits per second (Gbps), 4 Gbps, or 8 Gbps full-duplex data
transfer over longwave or shortwave fibre links.
A nondisruptive upgrade path for the IBM DS8870 configurations allows processors, memory, and
storage capacity enhancement to be performed concurrently. The DS8870 supports a scalable
upgrade path from the smallest to the largest processor configuration (with certain restrictions). Field
model conversions from DS8800 to IBM DS8870 POWER7+ are also available, to offer greater
choices in price and performance.
The IBM DS8870 features Smart Rebuild, a function designed to help reduce the possibility of
secondary failures and data loss in RAID arrays. The IBM DS8870 supports RAID 5, RAID 6, and
RAID 10.
The Dynamic Volume Expansion simplifies management by enabling easier, online volume expansion
(for Open Systems and System z) to support application data growth, and to support data center
migration and consolidation to larger volumes to ease addressing constraints.
For data protection and availability, the IBM DS8870 supports advanced disaster recovery (DR) and
business continuity solutions, such as Copy Services functions, available for thin provisioned volumes
as well.
FlashCopy handling of volume reservations provides the detection of SCSI reserves that exist for
devices in a Metro Mirror or Global Mirror environments. It resets the reserve when performing a
FlashCopy after it has been identified that it is not a valid reserve for a running server.
IBM z/OS Soft Fence prevents any system to access data from the former remote mirror primary
site when an unplanned HyperSwap occurs.
Active Volume Protection is a feature that prevents the deletion of volumes still in use.
Support for T10 Data Integrity Field is standard. The Data Integrity Field standard of SCSI T10
enables end-to-end data protection, from the application or host HBA down to the storage drives.
Support for IBM System i variable LUN adds flexibility for volume sizes, and can increase capacity
usage for IBM i environments.Previously, clients were limited to fixed LUN sizes of 35 GB, 70 GB, 141
GB, and 282 GBs.
Lightweight Directory Access Protocol (LDAP) authentication support, which allows single sign-on
(SSO) functionality, can simplify user management by allowing the IBM DS8870 to rely on a
centralized LDAP directory rather than a local user repository. For more information, see IBM System
Storage DS8000: LDAP Authentication, REDP-4505.
The IBM DS8870 is certified as meeting the requirements of the IPv6 Ready Logo program, which
indicates its implementation of IPv6 mandatory core protocols and the ability to interoperate with other
IPv6 implementations. The IBM DS8870 can be configured in native IPv6 environments. The logo
program provides conformance and interoperability test specifications that are based on open
standards to support IPv6 deployment globally. Furthermore, the US National Institute of Standards
and Technology (NIST) tested IPv6 with the IBM DS8870, thus granting it support for the USGv6
profile and testing program.
The IBM DS8870 includes a power architecture based on a direct current uninterruptible power
supply (DC-UPS). DC-UPS converts incoming alternating current (ac) line voltage to rectified ac, and
contains an integrated battery subsystem. DC-UPS allows the IBM DS8870 to achieve the highest
energy efficiency in the DS8000 series.
The IBM DS8870 is designed to comply with the ENERGY STAR specifications. ENERGY STAR is a
joint program of the US Environmental Protection Agency and the US Department of Energy and
helps us all to save money and protect the environment through energy efficient products and
practices.
High-density storage enclosures offer a considerable reduction in footprint and energy consumption.
Hot-aisle and Cold-aisle are designed to optimize airflow, reduce cooling costs, and increase energy
efficiency.
Self-encrypted drives are a standard feature. You just need to activate encryption on drives using IBM
Security Key Lifecycle Manager. For more information, see the IBM Redpaper publication IBM
DS8870 Drive Encryption, REDP-4500.
Full Disk Encryption (FDE) can protect business-sensitive data by providing drive-based hardware
encryption that is combined with a sophisticated key management software (ISKLM). The Full Disk
Encryption is available for all drive types, including flash cards and flash drives (SSDs). Because
encryption is done by the drive, it is transparent to host systems, and can be used in any
environment, including z/OS.
Security improvements in the IBM DS8870 enable customers to become compliant with the Special
Publication (SP) number 800-131a, which is an NIST directive that provides guidance for protecting
sensitive data by using cryptographic algorithms that have key strengths of 112 bits. For more
information, refer to the IBM Redpaper publication IBM DS8870 and NIST SP 800-131a Compliance,
REDP-5069.
The following specific features of encryption key management help address Payment Card Industry
Data Security Standard (PCI DSS) requirements:
Encryption deadlock recovery key option. When enabled, this option enables you to restore
access to an IBM DS8870 when the encryption key for the storage is unavailable because of an
encryption deadlock scenario.
Dual platform key server support. This support is important if key servers on z/OS share keys with
key servers on open systems. The DS8870 requires an isolated key server in encryption
configurations. The isolated key server that is currently defined is an IBM System x x3350
server. Dual platform key server support allows two server platforms to host the key manager,
with either platform operating in either clear key or secure key mode.
Recovery key Enabling/Disabling and Rekey data key option for the FDE feature. Both of these
enhancements can help clients satisfy PCI security standards.
Advanced functions
The IBM DS8870 has the following advanced functions:
The IBM DS8870 provides DS Storage Manager (the graphical user interface, or GUI) and DS
command-line interface (CLI) management interfaces to configure the system or query status
information. The IBM DS8870 DS GUI has the same look and feel as the GUIs of other IBM storage
products, making it easier for a storage administrator to work with different IBM storage products.
Release 7.4 has introduced the next generation of the GUI, featuring improved speed and usabilty.
Thin Provisioning enables the creation of over-provisioned devices for more efficient usage of the
storage capacity for Open Systems. Copy Services are now available for Thin Provisioning.
Quick Initialization provides very fast volume initialization (for Open Systems LUNs and count key
data (CKD) volumes) and therefore allows the creation of devices, making them available as soon as
the command completes.
The following list includes advanced Copy Services features in the IBM DS8870:
IBM FlashCopy is an optional feature that allows the creation of volume copies (and data set
copies for z/OS) nearly instantaneously. Different options are available to create full copies,
incremental copies, or copy-on-write copies. FlashCopy can be used to perform backup
operations parallel to production or to create test systems. The IBM FlashCopy SE capability
enables more space-efficient capacity usage for copies, enabling improved cost effectiveness.
The DS8870 provides the same remote mirroring options as previous models of the DS8000
family. Synchronous remote mirroring (Metro Mirror) is supported up to 300 km. Asynchronous
copy (Global Mirror) is supported for unlimited distances. Three-site options are available by
combining Metro Mirror and Global Mirror.
Metro Mirror, Global Copy, Global Mirror, Metro/Global Mirror, z/OS Global Mirror, z/OS
Metro/Global Mirror, and Multiple Ttarget PPRC business continuity solutions are designed to
provide the advanced functionality and flexibility that is needed to tailor a business continuity
environment for almost any recovery point or recovery time objective.
Release 7.4 introduces Multiple Target Peer-to-Peer Remote Copy (MT-PPRC). MT-PPRC
provides the capability to have two PPRC relationships on a single primary volume. With this
enhancement, there will be another target available to provide additional data protection to act as
a backup if a disaster occurs.
The Copy Services can be managed and automated with IBM Tivoli Storage Productivity Center
for Replication. For z/OS environments, IBM Geographically Dispersed Parallel Sysplex
(GDPS) provides an automated DR solution.
With AIX operating systems, the DS8870 supports Open IBM HyperSwap replication. The Open
HyperSwap is a special Metro Mirror replication method designed to automatically fail over I/O
from the primary logical devices to the secondary logical devices in the event of a primary storage
system failure. The swap can be accomplished with minimal disruption to the applications that are
using the logical devices
In co-operation with z/OSs Data Mover, another option is available for z/OS: Global Mirror for
z/OS. Another important feature for z/OS Global Mirror (2-site) and z/OS Metro/Global Mirror
(3-site) is Extended Distance FICON, which can help reduce the need for channel extender
configurations by increasing the number of read commands in flight.
Remote Pair FlashCopy enables you to establish a FlashCopy relationship where the target is a
remote mirror Metro Mirror primary volume, keeping the pair in the full duplex state.
The Easy Tier Heat Map Transfer utility is also integrated with Tivoli Storage Productivity Center
for Replication, and all of the functions are available through Tivoli Storage Productivity Center for
Replication.
The Resource Groups feature is a policy-based resource scope limiting function that enables the
secure use of Copy Services functions by multiple users on a DS8000 series storage subsystem.
Resource Groups are used to define an aggregation of resources and policies for configuration
and management of those resources. The scope of the aggregated resources can be tailored to
meet each hosted customers Copy Services requirements for any given operating system
platform supported by the IBM DS8870.
The IBM DS8870 provides support for VMware vStorage application programming interfaces
(APIs) for Array Integration (VAAI). VAAI enables certain storage tasks to be offloaded from the
server hardware to the storage array. Support is included for the Atomic Test and Set (ATS)
primitive, the Cloning Blocks primitive, and the Zeroing Blocks primitive.
The IBM DS8870 also supports IBM Storage Management Console for VMware vCenter. The
IBM Storage Management Console for VMware vCenter is a software plug-in that integrates into
the VMware vCenter server platform and enables VMware administrators to independently and
centrally manage their storage resources on IBM storage systems. In addition to being a
virtualization-related solution, the IBM Storage Management Console is a powerful management
solution for VMware administrators who would like to control storage resources primarily from the
VMware vSphere Client GUI.
IBM DS8870 POWER7+ servers use point-to-point, high-speed PCI Express (PCIe) connections to
the I/O enclosures to communicate with HPFEs, device adapters and host adapters. Each PCIe
connection has a 2 gigabytes per second (GBps) bidirectional bandwidth. There are up to 16 PCIe
connections from the processor complexes to the I/O enclosures.
The I/O enclosures provide connectivity between the adapters and the POWER7+ processor
complexes. The I/O enclosures contain custom intelligent adapters, designed for performance and
reliability. The I/O enclosures support three types of adapters: the host adapters, the DAs, and the
Flash Interface Card.
In the IBM DS8870s that are equipped with HPFEs, the flash enclosure connects to the I/O
enclosures using two Flash Interface Cards (FAs). The Flash Interface Cards extend the I/O
enclosure PCIe bus connections to the flash enclosure. Each Flash Interface Card is a PCIe redriver
card that plugs into the I/O enclosure and has limited logic and no firmware.
Switched Fibre Channel Arbitrated Loop and device adapters
The IBM DS8870 DAs are configured in the following way:
The IBM DS8870 uses switched 8 Gbps FC-AL technology to connect the DAs to the standard drive
enclosures. Switched FC-AL uses the standard FC-AL protocol, but the physical implementation is
different. Switched FC-AL technology includes the following key features:
The IBM DS8870 architecture uses dual redundant switched FC-AL access to each of the storage
enclosures. This configuration features the following key benefits:
Two independent switched FC-AL networks provide high performance connections to drives.
Four access paths are available to each drive.
Each DA port operates independently.
The configuration provides double the bandwidth of traditional FC-AL loop implementations.
The standard drive enclosures connect to the processor complexes using 8 Gb four-port FC DAs.
These adapters provide improved IOPS, throughput, and scalability over previous models of the
DS8000 series. They are optimized for Flash Drive (SSD) technology and designed for long-term
scalability growth. These capabilities provide significant performance enhancements, with up to a
400% improvement in performance benchmarks over previous generations (DS8700).
Host adapter
Each host adapter has either four or eight ports that can be configured as either FC port, FICON port, or
Fibre Channel Arbitrated Loop (FC-AL) port. The adapter supports 2,4 or 8 Gbps full duplex data transfer
over long-wave or shortwave fibre links. Having multiple host adapters allows the creation of redundant
paths to host bus adapters (HBAs) in host servers connected to the IBM DS8870.
Flash memory
To improve data transfer rate (IOPS) and response time, the IBM DS8870 provides support for Flash
Drives and High Performance Flash Cards, based on NAND technology:
Flash drives feature improved I/O transaction-based performance over traditional spinning drives in
the same standard drive enclosures. Flash drives are available with 200 GB, 400 GB, and 800 GB,
and 1.6 TB encryption-capable drives.
High-performance flash cards offer even higher throughput using the flash RAID adapters in the
HPFE and direct PCIe connections to the processor complexes. The 400 GB flash cards are
encryption-capable.
Flash drives and flash cards are high-IOPS class enterprise storage devices that are targeted at Tier 0,
I/O-intensive workload applications that can use a high level of fast-access storage. Both types offer a
number of potential benefits over spinning drives, including better IOPS, lower power consumption, less
heat generation, and lower acoustical noise.
Storage enclosures
The data drives are installed in storage enclosures. The IBM DS8870 integrates two types of storage
enclosures, which are the standard drive enclosures and the HPFEs:
The standard drive enclosure is a 2U storage enclosure. These enclosures are installed in pairs, and
can contain up to 24 drives with the SFF storage enclosure, or 12 drives with the large form-factor
(LFF) storage enclosure. The available drives are flash drives (SSDs) and spinning drives, also
called hard disk drives (HDDs) or disk drive modules (DDMs). Although both spinning drives or flash
drives can be used in the same storage system, they cannot be intermixed within the same storage
enclosure pair. Each standard drive enclosure pair contains the following hardware components:
Two Fibre Channel interconnect cards (FCIC) that connect four 8 Gbps FC interfaces to a pair of
device adapters, or to another standard drive enclosure.
The IBM DS8870 base frame supports up to 10 standard drive enclosures (Enterprise and Business
Class configuration). Additionally, the base frame can contain up to four HPFEs. In its maximum
configuration, the base frame can hold 240 SFF drives or 120 LFF drives and up to an additional 120
flash cards. Figure 2 shows the standard drive enclosures (SFF and LFF configuration).
10
For the most demanding workloads, the IBM DS8870 features HPFEs. The HPFE is a 1U storage
enclosure that can be installed individually. HPFEs do not need to be installed in pairs. Each HPFE
contains the following hardware components:
The HPFEs are directly attached to the I/O enclosures by a flash interface card using the PCIe bus fabric,
which increases bandwidth and transaction-processing capability compared to standard drive enclosures
connectivity (FC-AL). The I/O enclosures connect to the POWER7+ servers by using a the same PCIe
bus fabric. Each flash enclosure connects to two I/O Enclosures, providing up to 4 GBps data transfer
rates to the enclosure.
The flash cards feature a 6-Gbps SAS 2.0 interface, while the flash enclosures are connected to the
processor complexes over redundant PCIe v2.0 interfaces.
Up to eight flash enclosures can be installed in the DS8870 high-performance All-Flash configuration, in a
single frame footprint. Up to four flash enclosures can be installed in an IBM DS8870 Enterprise or
Business Class configuration, and another four HPFEs can be installed in the first expansion frame
(model 96E).
Figure 3 shows the front and rear view of the HPFE.
11
146 GB and 300 GB 15,000 RPM Enterprise drives for high performance requirements
600 GB and 1.2 TB 10,000 RPM drives for standard performance requirements
4 TB 7200 RPM Nearline drives for large-capacity requirements
Flash cards and flash drives are treated as the same tier, and the Easy Tier intra-tier auto-rebalance
function enables you to use the higher IOPS capability of flash cards.
Flash drives provide up to 100 times the throughput and 10 times lower response time than 15,000 RPM
spinning drives. They also use less power than traditional spinning drives.
All types of drives are FDE capable. However, you do not need to use encryption unless you want to.
Power subsystem
The IBM DS8870 power subsystem has the following characteristics:
The IBM DS8870 power subsystem is based on DC-UPS with integrated battery sets. DC-UPS
delivers greater levels of efficiency over the primary power supplies (PPSs) used in previous
generations of the DS8000 series. The IBM DS8870 base frame uses 20% less power than the
DS8800. The power subsystem in the IBM DS8870 complies with the current directives for the RoHS,
and is engineered to comply with US Energy Star guidelines.
Each frame contains two DC-UPS power supplies in a redundant active-active configuration. Each
frame has two AC power cords, with each cord supplying a single DC-UPS. If input AC is not present
on one power cord, the associated DC-UPS will continue to operate using rectified AC from the
partner DC-UPS, with no reduction of system power redundancy. If neither AC input is active, the
DC-UPSs will switch to battery power. Depending on whether the system has the ePLD feature, the
system runs on battery power for either 4 or 50 seconds before initiating an orderly shutdown.
Each DC-UPS has its own battery backup functions. Therefore, the battery system also provides 2N
redundancy. The battery of a single DC-UPS is able to preserve NVS in case of a complete power outage.
The battery module is called a battery service module (BSM). A group of four battery enclosures makes
up a BSM set.
The BSM helps protect data in the event of a loss of external power. If there is a complete loss of ac input
power, the batteries are used to maintain power to the processor complexes and I/O enclosures for
sufficient time to allow the contents of NVS memory (modified data that is not yet destaged to drive from
cache) to be written to the drives internal to the processor complexes (not the storage enclosures drives).
Other key elements of the power subsystem include the following components:
The rack power control (RPC) cards manage the power subsystem, providing functions of control,
monitor and reporting. There are two RPC cards for redundancy.
The system power control network (SPCN) is used to control the power of the attached I/O
subsystem.
12
Models
The DS8870 storage systems include the IBM DS8870 Model 961 base frame and the associated IBM
DS8870 expansion frames Model 96E. The IBM DS8870 is available in the three following configurations:
13
Up to 10 standard drive enclosures and up to four HPFEs in a base frame (model 961)
Up to 14 standard drive enclosures in a first expansion frame (model 96E)
Up to 20 standard drive enclosures in a second expansion frame
Up to 20 standard drive enclosures in a third expansion frame
This configuration uses 8 Gbps FC host adapters that run FCP, FICON, or HPF.
Restriction: Copy Services and I/O Priority Manager functions require 32 GB system memory.
Up to 10 standard drive enclosures and up to four HPFEs in a base frame (model 961)
Up to 14 standard drive enclosures and 4 HPFEs in a first expansion frame (model 96E)
Up to 20 standard drive enclosures in a second expansion frame
This configuration uses 8 Gbps FC host adapters that run FCP, FICON, or High Performance
FICON (zHPF).
Restriction: Copy Services and I/O Priority Manager functions require 32 GB system memory.
14
Figure 4. The IBM DS8870 Model 961 High Performance All Flash and Enterprise Class front views
Figure 4 shows the front view of the Model 961 base frame for high-performance All Flash (left) and
Enterprise or Business Class configuration (right):
The high-performance All Flash configuration includes space for up to 8 HPFEs (#1), while the
Enterprise Class (and Business Class) configuration includes space for up to 4 HPFEs (#1), and up to
10 standard disk enclosures (#2).
The power subsystem is based on DC-UPSs with integrated battery sets. Each frame contains two
DC-UPS power supplies in a fully redundant configuration (#3).
The POWER7+ processor-based servers (#5) contain the processors and memory that drive all
functions within the IBM DS8870. Processor and system memory can be upgraded concurrently.
The I/O enclosures (#6) provide connectivity between the adapters and the storage complexes (#5).
The adapters that are contained in the I/O enclosures can be either DAs or host adapters, or Flash
Interface Cards.
15
Specifications
Table 1 summarizes the IBM DS8870 specifications.
16 GB/1024 GB
2/16
8/128
Drive interface
Device adapters
Up to 16 4-port, 8 Gbps FC
Drive sizes
RAID levels
5, 6, and 10
16 C 32 C (60 F 90 F)
Relative humidity
20% 80%
16
Power supply
For more information about specifications, refer to the IBM publication IBM DS8870 Introduction and
17
Configuration options
Table 2 lists the base and expansion frame configuration options.
Table 2. IBM DS8870 Configuration options for base and expansion frames
Model number/
Class
Processor
Max.
Max.
Flash
Flash
Adapter Cards
Pairs
Max. Max.
Flash
DA
Pairs Drives/
drives
System
memory
Host
9xE
Adapters attach
144
16 GB
60
144
32 GB
120
240
64 GB
120
1056
128 GB
256 GB
16
0-2
120
1056
512 GB
1 TB
16
0-2
961 Enterprise
Class
2-core
144
16 GB
961 Enterprise
Class
2-core
60
144
32 GB
961 Enterprise
Class
4-core
120
240
64 GB
961 Enterprise
Class
8-core
120
1056
128 GB
16
0-2
961 Enterprise
Class
8-core
120
1536
256 GB
16
0-3
961 Enterprise
Class
16-core
120
1536
512 GB
1 TB
16
0-3
240
256 GB
16
240
512 GB
1 TB
16
Not
applicable
(N/A)
120
336
N/A
961
N/A
480
N/A
961
Important: Cache size and the possible processor options (number of cores) are not fully independent.
Only certain combinations of both are allowed.
18
An external HMC can be ordered as a second HMC to provide continuous availability to the HMC
functions. The use of a second HMC can be very useful in storage environments where encryption
capability has been activated.
The Extended Power Line Disturbance (ePLD) option is designed to protect your storage unit for 50
seconds, rather than only 4 seconds, from a power-line disturbance. If no ePLD option is ordered, one
BSM set per DC-UPS (for both the main and expansion racks) is needed. If the ePLD option is
ordered, two BSM sets per DC-UPS (for both the main and expansion racks) are needed.
The BSMI certificate for Taiwan option provides the required Bureau of Standards, Metrology, and
Inspection (BSMI) ISO 9001 certification documents for storage system shipments to Taiwan.
The optional remote zSeries power control feature adds a logic card that is used by one or more
attached System z or IBM S/390 hosts to control the power-on and power-off sequences for your
storage system.
For environments with nonraised floors, an optional overhead cabling feature is available. The
overhead cabling option includes a top-exit bracket for fiber cables.
The shipping weight reduction option allows you to receive delivery of an IBM DS8870 model in
multiple shipments. If your site has delivery weight constraints, IBM offers a shipping weight reduction
option that ensures the maximum shipping weight of the initial model shipment does not exceed 909
kg (2000 lb). The model weight is reduced by removing selected components, which are shipped
separately. The IBM service representative installs the components that were shipped separately
during the storage unit installation.
The Earthquake Resistance Kit is an optional seismic kit for stabilizing the storage unit rack, so that
the rack complies with IBM earthquake resistance standards. The Earthquake Resistance Kit option is
available for models 961 and 96E.
19
Capacity
A summary of the capacity characteristics is listed in Table 3. The minimum capacity is achieved by
installing one SFF drive group (16 drives) of 146 GB 15,000 RPM enterprise drives.
Table 3. Capacity comparison of device adapters, DDMs, and storage capacity
Component
2-core base
frame
8-core or
16-core, All
flash
4-core, 8-core,
or 16-core
base frame
8-core or
16-core, with
one expansion
frame
8-core or
16-core, with
two expansion
frames
8-core or
16-core, with
three expansion
frames
DA pairs
1-2
N/A
1-4
5-8
Fibre
1-2
Channel
adapter (FA)
pairs
1-8
1-4
1-4
1-4
1-4
HDDs
Up to 144
N/A
Up to 240
Up to 576
Up to 1056
Up to 1536
Flash drives
(SSD)
Up to 96
N/A
Up to 192
Up to 384
Up to 384
Up to 384
Flash cards
Up to 60
Up to 240
Up to 120
Up to 120
Up to 120
Up to 120
Raw
capacity*,
2.5-inch
SFF drives
Up to 173 TB
N/A
Up to 288 TB
Up to 690 TB
Up to 1.27 PB
Up to 1.84 PB
Usable
capacity*,
RAID-5,
2.5-inch
SFF drives
Up to 133 TB
N/A
Up to 218 TB
Up to 532 TB
Up to 1.00 PB
Up to 1.48 PB
Raw
capacity*,
Flash Cards
Up to 24 TB
Up to 96 TB
Up to 48 TB
Up to 48 TB
Up to 48 TB
Up to 48 TB
Usable
capacity*,
RAID-5,
Flash Cards
Up to 18.5 TB
Up to 74.3 TB Up to 37.1 TB
Up to 37.1 TB
Up to 37.1 TB
Up to 37.1 TB
Raw
Up to 288 TB
capacity*,
3.5-inch LFF
drives
N/A
Up to 480 TB
Up to 1152 TB
Up to 1.58 PB
Up to 3.06 PB
Usable
capacity*,
RAID-6,
3.5-inch
LFF drives
N/A
Up to 284 TB
Up to 694 TB
Up to 1.34 PB
Up to 2.01 PB
Up to 173 TB
Additional drive types are continuously qualified during the lifetime of the machine.
Leading practice: Although the flash drives (SSDs) can be ordered in full sets (16 drives) or half sets
(eight drives), the optimum price-to-performance ratio is achieved by using full drive sets (16).
20
For more information about comparison values for Model 961 and 96E, see the Overview of physical
configurations section on the following web page:
http://ibm.co/1jO9xaH
Model Conversion
It is possible to convert an existing DS8800 (Model 951, 95E) into an IBM DS8870 (Model 961, 96E). This
conversion uses existing storage enclosures, drives, host adapters, and DAs. All other hardware is
physically replaced. This conversion process can only be performed by an IBM service representative.
The model conversion consists of four phases: Planning, verification of prerequisites, physical model
conversion, and post-conversion operations. The IBM service representative will not begin mechanical
conversion until all prerequisites are complete.
21
Scalable upgrades
With the IBM DS8870 Business Class Configuration option, it is possible to start with a single-frame,
two-core configuration with storage enclosures for 48 DDMs, and grow to a full-scale, 1536-drive, 240
Flash Card, four-frame configuration. With the IBM DS8870 Enterprise Class Configuration option, it is
also possible to start with a single-frame, two-core configuration, and grow to a 1536-drive, 120 Flash
Card, four-frame configuration. All frame and capacity upgrades are concurrent, regardless of
configuration type.
Note: A Business Class Configuration cannot be upgraded to an Enterprise Class Configuration .
22
Licensed functions
Many of the software optional licensed functions of the IBM DS8870 need a License Key to be activated.
In fact, licensed functions are enabled through a licensed function indicator feature plus a licensed
function authorization feature number.
In addition, for every storage unit, an Operating Environment License (OEL) must also be ordered, so that
the OEL licenses the operating environment and is based on the total physical (raw) capacity of the IBM
DS8870.
Licensed functions are activated and enforced within a defined License Scope. License scope refers to
the type of storage, and therefore the type of servers, that the function can be used with:
Each IBM DS8870 licensed function can have its own peculiarity in the way that it is ordered or activated.
The Copy Services, for instance, are licensed by the gross amount of capacity installed. With Easy Tier
on the other hand, while you do need a license key, because this feature is available at no cost it is
generally always configured.
23
1750
1754
FICON Attachment
Thin Provisioning
Database Protection
Easy Tier
FlashCopy
Metro/Global Mirror
Metro Mirror
Global Mirror
HyperPAV
1760
For more details, see the IBM publication IBM DS8870 Introduction and Planning Guide, GC27-4209.
24
For remote support, the IBM DS8870 HMC can be accessed remotely by IBM Support personnel for many
service tasks. IBM Support can offload service data, change configuration settings, and initiate recovery
actions over a remote connection. You decide which type of connection you want to allow for remote
support. The following options are included:
Remote support is an important item for IBM DS8870 support. As more clients eliminate modems and
analog phone lines from their data centers, the usage of a VPN or AOS connection becomes more
important. For more information about remote support operations, see the IBM Redbooks publication IBM
DS8870 Architecture and Implementation, SG24-8085.
Supported Environments
The IBM DS8870 offers connectivity support across a broad range of server environments, including IBM
Power Systems, System z and System x servers, servers from Oracle and Hewlett-Packard, non-IBM
Intel, and AMD-based servers.
The DS8000 supports over 90 platforms. For the most current list of supported platforms, see the IBM
System Storage Interoperation Center (SSIC) on the following website:
http://www.ibm.com/systems/support/storage/config/ssic/index.jsp
A Host Attachment and Interoperability IBM Redbooks publication that provides answers to the applicable
supported environments is available on the following website:
http://www.redbooks.ibm.com/Redbooks.nsf/RedbookAbstracts/sg248887.html?Open
This rich support of heterogeneous environments and attachments, along with the flexibility to easily
partition the IBM DS8870 storage capacity among the attached environments, can help support storage
consolidation requirements and dynamic environments.
Disk Magic
Disk Magic is a Windows-based performance modeling tool that is used by IBM and IBM Business
Partners to model storage system performance. It supports storage systems from multiple vendors, and
offers detailed support for IBM storage systems.
For the IBM DS8870, Disk Magic provides a capability to advise on data placement with flash memory.
Having IBM DS8870 configurations with flash memory and multiple servers, Disk Magic can select a
specific server workload that most benefits from running on flash. This feature is called SSD Advisor and
applies to IBM System z and open systems models.
Important: IBM Disk Magic for Windows is a product of IntelliMagic, which is licensed to IBM and IBM
Business Partners to model disk storage system performance. Contact your IBM Representative or IBM
Business Partner to discuss a Disk Magic study.
Note: Disk Magic supports the HPFE and two new flash drive (SSD) sizes (200 GB and 800 GB) in
DS8870 with LMC 7.7.30.xx.xx (bundle version 87.30.xx.xx) or later.
25
IBM publication IBM System Storage DS8000 242x Model 961 Installing a Storage Facility,
GA32-2236
IBM System Storage DS8000: Copy Services for Open Systems, SG24-6788:
http://www.redbooks.ibm.com/redpieces/abstracts/sg246788.html?Open
IBM System Storage IBM System Storage DS8000: Copy Services for IBM System z, SG24-6787:
http://www.redbooks.ibm.com/redpieces/abstracts/sg246787.html?Open
IBM System Storage DS8000 Easy Tier Heat Map Transfer Server, REDP-4515
http://www.redbooks.ibm.com/abstracts/redp4515.html?Open
26
http://www.ibm.com/support/assistonsite/
IBM System Storage DS Command-Line Interface Users Guide for DS8000 series, GC27-4212:
http://www.ibm.com/support/docview.wss?uid=ssg1S7002620
DS8870 support:
http://ibm.co/1mfO0lJ
IBM Power 720 and 740 Technical Overview and Introduction, REDP-4797:
http://www.redbooks.ibm.com/abstracts/redp4797.html?Open
27
Notices
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local
IBM representative for information on the products and services currently available in your area. Any reference to an
IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may
be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property
right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM
product, program, or service. IBM may have patents or pending patent applications covering subject matter described
in this document. The furnishing of this document does not give you any license to these patents. You can send
license inquiries, in writing, to:
IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions are
inconsistent with local law : INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain
transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or
typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in
new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s)
described in this publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner
serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this
IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information you
supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM
products was obtained from the suppliers of those products, their published announcements or other publicly available
sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any
other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to
the suppliers of those products. This information contains examples of data and reports used in daily business
operations. To illustrate them as completely as possible, the examples include the names of individuals, companies,
brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an
actual business enterprise is entirely coincidental.
Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained
in other operating environments may vary significantly. Some measurements may have been made on
development-level systems and there is no guarantee that these measurements will be the same on generally
available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results
may vary. Users of this document should verify the applicable data for their specific environment.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrate programming techniques
on various operating platforms. You may copy, modify, and distribute these sample programs in any form without
payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to
the application programming interface for the operating platform for which the sample programs are written. These
examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability,
serviceability, or function of these programs.
Copyright International Business Machines Corporation 2014. All rights reserved .
Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by
GSA ADP Schedule Contract with IBM Corp.
28
Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business
Machines Corporation in the United States, other countries, or both. These and other IBM trademarked
terms are marked on their first occurrence in this information with the appropriate symbol ( or ),
indicating US registered or common law trademarks owned by IBM at the time this information was
published. Such trademarks may also be registered or common law trademarks in other countries. A
current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml
The following terms are trademarks of the International Business Machines Corporation in the United
States, other countries, or both:
AIX
DB2
DS8000
Easy Tier
FICON
FlashCopy
GDPS
Geographically Dispersed
Parallel Sysplex
HyperSwap
IBM
Parallel Sysplex
POWER
Power Systems
POWER7
POWER7+
PowerPC
Redbooks
Redpaper
Redbooks (logo)
S/390
System i
System Storage
System Storage DS
System x
System z
System z10
System/390
Tivoli
z/OS
z10
zEnterprise
29