Network Design Considerations in A Blade Server Environment - LAN & Storage
Network Design Considerations in A Blade Server Environment - LAN & Storage
Network Design Considerations in A Blade Server Environment - LAN & Storage
Considerations in a Blade
Server Environment - LAN &
Storage
Session Number-BRKDCT-2869
Session_ID
Presentation_ID © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 2
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 3
Session Objectives
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 4
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 5
WAN
LAN MAN
Integrated Network Services
Server Balancing
Intrusion Detection
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 6
Does this look Manageable? How to I find and replace bad cable?
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 8
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 9
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 10
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 11
• Layer 3 Core
Core • High Speed / Bandwidth
• High Availability
Access
• High Perf Server Connectivity
• Port Density
• Partitioning with VLANs
• Layer 2 resiliency with STP
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 12
OSPF, EIGRP
trunks L3 links
Access
Access
Layer 2
Layer 3
The Choice of one design versus the other one has to do with:
Layer 2 loops being more difficult to manage than Layer 3 loops
Convergence time, Link Utilization, Specific Application Requirements
Requirements of NIC teaming and Clustering
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 13
y
ar
nd
Used when server sees two or more upstream switches
co
Pr
im
Se
NIC connectivity is PREDEFINED with built-in switches and
ar
y
may limit NIC configuration options
Transmit Load Balancing (TLB)
ry
Primary adapter transmit and receives
a
nd
Secondary adapters transmit only
co
Pr
im
Se
Rarely used
ar
y
Switch Assisted Load Balancing (SLB)
Often referred to as Active/Active
Server must see same switch on all member NICs
GEC/802.3ad
Increased throughput
Available with VBS switches Active
Standby
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 15
or
Aggregation Aggregation
Access Access
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 17
L3
Switches
Link Link
State Cisco Blade State
Group 1 Switches Group 1
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 19
Cat6K Cat6K
Core
Aggregation
Access
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 20
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 21
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 22
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 23
CBS3120-VBS-TOP#
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 24
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 25
Mix-n-match
GE & 10GE
switches
Local Traffic
doesn’t go to
distribution
switch
Higher
Resiliency With VSS on Cat
with 6K, all links
Etherchannel utilized
Benefits
Common Scenario
Cost Effective
Single Virtual Blade switch per rack
Entire rack can be deployed with as
little as two 10 GE uplinks or two GE
Etherchannels
Allows for Active/Active NIC teams
Creates a single router for entire rack
if deploying L3 on the edge
Keeps Rack traffic in the Rack
Design Considerations
Ring is limited to 64 Gbps
May cause Oversubscription
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 27
Benefits
Separate VBS divide Left/Right switches
More resilient
Provides more Ring capacity since two
rings per Rack
Design Considerations
Requires more Uplinks per Rack
Servers can not form A/A NIC teams
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 28
Benefits
Allows for 4 NICs per server
Can Active/Active Team all 4 NICs
More Server Bandwidth
Design Considerations
Creates smaller Rings
Requires more Uplinks
May Increase Traffic on each Ring
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 29
Additional Options
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 30
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 31
~2 FT
~2 FT
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 32
Aggregation
Layer
Core
Layer
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 33
Deployment Example
7 8
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 34
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 35
Configuration Commands
interface range ten2/0/1, ten4/0/1
switchport mode trunk
switchport trunk allowed vlans 1-10
channel group 1 mode active
interface range ten6/0/1, ten8/0/1
switchport mode trunk
switchport trunk allowed vlans 1-10
channel group 2 mode active
interface po1
spanning-tree vlan 1,3,5,6,7,9 port-priority 0
spanning-tree vlan 2,4,6,8,10 port-priority 16
interface po2
spanning-tree vlan 1,3,5,6,7,9 port-priority 16
spanning-tree vlan 2,4,6,8,10 port-priority 0
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 36
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 37
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 38
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 39
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 40
Sup720-10GE
VSL Interconnect
WS-X6708-10GE
Sup720-10GE DFC3C/CXL
Software:
>=12.2 RLS6
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 43
Blade Server
Integrated
Blade Switch
Director Class
SAN Switch
FC
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 44
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 45
What is FlexAttach
Flexibility for Adds, Moves, and Changes
Blade Server
FlexAttach (Based on WWN NAT)
….
Blade N
Blade 1
Blade
New
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 46
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 47
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 48
Server S1
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 49
ESX Servers
Centralized Storage for
Multiple Network / Storage OS & data (SAN or
SAN connections Network NAS)
SAN
NAS
Server Pool Network Pool Storage Pool
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 52
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 53
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 54
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 55
Q and A
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 56
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 57
Product Pages
For More information on Cisco Ethernet or FC Blades:
www.cisco.com/go/bladeswitch
For More information on VFrame Datacenter:
http://www.cisco.com/en/US/products/ps8463/index.html
For More information on Blade Server Partners:
DELL:
http://www.dell.com/content/products/compare.aspx/blade?c=us&cs=5
55&l=en&s=biz&~ck=mn
HP:
http://h18004.www1.hp.com/products/blades/components/c-class-
components.html
IBM:
http://www-03.ibm.com/systems/bladecenter/
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 58
http://www.ciscopress.com/bookstore/browse.asp?st=60113
Available Onsite at the Cisco Company Store
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 59
BRKDCT-2869 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 60