128037-CUBE ASR HA Application Note Pamistry v2
128037-CUBE ASR HA Application Note Pamistry v2
128037-CUBE ASR HA Application Note Pamistry v2
Introduction...................................................................................................................................... 2
Box-to-Box Redundancy............................................................................................................................. 2
Inbox Redundancy........................................................................................................................................ 2
Prerequisites.................................................................................................................................... 3
Requirements................................................................................................................................................. 3
Components Used......................................................................................................................................... 3
Conventions..................................................................................................................................................... 3
Background Information.............................................................................................................. 3
Steps to Configure........................................................................................................................... 4
Network Diagram.......................................................................................................................................... 5
Step 1: Disable inbox and software redundancy..............................................................................5
Step 2: Configure Redundancy Group (RG)........................................................................................ 6
Step 3: Configure interface tracking:..................................................................................................... 7
Step 4: Configure the interfaces.............................................................................................................. 7
Step 4: Configure SIP Binding.................................................................................................................. 8
Step 5: Configure H323 binding (only if H323 calls are involved)............................................9
Step 6: Enable B2B Redundancy............................................................................................................. 9
Step 7: Media Inactivity Timer.............................................................................................................. 10
Step 8: Reload the Router....................................................................................................................... 10
Step 9: Configure the peer ASR router:.............................................................................................. 10
Step 10: Point Attached Devices to the CUBE Virtual IP (VIP) Address...............................10
Configuration of Software MTP on the CUBE ASR (Optional)..................................................11
Removing B2B HA Configurations........................................................................................... 11
Full Sample Configurations for CUBE Box to Box Redundancy.......................................12
Feature Use Notes......................................................................................................................... 19
Verify................................................................................................................................................ 19
Verify Redundancy State on the Active Router..............................................................................19
Verify Redundancy State on the Standby Router..........................................................................20
Verify Call State after a Switchover..................................................................................................... 22
Verify SIP IP Address Bindings............................................................................................................. 26
Verify Current CPU Use............................................................................................................................ 26
Forcing a Manual Failover for Testing............................................................................................... 27
Troubleshoot................................................................................................................................. 27
Troubleshooting tips................................................................................................................................. 28
NetPro Discussion Forums - Featured Conversations.......................................................29
Related Information.................................................................................................................... 29
Introduction
The Cisco Unified Border Element (CUBE) provides two types of high availability (HA)
options on the Cisco Aggregation Services Router (ASR1000) platform:
1. Box-to-box redundancy
2. Inbox Redundancy
The CUBE HA implementation on the ASR Platforms supports full stateful failover for
active SIP-SIP calls using UDP transport. This means both media and session signaling
information is preserved after switchover. For active SIP-SIP calls using TCP transport,
SIP-H323, H323-H323, we support media preservation after switchover. This capability
is supported as of Cisco IOS XE Release 3.2
Box-to-Box Redundancy
Inbox Redundancy
Inbox redundancy mechanism provides redundancy within the same box. Some models of
the ASR offers hardware redundancy within the box and some offers software
redundancy. This section discusses the various aspects for Inbox Redundancy on the
Cisco ASR1000 platforms.
This application note will provide detailed information on how to set up CUBE on the
ASR platform for the Box-to-box redundancy and for Inbox redundancy options.
Prerequisites
Requirements
Ensure that you meet these requirements before you attempt this configuration:
The basic requirements for setting up CUBE ASR box-to-box redundancy include:
Two identical ASRs equipped with Cisco release R3.2 image or later
Both routers must be physically located on the same Ethernet LAN.
A separate interface should be used for check-pointing control and data traffic
across the 2 routers and must be connected via a switch
The CUBE configuration of both routers is identical and must be manually copied
from one router to the other. One router is designated as the Active router and the
second as the Standby.
Components Used
The information in this document is based on a minimum software release of Cisco IOS
XE Release 3.2 implemented on a Cisco ASR1001, 1002 or 1004.
The information in this document was created from the devices in a specific lab
environment. All of the devices used in this document started with a cleared (default)
configuration. If your network is live, make sure that you understand the potential impact
of any command.
Conventions
Refer to the Cisco Technical Tips Conventions for more information on document
conventions.
Background Information
Box-to-box redundancy requires two identical ASR platforms on the same LAN.
Redundancy Group (RG) Infra component will provide the box-to-box communication
infrastructure support between the two ASRs and will negotiate the final stable
redundancy state. The RG Infra component provides:
An HSRP-like protocol that negotiates the final redundancy state for each router
(via the control interface)
A transport mechanism for checkpointing the signaling and media state for each
call from the ACTIVE to the STANDBY router (via the data interface)
This RG component will have to be specifically configured to support voice B2B HA.
Please note that only one RG component can be configured on each router for voice B2B
HA.
Virtual IP address management (VIP) for both signaling and media - B2B HA relies
on VIP to achieve redundancy. The VIP and associated physical interfaces on both ASRs
in the ASR B2B pair must reside on the same LAN subnet. Configuration of the VIP and
binding of the VIP interface to a particular Symphony voice application (SIP, H.323,
SWMTP) is mandatory for voice B2B HA support. External devices, such as CUCM,
gateway or proxy, will use VIP as the destination IP address for the calls traversing
through CUBE(Ent) router.
The signaling and RTP streams of established calls are checkpointed between the Active
and Standby routers. In the case of a heartbeat failure when the Active router goes down,
the Standby router takes over, and continues to forward the RTP stream that was
previously routed by the first router.
Calls in a transient state (i.e. calls that are not established yet, or are in the process of
being modified with a transfer or hold function) at the time of failover are disconnected.
Also, any calls using DSP services such as transcoding are not preserved.
Steps to Configure
In this section, you are presented with the information to configure the features described
in this document.
CUBE B2B configuration on ASR platforms, follows a specific order of steps, outlined
below:
Step 1: Disable inbox and software redundancy
Step 2: Configure Redundancy Group (RG)
Step 3: Configure interfaces
Step 4: Configure SIP binding (only for SIP calls)
Step 5: Configure H.323 binding (only for H.323 calls)
Step 6: Enable B2B Redundancy
Step 7: Configure Media Inactivity timer
Step 8: Reload the Routers
Both the ASRs within a B2B HA pair must be manually configured, as B2B
infrastructure does not provide configuration-sync to maintain the configuration between
the two ASRs used for voice B2B HA.
Note: Use the Command Lookup Tool ( registered customers only) to obtain more
information on the commands used in this section.
Network Diagram
Figure 1 shows the topology of an Active/Standby pair of ASR routers used in a SIP
trunk deployment between a Cisco Unified Communications Manager (CUCM) and a
service provider (SP) SIP trunk for PSTN access.
Note: The Gig0/0/2 interface used for checkpointing traffic, should be connected via a
switch and not directly connected
6. Boot the ASR image from the bootflash or harddisk: or from the network
7. When the router is up, re-apply the old configuration by copying the configuration file
to the running-configuration
Router# copy bootflash:<filename> running-configuration
Configure an RG group for use with VoIP HA under the “application redundancy”
submode
redundancy
mode none
application redundancy
group 1
name voice-b2bha
priority 100 failover threshold 75
timers delay 30 reload 60
control GigabitEthernet0/0/2 protocol 1
data GigabitEthernet0/0/2
protocol 1
timers hellotime 3 holdtime 10
Track CLI is used in RG to track the voice traffic interface state so that the Active router
will initiate switchover after the traffic interface is down
Configure the below at global level to track the status of the interface.
application redundancy
group 1
track 1 shutdown
track 2 shutdown
interface GigabitEthernet0/0/0
ip address 9.13.25.190 255.255.0.0
negotiation auto
bfd interval 50 min_rx 50 multiplier 3
redundancy rii 1
redundancy group 1 ip 9.13.25.123 exclusive
interface GigabitEthernet0/0/1
ip address 8.13.25.190 255.255.255.0
media-type rj45
negotiation auto
bfd interval 50 min_rx 50 multiplier 3
redundancy rii 2
redundancy group 1 ip 8.13.25.123 exclusive
interface GigabitEthernet0/0/2
ip address 10.1.1.2 255.255.255.0
media-type rj45
negotiation auto
Note: It is mandatory to use separate interface for redundancy. Ie. Interface used for
traffic cannot be used for HA keep-alives and checkpointing. In this example, Gigabit
interface 0/0/2 is used for checkpointing.
Configure CUBE to bind SIP messages to the interface that is configured with a Virtual
IP address (VIP) for the RG group employed.
Under the interface used by H.323, configure voip-bind with its source address equal to
this interface’s VIP for the RG group employed
interface GigabitEthernet0/0/0
ip address 9.13.25.190 255.255.0.0
media-type rj45
negotiation auto
bfd interval 50 min_rx 50 multiplier 3
redundancy rii 1
redundancy group 1 ip 9.13.25.123 exclusive
h323-gateway voip interface
h323-gateway voip bind srcaddr 9.13.25.123
interface GigabitEthernet0/0/1
ip address 8.13.25.190 255.255.255.0
media-type rj45
negotiation auto
bfd interval 50 min_rx 50 multiplier 3
redundancy rii 2
redundancy group 1 ip 8.13.25.123 exclusive
h323-gateway voip interface
h323-gateway voip bind srcaddr 8.13.25.123
Configure this RG group under the “voice service voip” . This is to enable voice B2B HA
voice service voip
redundancy-group 1
The Media Inactivity Timer enables the Active/Standby router pair to monitor and
disconnect calls if no Real-Time Protocol (RTP) packets are received within a
configurable time period.
In case of SIP calls, the switched over calls will be cleared with signaling (as signaling
information is preserved for switched calls)
For calls which are TCP-based, H.323, or Software MTP based, will be released by the
Media Inactivity timer. This is used to guard against any hung sessions that may have
resulted from the failover in the event that a normal call disconnect does not clear the
call.
The same duration for the Media Inactivity Timer should be configured on both routers.
The default value is 30 seconds for SIP and H323 calls. For SW MTP calls the default
value is 1200 seconds. This timer is configured as follows:
SIP/H323 call legs will be cleared once RTCP timer expires and SWMTP legs will be
cleared after RTP timer expired
In the above example, the RTCP timer value will be 9000x5=45000millisecs=45 secs and
RTP timer value will be 1200 secs
Once all the above configs are completed, save and reload the router
Follow the above steps to configure the Standby ASR router. Make sure the correct IP
addresses are used.
Step 10: Point Attached Devices to the CUBE Virtual IP (VIP) Address
The IP-PBX, SIP proxy or service provider must route the calls to CUBE’s virtual IP
address .
SIP/H323 messages to the CUBE’s physical IP addresses are not handled with this HA
configuration.
For H323 calls, you should disable the keepalive messages in CUCM configuration.
To remove a previously entered B2B HA configuration from a CUBE router, follow the
steps below in the specific order.
Router1(config)# redundancy
Router1(config-red)# redundancy application
Router1(config-red-app)#group 1
Router1(config-red-app-grp)#shutdown
Router1(config-red-app-grp)#exit
Router1(config-red-app)#no group 1
Router1(config-red-app)#exit
Router1(config-red)#no redundancy application
Router1(config)#interface GigabitEthernet0/0/0
Router1(config-int)# no redundancy group 1 ip 9.13.25.123 exclusive
Router1(config-int)#no redundancy rii 1
Router(config)#write
Router#reload
!
interface GigabitEthernet0/0/1
ip address 8.13.25.190 255.255.255.0
media-type rj45
negotiation auto
bfd interval 50 min_rx 50 multiplier 3
redundancy rii 2
redundancy group 1 ip 8.13.25.123 exclusive
h323-gateway voip interface
h323-gateway voip bind srcaddr 8.13.25.123
interface GigabitEthernet0/0/2
ip address 10.1.1.2 255.255.255.0
media-type rj45
negotiation auto
!
interface GigabitEthernet0
vrf forwarding Mgmt-intf
no ip address
negotiation auto
!
!
no ip http server
no ip http secure-server
ip rtcp report interval 9000
ip route 0.0.0.0 0.0.0.0 9.44.0.1
!
logging esm config
dialer-list 1 protocol ip permit
dialer-list 1 protocol ipx permit
!
!
!
control-plane
!
!
!
dial-peer voice 10 voip
destination-pattern 140854.....
session protocol sipv2
session target ipv4:8.13.25.102
voice-class sip bind control source-interface GigabitEthernet0/0/1
voice-class sip bind media source-interface GigabitEthernet0/0/1
codec g711ulaw
no vad
!
dial-peer voice 20 voip
session protocol sipv2
session target ipv4:9.13.25.101
incoming called-number 140854.....
voice-class sip bind control source-interface GigabitEthernet0/0/0
voice-class sip bind media source-interface GigabitEthernet0/0/0
codec g711ulaw
no vad
!
!
gateway
media-inactivity-criteria all
timer receive-rtcp 5
timer receive-rtp 1200
!
!
line con 0
exec-timeout 0 0
stopbits 1
line vty 0 4
no login
!
exception data-corruption buffer truncate
end
!
interface GigabitEthernet0/0/1
ip address 8.13.25.191 255.255.255.0
media-type rj45
negotiation auto
bfd interval 50 min_rx 50 multiplier 3
redundancy rii 2
redundancy group 1 ip 8.13.25.123 exclusive
h323-gateway voip interface
h323-gateway voip bind srcaddr 8.13.25.123
interface GigabitEthernet0/0/2
ip address 10.1.1.1 255.255.255.0
media-type rj45
negotiation auto
!
interface GigabitEthernet0
vrf forwarding Mgmt-intf
no ip address
shutdown
negotiation auto
!
!
no ip http server
no ip http secure-server
ip rtcp report interval 9000
ip route 0.0.0.0 0.0.0.0 9.44.0.1
!
logging esm config
!
!
!
control-plane
!
!
!
dial-peer voice 10 voip
destination-pattern 140854.....
session protocol sipv2
session target ipv4:8.13.25.102
voice-class sip bind control source-interface GigabitEthernet0/0/1
voice-class sip bind media source-interface GigabitEthernet0/0/1
codec g711ulaw
no vad
!
dial-peer voice 20 voip
session protocol sipv2
session target ipv4:9.13.25.101
incoming called-number 140854.....
voice-class sip bind control source-interface GigabitEthernet0/0/0
voice-class sip bind media source-interface GigabitEthernet0/0/0
codec g711ulaw
no vad
!
!
gateway
media-inactivity-criteria all
timer receive-rtcp 5
timer receive-rtp 1200
!
!
line con 0
exec-timeout 0 0
stopbits 1
line vty 0 4
no login
!
exception data-corruption buffer truncate
end
It is recommended to use the same hardware for both boxes in the active/standby
pair to ensure compatibility before & after failover.
It is mandatory to use separate interface for redundancy. Ie. Interface used for
traffic cannot be used for HA keep-alives and checkpointing.
After failover, CUBE will continue to send and process received Options ping
message
Only media preservation is supported for H323, TCP based and Software MTP
based calls
Transcoded calls are not preserved.
Call Admission Control will continue to work after failover. After stateful
switchover, no calls will be allowed if CAC limit is reached before the switchover
took place
CDRs are sent to the Radius Server even after a switchover occurs. Thus, close
CDRs are sent by the newly ACTIVE router (which is the STANDBY router prior
to the switchover) when the call disconnects.
Only RFC2833 to RFC2833 and voice-inband to voice-inband DTMF works after
switchover
Verify
Use the CLI below to verify the Box-to-box configuration is correct and working.
Verify the redundancy state with the “show redundancy application group all” command.
This command shows the redundancy inter-device information such as the redundancy
inter-device states.
RF Domain: btob-one
RF state: ACTIVE
Peer RF state: STANDBY HOT
RG Protocol RG 1
------------------
Role: Active
Negotiation: Enabled
Priority: 100
Protocol state: Active
Ctrl Intf(s) state: Up
Active Peer: Local
Standby Peer: address 10.1.1.1, priority 100, intf Gi0/0/2
Log counters:
role change to active: 1
role change to standby: 0
disable events: rg down state 1, rg shut 0
ctrl intf events: up 1, down 2, admin_down 1
reload events: local request 0, peer request 0
RF Domain: btob-one
RF state: STANDBY HOT
Peer RF state: ACTIVE
RG Protocol RG 1
------------------
Role: Standby
Negotiation: Enabled
Priority: 100
Protocol state: Standby-hot
Ctrl Intf(s) state: Up
Active Peer: address 10.1.1.2, priority 100, intf Gi0/0/2
Standby Peer: Local
Log counters:
role change to active: 0
role change to standby: 1
disable events: rg down state 1, rg shut 0
ctrl intf events: up 1, down 2, admin_down 1
reload events: local request 0, peer request 0
The “show voice high-availability summary” command is used to verify the following:
The checkpointing of calls on the Standby router after a switchover
The media-inactivity count on the Active when the calls are over
To check for native and nonnative (i.e. preserved) calls when both types of calls
are present
To identify the presence of leaked RTP, HA, SPI sessions
-----------------------------
First a few entries in HA DB:
-----------------------------
---------------------------------------
First a few entries in Sync Pending DB:
---------------------------------------
----------------------------
-----
RF Domain: 0x2 [RG: 1]
Voice HA Client Name: VOIP RG CLIENT
Voice HA RF Client ID: 4054
Voice HA RF Client SEQ: 418
My current RF state ACTIVE (13)
Peer current RF state STANDBY HOT (8)
-----
Voice HA Active and Standby are in sync.
System has experienced switchover.
Checkpoint overflow: 0
HA DB elememnt pool overrun count: 0
HA DB aux element pool overrun count: 0
HA DB insertion failure count: 0
HA DB deletion failure count: 0
Tick event pool overrun count: 0
Tick event queue overrun count: 0
Checkpoint send failure count - ISSU Transform Failure: 0
Checkpoint send failure count - CF failed: 0
Checkpoint get buffer failure count: 0
Checkpoint Received IPC Flow ON from CF: 0
Checkpoint Received IPC Flow OFF from CF: 0
-----------------------------
First a few entries in HA DB:
-----------------------------
---------------------------------------
First a few entries in Sync Pending DB:
---------------------------------------
----------------------------
-----
RF Domain: 0x0
Voice HA Client Name: VOIP RF CLIENT
Voice HA RF Client ID: 1345
Voice HA RF Client SEQ: 128
My current RF state ACTIVE (13)
Peer current RF state DISABLED (1)
-----
RF Domain: 0x2 [RG: 1]
Voice HA Client Name: VOIP RG CLIENT
Voice HA RF Client ID: 4054
Voice HA RF Client SEQ: 418
My current RF state STANDBY HOT (8)
Peer current RF state ACTIVE (13)
-----
Voice HA Standby is not available.
System has not experienced switchover.
Checkpoint overflow: 0
HA DB elememnt pool overrun count: 0
HA DB aux element pool overrun count: 0
HA DB insertion failure count: 0
HA DB deletion failure count: 0
Tick event pool overrun count: 0
Tick event queue overrun count: 0
Checkpoint send failure count - ISSU Transform Failure: 0
Checkpoint send failure count - CF failed: 0
Checkpoint get buffer failure count: 0
Checkpoint Received IPC Flow ON from CF: 0
Checkpoint Received IPC Flow OFF from CF: 0
The “show process cpu history” command is used to verify the CPU utilization
percentage at regular intervals.
Check CPU utilization before performing a switchover and proceed with a forced failover
only when the CPU utilization is less than 70%. “show process cpu sorted” can also be
issued repeatedly to get an idea of the CPU utilization for a particular process.
Box-to-box redundancy on the ASR platform supports full stateful switchover of calls.
This means the media (RTP) and signaling information of the calls is preserved.
Follow the procedure below to force a manual switchover to check that the configuration
and operation is correct.
A switchover involves the formerly Active router reloading, while the formerly Standby
router takes over and becomes the new Active router, processing new calls and
maintaining the media streams and signaling information for calls until they are
complete. The new Active router will continue to act as the Active router until another
switchover occurs. There is no pre-emption mechanisms on the B2B Redundancy
Manual (forced) switchovers can be achieved in any one of the following ways:
Initiate it by the CLI “redundancy application reload group <RG ID> self” on the
Active router
Reload of the Active router
Power cycle the Active router
Pull out any RG configured interface of the Active router
Shutdown any RG configured interface of the Active router
Troubleshoot
This section provides information you can use to troubleshoot your configuration.
The following is a summary list of the debugs useful during troubleshooting of B2B HA:
Note: On every switchover after reload the debugs need to be enabled on the new STBY.
Note: Do not turn on a large number of debugs on a system carrying a high volume of
active call traffic.
Troubleshooting tips
1. Check for proper HA states on both the active & standby in the output of the show
commands, like “show redundancy application group”.
2. Perform incoming & outgoing ping tests with the VIPs employed.
3. In the presence of active calls, look for any use of any physical interface’s IP
address in the output of “show voip rtp connections” on both the active &
standby. VIP should be used in the show outputs and in the debugs as well
4. In the output of “show voip rtp connection | inc Found” and “show call active
voice compact | inc Total” on both the active & standby, check for any large
number of mismatched calls.
5. To debug problems, enable the corresponding debug options:
• VoIP RTP
• VoIP FPI
• VoIP HA
• SPIs (SIP, H.323, SCCPAPP, etc)