Omni-Q System Architecture

Golan Elmadvi
Professional Technical Services

confidential
 Lesson Objectives
By the end of this session you will be able to:

 Describe the Omni-Q system concept and

architecture
 Explain each unit’s role and function
 Better understand the system interfaces

2 04/05/20 Confidential
 Agenda

 High Level System Architecture

 Detailed System Architecture
 System Management Components and Interfaces
• QConsole, QExpert
 Distributed Omni-Q system and models
 Omni-Q Probes
• Non Intrusive R70 Probes
• Non Intrusive CN Probe (SS7)

3 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
4 04/05/20 Confidential
 R70 Software Architecture: Processes

Core Process Storage Write Probe Mgmt. Storage Clean

(hpacoreproc) (hpastoragewrite) (hpamgmt) (hpastorageclean)

Host Server
(hpahostsrvr)

SS7 Decoder SIP Decoder MGCP Decoder Megaco Decoder

(hpass7decoder) (hpasipdecoder) (hpamgcpdecoder) (hpamegacodecoder)

R70
Packet Router
(hpapacketrouter) Host Server

Line Status HW Config R70 Probe

(hpalinestatus) (hpahwconfig)

5 04/05/20 Confidential
 R70 Software Architecture: Host Processes
 Core Process (hpacoreproc)
• Start all the processes
• Run the watchdog
• Run the relaunch process
 Host Server (hpahostsrvr) –
• The only process which communicates with both the probe and
the QManager
• Sends configuration information received locally or from the
QManager to the probe
• Receives the EDR from the probe
• Encapsulates the EDR to CDR
• Sends the CDR to the database

6 04/05/20 Confidential
 R70 Software Architecture: Host Processes (2)

 Storage Write (hpastoragewrite)

• Receives signaling information from the probe
• Writes the file to the desired location (local, network and in the
future to FTP)
 Storage Clean (hpastorageclean)
• Receives from QConsole user configuration of time to save the
files
• Its only purpose is to delete the files at the end of the configured
period

7 04/05/20 Confidential
 R70 Software Architecture: Probe Processes

 Core Process (hpacoreproc)

• Starts all the processes
• Runs the watchdog
• Runs the relaunch process
 HW Config (hpahwconfig)
• Receives the physical configuration from the host
 Line Status (hpalinestatus)
• Displays the status of the physical line: packet received, CRC
error, etc.
• Displays the status of the RTP received, decoded and sent
(CLS & SPR)

8 04/05/20 Confidential
 R70 Software Architecture: Probe Processes
 Packet Router (hpapacketrouter)
• Receives all the packets and sends each packet to the
appropriate decoder

 Protocol Decoders – SIP, MGCP, MEGACO, SS7

• Receive packets from packet router and decode them
• Combine all relevant packets into one session
• Send results to the probe management
 Probe Management (hpamgmt)
• Receives session summaries from the decoders
• Sends them to the host server process

9 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
10 04/05/20 Confidential
 QRouter Module
 Receives the CDRs from the probes
 Route CDRs to the proper thread into Omniq++
 The CDRs are processed FIFO
 Passes the CDRs to the Omni-Q++ or to the
QManager
 In case of heavy traffic, it saves the CDRs to the
RAM and to the disk Open Calls
ReRo
Probes uterin Merge TCAP Correlation
g
CDRs Merge ISUP
QRouter Merge
CAMEL

11 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
12 04/05/20 Confidential
 Correlation Module (Omni-Q++)
 Executing the Correlation and Merge
 Correlate according to rules (flexible)
 Includes separate threads
 Each thread can be executed separately
 Each thread can be executed on a different machine
Omni-Q Unifier
Correlation Open Calls Record QManager
Correlation
Manager
Merge
Merge

QRouter Probes

13 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
14 04/05/20 Confidential
 QManager module

Users

QConsole
QManager
Sys. Config.
Alarms Correlation Probe Mngt. Enrichment

cDR
Database

OmniQ++

15 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
16 04/05/20 Confidential
 QManager Engines – Why?
 Bottleneck: CDR processing
 Solution: Split processing for load balancing

QManagerEngine

QManagerEngine
JDBC
CDRs
QManager JDBC
QManagerEngine DB

QManagerEngine

17 04/05/20 Confidential
 QManager engines
 Two working mode:
• Write directly to DB
• Write files (CSV) according to type
• Checking time accuracy
• Correlation
QManagerEngine

QManagerEngine

CDRs QManagerEngine
File
QManager System
QManagerEngine

DB
QLoader
18 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
19 04/05/20 Confidential
 QLoader – Why?
 Bottleneck: Saving CDRs to DB
 Solution: QLoader
• Use advance saving method - SQL Loader
• Peak Blaster
• Improve stability – in case of failure while writing to
DB, keep the “bad” CDRs
File
QManagerEngine
System
QManagerEngine
CDRs
QManagerEngine
QManager
QManagerEngine DB
QLoader
20 04/05/20 Confidential
 QLoader Module
 QManager side:
• QManager/Engines open new file per CDR type per
DB partition and save to file system with .tmp suffix
• After X CDRs/time interval close the file and change
the suffix to .cdr
 QLoader side:
• Read .cdr files – change suffix to .loading
• Load all files to DB, in case of fail change to .bad.

21 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
22 04/05/20 Confidential
 Data Base
 Contains the following tables:
CDR_XXX – contains detailed CDRs sent by the probe
The structure of CDR_ tables is derived from cdrs.xml
AGG_XXX – aggregation tables based on CDR data.
Aggregation granularity: 5 min, 15 min, 1 hour, 1 day and week

File
QManagerEngine
System
QManagerEngine
CDRs
QManagerEngine
QManager
QManagerEngine DB
QLoader
23 04/05/20 Confidential
 Data Base – Cont’
 CDR_XXX
- CDR_TYPE (According to protocol)
- Partition section
• Partitioning key is the START_TIME column.
• Default range = one hour (each partition holds data
for 1 hour)
• Partitions naming convention:
PART_YYYYMMDDHH00_YYYYMMDDHH00
• For example PART_201101090800_201101090900
 Example:
Diameter protocol will be saved
within cdr_hpa_diameter table
24 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
25 04/05/20 Confidential
 Daemon Module
 House Keeping – cleaning the DB according to
user’s maintenance rules.
 Aggregation - Aggregate CDRs tables

26 04/05/20 Confidential
 The OmniQ Browser QTrace

Architecture
Client

Reports engine + reports BI QTrace Server

Cognos/QEP

Aggregations, Partitions,
Daemon DB
Maintenance QTraceDB TimesTen
(in memory DB)
Import files concurrently into the QLoader
DB
CSV
CSV
CSV
Write concurrently to csv Engine Engine Engine
files
Modify the data by custom
QManager QConsole
actions, generate alarms,
control the probes

Correlate sessions into complete Correlation (Omniq++)

calls
Omniq++
Web Monitor
Collect CDR packets from all the
QRouter
probes and divide by protocols

LAN / WAN Probe

LAN / WAN Web Monitor

CDRs
Collect signaling + RTP and Data VOIP SS7
create session records (CDRs) Probe Probe Probe

RNC SGSN GGSN GGSN MGW MGW

Customer
Core
Network
MGW MGCF SBC
27 04/05/20 Confidential
 QTrace building structures

QTrace
Client

Database

QManager QTrace
server
QTraceDB

OmniQ++

TimeTen

28 04/05/20 Confidential
 QTrace components
 TimeTen – holds the given CDRs in memory DB
• Has two instants each one size is 1 Giga
• QTrace sends SQL query into these instants and
search accordantly
 QTrace DB – Ensure that both instants will work
in parallel
• Delete older info from instants
• Read from DB (CDR.xml and fields.xml) and create
tables in TimeTen accordantly

29 04/05/20 Confidential
 Additional Modules
 CogBridge - Read from DB: Configuration and
synch to the QExpert (Cognos)
 JBoss – Java Application Server, Ensure
connection to: Login and main page, QConsole
 QExpert (Cognos) – Report tool

30 04/05/20 Confidential
 Scalability
 Changes in technology are causing a constant increase in
monitored traffic, creating the need for constant evolution of
the monitoring product
 Scalability issues are mostly experienced in the data
monitoring
 Omni-Q is now able to “grow with the load”

31 04/05/20 Confidential
 Omni-Q Architecture – Scalability
 Bottleneck: QManager traffic load
 Solution: Multi QManager Listeners
• QManager can instantiate more than one listener.
• Each listener can redirect the incoming traffic to
some of the engines.

QManager

CDRs QManagerEngine
Listener
QManagerEngine
Listener
CDRs
Listener QManagerEngine

QManagerEngine

32 04/05/20 Confidential
 Omni-Q Architecture – Scalability
 Bottleneck: Oracle cannot handle CDR Rate
 Solution: Multi DataBase servers
• DB can instantiate more than one QLoader.
• On each DB server there is QLoader that write the
incoming traffic to his DB.
Oracle
QManager
QLoader
CDRs Oracle
Listener
Listener QLoader
CDRs
Listener Oracle
QLoader

33 04/05/20 Confidential
 Omni-Q System: Fully Scalable

QManager
Probes
Probes Omni-Q++
Probes Engines

Problem:
Engines cannot
handle the load

Oracle
Cognos XDRs Storage

34 04/05/20 Confidential
 Omni-Q System: Fully Scalable

QManager Engine
Probes
Probes Omni-Q++ Engine
Probes
Engine

Problem:
Engines cannot
handle the load
Solution:
distribute Engines
to other servers

Oracle
Cognos XDRs Storage

35 04/05/20 Confidential
 Omni-Q System: Fully Scalable

QManager Engine
Probes
Probes Omni-Q++ Engine
Probes
Engine

Problem: Problem:
Engines cannot QManager Listener
handle the load Bottleneck
Solution:
distribute Engines
to other servers

Oracle
Cognos XDRs Storage

36 04/05/20 Confidential
 Omni-Q System: Fully Scalable

QManager Engine
Probes
Probes Omni-Q++ Engine
Probes Listeners Engine

Problem: Problem:
Engines cannot QManager Listener
handle the load Bottleneck
Solution: Solution:
distribute Engines allow multiple
to other servers listener processes

Oracle
Cognos XDRs Storage

37 04/05/20 Confidential
 Omni-Q System: Fully Scalable

QManager Engine
Probes
Probes Omni-Q++ Engine
Probes Listeners Engine

Problem: Problem: Problem:

Engines cannot QManager Listener Oracle Cannot
handle the load Bottleneck handle CDR Rate
Solution: Solution:
distribute Engines allow multiple
to other servers listener processes

Oracle
Cognos XDRs Storage

38 04/05/20 Confidential
 Omni-Q System: Fully Scalable

QManager Engine
Probes
Probes Omni-Q++ Engine
Probes Listeners Engine

Problem: Problem: Problem:

Engines cannot QManager Listener Oracle Cannot
handle the load Bottleneck handle CDR Rate
Solution: Solution: Solution:
distribute Engines allow multiple support multiple
to other servers listener processes database servers

Cognos Oracle
XDRs XDRs XDRs

39 04/05/20 Confidential
 Omni-Q Scalability
 Several processes - several machines
 Unlimited Scalability.
Probes

Internal IP
QManager &
QM Engines Omni-Q++
Internal IP

CDRs
Oracle Storage

Cognos

40 04/05/20 Confidential
 QConsole
QExpert

System Management
Components and Interfaces

confidential
 Management Tools
QConsole
 Remote user, PC-based GUI module provides
remote access from any desktop to the
QManager server
 Allows the connection of multiple users to the
QManager at one time
 Configures the probes and tests
 Enables DB maintenance and
backups

42 04/05/20 Confidential
 Reporting Tool - QExpert
 Report generation and analysis module
 Web-based GUI
 Supports multiple users

43 04/05/20 Confidential
Omni-Q Probes

confidential
 Monitoring Methodologies Using Probes
 Non-intrusive: on real communication without reference
signal; better for the supervision of QoS inside networks
 End-to-end intrusive: on test calls with reference
signal, better fitted for the measurement of quality as
perceived by end users
INMD IP-Phone
vProbe
H.323
v Terminal
cProbe
IP v iProbe
PSTN
cProbe
iProbe
Telephone
cProbe

45 04/05/20 Confidential
 cProbe Description (Intrusive)
 cProbe: Circuit-switched Active Probe
• Generates test calls using PSTN interfaces
• Interfaces Supported:
­ Analog ports (FXO)
­ ISDN PRI (E1/T1)
­ ISDN BRI
­ SS#7
• Measurements include:
­ Post Dialing Delay, Post Gateway Answer Delay
­ PESQ Voice Quality
­ Background Noise
­ Round Trip Delay
­ Echo Attenuation and Delay
­ DTMF Integrity
­ Fax Measurements

46 04/05/20 Confidential
 iProbe Description (Intrusive)
 iProbe – Packet-switched Active Probe
• Generates test calls using VoIP interfaces
• Interfaces supported:
­ H.323/SIP
• Measurements include:
­ Call Setup Time
­ PESQ Voice Quality
­ Background Noise
­ Number of Packets
­ Jitter
­ Packet Loss, Packet Loss Bursts

47 04/05/20 Confidential
 Unified Probe Platform
 R70S platform to support all technologies
• UMTS
• VoIP & IMS
• LTE - New
• CDMA2000 - New
• GPRS & GSM – - New
 Enhanced LIM support
• 10G – Coming soon
• E1 with ATM - New
• E1 with HDLC
• STM1
• Channelized STM1 - Coming Soon…

48 04/05/20 Confidential
 R70 Probe Description
 R70S VoIP Probe: Packet-switched Passive Probe
• In-service Non-intrusive Measurement Device (INMD)
• Monitors live traffic
• Protocols supported:
­ SIP / MGCP / MEGACO (H.248)/Diameter, DNS, ENUM.
­ 10/100/1000 links
• Live Traffic measurements include:
­ Setup Times
­ Jitter
­ Packet Loss, Packet Loss Bursts
­ Passive MOS

49 04/05/20 Confidential
 R70S SS7 Probe (Non-Intrusive)

 Non-intrusive SS7 monitoring probe
• In-service Non-intrusive Measurement Device (INMD)
• Monitors live traffic
• Interfaces supported:
­ ISUP over TDM (T1/E1)
­ ISUP over IP
– M2UA, M3UA
­ ISDN over IP
– IUA
• Measurements
­ Set up time
­ Attributes (Calling, Called)
­ Termination cause

50 04/05/20 Confidential
 R70S Data Probe (Gn-Gi)
 Gn – interface between SGSN and GGSN
 Gi – user plane over Gn
• Between RNC and GGSN for direct tunneling

 Gn control and Gi user plane

 Gi-Gn correlation
• Gn parameters written to Gi CDR
• Performed by probe

 For UMTS and GPRS

51 04/05/20 Confidential
 The Applications Sphere

Omni-Q

52 04/05/20 Confidential
 Summary
The Omni-Q solution allows multiple and diverse users, including
NOC, engineering, customer support and management, to meet all
their needs with a single system.

The Omni-Q system is comprised of:

Probes, QRouter, OmniQ++, QManager, QManager engines,
QLoader, QTrace (TimeTen, QTraceDB, QTrace server).
 Additional Modules
• Daemon, JBoss, CogBridge.
Management components
• Administration and Configuration by QConsole app.
• QExpert, a Web-based report generator

 Probe elements
• Passive/Non-intrusive probe:
­ R70S VoIPProbe – Packet-switch probe
­ R70S SS7 Probe – Packet –switch probe&E1/T1

53 04/05/20 Confidential
 Summary – Cont.
• R70S – Support all technologies
• Applications
­ QMyNetwork
­ QRoam
­ QTrace
­ QAlarm
­ And More…

54 04/05/20 Confidential