MSBI Project

Tardis – Insurance Domain

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
About Project
 Client : TORUS (UK)
 Project : TARDIS
 Domain : Healthcare/Medical
 Team Size: 10 Members
 Project Duration: Last 2 Years
 Module: Insurance Module
 Role in this Project:
◦ Created SSIS Packages for Full/Incr Loading (30 Pkgs)
◦ Worked on SQL and T-SQL (SP, Views, Functions)
◦ Created SSRS Reports (100+ Reports)
◦ Attend Meetings
◦ Documentation
◦ Coding
◦ Conduct KT Sessions
Project Description
 It is a Medical Insurance Project from UK
 Any customer can buy a medical policy thru
web or online/agents or broker / 3rd party etc
 Policy can be renewed and these policies are
bought from various locations
 Customer will get deductions when they buy a
policy
 A policy will have a limit on the insured amount
 Customer will pay premium amount for given
policy on yearly basis
Project Objectives
 Growth Rate in terms no of customers/profit
 Growth Rate for renewals for last few years
 Analyze New Customers Ratio
 Analyze Renewals Ratio
 Analyze Time to issue new policy
 Customers and their existing policies,
recommendations
 Analyze no of Claim settlements for last few years
 Analyze Claim settlements Amount for last few
years
Projects
 Retail:

 https://www.cdw.com/

 Healthcare

 http://ehryourway.com
SSIS - Loading the Data

PHASE 1 PHASE 2

OLTP Data
Staging
Server Warehouse
Client Server
Server
TARDIS
TARDIS_STAGE TARDISDW

Databases
Load the Data To Staging
Phase 1
Stage
Project Setup Steps
 1) Restore Tardis from Backup file
 2) Create database Tardis_Stage

use master
go

create database Tardis_Stage

go
Tables: OLTP to Stage
DB Tables
1. Policy
2. RevenueType
3. [Finance].[Currency]
4. TransactionType

Excel
5. PolicySection
6. PolicyCoverage
7. Premium
8. Limit
9. Deduction
Create SSIS Project
SSIS_Tardis_Stage
Tables in Tardis_Stage Database
1. Stage_Policy (1000 rows)
2. Stage_RevenueType (1 row)
3. Stage_Currency (3 rows)
4. Stage_TransactionType (1 row)
5. Stage_PolicySection (1000 rows)
6. Stage_PolicyCoverage (1000 rows)
7. Stage_Premium (1000 rows)
8. Stage_Limit (1000 rows)
9. Stage_Deduction (1000 rows)
SSIS Package Design Requirements
 To load data to Staging…
 Create 9 SSIS Packages for 9 Tables
 Package Name = Stage_LoadPolicy.dtsx

◦ Source - OLEDB Source

◦ Destination - OLEDB Destination
 Truncate and Load the data for all these
tables
 Validate row count in Source and Destination
 SSIS Logging
Customized Logging – Success
Ready Made Logging - Failure
SSIS Package Name
 Stage_LoadPolicy.dtsx
 Stage_LoadRevenueType.dtsx
 Stage_LoadCurrency.dtsx
 Stage_LoadTransactionType.dtsx

 Stage_LoadPolicySection.dtsx
 Stage_LoadPolicyCoverage.dtsx
 Stage_LoadPremium.dtsx
 Stage_LoadLimit.dtsx
 Stage_LoadDeduction.dtsx
MSBI Project
Tardis – Insurance Domain

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
SSIS - Loading the Data

PHASE 1 PHASE 2

OLTP Data
Staging
Server Warehouse
Client Server
Server
TARDIS
TARDIS_STAGE TARDISDW

Databases
Load the Data To DWH
Phase 2
Why Full Loading/Partial Loading
to Fact Table

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Perform Following
 Run DWH Script
 Run XrefData- DW Inserting Data Script

 Read ETL Mapping Document and perform

steps
Tardis – Flow Chart
Create Data Warehouse
 Using below Script
Tables in DWH
 Dimension Tables
◦ Dimension.Policy (379 Rows)
◦ Dimension.PolicySection (365 Rows)
◦ Dimension.PolicyCoverage (365 Rows)
◦ Dimension.TransactionType (1 Row)
◦ Dimension.RevenueType (2 Rows)
◦ Dimension.Currency (3 Rows)
◦ Dimension.Date (7671 Rows)

 Fact Tables
◦ Fact.Premium (366 Rows)
◦ Fact.Limit (365 Rows)
◦ Fact.Deduction (365 Rows)
Tables in DWH
 Reference Table
◦ AssuredXRef
◦ BranchXRef
◦ BrokerXRef
◦ CompanyXRef
◦ ProductXRef
◦ SectionTypeXRef
◦ StatusXRef
◦ UnderwriterXRef
Dimension.Policy
 In this table PK column is PolicyID
 It is also Identity column
 That means, no data can come from source to

this column

 In this table,
 Consider MasterNumber, MasterSeq as

Business Key
Dim Policy
ETL Mapping
Dim Policy
ETL Mapping
Dim Policy
ETL Mapping

 DepartmentID to 1

 Take Derived Column Transformation

 Make DepartmentID = 1
Tardis Project
MSBI Project

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
SSIS - Loading the Data

PHASE 1 PHASE 2

OLTP Data
Staging
Server Warehouse
Client Server
Server
TARDIS
TARDIS_STAGE TARDISDW

Databases
Challenges
 Fact Tables
◦ OriginalCurrencyID
◦ SettlementCurrencyID
 Time Table Issue
Dim Time
 Run below script
Tardis Project
Data Warehouse Architecture

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Questions on DWH…?
 What is the schema of DWH…?
◦ Star Schema
◦ Snowflake Schema
 Relationship between Dim n Fact Table?
 How do you load the data to DWH…?
◦ First, Load the data into Dim Table
◦ Then Load the data into Fact Table
Tardis – Flow Chart
Tardis Project
Incr Loading

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Design Patterns for Incr Loading
 Load the Data to DWH
◦ Pattern1: Using Lookup
◦ Pattern2: Using SCD
◦ Pattern3: Using Stored Procedures
◦ Pattern4: Using Merge Command (SQL DEV)

 Note: Above patterns are used to perform

incremental/delta loading
Update OLTP Tardis to Check
Incremental Loading with SCD
--Update in OLTP
Update Policy
SET Domicile = 'AAA'
WHERE MasterSeq=001 and
MasterNumber='Q05WMX'

--Read from OLTP

SELECT Domicile , *
FROM Policy
WHERE MasterSeq=001 and
MasterNumber='Q05WMX'
SSIS Package Design Requirements
 To load data to DWH…
 Create 9 SSIS Packages for 9 Tables
 Package Name = DWH_LoadPolicy.dtsx

◦ Source - OLEDB Source

◦ Destination - OLEDB Destination
 Use Mapping Document
 Perform Incremental Loading
 Validate row count in Source and Destination
Check The Below Column Value
 Column Name: SourceSystemID
 This Column value should be 5 in

Dimension.Policy and Fact.Premium

 Should not be -1
Insert Row in AssuredXRef
Fill gaps in Identity cols
 SET IDENTITY_INSERT DimEmp ON;
 GO

 -- Try to insert an explicit ID value of 3.

 INSERT INTO DimEmp (ID, Name, Salary)

VALUES (3, 'John', 2000);

 GO
Insert in CompanyXRef
 Error:
 Microsoft SQL Server Native Client 11.0" 

Hresult: 0x80004005  Description:

"The INSERT statement conflicted with the
FOREIGN KEY constraint
"FK_Policy_Company".
The conflict occurred in database
"TARDIS_DW", table "dbo.CompanyXRef",
column 'CompanyID'.
Policy Table Contains
 Policy Details
 Broker
 Renewal Details
 Locations

◦ Branch
◦ Area
Facts
 Premium
 Limit
 Deductions
CR – Change Request
 Load Unmatched data to Dimension tables
Issue: Not Able to Load Data in
Fact.Premium
 Fact.Premium is referring Dimension.Time for its
values
 Dimension.Time does not have data
 Hence the error while loading data in
Fact.Premium

 Run below script to resolve issues

 Drop Existing FK between Dimension.Time to
Fact.Premium
 Make FK between in Dimension.Date and
Fact.Premium (TimeID Column)
MSBI Project
Create Cube for Tardis Project

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Create Cube - Steps
1. Create SSAS Project
2. Create Data Source
3. Create Data Source View
4. Build Dimensions
5. Build Cube
6. Create Calculations
7. Deploy the Cube
8. Test the Cube – Excel/Browser
9. Create SSRS Reports using MDX Queries
Reports with MDX
 Brach Wise Revenue (Premium amount)
 Brach Wise, Year Wise Revenue (Premium

amount)
 Area wise, Brach Wise, Year Wise Revenue

(Premium amount)
 Year wise, No of policies Renewed
 Year wise, No of policies not Renewed
 Branch wise, No of policies Renewed
 Branch wise, No of policies not Renewed
Reports
 TOP 5 Brokers, based on Revenue (Premium
Amount) across Branches/Area
 TOP 5 Policy Names based on Revenue

(Premium Amount)
 Branch wise Revenue and Deductions for

current period and last period

 Year wise Revenue and Deductions for current

period and last period

 Bottom 5 Branches where the Revenue

(Premium Amount) is low

MSBI Project
Tardis – Insurance Domain

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
MSBI Project
Tardis – Insurance Domain

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Issues
 Issue:
◦ Not able to load data to SSIS 2012, using .xlsx files
 Solution:
◦ Save as xls file and chose Excel 97 to 2003 workbook option
 Issue
◦ Sheet Names contains special characters
◦ Eg: Sheet Name  Deduction’s
 Solution:
◦ Remove the special Character
 Issue:
◦ Date format is reversed when loading data from Excel Files to stage
 Solution:
◦ Go to Excel  Right Click On Date Column  Format Cells  Choose
Custom  Choose mm/dd/yyyy format
Issues
 Issue:
◦ Cannot load data from excel 2007 of 32 bit version
using SSIS 2012
 Solution:
◦ Go to SSIS Project  Go to Solution Explorer 
Right Click on the Project  Expand Configuration
and Properties  Click on Debugging
Set Run 64 Bit Run Time = FALSE
ETL Requirements
 Load the data from OLTP to DWH as per
Mapping Document
 Implement Logging for the package
 Row Count needs to be captured during the

ETL
MSBI Project
Healthcare (Insurance Module)

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Project Deployment

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Dev Tasks
 DEV need to check in the code – VSTF
 Testing will done by Testers
 Download and install the code in PROD

◦ DWH and Xref Tables are ready

◦ Dimension.Date table is also ready
◦ Deploy all SSIS Package

◦ Note: Deployment Guide to be provided by DEV.

Deliverables as DEV
 Document Requirements (Functional Spec Doc)
 Document Design (Tech Spec Docs)
 Code - Create the packages
 Testing - Perform the unit testing
 Deploy – Build and Deploy package, monitor

jobs
 Schedule the Package
 Create doc on Troubleshooting steps
 Document on Deployment – Deploy Guide
 Project Explanation
Interview Questions
Interview Questions
 Tell me about yourself
 After my graduation, I got job in Infosys
 I have total 3.6 yrs of exp (SQL – 2 Yrs, SSIS 2 Yrs, SSRS 1.5 Yrs)
 Then onwards, I started working in SQL Server with MSBI (SSIS,
SSRS, SSAS – Basics)
 I am strong in SQL Server – Queries, Views, SP, Functions,
Ranking Functions etc (My rating is 7/10)
 I am also strong in SSIS – Create, Deploy, Debug the packages,
used Full Loading/Incr Loading of data, strong exp in Lookup,
Data Conversion, Containers, Conditional Split etc (My rating is
7/10)
 Also good knowledge in Data Warehouse – Dims/Facts,
Schemas etc.
Interview Questions
 I am also Good in SSRS – Created 1000 Plus
reports in last 2 years
 Such as Drill Down, Drill Thru, Parameter,

Cascade, Sub Reports, Gauge, Indicator etc

 Good Knowledge on Report Deployment

Subscriptions, Linked Reports, Report Security,

Cache/Snapshots of Reports, Report Server
Conjurations etc
 Created Reports using OLTP, DWH, MDX Queries
 My Rating is 8/10
Tell me about Your Project
Issues in the Project
Daily Tasks in Company
 Replying Mails
 Attending Meetings with Team Lead/Clients
 Coding
 Documentation
 Helping Others in Team
 Send status Reports my Team Lead
 Filling Timesheet
Why are you looking for change?
Thanks for your
time.
MSBI Project
Review on Deployment Guide

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
MSBI Project

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
3. Question
 Tell
me the challenges faced in
your project
4. Question
 Tell
me one SSIS Package which
you created, from starting to end
5. Question
 What type of data you have it
◦ Financial Data
◦ Loans Data
◦ Loan EMI Data
◦ Score Data
◦ Claims Data
◦ Defaulters Data
◦ Cheque Bouncing Data
Thanks for your
time.
Thanks for your
time.
1. Question
Tell me about yourself
Years of Exp
 I have 3.5 Years of exp in SQL, SSIS, SSAS,
SSRS
 SQL Server – 3.5 Years - 8/10
 SSIS – 3.0 Years - 8/10
 SSRS – 3.0 Years - 7/10
 SSAS – 1.0 Years - 2/10
2. Question
 Tell me about your project
3. Question
 Tell
me the challenges faced in
your project
4. Question
 Tell
me one SSIS Package which
you created, from starting to end
5. Question
 What type of data you have it
◦ Financial Data
◦ Loans Data
◦ Loan EMI Data
◦ Score Data
◦ Claims Data
◦ Defaulters Data
◦ Cheque Bouncing Data
MSBI Project
University (Education Module)

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942
Incremental Loading
Using Lookup
Using SCD
Using Stored Procedures
Using Merge Statement in SQL
MSBI Project
University (Education Module)

www.GoOnlineTrainings.com
Mr. Bhaskar Jogi
[email protected]
[email protected]
+91 90000-75637
+91 96421-43942