Using MySQL for Distributed Database

Architectures

Peter Zaitsev
CEO, Percona
Percona Technical Webinars
July 31, 2018

© 2018 Percona.
1
Presentation

Cover Basics

Why Going Distributed

How to do it
© 2018 Percona.
2
Distributed ?

MySQL Deployment on More

than one System

© 2018 Percona.
3
Modern MySQL Scalability

© 2018 Percona.
4
Even more Modern MySQL Scalability

© 2018 Percona.
5
Single MySQL Instance Can Do
Hundreds of Thousands of Queries/Sec

Tends of Thousands of Updates/Sec

Traverse Tens of Millions of Rows/Sec

Comfortably Handle Several TB Database size

© 2018 Percona.
6
Lets Do Some Math
100.000 QPS

10 Queries per User Interaction

10.000 User Interactions/sec

864.000.000 User Interactions/Day

30 User Interactions/User Avg

28.000.000 Daily Active Users Possible

15M of Daily Active Users counting time of day skew

© 2018 Percona.
7
Distributed Systems Tend To be
More Complicated to Develop Against

More Complicated to Operate

Have Additional Performance Bottlenecks

Have Complicated Failure Modes

© 2018 Percona.
8
With All of this ?

Why “Go Distributed” ?

© 2018 Percona.
9
Reasons to “Go Distributed”

High Data
Scalability
Availability Distribution

© 2018 Percona.
10
High Availability with MySQL

Cold Standby (ie DRBD)

Failover (Classical Replication)

Active-Active Clustering (PXC, MySQL Group Replication)

© 2018 Percona.
11
Q1:What Failure Modes Do you Consider ?
Server Crash/Server Hardware Failure

Software Bugs and Storage Corruption

Network Failure

“Datacenter” Failure

Developer Mistakes/Intruder Actions

© 2018 Percona.
12
Q2:What Data Am I allowed to lose ?

Limited Data Loss Allowed

No Data Loss

No Transactions In Flight Loss

© 2018 Percona.
13
Q3:How Quickly do you need to Recover ?
“Immediate?”

“Seconds?”

“Minutes?”

“Hours?”
© 2018 Percona.
14
Speed of Light Realities

Data •Synchronous – Slow

Propagation •Asynchronous –
Can Be Data Loss Can Occur
© 2018 Percona.
15
Scalability

Scaling Scaling Scaling

Reads Writes Data Size

© 2018 Percona.
16
Data Distribution

Some Data
Must be in •User Latency Reasons
Specific •Legal and Compliance
Geographic Reasons
Location
© 2018 Percona.
17
Distributed Architectures with MySQL

© 2018 Percona.
18
Main Concepts
Replication

Sharding

Failover Management

Traffic Management
© 2018 Percona.
19
Replication

Having Multiple Copies of the

data, updated with changes

© 2018 Percona.
20
Availability

Service Stays up when

component fails

© 2018 Percona.
21
Availability via Redundancy

Have more than one system

Works well for stateless systems

Is not enough for databases

© 2018 Percona.
22
Availability via Replication

Redundant Paired with

Computing Replicated
Resource Data
© 2018 Percona.
23
Where Replication Happens

Storage Level

Database Level

Application Level
© 2018 Percona.
24
Storage Level Replication

Replication in SAN/NAS, DRBD

Typically provides cold standby

Simple choice which works with many systems

Amazon Aurora – Smart Storage

© 2018 Percona.
25
Database level

Most Flexible

Most Common

Hot/Warm Spare

Some can do Active-Active

© 2018 Percona.
26
Application Level
Hard to get right

Rarely used, especially “used right”

Partial Replication/Syncronization

Smart conflict resolution

Cross Vendor Redundancy

© 2018 Percona.
27
Sharding

Split data set by certain criteria

and store such “shards” on
separate “clusters”
© 2018 Percona.
28
Typical Sharding

By User

By Customer Account/Company
© 2018 Percona.
29
Sharding and Replication

Sharding Almost Always

used with some kind of
Replication
© 2018 Percona.
30
Failover Management

Many Replication Modes Require “Failover”

Need some Tool To Decide on Failover

Need some Tool to Perform Failover

© 2018 Percona.
31
Traffic Management
Scaling with Large Number of Connections

Routing Traffic to Right “Shard”

Read-Write Splitting

Load Management

Avoiding “Dead” Nodes

© 2018 Percona.
32
Options in MySQL

© 2018 Percona.
33
Replication Options in MySQL
Classical MySQL Replication

MySQL Group Replication

Percona XtraDB Cluster and Galera

MySQL (NDB) Cluster

© 2018 Percona.
34
Classical MySQL Replication

© 2018 Percona.
35
Classical MySQL Replication Properties
Asynchronous or Semi-Synchronous

Parallel (since MySQL 5.7)

Many Masters to Many Slaves (MySQL 5.7)

No Conflict Resolution or “Protection”

No Built-in Failover
© 2018 Percona.
36
Advanced MySQL Replication Topologies

© 2018 Percona.
37
PMM Dashboard for Replication

© 2018 Percona.
38
MySQL Group Replication

© 2018 Percona.
39
MySQL Group Replication (New in 5.7)
“Group of Peers”

Write-Anywhere or Dedicated Writer

Asynchronous Replication with Flow Control

Conflicts Prevented through Certification

Built in Failover

No Automated Provisioning
© 2018 Percona.
40
Percona XtraDB Cluster/Galera

© 2018 Percona.
41
Percona XtraDB Cluster Topology

© 2018 Percona.
42
PXC/Galera Properties
Write to Any Node

Certification Based Replication

Virtually Synchronous; Can ensure no stale reads

Built in Fail-Over

Built-in Node Provisioning

© 2018 Percona.
43
Transaction Commit Flow

© 2018 Percona.
44
PXC 5.7 Performance Improvements
http://bit.ly/2qGCr0T and http://bit.ly/2pzvAIW

© 2018 Percona.
45
PMM Dashboard for PXC

© 2018 Percona.
46
MySQL Cluster

Mostly In Memory Storage

Synchronous Replication

Pessimistic Locking

Conflict Detection with Async Replication

Niche Use Only

© 2018 Percona.
47
Sharding in MySQL

Typically Painful or Very Painful

No Built-In or Standard Solution

Many Custom App-Layer Implementation Exists

© 2018 Percona.
48
Thinking about Sharding

Query Routing to the right Shard

Data Aggregation for Cross-Shard Queries

Shard Balancing
© 2018 Percona.
49
Vitess
Stated by team in YouTube

Now Open Source in CNCF

Deployed at Slack

Supports MySQL Protocol

Supports Cross Shard Queries

Supports Re-Sharding
© 2018 Percona.
50
Vitess Architecture

© 2018 Percona.
51
Failover in MySQL

MHA

MySQL Failover

Orchestrator
© 2018 Percona.
52
Orchestrator Screenshot

© 2018 Percona.
53
Traffic Management Solutions
DNS • Not Immediate, Does not handle existing connections

HAProxy • TCP/IP Port level. Does not understand MySQL Protocol

Elastic Load Balancer (etc) • Like HA Proxy in the Cloud

MySQL Router • Currently very basic

MaxScale, ScaleArc • Proprietary Solutions

ProxySQL • MySQL Protocol Aware 100% Open Source Proxy Solution for MySQL

© 2018 Percona.
54
ProxySQL
• 100% OpenSource
• Well Supported
• Read-Write Splitting
• Caching
• Query Rewrites
• Load Balancing
• 10k+ Connection Support

© 2018 Percona.
55
 Dedicated shared ProxySQL 5
6

application server 1 application server 2 application server 3

ProxySQL

PXC node 1 PXC node 2 PXC node 3

© 2018 Percona.
56
 ProxySQL on application side 5
7

application server 1 application server 2 application server 3

ProxySQL ProxySQL ProxySQL

PXC node 1 PXC node 2 PXC node 3

© 2018 Percona.
57
ProxySQL at PMM

© 2018 Percona.
58
Cloud Only Options

DBaaS in
•Amazon RDS
the cloud
•Amazon Aurora
comes with
•Google Cloud SQL
built-in HA •Azure Database for MySQL
Options
© 2018 Percona.
59
Beyond MySQL

© 2018 Percona.
60
MySQL is a Part of your Data Infrastructure

MySQL is Good for Many

Things but MySQL is not
Good for Everything
© 2018 Percona.
61
MySQL can be used together with

Full Text Queue/Stream Analytics at

Caching
Search Processing Scale
• Redis, • Elastic, Solr • Kafka • Hadoop,
Memcache Clickhouse

© 2018 Percona.
62
Cross Technology Replication
Trigger Based • SymmetricDS, Self-Made Solution
Replication Tools

Kafka Gateway • Debezium, Yelp’s MySQLStreamer

Tungsten Replicator • Replication from MySQL to Variety Data Stores

Custom Binary Log • MySQL to Tarantool Replication

Consumers • MySQL to ClickHouse Replication

© 2018 Percona.
63
Summary

Lots of Options Exist for Building

Distributed Architectures with MySQL

Lots of Option for Integrating MySQL

with other Open Source Data Stores
© 2018 Percona.
64
 November 5-7th, 2018
Call for Papers Open! Get Your Tickets for Percona
Connect. Accelerate. Innovate. Live Europe!
● We’re delighted to be in Frankfurt this year! A
● MySQL, MongoDB, PostgreSQL & other Open Source vibrant city, in a central location with many direct
Databases flights makes it easy for you to get here!
● Security, Open Source Databases, Serverless, Cloud ● Percona Live Europe 2018 includes a new
or On Premise business track that covers the best ideas for how
● High Availability, Scalability open source databases and database
● Business Goals, Case Studies, What the Future Holds technologies can address and solve business
● Radisson Blu Hotel, Frankfurt, Germany issues such as application time-to-market,
resource costs, OPEX and CAPEX expenses, etc.
Submit Your Proposal by August 10th! Super Saver Tickets Available Until
August 19th!
Prices Increase on the 20th!

© 2018 Percona.
65
www.percona.com/live/e18/
Thank You!

© 2018 Percona.
66