D-Paxos: Building Hierarchical Replicated State Machine for Cloud Environments

Fagui LIU
Yingyi YANG

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E99-D    No.6    pp.1485-1501
Publication Date: 2016/06/01
Publicized: 2016/03/22
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2016EDP7036
Type of Manuscript: PAPER
Category: Fundamentals of Information Systems
Keyword: 
replication,  replicated state machine,  consensus protocol,  batching,  logical pipelining,  

Full Text: PDF(934.7KB)>>
Buy this Article



Summary: 
We present a hierarchical replicated state machine (H-RSM) and its corresponding consensus protocol D-Paxos for replication across multiple data centers in the cloud. Our H-RSM is based on the idea of parallel processing and aims to improve resource utilization. We detail D-Paxos and theoretically prove that D-Paxos implements an H-RSM. With batching and logical pipelining, D-Paxos efficiently utilizes the idle time caused by high-latency message transmission in a wide-area network and available bandwidth in a local-area network. Experiments show that D-Paxos provides higher throughput and better scalability than other Paxos variants for replication across multiple data centers. To predict the optimal batch sizes when D-Paxos reaches its maximum throughput, an analytical model is developed theoretically and validated experimentally.


open access publishing via