Admission Control with Response Time Objectives for Low-latency Online Data Systems

H Xu, JA Colmenares - arXiv preprint arXiv:2312.15123, 2023 - arxiv.org
To provide quick responses to users, Internet companies rely on online data systems able to
answer queries in milliseconds. These systems employ complementary overload
management techniques to ensure they provide a continued, acceptable service through-out
traffic surges, where'acceptable'partly means that serviced queries meet or track closely their
response time objectives. Thus, in this paper we present Bouncer, an admission control
policy aimed to keep admitted queries under or near their service level objectives (SLOs) on …

Bouncer: Admission Control with Response Time Objectives for Low-latency Online Data Systems

H Xu, JA Colmenares - … of the 2024 International Conference on …, 2024 - dl.acm.org
Internet companies rely on low-latency online data systems to provide quick responses to
users. These systems employ complementary overload management techniques to offer a
continued, acceptable service throughout traffic surges, where" acceptable" partly means
that serviced queries meet or track closely their response time objectives. Thus, in this paper
we present Bouncer, an admission control policy aimed to keep admitted queries under or
near their service level objectives (SLOs) on percentile response times. Bouncer decides to …
Showing the best results for this search. See all results