Scaling Up The Performance of Distributed Key-Value Stores With In-Switch Coordination [conference paper]

Three computers with locks in a circle illustration

Conference

29th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS) - November 3-5, 2021

Authors

Hebatalla Eldakiky (Ph.D. 2021), David Hung-Chang Du (professor)

Abstract

The power and flexibility of software-defined networks lead to a programmable network infrastructure in which in-network computation can help accelerating the performance of applications. This can be achieved by offloading some computational tasks to the network. In this paper, we propose TurboKV, an efficient distributed key-value store architecture that utilizes programmable switches as: 1) partition management nodes to store the key-value store partitions and replicas information; and 2) monitoring stations to measure and balance the load among storage nodes. We also propose a key-based routing protocol to route the queries of clients based on the requested keys to targeted storage nodes. Our experimental results of an initial prototype show that our proposed architecture improves the throughput and reduces the latency of distributed key-value stores when compared to the existing architectures.

Link to full paper

Scaling Up The Performance of Distributed Key-Value Stores With In-Switch Coordination

Keywords

architecture, networks