Transkv: A networking support for transaction processing in distributed key-value stores [conference paper]

Three computers with locks in a circle illustration

Conference

IEEE 7th International Conference on Big Data Computing Service and Applications (BigDataService) - August 23, 2021

Authors

Hebatalla Eldakiky (Ph.D. 2021), David Hung-Chang Du (professor)

Abstract

Through the massive use of mobile devices, data clouds, and the rise of Internet of Things, enormous amount of data has been generated and analyzed for the benefit of society. NoSQL Databases and specially key-value stores become the backbone in managing these large amounts of data. Most of key-value stores ignore transactions due to their effect on degrading key-value store’s performance. Meanwhile, programmable switches with the software-defined networks and the Programming Protocol-Independent Packet Processor (P4) lead to a programmable network where in-network computation can help accelerating the performance of applications. In this paper, we proposed a networking support for transaction processing in distributed key-value stores. Our system leverages the programmable switch to act as a transaction coordinator. Using a variation of the time stamp ordering concurrency control approach, the programmable switch can decide to proceed in transaction processing or abort the transaction directly from the network. Our experimental results on an initial prototype show that our proposed approach, while supporting transactions, improves the throughput by up to 4X and reduces the latency by 35% when compared to the existing architectures.

Link to full paper

Transkv: A networking support for transaction processing in distributed key-value stores

Keywords

storage, networking