Fast in-memory transaction processing using RDMA and HTM

Published: 14 December 2015
on channel: Association for Computing Machinery (ACM)
1,701
14

Authors: Xingda Wei, Jiaxin Shi, Yanzhe Chen, Rong Chen, Haibo Chen

Abstract:

We present DrTM, a fast in-memory transaction processing system that exploits advanced hardware features (i.e., RDMA and HTM) to improve latency and throughput by over one order of magnitude compared to state-of-the-art distributed transaction systems. The high performance of DrTM are enabled by mostly offloading concurrency control within a local machine into HTM and leveraging the strong consistency between RDMA and HTM to ensure serializability among concurrent transactions across machines. We further build an efficient hash table for DrTM by leveraging HTM and RDMA to simplify the design and notably improve the performance. We describe how DrTM supports common database features like read-only transactions and logging for durability. Evaluation using typical OLTP workloads including TPC-C and SmallBank show that DrTM scales well on a 6-node cluster and achieves over 5.52 and 138 million transactions per second for TPC-C and SmallBank Respectively. This number outperforms a state-of-the-art distributed transaction system (namely Calvin) by at least 17.9X for TPC-C.

ACM DL: http://dl.acm.org/citation.cfm?id=281...
DOI: http://dx.doi.org/10.1145/2815400.281...


Watch video Fast in-memory transaction processing using RDMA and HTM online without registration, duration hours minute second in high quality. This video was added by user Association for Computing Machinery (ACM) 14 December 2015, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,701 once and liked it 14 people.