Balancing CPU and network in the cell distributed b-tree store

Christopher Mitchell, Kate Montgomery, Lamont Nelson, Siddhartha Sen, Jinyang Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In traditional client-server designs, all requests are processed at the server storing the state, thereby maintaining strict locality between computation and state. The adoption of RDMA (Remote Direct Memory Access) makes it practical to relax locality by letting clients fetch server state and process requests themselves. Such client-side processing improves performance when the server CPU, instead of the network, is the bottleneck.We observe that combining server-side and client-side processing allows systems to balance and adapt to the available CPU and network resources with minimal configuration, and can free resources for other CPU-intensive work. We present Cell, a distributed B-tree store that combines client-side and server-side processing. Cell distributes a global B-tree of "fat" (64MB) nodes across machines for server-side searches. Within each fat node, Cell organizes keys as a local B-tree of RDMA-friendly small nodes for client-side searches. Cell clients dynamically select whether to use client-side or server-side processing in response to available resources and the current workload. Our evaluation on a large RDMA-capable cluster show that Cell scales well and that its dynamic selector effectively responds to resource availability and workload properties.

Original languageEnglish (US)
Title of host publicationProceedings of the 2016 USENIX Annual Technical Conference, USENIX ATC 2016
PublisherUSENIX Association
Pages451-464
Number of pages14
ISBN (Electronic)9781931971300
StatePublished - Jan 1 2016
Event2016 USENIX Annual Technical Conference, USENIX ATC 2016 - Denver, United States
Duration: Jun 22 2016Jun 24 2016

Publication series

NameProceedings of the 2016 USENIX Annual Technical Conference, USENIX ATC 2016

Conference

Conference2016 USENIX Annual Technical Conference, USENIX ATC 2016
CountryUnited States
CityDenver
Period6/22/166/24/16

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Balancing CPU and network in the cell distributed b-tree store'. Together they form a unique fingerprint.

  • Cite this

    Mitchell, C., Montgomery, K., Nelson, L., Sen, S., & Li, J. (2016). Balancing CPU and network in the cell distributed b-tree store. In Proceedings of the 2016 USENIX Annual Technical Conference, USENIX ATC 2016 (pp. 451-464). (Proceedings of the 2016 USENIX Annual Technical Conference, USENIX ATC 2016). USENIX Association.