Optimization of Load Balancing on LSM-Tree based Distributed Key-Value Store using NVMe-oF

Hera Koo, Sungho Moon, Hyeongjun Jeon, Beomsuk Nam

http://doi.org/10.5626/JOK.2022.49.7.561

One of the challenges of distributed key-value databases which distribute and store data according to the key is load balancing. In this paper, we propose MongoRocks-oF, a redesigned MongoRocks, which is a MongoDB distributed database with RocksDB engine, an LSM-tree based key-value store, for optimizing load balancing with NVMe-over-Fabrics. MongoRocks-oF distributes data evenly in a round-robin fashion using NVMe-over-Fabrics that enables computing nodes to share multiple NVMe SSDs in remote storage through all-to-all connections, and fully utilizes storage resources. Based on this design, the proposed MongoRocks-oF improve load balance of legacy MongoRocks and shows better performance on write operations compared to MongoRocks.