2021 ACSW – Keynote Presentation: Redesigning Storage Systems for Future Workloads, Hardware, and Performance Requirements
Winner, CORE John Makepeace Bennett Award for the Australasian Distinguished Doctoral Dissertation
Cloud and edge storage stacks are being challenged by new workloads, new hardware and new performance requirements. First, workloads evolved from following a read-heavy pattern (e.g., a static web-page) to a write-heavy profile where the read:write ratio is closer to 1:1 (e.g., as in the Internet of Things). Second, the hardware is undergoing rapid changes. The divide between fine-grained volatile memory and slow block-level storage is rapidly being bridged by the emerging byte-addressable non-volatile memory devices and the fast block-addressable NVMe SSDs (e.g., Intel Optane NVMe SSDs). Third, performance requirements in storage systems now emphasize low tail latency, in addition to high throughput.
In this talk I will argue that existing storage systems have fundamental limitations that do not allow them to fully meet these challenges, and that therefore the storage stack needs to undergo significant change. In particular, using state-of-the-art key-value stores I will demonstrate that with modern workloads and hardware the bottleneck shifts from I/O to CPU, invalidating an assumption that has underpinned all past storage system design. In line with this observation I will then present a new design paradigm for key-value stores that departs from the conventional wisdom of optimizing disk usage and instead optimizes CPU usage. This design has been implemented in the KVell key-value store. KVell outperforms state-of-the-art key-value stores such as RocksDB in both read- and write-heavy workloads, running on modern NVMe SSDs. Thanks to its novel design, KVell achieves up to 5x better throughput, and up to two orders of magnitude lower tail latency.
Oana Balmau is an Assistant Professor at McGill University. She completed her PhD in Computer Science at the University of Sydney, advised by Prof. Willy Zwaenepoel. She earned her Bachelors and Masters degrees in Computer Science from EPFL, Switzerland. Her research interests are computer systems and storage technologies. Currently, she is focusing on redesigning edge storage systems, persistent memory technologies, and their role in the way we manage large-scale data for Internet of Things workloads. (Homepage: https://www.cs.mcgill.ca/~balmau/ )