November 18, 2019 | San Diego, California
View More Details & Register Here
Back To Schedule
Monday, November 18 • 2:30pm - 2:50pm
Building a Performant Configuration-Store Layer - Guarav Agarwal, VMware

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Frequently, one needs an “ordered-log” model that has the characteristic of appending to the End of the key-space. For example, one such use-case is to model a “change-log” table, that maintains an ordered-history of changes that are happening to some other data/state. Typically, in FDB, this model is implemented by prefixing the change-keys with VersionStamp, to provide a strong ordering between change records.

However, this creates write-hotspots due to the inherent concentration of new rows to a specific shard at any given time.

We would like to present a technique that can help solve this problem by avoiding this severe concentration of keys, while still preserving the desired ordering, at the cost of some overhead at read-time, and some conflicts at write time. The conflicts could possibly be solved with potential enhancement in FDB core (https://bit.ly/2M6twot).


Gaurav Agarwal

Staff-2 Engineer, VMware, Inc.
I work on VMWare's Network Insight's infrastructure layer team to build robust and scalable distributed storage systems: configuration-stores, metric time-series stores and flow analysis systems. In the past, I have had an opportunity to work on very large scale data processing and... Read More →

Monday November 18, 2019 2:30pm - 2:50pm PST
Grand Ballroom 8
  Building Layers
  • Session Slides Included Yes