DevConf.US 2019 has ended
DevConf.us 2019 is the 2nd annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.

When: Thursday, August 15 to Saturday, August 17, 2018

Venue: Boston University, George Sherman Union Building
Back To Schedule
Saturday, August 17 • 14:40 - 15:25
D3N: A multi-layer cache for data centers

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Current caching methods for improving the performance of big-data jobs assume abundant (e.g., full bi-section) bandwidth to cache nodes. However, many enterprise data centers and co-location facilities exhibit significant network imbalances due to over-subscription and incremental networking upgrades. In this talk, we describe D3N, a novel multi-layer cooperative caching architecture that mitigates network imbalances by caching data on the access side of each layer of hierarchical network topology.

Our prototype of D3N, which incorporates a two-layer cache, is highly-performant (can read cached data at 5GB/s, the maximum speed of our SSDs) and significantly improves big-data jobs' performance. To fully utilize bandwidth within each layer under dynamic conditions, we present an algorithm that adaptively adjusts cache sizes of each layer based on observed workload patterns and network congestion.


Saturday August 17, 2019 14:40 - 15:25 EDT
Metcalf Small GS Union, BU