DevConf.US 2019 has ended
DevConf.us 2019 is the 2nd annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.

When: Thursday, August 15 to Saturday, August 17, 2018

Venue: Boston University, George Sherman Union Building
Back To Schedule
Friday, August 16 • 14:00 - 14:45
Scaling your Open Data Hub for fun and production

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

What do you do when the environment you setup as a proof of concept has suddenly become a production system where users are demanding 200% uptime, 20 years of data retention and unlimited resources? In this talk we will discuss the major pain points we encountered as use of the Open Data Hub (ODH) has grown in our OpenShift cluster. We will cover topics such as monitoring ODH components using Prometheus and Grafana, storage/resource/permissions considerations when running different data science tools on OpenShift. We will also share our best practice recommendations on topics such as organizing and managing data in Elasticsearch and leveraging Kafka in architecting a big data platform that scales.

avatar for Alex Corvin

Alex Corvin

Senior Software Engineer, Red Hat
Senior Software Engineer
avatar for Landon LaSmith

Landon LaSmith

Senior Software Engineer, Red Hat
Landon LaSmith is a Senior Software Engineer in the AI Center of Excellence at Red Hat working on the Open Data Hub.

Friday August 16, 2019 14:00 - 14:45 EDT
Metcalf Small GS Union, BU