DevConf.us 2019 is the 2nd annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.
When: Thursday, August 15 to Saturday, August 17, 2018
What do you do when the environment you setup as a proof of concept has suddenly become a production system where users are demanding 200% uptime, 20 years of data retention and unlimited resources? In this talk we will discuss the major pain points we encountered as use of the Open Data Hub (ODH) has grown in our OpenShift cluster. We will cover topics such as monitoring ODH components using Prometheus and Grafana, storage/resource/permissions considerations when running different data science tools on OpenShift. We will also share our best practice recommendations on topics such as organizing and managing data in Elasticsearch and leveraging Kafka in architecting a big data platform that scales.