DevConf.US 2019 has ended
DevConf.us 2019 is the 2nd annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.

When: Thursday, August 15 to Saturday, August 17, 2018

Venue: Boston University, George Sherman Union Building
Back To Schedule
Wednesday, August 14 • 09:30 - 12:30
[Cloud-Native AI] Data Engineering, Analytics and Machine Learning Infrastructure with OpenShift

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

As data is exponentially growing in organizations, there is an increasing need to consolidate silos of information into a single source of truth, a Data Lake to feed hungry Analytics and Machine Learning Engines that can gather insight at scale. In this workshop, we will detail how to architect data infrastructure services using Red Hat OpenShift, Ceph Storage, Spark, Kafka, Prometheus, and Seldon.
As part of the workshop, we will deploy the Open Data Hub and cover the entire end-to-end infrastructure. Some of the things we will demonstrate are: 
  • Deployment of a Ceph S3 instance for storage of data
  • Usage of Jupyter notebooks and spark to interact with data sets using the S3A filesystem client on different clouds.
  • Using Spark schema detection and SparkSQL to query and transform stored data.
  • Deployment of a simple model as well as the supporting messaging tools for interacting with the model.
  • Monitoring of the entire infrastructure as well as deployed models with Prometheus and Grafana.


Anish Asthana

Senior Software Engineer, Red Hat, Inc.
Anish is an engineer at Red Hat in the AI Services Organization. He is primarily working on the Open Data Hub - a machine learning-as-a-service platform built with OpenShift at the core. His interests include monitoring, scalability, and reliability.
avatar for Juana Nakfour

Juana Nakfour

Senior Software Engineer at Red Hat AICOE team., Red Hat
Senior Software Engineer at Red Hat AICOE team with many years of advanced R&D experience in the telecommunications industry. Juana's focus is broad and includes AI/ML Platform, wireless communication networks, embedded/mobile devices, cloud services and data analysis.

Wednesday August 14, 2019 09:30 - 12:30 EDT
Terrace Lounge GS Union, BU