Loading…
DevConf.US 2019 has ended
DevConf.us 2019 is the 2nd annual, free, Red Hat sponsored technology conference for community project and professional contributors to Free and Open Source technologies held at the Boston University in the historic city of Boston, USA.

When: Thursday, August 15 to Saturday, August 17, 2018

Venue: Boston University, George Sherman Union Building
Back To Schedule
Saturday, August 17 • 13:00 - 13:45
Streaming Functions as a Service with Apache Spark and Kubernetes

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Although there are several popular frameworks that have arisen in the past few years to address the need for Function as a Service (FaaS) architectures, did you know it is possible to use Apache Spark as a FaaS runtime to achieve a similar end goal?

In this presentation Michael will talk about how Spark’s user defined function interface can be used in concert with Kubernetes’ dynamic deployment model to create flexible FaaS-enabled pipelines for streaming data. He will demonstrate how to deploy Spark-based microservices on Kubernetes that can change their behavior dynamically during runtime. Finally, he will examine the future of these techniques and how the capabilities provided by Spark and Kubernetes can improve the flexibility of your streaming pipelines.

Speakers
avatar for Michael McCune

Michael McCune

Principal Software Engineer, Red Hat, Inc.
Michael is a software developer creating open source infrastructure and applications for cloud platforms. He has a passion for problem solving and team building, and a lifelong love of music, food, and culture.


Saturday August 17, 2019 13:00 - 13:45 EDT
Metcalf Small GS Union, BU