Back

Speaker "Holden Karau" Details Back

 

Topic

Beyond Shuffling: Scaling your Spark Jobs

Abstract

We will explore a number of different factors that can impact Spark job performance as well as discuss best practices for creating scalable Spark jobs.

Profile

Holden Karau is a software development engineer and is active in open source. She the author of a book on Spark and has assisted with Spark workshops. Prior to Databricks she worked on a variety of search and classification problems at Google, Foursquare, and Amazon. She graduated from the University of Waterloo with a Bachelors of Mathematics in Computer Science.