Scale your ML and Data pipelines with Cadence

Big part of ML and Big Data is ensuring the scalability and reliability of production pipelines. Cadence is a distributed, scalable, durable, and highly available orchestration engine we developed at Uber Engineering. It greatly simplifies the task management needed to make your backend processes resilient. The talk explains how Cadence is used to manage the lifecycle of globally replicated datasets in Uber HDFS clusters and then presents the service most notable features as well as the Cadence Java SDK.

Maxim has over 20 years of experience building large scale distributed systems at Amazon, Microsoft, Google and Uber. While at Amazon, he led the design and development of Amazon Messaging System that later was adopted as the AWS SQL backend. Afterwards,  he was a tech lead of the AWS Simple Workflow Service. At Uber, Maxim led both the Cherami open source messaging project and later Cadence Workflow. In October of 2019, Maxim cofounded Temporal Technologies where he has led as CEO since.