Kafka Summit Logo
Organized by

Kafka Summit San Francisco 2018

Streaming platforms at massive scale.

October 16-17, 2018 | San Francisco

From Propeller to Jet: Upgrading Your Engines Mid-Flight

Session Level: Intermediate
Video & Slides

Don’t you love signing in to your favorite application only to find out it’s undergoing scheduled maintenance? I know I don’t! Designing scalable systems is a challenge all software engineers face. Ultimately this means you will find yourself in a situation where you need to upgrade your software engines for better performance.

In this session, I will guide you through the experience of swapping out PagerDuty’s original prop engine consisting of a Cassandra queue-based system to that of a 747 which utilizes Kafka not only for ingestion of customer data but also internal heuristics and back pressure support. This includes the most critical techniques used by our engineering team which allowed us to validate that our proposed solution would in fact scale, all while continuing to consume millions of customers events and ensuring that our users get notified in a timely manner.

Audience members will leave with the necessary insight to have a smooth transition to a Kafka-based system all while not interrupting day-to-day operations for their customers.


We use cookies to understand how you use our site and to improve your experience. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.