Kafka Summit Logo
Organized by

Kafka Summit San Francisco 2018

October 16-17, 2018 | San Francisco

Celia Kung

Senior Software Engineer, LinkedIn

Celia is an engineer on LinkedIn’s Streams Infrastructure Team. She was the lead/sole engineer for building Oracle data streaming pipelines and is now leading an effort to move all of LinkedIn’s Kafka MirrorMaker pipelines onto the new Kafka mirroring solution which she developed.

Sessions

More Data, More Problems: Scaling Kafka-Mirroring Pipelines at LinkedIn

Video & Slides

For several years, LinkedIn has been using Kafka MirrorMaker as the mirroring solution for copying data between Kafka clusters across data centers. However, as LinkedIn data continued to grow, mirroring trillions of Kafka messages per day across data centers uncovered the scale limitations and operability challenges of Kafka MirrorMaker. To ... Read More


Sign up for updates

Organized by Confluent Logo

Privacy Policy | Terms & Conditions, Apache Kafka®, Kafka, and associated open source project names are trademarks of the Apache Software Foundation Copyright © Confluent, Inc. 2016 - 2019

We use cookies to understand how you use our site and to improve your experience. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.