Kafka Summit San Francisco 2018

Streaming platforms at massive scale.

October 16-17, 2018 | San Francisco

Celia Kung

Senior Software Engineer, LinkedIn

Celia is an engineer on LinkedIn’s Streams Infrastructure Team. She was the lead/sole engineer for building Oracle data streaming pipelines and is now leading an effort to move all of LinkedIn’s Kafka MirrorMaker pipelines onto the new Kafka mirroring solution which she developed.

Sessions

More Data, More Problems: Scaling Kafka-Mirroring Pipelines at LinkedIn

1:00 pm - 1:40 pm, Pipelines Track, Video & Slides

For several years, LinkedIn has been using Kafka MirrorMaker as the mirroring solution for copying data between Kafka clusters across data centers. However, as LinkedIn data continued to grow, mirroring trillions of Kafka messages per day across data centers uncovered the scale limitations and operability challenges of Kafka MirrorMaker. To ... Read More

Organized by

Celia Kung

Senior Software Engineer, LinkedIn

Sessions

Sign up for updates

#kafkasummit