More Data, More Problems: Scaling Kafka-Mirroring Pipelines at LinkedIn
Video & SlidesFor several years, LinkedIn has been using Kafka MirrorMaker as the mirroring solution for copying data between Kafka clusters across data centers. However, as LinkedIn data continued to grow, mirroring trillions of Kafka messages per day across data centers uncovered the scale limitations and operability challenges of Kafka MirrorMaker. To ... Read More