Kafka was introduced as part of a proof of concept for collecting 20 million click events a day at Norway’s biggest site, FINN.no. Other teams started using Kafka for different purposes, but our configuration was still as if it was a proof of concept (prototype). This lead to scaling problems, stability problems, and lost messages. We’ll tell you what we did, and how we solved it. Enjoy our mistakes and learn!