Data Engineering
Bug Report
Orders missing after a Kafka broker restart: acks=1 and an unclean leader handover lost writes
After a rolling restart of our Kafka cluster, the warehouse system was missing about 300 order events the producer had logged as sent. The producer used acks=1, so the leader acknowledged before followers had the data. How we proved it, and the settings that make acknowledged writes durable.