Jun 25, 2016 · The partitions of a topic are distributed over the brokers in the Kafka cluster where each broker handles data and requests for a share of the partitions. Each partition is replicated …

Mar 2, 2018 · The first thing to understand is that a topic partition is the unit of parallelism in Kafka. On both the producer and the broker side, writes to different partitions can be done fully …

Apr 6, 2016 · For a topic with replication factor N, Kafka can tolerate up to N-1 server failures without losing any messages committed to the log. 3 replicas are common configuration. Of …

Jan 25, 2022 · I pushed a message that was too big into a kafka message topic on my local machine, now I'm getting an error: kafka.common.InvalidMessageSizeException: invalid …

Jan 9, 2014 · I send String-messages to Kafka V. 0.8 with the Java Producer API. If the message size is about 15 MB I get a MessageSizeTooLargeException. I have tried to set …

Jan 20, 2024 · 117 Is there a way to delete all the data from a topic or delete the topic before every run? Can I modify the KafkaConfig.scala file to change the logRetentionHours property? …

Mar 2, 2023 · Since the kafka topic names are going to be shared across teams, is there any best practice for naming? Basically we don't want to see team A naming a topic companyname …

Feb 18, 2015 · I am using Apache Kafka for messaging. I have implemented the producer and consumer in Java. How can we get the number of messages in a particular topic?

Jun 12, 2020 · When topic gives us the stream of events, what is the need for us to create stream from a topic? A. Stream is the basic entity in Kafka streams. A stream goes through a set of …

Jun 22, 2016 · After a Kafka topic has been created by a producer or an administrator, how would you change the number of replicas of this topic?