Breaking News: Grepper is joining You.com. Read the official announcement!

if messages are above 50 in kafka

Deepika Sahu answered on December 6, 2022 Popularity 1/10 Helpfulness 1/10

answer if messages are above 50 in kafka

if messages are above 50 in kafka

Comment

257


You need to adjust three (or four) properties:

Consumer side:fetch.message.max.bytes - this will determine the largest size of a message that can be fetched by the consumer.
Broker side: replica.fetch.max.bytes - this will allow for the replicas in the brokers to send messages within the cluster and make sure the messages are replicated correctly. If this is too small, then the message will never be replicated, and therefore, the consumer will never see the message because the message will never be committed (fully replicated).
Broker side: message.max.bytes - this is the largest size of the message that can be received by the broker from a producer.
Broker side (per topic): max.message.bytes - this is the largest size of the message the broker will allow to be appended to the topic. This size is validated pre-compression. (Defaults to broker's message.max.bytes.)
I found out the hard way about number 2 - you don't get ANY exceptions, messages, or warnings from Kafka, so be sure to consider this when you are sending large messages.

Popularity 1/10 Helpfulness 1/10 Language whatever

Source: Grepper

Tags: messages whatever

Link to this answer
Share Copy Link

Contributed on Dec 06 2022

Deepika Sahu

0 Answers Avg Quality 2/10

if messages are above 50 in kafka

Contents

More Related Answers

if messages are above 50 in kafka

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.