Breaking News: Grepper is joining You.com. Read the official announcement!
Check it out

How to properly flag a message in Kafka Streams

Sumit Rawal answered on May 11, 2023 Popularity 1/10 Helpfulness 1/10

Contents


More Related Answers

  • kafkacat receive message
  • see message in kafka
  • kafka create topic
  • kafka create topic
  • Kafka consume message and get offset
  • Kafka poll message and get offset
  • Kafka Message index
  • Sending blocking messages to Apache Kafka
  • Why is Apache Kafka preferred over traditional messaging techniques?
  • What do you mean by Stream Processing in Kafka?
  • Explain some Kafka Streams real-time Use Cases.
  • How long are messages retained in Apache Kafka?
  • Define the role of Kafka Streams API and Kafka Connector API.
  • Writing to Kafka
  • when to use kafka streams
  • Kafka Stream Consumer:
  • POS fanout app using Kafka Streams
  • Recommended additional configuration for Kafka

  • How to properly flag a message in Kafka Streams

    0

    One possibility is to add a custom header to the message context. In the specific case of the proposed example we could add a transformer after consuming from Topic A, adding some specific header which would be the basis for the filtering condition on the monitoring transformer after the join.

    Another possibility would be to flag the message in the message content itself. In this case the transformer after consuming from Topic A would extend the message value with a boolean flag which would have to be propagated to the monitoring transformer.

    Both options have pros and cons and should be considered depending on the specific use case. Flagging via context headers has a minimum impact but requires deserializing the headers for evaluating the flag-based filtering condition while flagging the message content itself makes the condition simpler to be evaluated but may require some refactoring/adaptation at other points of the topology. 

    Popularity 1/10 Helpfulness 1/10 Language whatever
    Source: Grepper
    Link to this answer
    Share Copy Link
    Contributed on May 11 2023
    Sumit Rawal
    0 Answers  Avg Quality 2/10


    X

    Continue with Google

    By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.
    X
    Grepper Account Login Required

    Oops, You will need to install Grepper and log-in to perform this action.