Breaking News: Grepper is joining You.com. Read the official announcement!

Kafka poll message and get offset

Edim Zdralovic answered on October 19, 2022 Popularity 3/10 Helpfulness 1/10

answer Kafka poll message and get offset

related Kafka consume message and get offset

Kafka poll message and get offset

Comment

from kafka import KafkaConsumer

# To consume latest messages and auto-commit offsets
consumer = KafkaConsumer('my-topic',
                         group_id='my-group',
                         bootstrap_servers=['localhost:9092'])
while True:
    # Response format is {TopicPartiton('topic1', 1): [msg1, msg2]}
    msg_pack = consumer.poll(timeout_ms=500)

    for tp, messages in msg_pack.items():
        # message value and key are raw bytes -- decode if necessary!
        # e.g., for unicode: `message.value.decode('utf-8')`
        print ("%s:%d:%d: key=%s value=%s" % (tp.topic, tp.partition,
                                              message.offset, message.key,
                                              message.value))

Popularity 3/10 Helpfulness 1/10 Language python

Source: Grepper

Tags: get message offset python

Link to this answer
Share Copy Link

Contributed on Oct 19 2022

Edim Zdralovic

0 Answers Avg Quality 2/10

Closely Related Answers

Kafka consume message and get offset

Comment

from kafka import KafkaConsumer

# To consume latest messages and auto-commit offsets
consumer = KafkaConsumer('my-topic',
                         group_id='my-group',
                         bootstrap_servers=['localhost:9092'])
for message in consumer:
    # message value and key are raw bytes -- decode if necessary!
    # e.g., for unicode: `message.value.decode('utf-8')`
    print ("%s:%d:%d: key=%s value=%s" % (message.topic, message.partition,
                                          message.offset, message.key,
                                          message.value))

Popularity 8/10 Helpfulness 2/10 Language python

Source: Grepper

Tags: message get python offset

Link to this answer
Share Copy Link

Contributed on Oct 19 2022

Edim Zdralovic

0 Answers Avg Quality 2/10

Kafka poll message and get offset

Contents

More Related Answers

Kafka poll message and get offset

Closely Related Answers

Kafka consume message and get offset

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.