Breaking News: Grepper is joining You.com. Read the official announcement!

How Kafka works?

Add Answer

Deepika Sahu answered on December 15, 2022 Popularity 5/10 Helpfulness 1/10

answer How Kafka works?

related What can you do with Kafka?

related What is Kafka used for?

related kafka basics

How Kafka works?

Comment

How does Kafka work? 
Kafka combines two messaging models, queuing and publish-subscribe, to provide the key benefits of each to consumers.
Queuing allows for data processing to be distributed across many consumer instances, making it highly scalable. 
However, traditional queues aren't multi-subscriber.

Popularity 5/10 Helpfulness 1/10 Language whatever

Source: Grepper

Tags: whatever

Link to this answer
Share Copy Link

Contributed on Dec 15 2022

Deepika Sahu

0 Answers Avg Quality 2/10

Closely Related Answers

What can you do with Kafka?

Comment

It can perform in several ways, such as:
>> In order to transmit data between two systems, we can build a real-time stream of data pipelines with it.
>> Also, we can build a real-time streaming platform with Kafka, that can actually react to the data.

Popularity 8/10 Helpfulness 1/10 Language whatever

Source: Grepper

Tags: whatever

Link to this answer
Share Copy Link

Contributed on Dec 29 2022

Deepika Sahu

0 Answers Avg Quality 2/10

What is Kafka used for?

Comment

Kafka is a distributed system used for creating real-time streaming data pipelines and applications.

@Configuration
@EnableKafka
public class Config {

    @Bean
    ConcurrentKafkaListenerContainerFactory<Integer, String>
                        kafkaListenerContainerFactory(ConsumerFactory<Integer, String> consumerFactory) {
        ConcurrentKafkaListenerContainerFactory<Integer, String> factory =
                                new ConcurrentKafkaListenerContainerFactory<>();
        factory.setConsumerFactory(consumerFactory);
        return factory;
    }

    @Bean
    public ConsumerFactory<Integer, String> consumerFactory() {
        return new DefaultKafkaConsumerFactory<>(consumerProps());
    }

    private Map<String, Object> consumerProps() {
        Map<String, Object> props = new HashMap<>();
        props.put(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092");
        props.put(ConsumerConfig.GROUP_ID_CONFIG, "group");
        props.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, IntegerDeserializer.class);
        props.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
        props.put(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "earliest");
        // ...
        return props;
    }

    @Bean
    public Sender sender(KafkaTemplate<Integer, String> template) {
        return new Sender(template);
    }

    @Bean
    public Listener listener() {
        return new Listener();
    }

    @Bean
    public ProducerFactory<Integer, String> producerFactory() {
        return new DefaultKafkaProducerFactory<>(senderProps());
    }

    private Map<String, Object> senderProps() {
        Map<String, Object> props = new HashMap<>();
        props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092");
        props.put(ProducerConfig.LINGER_MS_CONFIG, 10);
        props.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, IntegerSerializer.class);
        props.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, StringSerializer.class);
        //...
        return props;
    }

    @Bean
    public KafkaTemplate<Integer, String> kafkaTemplate(ProducerFactory<Integer, String> producerFactory) {
        return new KafkaTemplate<Integer, String>(producerFactory);
    }

}

https://aws.amazon.com/msk/what-is-kafka/#:~:text=Kafka%20is%20primarily%20used%20to,historical%20and%20real%2Dtime%20data.

Popularity 8/10 Helpfulness 1/10 Language java

Source: Grepper

Tags: java

Link to this answer
Share Copy Link

Contributed on Feb 06 2023

Pragya Keshap

0 Answers Avg Quality 2/10

kafka basics

Comment

Immutable, append-only logs

Fast, resilient, scalable, high throughput

Relies on file system for storing and caching messages

Resilient and fault-tolerant by replication

Disk caching, memory mapped files instead of GC eligible memory

Scale by partitions

Ordered inside partition

As an event store: A great match for event-driven microservices

kafka-topics — create — zookeeper zookeeper:2181 — topic applog — partitions 5 — replication-factor 3

https://medium.com/inspiredbrilliance/kafka-basics-and-core-concepts-5fd7a68c3193#:~:text=Kafka%20works%20as%20a%20cluster,available%2C%20and%20fault%2Dtolerant.&text=Kafka%20stores%20data%20as%20a,be%20processed%20in%20different%20methods.

Popularity 9/10 Helpfulness 1/10 Language whatever

Source: Grepper

Tags: whatever whateve

Link to this answer
Share Copy Link

Contributed on Feb 21 2023

Pragya Keshap

0 Answers Avg Quality 2/10

How Kafka works?

Contents

More Related Answers

How Kafka works?

Closely Related Answers

What can you do with Kafka?

What is Kafka used for?

kafka basics

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.