Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Using Apache Kafka from Go

Using Apache Kafka from Go

At Uber, we use Kafka and Golang a lot. In this talk, I go over the basic concepts in Kafka and the libraries we use to publish and consume messages.

Nikolay Stoitsev

February 19, 2019
Tweet

More Decks by Nikolay Stoitsev

Other Decks in Technology

Transcript

  1. Partition - ordered, immutable sequence Message Message Message Message Message

    Message Message Message Message Message Message Message Message Message Message Partition 0 Partition 1 Partition 2
  2. Broker Broker Broker P0 P0 P0 P1 P1 P1 P2

    P2 P2 Partitioned and Replicated
  3. Broker Broker Broker P0 P0 P0 P1 P1 P1 P2

    P2 P2 Producers Producer Producer
  4. Consumer Consumer Consumer Consumer Consumer Broker Broker Broker P0 P0

    P0 P1 P1 P1 P2 P2 P2 Producers Producer Producer Consumer Group 1 Consumer Group 2