https://www.youtube.com/watch?v=aj9CDZm0Glc

Overview

Apache kafka is a distributed streaming platform that allows for the development of real time event driven applications, it allows developers to build applications that create and consume streams of data records.

• It runs as a cluster that can span multiple servers and data centers
• Low lag
• High accuracy
• in order
• resilient and fault tolerant

Use Cases

• decoupling system dependencies
• messaging
• location tracking
• data gathering

Main APIs behind Apache Kafka

Kafka is based on 4 main apis

Producer API

Allows to produce streams of data, creates data and produces to topics, topics can be persisted for as long as you have enough storage

Consumer API

The consumer api subscribes to one or more topics, and listens in to just that data

Streams API