HARD
Event Streaming Platform
Build Kafka-like system supporting 1M+ messages/sec with exactly-once semantics.
Estimated Time: 120 minutes
#streaming#scale
Solution Overview
Partitioned log, consumer groups, offset management, replication, compaction.
Used By Companies
GoogleAmazonLinkedIn
Solution Overview
Partitioned log, consumer groups, offset management, replication, compaction.
Approach
Broker partition management, consumer groups, replication, compaction
Companies
- •Amazon
Components
- •Broker
- •Partition manager
- •Consumer groups
- •Replication
- •Log compactor