HARD

Distributed File Storage

Design GCS/S3-like storage for 100B+ objects with 99.99% durability.

Estimated Time: 120 minutes
#storage#scale#durability

Solution Overview

Erasure coding, consistent replication, repair, geographic distribution, checksum.

Used By Companies

GoogleAmazon
Solution Overview

Erasure coding, consistent replication, repair, geographic distribution, checksum.

Approach

Erasure coding, replication, repair mechanisms, geo-distribution

Companies
  • Google
  • Amazon
Components
  • Storage nodes
  • Metadata store
  • Repair daemon
  • Checksum validator
  • Replicator