The Staff & Principal System Design Roadmap
Master 50+ distributed systems building blocks, consensus algorithms (Raft/Paxos), CRDTs, data structures (Skip Lists, Merkle Trees), and reliability patterns tested in Big Tech Principal interview loops.
Progress stored locally. to sync across all workstations.
1. Fundamentals & Core Architecture
Foundational concepts for sizing, scaling, and architecting distributed backends.
Client–Server Architecture
Deep DiveSeparation of concerns between request-initiating clients and service-providing servers over standardized network protocols.
Request–Response Model
Deep DiveSynchronous message-passing communication pattern where clients issue requests and block or await discrete server responses.
HTTP / HTTPS
Deep DiveStateless application-layer transfer protocol and its TLS-encrypted variant securing integrity, confidentiality, and authentication.
REST APIs
Deep DiveResource-oriented architectural style leveraging standard HTTP verbs, stateless interactions, URIs, and representations.
RPC / gRPC
Deep DiveRemote procedure call abstraction and modern HTTP/2 Protocol Buffers framework for strongly-typed, low-latency service calls.
WebSockets
Deep DivePersistent, bidirectional full-duplex TCP communication channels for event-driven real-time data push.
DNS (Domain Name System)
Deep DiveHierarchical distributed naming system resolving human-readable hostnames into IP addresses with multi-level caching.
IP Addresses (IPv4 & IPv6)
Deep DiveLogical numerical network identifiers facilitating packet addressing and routing across local subnets and the public Internet.
Network Ports & Sockets
Deep Dive16-bit process endpoints multiplexing network traffic across operating system services on a single IP address.
TCP / UDP
Deep DiveConnection-oriented reliable ordered byte-stream delivery (TCP) versus connectionless, low-overhead datagrams (UDP).
OSI 7-Layer Model
Deep DiveConceptual framework decomposing networked computing systems into seven distinct abstraction layers from physical to application.
TLS/SSL
Deep DiveCryptographic transport security layer enforcing asymmetric certificate authentication, key exchange, and symmetric payload encryption.
Serialization / Deserialization
Deep DiveTransforming in-memory objects into portable wire/disk formats (bytes or text) and reconstructing them across network boundaries.
JSON / Protocol Buffers
Deep DiveText-based human-readable serialization versus schema-compiled binary encoding trade-offs in distributed microservices.
Functional vs Non-Functional Requirements
Distinguishing core feature scope from SLA targets (latency, availability, throughput, durability).
Back-of-the-Envelope Capacity Estimation
Estimating QPS, peak RPS, bandwidth in/out, memory cache footprint, and storage growth over 5 years.
CAP Theorem & PACELC Trade-offs
Choosing Consistency vs Availability under network partitions, and Latency vs Consistency in normal operation.
High Availability & The Nines (99.9% vs 99.999%)
Calculating allowed downtime per year and designing active-active redundancy to eliminate SPOFs.
2. Networking & Traffic Routing
Protocol choices, CDN edge distribution, BGP Anycast, service mesh, and ingress traffic management.
Global Load Balancing with Anycast
Deep DiveBGP route announcements, Anycast Layer 3 path selection, RPKI cryptographic validation, and low-TTL DNS failover.
CDN Edge Routing and Origin Shield
Deep DiveMulti-tier intermediate caching, request coalescing, cache stampede elimination, and TLS edge termination.
Service Mesh and Traffic Splitting
Deep DiveSidecar Envoy proxies, progressive canary rollouts, automated mTLS certificate rotation, and latency-aware circuit breaking.
Network Partition and Split-Brain
Deep DiveCAP theorem trade-offs, Raft/Paxos majority quorums, monotonic fencing tokens, and CRDT convergence.
DDoS Mitigation and Edge Rate Limiting
Deep DiveBGP scrubbing centers, Anycast attack absorption, token bucket & sliding window algorithms, and behavioral fingerprinting.
TCP Connection Management and Congestion Control
Deep DiveTCP slow start tuning (initcwnd), TIME_WAIT socket exhaustion, keep-alive connection pooling, and Nagle + Delayed ACK deadlocks.
API Gateway with Advanced Routing
Deep DiveLayer 7 path & header routing, edge JWT authentication, per-API-key quotas, and VPC network boundary isolation.
Multi-Region Active-Active with Global Database
Deep DiveMulti-master active-active replication, CRDT field-level conflict resolution, local read replicas, and GDPR data residency compliance.
3. Scalability & Load Balancing
Horizontal scaling techniques, LB scheduling algorithms, and stateless design.
Stateless Service Tier & Horizontal Autoscaling
Decoupling session state to external stores to allow instant scaling from 5 to 500 pods.
Load Balancing Algorithms (Least Connections, Round Robin, Consistent Hashing)
Selecting optimal traffic distribution mechanisms based on backend resource consumption.
Active vs Passive Health Checks & Outlier Detection
Automatically ejecting unhealthy backend instances from the routing pool before errors spike.
4. Caching Strategies & Memory Systems
High-throughput in-memory data tiers, cache topologies, and stampede defenses.
Cache-Aside, Write-Through, and Write-Back Patterns
Balancing read latency, write overhead, and dirty data risk during database synchronization.
Eviction Policies (LRU, LFU, FIFO, TTL Expiration)
Managing memory pressure and ensuring hot keys remain resident in Redis/Memcached.
Cache Stampede & Thundering Herd Mitigation
Preventing thousands of concurrent misses from collapsing databases upon hot key expiry.
5. Database Design & Scaling
Relational vs NoSQL trade-offs, indexing strategies, replication, and sharding.
SQL vs Document vs Wide-Column vs Key-Value
Matching data models and query patterns to PostgreSQL, MongoDB, Cassandra, and DynamoDB.
Database Indexing: B-Trees & Query Optimization
Optimizing read-heavy OLTP queries and index selectivity in relational engines.
Primary-Replica Replication & Lag Mitigation
Handling read-after-write consistency issues when secondary read replicas fall behind.
6. Advanced Distributed Systems & Consensus [Pro]
Staff-level consensus protocols, replication convergence, and Byzantine fault handling.
Two-Phase Commit (2PC) vs Three-Phase Commit (3PC)
PROCoordinating distributed atomic transactions across heterogeneous databases and resolving coordinator crash lockups.
Conflict-Free Replicated Data Types (CRDTs: State vs Operation-based)
PROMathematically guaranteeing eventual consistency without central coordinators in collaborative apps and offline databases.
Gossip Protocols & SWIM Failure Detection
PRODecentralized peer-to-peer cluster membership state dissemination and suspicion-based heartbeat algorithms (Cassandra / Dynamo).
Byzantine Fault Tolerance (BFT) & PBFT Algorithms
PROMaintaining consensus in adversarial networks where nodes can act maliciously or emit contradictory votes.
Vector Clocks vs Lamport Timestamps (Deep Dive)
PROTracking causality graphs, concurrent branch identification, and version vector pruning at petabyte scale.
Distributed Transactions & Saga Orchestration vs Choreography
PRODesigning compensable forward/backward recovery workflows across decoupled microservices without two-phase locking.
Quorum-based Consensus & Tunable Consistency (N, R, W)
PROConfiguring read/write quorum overlap (R + W > N) in leaderless distributed storage systems.
7. Advanced Distributed Data Structures & Algorithms [Pro]
Specialized data structures powering distributed search, caching, and storage engines.
Consistent Hashing: Virtual Nodes & Bounded Loads
PRODistributing data across dynamically scaling shards with zero rebalancing lockups.
Rendezvous Hashing (Highest Random Weight / HRW)
PROAlternative hashing for distributed caching that minimizes reassignment on cluster churn.
Counting Bloom Filters & Cuckoo Filters
PROProbabilistic set membership structures supporting dynamic element deletion with minimal false positives.
HyperLogLog (HLL) Cardinality Estimation
PROEstimating unique visitor counts with billions of items in constant 12KB memory using register trailing zeroes.
Count-Min Sketch for Frequency Estimation
PROSub-linear space tracking of heavy hitters and top trending search terms across high-throughput data streams.
Merkle Trees & Anti-Entropy Synchronization
PROComparing cryptographic hash trees to repair divergent replica ranges with minimal network payload.
LSM Trees vs B+ Trees (Read vs Write Tradeoffs)
PROSSTables, Memtables, write amplification, and compaction strategies (RocksDB vs PostgreSQL engine internals).
Skip Lists in In-Memory Stores
PROProbabilistic linked lists enabling O(log N) concurrent concurrent sorted sets in Redis and LevelDB.
Snowflake ID & Distributed Timestamp-Ordered Generators
PROGenerating 64-bit globally unique, time-sortable IDs across 1024 worker nodes without central locks.
8. Advanced Architecture & Reliability Patterns [Pro]
Enterprise zero-trust topologies, service mesh internals, and fault injection engineering.
CQRS + Event Sourcing with Snapshotting & Rebuilds
PROReplaying append-only domain event logs and asynchronously projecting materializations into elastic search views.
Service Mesh Internals (Envoy, mTLS & Sidecar Proxies)
PROTransparent cryptographic mutual authentication, automated retries, and distributed tracing injection.
Zero Trust Network Architecture (BeyondCorp Principles)
PROContinuous identity validation, perimeter-less microsegmentation, and ephemeral short-lived SPIFFE tokens.
Edge Computing & V8 Worker Isolates
PROExecuting compute-at-the-edge with sub-millisecond cold starts (Cloudflare Workers, Deno Deploy).
Multi-Tenancy Isolation Patterns (Shared vs Siloed vs Pooled)
PRORow-level tenant isolation, tenant-specific connection pooling, and noisy neighbor mitigation.
Feature Flags & Progressive Delivery at Scale
PROReal-time client-side rule evaluation, dynamic percentage rollouts, and kill-switches with zero latency hit.
Chaos Engineering & Fault Injection (Chaos Monkey)
PROSimulating pod evictions, packet drops, clock skew, and disk corruptions in staging environments.
Canary vs Blue-Green vs Progressive Deployment Strategies
PROAutomated metric-driven rollback algorithms evaluating real-time error budget consumption.
Active-Active Multi-Region Geo-Replication & Conflict Resolution
PROSynchronizing dual write regions while preventing split-brain state divergence.
Disaster Recovery: RTO / RPO Planning & Tiering
PROArchitecting cross-cloud cold/warm/hot standbys and data tiering to hit 15-minute recovery objectives.
9. Data-Intensive & Analytics Systems [Pro]
High-volume streaming, real-time analytics, and Change Data Capture pipelines.
Data Lake vs Data Warehouse vs Lakehouse (Iceberg/Delta)
PROACID transactions on object storage, metadata layers, and column-oriented parquet compression.
Change Data Capture (CDC) with Debezium & Kafka Connect
PROStreaming database write-ahead logs (WAL) to search indexes and caches without touching OLTP CPU.
Real-Time OLAP Engines (ClickHouse, Pinot, Druid)
PROVectorized query execution, sparse primary indexing, and sub-second aggregations over billions of events.
Kappa vs Lambda Architecture (Batch vs Stream)
PROChoosing between dual-path batch/speed layers versus pure single-model stream processing (Apache Flink).
10. Staff-Level Case Studies & System Designs [Pro]
Complex end-to-end architectures frequently tested in Big Tech Principal loops.
Design a Distributed Lock Service (etcd / ZooKeeper)
PRORaft consensus, heartbeat leases, watch notifications, and split-brain fencing tokens.
Design a Global Payment & Ledger System (Stripe / Razorpay)
PRODouble-entry immutability, idempotency keys, payment intent state machines, and reconciliation.
Design a Real-Time Collaborative Document Editor (Google Docs / Figma)
PROOperational Transformation (OT) vs CRDTs, WebSocket multiplexing, and undo/redo stacks.
Design a Distributed Job Scheduler & Cron Engine
PRODelayed queues, distributed timing wheels, leader election, and at-least-once execution guarantees.
Design a Global Feature-Flagging & Experimentation Platform
PROSub-millisecond SDK evaluation, streaming rule updates via SSE/gRPC, and statistical A/B test bucketing.
Design a Global Cross-Region Rate Limiter
PROSliding window counters, Redis cluster local sync, and edge botnet WAF mitigation.