Distributed-Systems

Comprehensive guide to Agentic AI Systems: Designing LLM-Powered Workflows with Tool Use, Memory, and Guardrails for software engineers

Explore key patterns like circuit breakers, bulkheads, and saga orchestration that make distributed systems resilient and scalable.

Learn how to design a highly available, distributed caching system with consistent hashing, replication, and eviction policies.

Learn how to design a scalable URL shortening service with high availability, low latency, and analytics capabilities.

Strategies and patterns for managing data consistency across distributed microservices, including event sourcing and SAGA patterns.

Distributed stream processing framework for real-time analytics, event-driven applications, and complex event processing

Distributed streaming platform designed for high-throughput, real-time data pipelines and event-driven architectures

Real-time computation system for processing unbounded streams of data with guaranteed message processing

Google's Distributed Storage System for Structured Data.

Understanding consensus algorithms that can tolerate Byzantine (malicious) failures in distributed systems

Understanding the fundamental trade-offs in distributed systems design and implementation

Understanding fault tolerance and failure handling in distributed systems

Understanding data distribution and load balancing in distributed systems

Separating read and write operations for scalable and maintainable distributed systems

Coordinating access to shared resources across distributed systems

Amazon's distributed key-value storage system designed for high availability and eventual consistency.

Distributed search and analytics engine built on Apache Lucene for real-time search, logging, and data analytics

Retry strategy that progressively increases delay between retry attempts to handle transient failures and prevent system overload

Google's scalable distributed file system designed for large distributed data-intensive applications.

Understanding epidemic-style information dissemination protocols for scalable and fault-tolerant distributed systems

Scaling strategy that increases system capacity by adding more machines or instances rather than upgrading existing hardware

Ensuring operations can be safely retried without unintended side effects

LinkedIn's distributed streaming platform designed for high-throughput, low-latency data streaming.

Understanding how distributed systems select a leader to coordinate operations and maintain consistency

Google's simplified data processing on large clusters.

Concurrency control mechanism that assumes conflicts are rare and handles them when they occur, using version numbers or timestamps to detect concurrent modifications

Messaging pattern for decoupled communication between distributed systems

Understanding quorum-based consensus mechanisms for ensuring consistency and availability in distributed systems

Raft is a consensus algorithm for managing a replicated log that is easier to understand than Paxos while providing equivalent functionality and efficiency.

Global vs local secondary indexes in distributed systems

Understanding techniques to prevent split-brain scenarios in distributed systems where multiple nodes believe they are the leader

Explore the most influential Apache Software Foundation projects used in modern distributed systems and data processing