Building a Resilient Cloud Application: The Network Layout

This is the first of a series that I want to breakdown the different components of modern day applications that operate around the world, and has become easy to deploy with the cloud.

The Network Layout

Regions

Around the world, the big cloud have graciously put the effort to build the infrastructure to host your applications in just about everywhere in the world. In order to organize a set of systems, each provider offers various "Regions" that you can set up your cluster.

For example AWS has setup 16 different regions all over the world, from US-WEST-1 in Northern Calfornia, to US-EAST-2 in Ohio, all across the world to EU-CENTRAL-1 in Frankfurt to AP-SOUTH-1 in Mumbai.
Image result for aws regions


For a full list check out their availability regions listed here.

Regions are responsible for isolating your application to a particular region. An application deployed to one region will not be available in another region. We use this principle to isolate failure and to have higher control of our systems which we'll talk about later.

Availability Zones 

Within each region, there are typically further physically isolated data centers called Availability Zones. While there are still network connectivity between the Availability Zones, each zone is physically separated from one another. This allows further resiliency that if one location experiences natural or technical issues, it has other availability zones to fall back to. It is generally easy to split your resources across these availability zones with small performance drawbacks.


Typical Application Setup

Utilizing this infrastructure, companies around the world have been able to build globally accessible, fault-tolerant systems.

What you will usually find is that a company will have multiple application stacks running concurrently across multiple regions, for example one in Northern California and one in Frankfurt. Each stack should more or less self-sustainable in that it has all the services it needs to operate. Persistent data such as Databases may be access cross-region, but there are emerging technology that is pushing us towards a more completely isolated system. In each region, their application will be deployed to one or more Availability Zones for further separation.

Now the question lies, if you have multiple application stacks running around the world, how do you determine which one a user accesses? This is solved by fronting your application with a DNS service such as UltraDNS, or Route 53 in order to route traffic according to various rules to the server that you want. Strategies will be explained in a future post.

Typical Request Flow

1. Request is made to your application
2. The DNS service decides which region to send your request
3. The Region accepts the request, and send to a Load Balancer
4. The Load Balancer will decide which instance to send the request, which is in a specific Availability Zone
5. Your instance will handle the request and respond appropriately

Comments

Post a Comment

Popular posts from this blog

Uncle Bob's Clean Architecture

Image
The basis of my current understanding of architecture comes from the brilliant mind of Robert C. Martin (Uncle Bob). You can find the original post through his blog , which I strongly encourage you to read. In this post I'll try to summarize some of the key points I've understood from his post. Clean Architecture Source Clean architecture is a design used to emphasize the structure and relation of your various code components to promote the idea of Dependency Rule , such that "source code dependencies only point inwards" . Clean architecture is able to promote this by defining that your software system consists of various layers , that can be organized in such a way that the layers point in one direction, and a dependency graph will not have circular reference. The reason this is important is because it allows you to keep closely code related, and increase clarity of how components fit into your system. Explaining the Layers We can really separate out this ...
Read more

C4 Model: Describing Software Architecture

Image
The point behind a presentation of Visualizing Software Architecture , by Simon Brown, was that we need to standardize the way software developers communicate with each other in respect to our discussions of software architecture. As part of Simon's consultation, one exercise he gave to software architects was a simple task to white board the architecture of a software system. The results he received varied immensely, and there was never a defacto standard format that he received from this exercise. When inspecting the feedback from the participants, the general answer was that it was easy to come up with the design, but difficult to properly put their ideas onto paper, or white board in this case. White Board Example, c4model.com Simon sought to start a movement by defining a set of organizational rules to help us describe our software architecture with a set of standard terminologies. His work has let to C4 Model , which stands for C ontext, C ontainers, C omponents,...
Read more

Running RabbitMQ with Docker

Image
Short post today, mostly just wanted to how to setup RabbitMQ for local development. Refer back to my previous post to learn more about RabbitMQ. Prerequisite Docker For complete guide reference, check out the Docker Hub Website for RabbitMQ . Why use Docker? Before starting my current job at iHerb, I would go straight for the Windows installation (my development environment) for all of my development tools needs. It was straight forward and "just worked" a lot of the time. What I've begun to realize experimenting with all these different tooling and services is that things can get a bit cluttered, you will have a bunch of supporting systems that need to be run - caches, queues, databases and it can be a hassle to manage them through window services and executables. Additionally some of these require additional dependencies outside of the executable itself, which prompts you to install even more tooling. The great thing about docker is that it defi...
Read more