AWS ECS using EC2 vs Fargate: What’s the difference?
When discussing options to run Docker on AWS, We need to know the differences between ECS and AWS Fargate?
Here you get the answer. You also learn about the advantages and disadvantages of both options.
To understand the difference, let’s divide the ECS service into two responsibilities:
- Managing the lifecycle and placement of tasks
- Running containers
Managing the lifecycle and placement of tasks
First, ECS is responsible for managing the lifecycle and placement of tasks. A task is usually made of one or two containers that work together, e.g., an nginx container with a php-fpm container. You can ask ECS to start or stop a task, and it stores your intent. However, ECS does not run or execute your container. ECS only provides the control plane to manage tasks. So, who runs the containers?
Running containers
To run containers, you have two options. You can use ECS container instances, or you can use Fargate. Both options work together with ECS.
ECS container instance
An ECS container instance is nothing more than an EC2 instance that runs the ECS Container Agent. The EC2 instance is owned and managed by you. The instance appears in the list of EC2 instances like any other EC2 instance. The ECS Container Agent regularly polls the ECS API if new containers need to be started or stopped. Usually, you run a cluster of container instances in an auto-scaling group. ECS is free of charge. You only pay for the EC2 instances. The downside is that you have to scale, monitor, patch, and secure the EC2 instances yourself. Especially the scaling is not easy because:
- There is no obvious metric to scale the cluster and no integration to scale when the task placement fails because of insufficient capacity.
- The auto-scaling group and ECS are not aware of each other, making task deployments very hard during cluster scale in or rolling updates via CloudFormation (Capacity Providers address this issue but are not ready for prime time yet).
- You have to scale down without killing running tasks, which is an even more significant challenge for long-lived tasks.
Even the AWS reference architecture does not include auto-scaling for the cluster. Check out our reference architecture with auto-scaling if you are interested.
An ECS container instance can run on Linux or Windows. Unused CPU shares can be used by other containers if available.
Fargate
AWS Fargate manages the task execution. No EC2 instances to manage anymore. You pay for running tasks. That’s it. As easy as it sounds.
Each task that runs in Fargate comes with a dedicated Elastic Network Interface (ENI) with a private IP address. All containers of the same task can communicate with each other via localhost. Inbound and outbound task communication goes through the ENI. A public IP address can be enabled as well.
Summary
So finally There are two major models for how to run your containers on AWS:
- EC2 (Deploy and manage your own cluster of EC2 instances for running the containers)
- AWS Fargate (Run containers directly, without any EC2 instances)
Both are completely valid techniques for operating your containers in a scalable and reliable fashion. Which one you pick primarily depends on which factors you want to optimize for.
ECS or Fargate is not the right question to ask. The question is whether to use container instances or Fargate. What ECS calls a container instance is known as a worker node in Kubernetes/EKS.
We learned it the hard way. Scaling container instances is a challenge. That’s why we recommend using Fargate. Fargate is much easier to operate. Use it if possible (see networking, vCPU, memory, host OS, and EBS limitations).