Problem 5: what if demand for machines increases?

Grow Without Waiting

Concepts appear as they come up…

Our Load Balancer is doing its

00:00/01:25

1 / 1

Grow Without Waiting

Certisured is an Edtech based out of Bangalore and is Co-founding team of Wizori - built to provide quick fundamental clarity in form of short vibes.

www.certisured.com

Grow Without Waiting

Loading comments…

Continue your learning — your way

Sign in to unlock the full playlist, save your progress, and get a personalized feed.

Up next

Engineering Problem 1: Renting a Computer
1:23
Problem 8: Must We Ask the Database Every Time?
1:38
Problem 4: Who Should Handle the Next User?
1:32
Problem 6: Do We Really Need a Server?
1:29
Problem 22: How Do We Analyze Massive Data?
1:39
Problem 7: Are Files Enough for Business?
1:45
Problem 21: Where Should We Keep Our Secrets?
1:44
Every Cloud Service Begins With a Problem
1:16
Problem 20: How Do Services Complete One Workflow?
1:38
Problem 3: Shared Object Storage
1:32
Problem 2 : Computer is temporary but, Data is permanent
1:20
Problem 23: How Do We Query Massive Data?
1:33

Problem 5: what if demand for machines increases? — full transcript

Grow Without Waiting

Grow Without Waiting

Our Load Balancer is doing its job. It distributes users across all available virtual machines. But one evening, your application suddenly goes viral. Within minutes, every virtual machine is running at full capacity. The Load Balancer has nowhere else to send new users. The engineering problem was now obvious. How do we increase computing capacity automatically when demand increases? The engineering concept that solved this problem is Auto Scaling. Instead of relying on engineers to manually launch new virtual machines, the cloud continuously monitors demand. When CPU usage, memory consumption or incoming traffic crosses a defined threshold, new virtual machines are created automatically. As demand falls, the extra machines are removed, ensuring resources are used efficiently. Amazon Web Services calls this Auto Scaling. Microsoft Azure calls it Virtual Machine Scale Sets (VMSS) with Autoscale. Google Cloud calls it Managed Instance Groups (MIG) with Autoscaling. Different names. One engineering concept. Applications can now expand and shrink automatically based on demand. But this revealed another question. Do we really need to create an entire virtual machine just to run a few lines of code?