Features

Autoscale

Copy page

Autoscaling is load balancing where the number of instances used to handle your traffic automatically adapts to match the current traffic load. On Unikraft Cloud, scale-out (the process of adding instances to cope with increased load) happens in milliseconds. You can transparently and effortlessly handle load increase including traffic peaks. No more headaches due to slow autoscale like keeping hot instances around to deal with peaks, coming up with complex predictive algorithms, or other painful workarounds. You can set autoscale on and let Unikraft Cloud handle your traffic increases and peaks.

The basics

As with load balancing, autoscaling in Unikraft Cloud takes care of a service. Services allow you to load balance traffic for an Internet-facing service like a web server by creating many instances within the same service.

While you can add or remove instances to a service to scale your service, doing this manually makes it hard to react to changes in traffic load. Keeping many instances running to cope with intermittent bursts would be wasteful and expensive. This is where autoscale comes into play.

With autoscale enabled, Unikraft Cloud takes care of the heavy lifting for you by continuously monitoring the load of your service and automatically creating or deleting instances as needed.

Setting up autoscale

First, use the kraft cloud deploy command to create an instance, in this example using NGINX:

 
git clone https://github.com/unikraft-cloud/examples
cd examples/nginx/
kraft cloud deploy -p 443:8080 -M 256 .

 
[●] Deployed successfully!
 │
 ├────────── name: nginx-4d7u3
 ├────────── uuid: 8fda2a70-6a32-4b5e-8900-4395b33d02d7
 ├───────── state: running
 ├─────────── url: https://small-leaf-rafirkw7.fra.unikraft.app
 ├───────── image: nginx@sha256:389bfa6be6455c92b61cfe429b50491373731dbdd8bd8dc79c08f985d6114758
 ├───── boot time: 20.36 ms
 ├──────── memory: 256 MiB
 ├─────── service: small-leaf-rafirkw7
 ├── private fqdn: nginx-4d7u3.internal
 ├──── private ip: 172.16.6.5
 └────────── args: /usr/bin/nginx -c /etc/nginx/nginx.conf

This single kraft cloud deploy command does 3 things:

1. Creates an instance of NGINX which will serve as the autoscale master instance.
2. Creates a service via the -p flag (named small-leaf-rafirkw7).
3. Attaches the instance to the service (the -p flag also does this automatically).

All that's left to do now to set up autoscale is to set an autoscale configuration policy and to set the instance as master. Unikraft Cloud then takes care of cloning this master instance whenever load increases. To achieve this, use the kraft cloud scale command:

 
kraft cloud scale init small-leaf-rafirkw7 \
  --master nginx-4d7u3 \
  --min-size 1 \
  --max-size 8 \
  --warmup-time 1s \
  --cooldown-time 1s

kraft cloud scale add small-leaf-rafirkw7 \
  --name scale-out-policy \
  --metric cpu \
  --adjustment percent \
  --step 600:800/50 \
  --step 800:/100

kraft cloud scale add small-leaf-rafirkw7 \
  --name scale-in-policy \
  --metric cpu \
  --adjustment percent \
  --step :50/-50

Note the following:

• The first command sets the master to the created instance, and configures it to scale up to a maximum of 8 instances and a minimum of 1; the command also sets the warm up and cool down time to 1 second each, so it doesn't constantly fluctuate up and down.
• The second command sets the scale-out policy based on CPU utilization (in millicores): between 60% and 80% utilization, the system increases instances by 50%. From 80% onward, the number of instances doubles.
• The third command sets the scale-in policy: below 50% utilization, the system reduces the number of instances by half (note the - sign for scale-in).

Testing it

To check it's working, you can use the kraft cloud scale get command to list the autoscale properties of the service:

 
kraft cloud scale get small-leaf-rafirkw7

You should see output like:

 
          uuid: 5ca059ec-a24a-41f2-8413-f09bc58730ca
          name: small-leaf-rafirkw7
       enabled: true
      min size: 0
      max size: 8
   warmup (ms): 1000
 cooldown (ms): 1000
        master: f840ac12-f485-4f02-9f33-6a0a7de46f1f
      policies: scale-out-policy;scale-in-policy

To list an individual policy, you can further use the kraft cloud scale get command as follows:

 
kraft cloud scale get --policy scale-out-policy small-leaf-rafirkw7

You should see output like:

 
adjustment_type: percent
enabled: true
metric: cpu
name: scale-out-policy
status: success
steps:
- adjustment: 50
  lower_bound: 600
  upper_bound: 800
- adjustment: 100
  lower_bound: 800
type: step

You can further check that the master instance is on standby (scaled to zero), assuming your service hasn't received any traffic yet. You can get the UUID of your master instance from the kraft cloud scale get command above.

 
kraft cloud instance get f840ac12-f485-4f02-9f33-6a0a7de46f1f -o list

You should see output like:

 
          uuid: f840ac12-f485-4f02-9f33-6a0a7de46f1f
          name: nginx-9mbf2
          fqdn: restless-resonance-0oo7m7s8.fra.unikraft.app
    private ip: 172.16.6.4
         state: standby
    created at: 30 minutes ago
         image: nginx@sha256:d4325c1f1a472c511723148adc380d491029f4c98a2367fbeff628c6456d4180
        memory: 256 MiB
          args: /usr/bin/nginx -c /etc/nginx/nginx.conf
           env:
       volumes:
      service : 5ca059ec-a24a-41f2-8413-f09bc58730ca
     boot time: 19465us

Note the value of the state field. Now to make sure the service is up, curl the service address:

 
curl https://small-leaf-rafirkw7.fra.unikraft.app

You should get an immediate response, even though the instance was on standby. You can use the watch tool to see if you catch the instance changing state from standby to running:

 
watch --color -n 0.5 kraft cloud instance list

Learn more

• The kraft cloud command-line tool reference, and in particular the scale subcommand.
• Unikraft Cloud's REST API reference, and in particular the section on autoscale.