A guide explaining how to set up and deploy GPU-powered virtual machines on Vultrs cloud platform.
Vultr Cloud GPU instances are virtual machines that run with dedicated NVIDIA GPUs designed for AI applications, machine learning, HPC, visual computing, and VDI. Cloud GPU instances include a dedicated GPU device capable of running multiple applications depending on your resource requirements.
Follow this guide to provision Vultr Cloud GPU instances using the Vultr Customer Portal, API, CLI, or Terraform.
Navigate to Products and select Compute on the list of product options.
Click Deploy to access the Deploy New Instance page.
Select Cloud GPU.
Choose your desired Vultr location to deploy the instance.
Select a GPU type from the sidebar based on your workload requirements.
Select a plan from the available options based on your GPU, vCPU, memory, storage, and bandwidth requirements.
Click Configure Software.
Select a cloud image to install on your instance based on the following options:
Select optional Server Settings to apply on the instance.
Enter a new hostname in the Server Hostname field and a descriptive label in the Server Label field to identify the instance.
Configure Additional Features for the instance.
linuxuser non-root user with sudo privileges as the default user account instead of root.Click Deploy to provision the instance.
Send a POST request to the Create Instance endpoint to create a new Vultr Cloud GPU instance. Replace VULTR_LOCATION, INSTANCE_PLAN, OS_ID, INSTANCE_LABEL, and HOSTNAME with your target values.
$ curl "https://api.vultr.com/v2/instances" \
-X POST \
-H "Authorization: Bearer ${VULTR_API_KEY}" \
-H "Content-Type: application/json" \
--data '{
"region" : "VULTR_LOCATION",
"plan" : "INSTANCE_PLAN",
"os_id" : OS_ID,
"label" : "INSTANCE_LABEL",
"hostname": "HOSTNAME"
}'
Visit the Create Instance API page to view additional attributes you can apply on the Vultr Cloud GPU instance.
Create a new Vultr Cloud GPU instance. Replace VULTR_LOCATION, INSTANCE_PLAN, OS_ID, INSTANCE_LABEL, and HOSTNAME with your target values.
$ vultr-cli instance create --region VULTR_LOCATION --plan INSTANCE_PLAN --os OS_ID --label INSTANCE_LABEL --host HOSTNAME
Run vultr-cli instance create --help to view additional options you can apply on the Vultr Cloud GPU instance.
Ensure the Vultr Terraform provider is configured in your Terraform project.
Add the Cloud GPU instance resource to your Terraform configuration.
terraform {
required_providers {
vultr = {
source = "vultr/vultr"
version = "~> 2.26"
}
}
}
provider "vultr" {}
resource "vultr_instance" "gpu" {
region = "del" # Target deployment region
plan = "vcg-a100-12c-120g-80vram" # Cloud GPU plan ID (A100/A40/A16)
os_id = 2284 # Ubuntu 24.04 LTS x64
label = "gpu-instance-1"
hostname = "gpu-instance-1"
enable_ipv6 = true
}
output "public_ip" {
value = vultr_instance.gpu.main_ip
}
Apply the configuration and observe the following output:
Apply complete! Resources: 1 added, 0 changed, 0 destroyed.