Requesting Quota Increase#
Most cloud providers enforce a quota policy to limit the number of VM instances that can exist in a given region. Users may encounter QuotaExceeded or VcpuLimitExceeded errors during resources provisioning, especially for high end GPUs such as H100/A100. To check or increase your quota limits, please follow the below instructions. After submitting the request, it will usually take a few days for the support team to review. To increase chances of being approved, you may respond their inquiry emails on how the requested resources will be used your projects.
AWS#
Go to the EC2 Quotas console.
Select a region on the top right.
Choose an EC2 instance type from the list (e.g,
Running On-Demand P instances
orAll P Spot Instance Requests
). Usesky show-gpus --cloud aws --all
or check here for more instance types.Click the quota name, and then choose Request quota increase.
For Change quota value, enter the new value.
Choose Request.
Azure#
First go to Azure’s quota page.
Select Request Increase near the top of the screen.
For Quota type, select
Compute-VM (cores-vCPUs) subscription limit increases
. Hint: note that a message “Get more quota now. You don’t need a support ticket to get more quota…” may pop up; feel free to skip it as requesting quotas for most GPU instances still requires creating support tickets (next steps).Select Next to go to the Additional details screen, then select Enter details.
In the Quota details screen:
For Deployment model, ensure Resource Manager is selected.
For Locations, select all regions in which you want to increase quotas.
For each region you selected, select one or more VM series from the Quotas drop-down list.
For each VM Series you selected (e.g.,
ND_H100_v5
for H100 instances), enter the new vCPU limit that you want for this subscription. You may check for more VM Series.When you’re finished, select Save and continue.
Enter or confirm your contact details, then select Next.
Finally, ensure that everything looks correct on the Review + create page, then select Create to submit your request.
GCP#
In the Google Cloud Console, go to the Quota page.
Click Filter and select
Service: Compute Engine API
.For H100 GPUs: choose
metric: GPUS_PER_GPU_FAMILY
and select dimensiongpu_family: NVIDIA_H100
.For all other GPUs: choose
Limit Name: instance_name
. (e.g.,NVIDIA-V100-GPUS-per-project-region
). You may check the the compute GPU list.Select the checkbox of the region whose quota you want to change.
Click Edit Quotas and fill out the new limit.
Click Submit Request.
OCI#
Go to the OCI Limits, Quotas and Usage console to check your current resources status.
Click the request a service limit increase link on the page if you want to increase quotas.
Choose a Service Category from the list (e.g,
Compute
).Choose a Resource from the list (e.g,
GPUs for GPU.A10 based VM and BM Instances
). Usesky show-gpus --cloud oci --all
or check here for more instance types.Enter the Limit field for your new limit and Reason for request for justification.
Click Create Support Request to submit.
You may check OCI Service Limits for more information.