How to Monitor Health Checks for Vultr Serverless Inference

Health Checks on Vultr Serverless Inference ensures that your deployments remain operational and responsive. By periodically checking its status, you can proactively detect potential issues and maintain seamless AI performance.

Follow this guide to check the status of Serverless Inference subscription using the Vultr API.

1. Send a GET request to the List Serverless Inference endpoint and note the target inference subscription's ID.

   console Copy

   $ curl "https://api.vultr.com/v2/inference" \
       -X GET \
       -H "Authorization: Bearer ${VULTR_API_KEY}"
   

2. Send a GET request to the Serverless Inference endpoint and note the target inference subscription's API key.

   console Copy

   $ curl "https://api.vultr.com/v2/inference/{inference-id}" \
       -X GET \
       -H "Authorization: Bearer ${VULTR_API_KEY}"
   

3. Send a GET request to the Health Check endpoint to view the current status of the target inference subscription.

   console Copy

   $ curl "https://api.vultrinference.com/v1/health" \
       -X GET \
       -H "Authorization: Bearer ${INFERENCE_API_KEY}"