Monitoring the Vultr Serverless Inference subscription is essential for maintaining the performance and cost-efficiency of your AI deployments. By tracking the usage of various AI workloads, such as "Prompt, Chat, Text-to-Speech" and "RAG Chat Completion," you can gain valuable insights into resource consumption, optimize performance, and prevent potential bottlenecks. This proactive monitoring ensures that your AI applications run smoothly, delivering consistent and reliable results while keeping operational costs under control.
Follow this guide to monitor the usage of Serverless Inference on your Vultr account using the Vultr Console, API, or CLI.
Navigate to Products, click Serverless, and then click Inference.
Click your target inference subscription to open its management page.
Open the Usage page.
View the usage statistics for all inference endpoints.
0 Comments
Be the first to comment and share your perspective with the community.