The Scale Tier on the API Platform enables you to purchase a set number of API input and output tokens per minute (known as “token units”) upfront for access to one dedicated model snapshot. Each token unit is purchased for a minimum of 30 days.
Once you’ve signed an order form, you can add and remove token units through your API Platform account. Please note that only Organization owners and authorized users may view Scale tier settings and purchase input and output token units.
How can I access my Scale Tier settings?
API Platform Organization owners can access their Scale tier settings by selecting the Settings gear on the top-right of the page and selecting Scale Tier.
The Scale tier setting page enables you to add more capacity, view your input token usage, plan for capacity, view your provisioned tokens, and review your authorized purchasers.
How can I purchase more capacity?
You can purchase capacity by selecting the Add capacity button on the top-right of your Scale tier page.
Please note that each input token unit increases your input capacity by 20k TPM, and each output token unit increases your output capacity by 2k TPM.
After selecting the type of tokens you will purchase, you can directly enter an amount or move the slider to select the number of tokens you wish to purchase. The slider enables you to easily view the TPM changes under Summary as you change the tokens. We will also provide a recommendation on the number of units to purchase to cover your last 30 days of traffic.
Once you have finalized your selection, select Checkout to confirm your purchase in the next modal.
Please note that the prices shown in our summary are our standard rates and do not include any discounts negotiated in your organization’s order form. Any applicable discounts will be applied and reflected in the invoice issued to your organization. Any units purchased will be active until the start of the next invoice period, and renew daily after that.
How can I view my purchase history and expired tokens?
You can view your Scale tier purchase history in your Scale tier page by selecting a model under Provisioned tokens.
Once you select a model, you will be able to view Expired tokens and Prior transactions at the bottom of the page.
How can I edit my token capacity?
You can edit a model’s token capacity by selecting a model under Provisioned tokens in your Scale tier page. Once you select a model, find your purchase under the Active header and select Cancel next to your purchase to edit
In the modal, you can enter the number of units to cancel directly or use the slider to model the TPM as you make your selection.
How can I view my Scale Tier RPM/TPM and usage?
You can view a summary of API usage for your organization in your Scale tier page. All dates and times are UTC-based, and data may be delayed up to 5 minutes.
You can review your usage in the Activity Usage Dashboard by selecting your Scale tier models in the models drop-down. You can view this data in a 30 day, 1 day, and 15 minute window. Your usage data is stacked to show the amount of usage for the model covered by your Scale tier against the amount of usage covered by your account plan.
Please note that only Organization owners can view the Usage Dashboard.
Does Scale Tier spend count against org spend limits?
Yes, all TCU spend contributes to the spend limits set on your project and your organization.
Spend limits can be set in the Limits page of your API Platform.