Skip to main content
Vantage integrates with your Baseten account using an API key to ingest cost and usage data through the Baseten Billing Usage Summary API. Vantage retrieves detailed cost and usage data broken down by product line (Dedicated Inference, Training, and Model APIs), model deployment, instance type, environment, and model. Usage data is available for Baseten, measured in hours for Dedicated Inference and Training, and in tokens for Model APIs.

​
Baseten Permissions

Vantage connects to Baseten using an API key and validates access by reading billing usage summary data. Vantage cannot deploy models, trigger inference or training jobs, or perform any actions that incur costs in your Baseten account. You must be a Team Admin (or organization Admin) to create a Team API key. See the Baseten API keys and Teams documentation for details. It’s best practice to create a dedicated Team API key for Vantage and rotate it according to your organization’s security policy. To access the Baseten Billing Usage Summary API, the Team API key must be created with the Manage and call all team models permission level. This grants additional permissions beyond what Vantage uses; however, Vantage only reads data from the Billing Usage Summary API endpoint related to usage, and will never perform any other actions. Baseten does not currently support fine-grained permissions for Team API keys. We recommend submitting a feature request to Baseten for improved permission scoping, and Vantage will adopt fine-grained permissions if this becomes available.

​
Connect Your Baseten Account

​
Prerequisites

  • You must have a Vantage Organization Owner or Integration Owner role to add or remove this integration. See the Role-Based Access Control documentation for details.
  • You must be a Team Admin (or organization Admin) in Baseten to create a Team API key.
  • Create a free Vantage account, then follow the steps below to integrate Baseten costs.

​
Create the Connection

1
Sign in to the Baseten console and click API Keys in the sidebar.
2
Click Create API key.
3
Give the key a descriptive name, select Team as the type, and click Next.
4
Select Manage and call all team models as the permission level, then click Create API key.
5
Copy the API key.
Baseten only shows the API key once. Save it securely before closing the dialog.
6
From the top navigation in Vantage, click Settings.
7
On the left navigation, select Integrations > Baseten.
8
The Baseten integrations page is displayed. Ensure you are on the Connect tab.
9
Click Add API Key and complete the integration form:
  • API Key: Paste the Baseten Team API key.
  • Description: Enter a label to identify this Baseten account or workspace in Vantage. This value is used as the Organization dimension in Cost Report filters.
10
Click Connect Account.
After clicking Connect Account, you will see the status of your integration change to Importing within the Vantage console. This status indicates that Vantage is actively importing your Baseten cost data. Vantage backfills up to six months of historical cost data upon initial connection. See the Integration Status documentation for details on integration statuses. You can connect multiple Baseten organizations, each with its own API key, as separate integrations in Vantage.
As soon as costs are processed, they will be available on your All Resources Cost Report. If you decide to remove your Baseten integration from Vantage, all costs associated with that Baseten API key will be removed from the Vantage console.

​
Next Steps - Manage Workspace Access

Once the import is complete and the integration status changes to Stable, you can select which workspaces this integration is associated with. See the Workspaces documentation for information.

​
Data Refresh

See the provider data refresh documentation for information on when data for each provider refreshes in Vantage. Baseten data refreshes once daily.

​
Baseten Reporting Dimensions

On Baseten Cost Reports, you can filter and group across several dimensions:
  • Organization (the description you enter when connecting the integration)
  • Service (i.e., the Baseten product line, such as Dedicated Inference, Training, or Model APIs)
  • Category (i.e., the model name)
  • Subcategory (i.e., the instance type for Dedicated Inference and Training, such as H100; or the token type for Model APIs, such as Input Tokens, Cached Input Tokens, or Output Tokens)
  • Resource (i.e., the deployment or job ID for Dedicated Inference and Training, or the model name for Model APIs)
  • Charge Type (Usage or Credit)
In addition, Baseten costs include the following provider tags, which are automatically created by Vantage and available for filtering and grouping alongside any Virtual Tags you create:
Historical cost attribution is preserved for deleted or torn-down deployments. The Baseten billing API continues to return deleted resources in the cost breakdown, so spend from a model deployment that has since been torn down still appears in your historical Baseten reports.