LLM Mesh cost quota
Catalog row in Vendor License Metrics · Cited
- Unit
- US dollars of LLM cost
- Aliases
- Quota
- Definition
- A quota in the LLM Mesh Cost Control that tracks LLM spend in US dollars for a scope (all queries, or a provider, project, connection or user filter), optionally blocking queries once exhausted.
- Counting rules
- A query can match several quotas, and all matching quotas are incremented. A Fallback Quota applies to queries that match no other quota. Cost tracking is not supported for Amazon SageMaker LLM, Databricks Mosaic AI or Snowflake Cortex.
- Floors / minimums
- Without Advanced LLM Mesh only a single global quota may be configured.
- Applies to products
- Dataiku LLM Mesh
- Product category