Token Consumption
The Token Consumption menu is your data source for detailed auditing, presenting a transactional log of each AI interaction. It allows the administrator to track token costs per question, ensuring full transparency in the consumption of your Azure account.
Purpose
Financial Audit: Identify exactly where the cost is being generated.
Cost Optimization: Analyze consumption by Model and Agent to make decisions about choosing the most efficient model for each function.
Governance: Link each interaction to a specific user and project.
Table Details
The log table displays the following fields for each transaction (question/response):
Project
The Azure resource that generated the consumption.
Model
The specific AI model used in the interaction.
Agent
The AI assistant used by the user.
User
The user who initiated the interaction.
Input Tokens
The number of tokens used in the user’s prompt.
Output Tokens
The number of tokens used to generate the AI response.
Total Cost
The financial cost of the specific interaction in US dollars (USD).
Last updated