The Monitoring section provides a real-time overview of Token Usage Metrics within your organization. It is the primary tool for administrators to track consumption, audit activity, and manage AI-related costs.
You can adjust the analysis period (Last 24h, Last 7 days, Last 30 days, or Earlier) in the upper-right corner.
Overview
The first row of the dashboard displays the financial and volume summary:
- Total Questions: The total number of interactions processed by the AI during the selected period.
- Average Cost / Question (USD): The average token cost required to generate a response. Helps assess the efficiency of Agent usage.
- Total Cost (USD): The total token consumption cost (billed to your Azure account) during the selected period.
Detailed Usage Metrics
Below the overview, the metrics are segmented to enable granular consumption auditing, ensuring full transparency and governance:
| Metrics Table | Purpose | Key Fields |
|---|---|---|
| Usage by Agent | Shows which Agents (AI assistants) are being used the most. Essential for identifying costs by specific area or function. |
|
| User by Number of Questions | Identifies the users generating the highest volume of interactions with the AI. Helps monitor adoption and identify users who may need additional training. |
|
| Usage by Model | Provides a breakdown of usage across the different registered AI Models. Enables administrators to make cost-related decisions by prioritizing more efficient models. |
|
| Agent by User | Displays cross-referenced data, showing which user is using which Agent and the specific cost of that interaction. |
|