Monitoring

The Monitoring section provides a real-time overview of Token Usage Metrics within your organization. It is the primary tool for administrators to track consumption, audit activity, and manage AI-related costs.

You can adjust the analysis period (Last 24h, Last 7 days, Last 30 days, or Earlier) in the upper-right corner.

Overview

The first row of the dashboard displays the financial and volume summary:

• Total Questions: The total number of interactions processed by the AI during the selected period.

• Average Cost / Question (USD): The average token cost required to generate a response. Helps assess the efficiency of Agent usage.

• Total Cost (USD): The total token consumption cost (billed to your Azure account) during the selected period.

Detailed Usage Metrics

Below the overview, the metrics are segmented to enable granular consumption auditing, ensuring full transparency and governance:

Metrics Table	Purpose	Key Fields
Usage by Agent	Shows which Agents (AI assistants) are being used the most. Essential for identifying costs by specific area or function.	Agent Questions Cost per Question Total Amount (USD)
User by Number of Questions	Identifies the users generating the highest volume of interactions with the AI. Helps monitor adoption and identify users who may need additional training.	User Total Questions Total Amount (USD)
Usage by Model	Provides a breakdown of usage across the different registered AI Models. Enables administrators to make cost-related decisions by prioritizing more efficient models.	Model Questions Total Amount (USD)
Agent by User	Displays cross-referenced data, showing which user is using which Agent and the specific cost of that interaction.	Agent User Questions Cost per Question

Governance and Cost

The Monitoring dashboard is your governance tool. By auditing Cost per Agent and Usage by Model, you can adjust Agent configurations and apply usage limits to control total token spending.