Home / Dashboards

Dashboards is the default landing page in the Admin UI. It gives operators a visual overview of request volume, token usage, spend, latency, guardrail activity, model reliability, user activity, and cache efficiency without opening Usage and Cost or Traces for every check. For scenario-based examples, see Use Cases — Dashboards.

The page contains dashboard tabs created by users. The DEFAULT dashboard tab is always available and provides an organization-wide overview. Time range controls (1h, 24h, 7d, 30d, and Custom) apply to all dashboard components. Available actions include REFRESH to reload data, auto-refresh controls, PIN DASHBOARD to pin the current dashboard when available, + CREATE DASHBOARD to create a custom dashboard, and EDIT to modify the dashboard layout. When you add or edit a panel, choose a Panel type in Panel settings—see Dashboard panel types.

DEFAULT Dashboard

The DEFAULT dashboard combines summary cards, charts, and ranked breakdowns for the selected time range.

The Cost and Usage Summary section provides a high-level overview of platform activity through summary cards for Total requests, Success rate, Total input tokens, Total output tokens, Total spend, and Avg latency. Use these metrics as a quick health check before investigating detailed trends.

The Total Tokens chart displays token consumption over time and helps identify spikes in input or output token volume.

The Cost Breakdown chart visualizes spending for the selected period. Use it to review cost trends and identify intervals that may require further investigation.

The Models Breakdown view ranks models by usage and supports both Spend and Total tokens modes. This view helps identify which models contribute most to overall cost and token consumption.

The Users Breakdown view ranks users by activity and also supports Spend and Total tokens modes. Use it to identify high-usage users and unusual activity patterns.

The Top Guardrail Violations panel highlights the most frequent guardrail violations when policy evaluation data is available. This information helps identify recurring safety, compliance, or prompt-quality issues.

The Model Reliability Hotspots panel compares Successful requests, Failed requests, and Total requests across models. Both Chart View and Table View are available for visual or tabular analysis.

The Cache Efficiency section provides summary metrics for Cache read / Total and Cache read share. Additional charts compare Cache read tokens, Input tokens, and Output tokens over time, helping evaluate the effectiveness of cache reads for repeated prompts and reusable context.

All dashboard components share the selected time range, making it possible to compare requests, tokens, cost, reliability, guardrail activity, and cache behavior for the same interval. After changing providers, models, routing rules, or policies, allow time for new traffic to be collected before expecting dashboard panels to reflect the changes.

Dashboard panel types

The dashboard supports four panel types: metric cards, chart panels, calendar panels, and table panels.

• Metric cards display summary values for key metrics, such as the total number of requests, success rate, or token usage. Use them to quickly assess current performance and usage at a glance.

• Chart panels visualize metric data over time, helping you identify trends, compare values, and analyze changes across the selected time period.

• Calendar panels display activities in both calendar and tabular views, helping you quickly identify important dates, spot periods of increased activity, and review activity details in a structured format.

• Table panels present detailed data in a structured, tabular format. Use them to get easy access to individual item details and attributes.

All panel types can be resized, repositioned, and configured to create a dashboard layout that fits your monitoring needs.

Dashboards provide metric cards, chart panels, calendar panels, and table panels for monitoring request volume, performance, token consumption, costs, model usage, and policy compliance, as well as visibility into training activity, experiments, pipelines, and model lifecycle events.

Table 1: OptScale AI dashboard — AI Gateway, FinOps, and Model Training panel types**

Panel type	Panel format	Purpose
Total requests	Metric card	Request volume for the selected period
Success rate	Metric card	Percentage of successful requests
Total input tokens	Metric card	Input token consumption
Total output tokens	Metric card	Output token consumption
Total spend	Metric card	Estimated cost for the selected period
Avg latency	Metric card	Average request latency
Total tokens	Chart panel	Input and output token volume over time
Cost breakdown	Chart panel	Spend trends over time
Models breakdown	Chart panel	Models ranked by Spend or Total tokens
Users breakdown	Chart panel	Users ranked by Spend or Total tokens
Top guardrail violations	Chart panel	Most frequent guardrail violations
Model reliability hotspots	Chart panel	Successful, failed, and total requests by model
Cache efficiency	Chart panel	Cache read metrics and token comparison over time
Recent tasks	Table panel	Latest profiled training tasks
Recent runs	Table panel	Latest experiment or pipeline runs
Runs activity	Calendar panel	Run volume and activity over time
Recent models	Table panel	Recently registered or updated models
Model versions	Calendar panel	Recent model version activity

Create a Dashboard

1. Open Home and click + CREATE DASHBOARD.
2. Enter a name for the dashboard in the Name field on the right.
3. (Optional) Enable Shared to make the dashboard available to other users.
4. (Optional) Click the ⚙ icon in the right-side panel to hide or show the panel containing the dashboard name and sharing settings.

5. Configure the dashboard layout:

   • Drag panels to rearrange their position.
   • Resize panels using the resize handle in the lower-right corner of each panel.
   • Add additional panels by clicking + in the right-side panel.
   • Change panel type: open ⋮ → Edit panel.
   • Delete panel: open ⋮ → Delete panel.

6. When the dashboard is ready, click CREATE in the upper-right corner.

The new dashboard appears in the dashboard list and displays data based on the selected panels and filters.

Edit a Dashboard

1. Open Home and select the dashboard tab to edit.
2. Click EDIT in the upper-right corner.

3. Make the required changes. For example:

   • Rearrange or resize panels.
   • Add or remove panels.
   • Update panel settings (⋮ → Edit panel).

4. Click SAVE in the upper-right corner.

Changes are saved to the selected dashboard and displayed when the dashboard tab is reopened.

Delete a Dashboard

1. Open Home and select the dashboard tab to delete.
2. Click EDIT in the upper-right corner.
3. Click DELETE in the upper-right corner.
4. Confirm the deletion when prompted.

The dashboard is removed from the list of available dashboards.