Back to Updates

Analytics: What Every Model Costs, Down to the Call

ibl.ai Engineering
Applicationiblai/vibe

The rebuilt ibl.ai analytics puts nine tabs behind one date range and agent picker — usage, users, topics, replayable transcripts, memory, audit trails, and a Cost tab that breaks AI spend down by provider, model, user and individual call, with p50 and p95 latency per model.

ibl.ai's rebuilt analytics shows what your AI costs by provider, model, user and individual call — with median and 95th-percentile latency per model — alongside usage, topics, replayable transcripts, memory and audit trails, all behind one date range — on ibl.ai, where you own all the code and the data.

These numbers come from your own deployment's records, not a vendor's summary.

The revamped analytics runs in Agentic OS. The /iblai-vibe-analytics skill that mounts the same components in any app built with Agentic Vibe was updated for it on September 17, 2026, and the transcript detail panel followed on September 25.

What does the ibl.ai analytics dashboard show?

Nine tabs, with Data Reports on the right, share one control bar: an agent picker, a groups filter, and a Today / 7D / 30D / 90D / Custom range that every chart follows.

Choose one agent and every tab narrows to it; choose a group of users and the Users, Topics and Transcripts tabs follow.

The top of the ibl.ai analytics Overview tab: tabs for Overview, Users, Courses, Programs, Topics, Transcripts, Memory, Cost and Audit, with Data Reports on the right; an All Agents picker, a Filter by Groups menu and a 30-day range; and five KPI cards for Messages, Active Users, Topics, Conversations and LLM spend, each with a sparkline and its change on the previous period.

The Overview opens with five KPIs — Messages, Active Users, Topics, Conversations and LLM spend — each with a sparkline and a change against the previous period, then a Sessions chart and the most-discussed topics ranked by messages.

Tab What it answers
UsersWho is logged in now, in the past 30 days, and in total — plus an access-times heatmap by day and hour
TopicsWhat people ask about, and how conversations trend over time
TranscriptsWhat was actually said, with documents, tool calls and per-turn details
MemoryWhat the agents remember, per user, per agent or globally
CostWhat it costs — by provider, model, user and call — and how fast each model answers
AuditWho changed an agent's configuration, and organization-wide security events
Data ReportsAsynchronous CSV and JSON exports: generate, poll, download

The Users tab of ibl.ai analytics, showing Users logged in right now, Users logged in past 30 days, and Total registered users, an Active Users bar chart by day, and an Access Times heatmap of activity by day of week and hour of day.

How do you see AI spend by model in ibl.ai?

On the Cost tab, which has three views. Spend shows weekly, monthly and total costs, cost per day, cost by provider and model, and cost per user — each user linking through to their individual calls.

The Cost tab's Spend view in ibl.ai analytics, with Weekly Costs, Monthly Costs and Total Costs cards showing change against the prior period, and a Cost per Day bar chart across the selected 30 days.

Usage & latency shows LLM spend, tokens, LLM calls and p95 latency, then ranks every model by the spend attributed to it and shows its p50 and p95 response time beside it. It is the view that settles which model is worth what it costs for a given job.

The Usage and latency view of the ibl.ai Cost tab: spend over time stacked by service, a Spend by model list ranking ten models with their cost and call counts, and a Latency by model chart showing median and 95th-percentile response times per model.

In the 30-day window shown, one preview model cost $1.21 across 11 calls at a p95 of 25 seconds, while an embedding model made 240 calls for $0.82 — the trade-off this view exists to show.

Traces lists every call — service, user, latency and cost — with a detail panel, and each trace links straight to the transcript it came from.

What can you see inside an ibl.ai conversation transcript?

The Transcripts tab replays a conversation the way the chat rendered it, from the context the platform attaches to each turn. Each piece renders only when the turn carries it:

  • Attachments — the files and images exchanged on a turn.
  • Retrieved documents — the chunks an answer cited, with source, snippet and relevance score.
  • Tool calls — each tool the agent used, with its input and output.
  • Show Details — per turn, the model with its provider's logo, the temperature, the client, and the request context: session, flow, datasets, system prompt and file references.

Each conversation row carries badges counting the documents and tool calls it used, and names the person by full name, then email, then username. The same panel powers an agent's History tab, so an agent's owner and an organization's administrator read the same record.

Who can see AI costs and audit logs in ibl.ai?

Access follows the platform's roles. Usage & latency and Traces need organization-admin analytics access; everyone else sees a permission notice rather than an error.

The platform-wide audit trail — logins and model changes, with IP address — shows only to organization admins or holders of the audit-log permission.

Costs are shown in US dollars exactly as the platform bills them, and the per-agent view never guesses at history it cannot attribute.

The documentation walks each tab in detail, starting at Analytics overview and Costs.

Want this level of visibility over your own AI spend?

We can show it running on your data in half an hour. Book a 30-minute demo or talk to the ibl.ai team — ibl.ai is family-owned and operated from New York, NY.