# Comprehensive Analytics

<iframe width="560" height="315" src="https://www.youtube.com/embed/t0oPlMFYFjU" title="YouTube video player" frameborder="0" allowfullscreen></iframe>

## Description

**Comprehensive Analytics** gives you a built-in, **real-time dashboard** for every agent in Agentic OS—no add-ons required. 


Track **engagement** (messages, users, topics), **satisfaction**, **transcripts**, and **financial usage** (by week/month/provider/model) to understand learning impact and optimize costs.


Admins can drill down to **sessions, users, and topics** for evidence-based course improvements.

---

## Target Audience

**Superadministrator · Administrator**

---

## Features

#### Single Click Access
Open analytics from any agent’s chat to see live metrics—**no separate setup**.

#### Overview Tab
Bare-bones totals at the top (messages this month, active users, topics, satisfaction), plus:  
- User sessions list  
- Most-popular topics  
- Active-users bar chart (**Today, Yesterday → 90-day default; custom ranges supported**)

#### Users Tab
- Active users over time  
- “Logged-in right now”  
- Last-30-days usage  
- Time-of-day heatmap  
- Total registered users  
- Per-user details

#### Topics Tab
- Totals for topics and active users  
- Average ratings by conversation/topic  
- Sessions over time  
- Ratings over time  
- Highlighted topics (bar chart)

#### Transcripts Tab
- Full chat histories to see what users ask (including **uncomfortable questions** they avoid in class)  
- KPIs: avg messages/session, avg cost/session, avg rating/session  
- Search by topic, user, or rating

#### Financials Tab
- Usage over time: weekly, monthly, total cost  
- Cost/day  
- Cost by provider  
- Cost by LLM model (reflecting Agentic OS’s LLM-agnostic design: OpenAI, Gemini, Microsoft, etc.)

#### No Extra Cost
Analytics are **included** and available to admins for any agent.

---

## How to Use (step by step)

#### Open Analytics
- In an agent’s chat interface, locate the **analytics icon** (lower-left, above Settings) and click it  
- The **Comprehensive Analytics** panel opens

#### Review the Overview
- Scan totals for **Messages, Active Users, Topics, Satisfaction**  
- Browse **User Sessions**, **Popular Topics**, and the **Active-Users bar chart (Today → 90 days)**  
- Adjust the **date range** if needed (custom ranges supported)

#### Drill into Users
- Open **Users** to view:  
  - Active-user trends  
  - Who’s online now  
  - Last-30-days usage  
  - Time-of-day patterns  
  - Total registered users  
  - User-level details

#### Explore Topics
- Open **Topics** for totals, active users, average ratings by topic/conversation  
- View **sessions and ratings over time**  
- See highlighted topics (bar chart)

#### Study Transcripts
- Open **Transcripts** to inspect full chat histories  
- Use **Search** to filter by topic, user, or rating  
- Note KPIs at the top: avg messages/session, avg cost/session, avg rating/session—to spot friction or confusion

#### Monitor Financials
- Open **Financials** for:  
  - Weekly/monthly/total cost  
  - Cost/day  
  - Breakdown by **provider** and **LLM model**  
- Use this to choose **cost-effective models** without sacrificing quality

#### Iterate & Improve
- Use insights to **refine prompts, datasets, tools, or LLM choices**  
- Recheck analytics after changes to measure impact

---

## Pedagogical Use Cases

#### Targeted Remediation
Use **Topics + Transcripts** to find concepts with low ratings/high volume, then add materials or adjust prompts.

#### Instructional Timing
**Time-of-day usage** informs when to schedule office hours or auto-released study nudges.

#### Quality Assurance
Track **satisfaction** and **avg rating/session** to verify the agent’s tone, clarity, and helpfulness.

#### Assessment & Curriculum Tuning
Common queries in **Transcripts** reveal where lessons or assessments need clarification.

#### Cost Optimization
Compare **cost by provider/model** to select LLMs that balance price, speed, and accuracy for each agent.

#### Program Evaluation
**Overview trends** (messages, active users) offer quick evidence of engagement and learning impact for stakeholders.

---

With **Comprehensive Analytics**, you gain a **clear, actionable picture** of learner engagement, topic mastery, and cost—so you can continuously improve your agents and your courses.