--- title: "How mentorAI Integrates with Microsoft" slug: "how-mentorai-integrates-with-microsoft" author: "Jeremy Weaver" date: "2025-05-07 21:56:16.698623" category: "Premium" topics: "Azure OpenAI Service integration GPT-4o on Azure mentorAI Azure Marketplace deployment AKS auto-scaling microservices Phi-3 small language model Azure AI Studio fine-tuning Azure Content Safety filters Entra ID SSO for universities VNet private endpoints FERPA compliance Pay-per-token OpenAI pricing Microsoft AI tutoring platform Azure AI Search contextual embedding Generative AI for higher education AKS exam-week scaling Tenant-segmented Azure SQL/CosmosDB Role-based RBAC in Entra ID GPT-4 Turbo cost governance One-click edtech deployment Serverless AI on Microsoft Azure Future-proof university AI strategy" summary: "mentorAI launches as a one-click Azure Marketplace app, runs its APIs on AKS, and routes prompts to Azure OpenAI Service models like GPT-4o, GPT-4 Turbo, GPT-3.5 Turbo, and Phi-3—letting universities tap enterprise LLMs without owning GPUs. Traffic and data stay inside each tenant’s VNet with Entra ID SSO, Azure Content Safety filtering, AKS auto-scaling, and full Azure Monitor telemetry, so campuses meet FERPA-level privacy while paying only per token and compute they actually use." banner: "" thumbnail: "images/Microsoft-Logo.png" --- mentorAI is available as a **one‑click deployment** on the [Microsoft Azure Marketplace](https://azuremarketplace.microsoft.com/en-us/marketplace/apps/iblai.mentorai?tab=Overview) where universities can launch a fully managed instance inside their own subscription. Once deployed, mentorAI relies on **Azure OpenAI Service** for large‑language models, **AKS** (or Container Apps) for its microservices, and the wider Azure stack—identity, data, and monitoring—to deliver secure, FERPA‑compliant generative AI at campus scale. --- # Key Azure Building Blocks - **Azure OpenAI Service** – direct access to all of OpenAI's latest models; mentorAI chooses the best model per query while Azure handles GPU capacity. - **Azure AI Studio & Content Safety** – fine‑tune or ground models on university data, and apply Microsoft safety filters before answers reach students. - **Azure Kubernetes Service (AKS)** – container host for mentorAI APIs, orchestration engine, and background workers; scales automatically during finals season. - **Azure SQL / Cosmos DB** – relational or NoSQL store for user profiles, transcripts, and analytics. Isolation can be per‑schema or per‑database to satisfy strict data policies. - **Azure Storage** – durable object storage for lecture uploads, embeddings, and backups, partitioned by tenant folder or container. - **Azure Virtual Network + Private Endpoints** – traffic stays on Microsoft’s backbone; each tenant can run in its own VNet with subnet‑level segmentation. - **Microsoft Entra ID (Azure AD)** – SSO for students and faculty; role‑based access control maps to tenant IDs for least‑privilege data access. - **Azure Monitor & Application Insights** – unified logs, metrics, and distributed traces power dashboards and auto‑scaling triggers. --- # How mentorAI Uses Azure Day‑to‑Day **1. User query arrives**. An Application Gateway routes HTTPS traffic to AKS pods running the mentorAI API. **2. Model selection**. The orchestration layer calls Azure OpenAI, picking GPT‑4o for rich tutoring or GPT‑3.5 Turbo for quick FAQ queues. **3. Context enrichment**. Course PDFs in Azure Storage are chunked, embedded via Azure AI Search, and injected into the prompt. **4. Response & telemetry**. The answer returns in <1 s; tokens, latency, and cost stream to Azure Monitor. Role‑based logs are stamped with TenantID for audit. --- # Why Azure Matters to Universities - **Enterprise‑grade compliance** – Azure certifications (FERPA, HIPAA, FedRAMP High) and Private Link keep student data locked down. - **Deep Microsoft ecosystem** – native hooks into Teams, Outlook, and OneDrive streamline faculty workflows. - **Elastic scale, predictable cost** – AKS autoscaling and pay‑per‑token OpenAI pricing prevent budget surprises. - **Granular identity & RBAC** – Entra ID ties AI access to existing campus roles; conditional access policies add extra safeguards. - **Innovation runway** – as Microsoft releases new models or new AI Safety features, mentorAI adopts them with a config toggle. By pairing Azure’s managed LLM platform with Microsoft’s secure cloud services, mentorAI lets universities launch real‑time, multimodal tutoring within their own Azure tenant—no GPU procurement, no data leaving campus control. Learn more at **[ibl.ai](https://ibl.ai)**