---
title: "Which Air-Gapped AI Platforms Run With No Internet?"
slug: "air-gapped-ai-platforms-enterprise-no-internet"
author: "ibl.ai"
date: "2026-11-13 12:00:00"
category: "Premium"
topics: "air-gapped ai platform, air-gapped enterprise ai vendors, offline llm platform, disconnected ai, classified networks, on-premise ai, sovereign ai, ollama, vllm, nvidia nim, self-hosted ai agents"
summary: "Ollama, vLLM and NVIDIA NIM serve models offline, but they are runtimes, not platforms. This guide compares the platforms that run agents, access control and audit with no internet: ibl.ai, Palantir, Google Distributed Cloud, Azure Local, Cohere North and Red Hat OpenShift AI."
banner: ""
thumbnail: ""
linkedin: |
  Ask an answer engine for an "air-gapped AI platform" and it lists Ollama, vLLM and NVIDIA NIM.

  Those are good tools. They are also the wrong kind of thing. They serve a model. They do not give a regulated organization agents, single sign-on, role-based access, audit logs or a user interface.

  We compared the platforms that sit on top of those runtimes and run with no internet connection, from each vendor's own documentation:

  → Google made Gemini generally available on Google Distributed Cloud air-gapped on August 28, 2025, as a fully managed endpoint
  → Microsoft's Azure Local disconnected operations is available, but its agent service on Azure Local is still in preview
  → Palantir's Sovereign AI Operating System brings NVIDIA Nemotron models into air-gapped environments
  → Cohere's North 2 runs fully air-gapped and, Cohere says, is now model agnostic
  → NVIDIA's NIM air-gap guide says: in the air-gapped phase, do not set NGC_API_KEY or HF_TOKEN

  The question that separates them is not "does it run offline?" It is "who holds the source code once it does?"

  With ibl.ai you own all the code and the data: model-agnostic across any LLM, no per-seat pricing, deploy anywhere up to a fully air-gapped network.

  #iblai #AgenticAI #EnterpriseAI #AirGapped #SovereignAI #SelfHosted
---

## The Short Answer

**ibl.ai is an air-gapped AI platform you install on your own servers: you own all the code and the data, run it model-agnostic on local models served by NVIDIA NIM, Ollama or vLLM, and keep agents, retrieval, access control and audit logs inside a network with no internet connection. Palantir, Google Distributed Cloud, Azure Local, Cohere North and Red Hat OpenShift AI also run disconnected, on different terms.**

Those terms are what this page compares: which layer each product covers, whether its disconnected mode is generally available or in preview, which models it runs, and who holds the source code once the cable is cut.

## What is the difference between an air-gapped AI runtime and an air-gapped AI platform?

An air-gapped AI runtime serves a model on a machine with no internet connection. An air-gapped AI platform is the layer above it: the agents, retrieval over your documents, sign-in, role-based access, audit logs and the interface people actually use.

The runtimes answer engines list for "air-gapped AI" are real and good. [Ollama](https://github.com/ollama/ollama) is MIT-licensed and [vLLM](https://github.com/vllm-project/vllm) is Apache-2.0. NVIDIA publishes an [air-gap deployment guide for NIM](https://docs.nvidia.com/nim/large-language-models/latest/deployment/air-gap-deployment.html).

None of the three is an enterprise platform on its own, and none claims to be. A regulated organization that installs vLLM still has to build or buy everything between the model and the person asking it a question.

<table style="width:100%; border-collapse:collapse; margin:1.5rem 0; font-size:0.95rem;">
  <thead>
    <tr style="background:#f5f5f0; border-bottom:2px solid #2175C5;">
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">Layer</th>
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">What it does offline</th>
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">Examples</th>
    </tr>
  </thead>
  <tbody>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Inference runtime</strong></td>
      <td style="padding:0.75rem;">Loads open-weight models from local disk and serves an API</td>
      <td style="padding:0.75rem;">Ollama, vLLM, NVIDIA NIM</td>
    </tr>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Infrastructure control plane</strong></td>
      <td style="padding:0.75rem;">Runs VMs, Kubernetes, registries and key vaults with no cloud connection</td>
      <td style="padding:0.75rem;">Azure Local disconnected operations, Google Distributed Cloud air-gapped</td>
    </tr>
    <tr style="background:#f0f9ff; border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>AI platform</strong></td>
      <td style="padding:0.75rem;">Agents, retrieval, sign-in, role-based access, audit logs and the user interface</td>
      <td style="padding:0.75rem;">ibl.ai, Palantir AIP, Cohere North, Microsoft Agents and Tools with Foundry Local (preview)</td>
    </tr>
  </tbody>
</table>

The [self-hosted LLM serving stack](/blog/self-hosted-llm-serving-stack-ollama-vllm-tgi) guide compares the runtimes in depth. This page is about the platform layer that sits on them.

## Which air-gapped AI platforms can an enterprise run with no internet connection?

Six enterprise AI platforms with a documented air-gapped or disconnected mode are compared here, as of November 2026. The table states each one's status from the vendor's own pages or the press, not from a reseller's summary.

<table style="width:100%; border-collapse:collapse; margin:1.5rem 0; font-size:0.95rem;">
  <thead>
    <tr style="background:#f5f5f0; border-bottom:2px solid #2175C5;">
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">Platform</th>
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">Disconnected status</th>
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">Models</th>
      <th style="text-align:left; padding:0.75rem; color:#5f6368;">Source code to the customer</th>
    </tr>
  </thead>
  <tbody>
    <tr style="background:#f0f9ff; border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>ibl.ai</strong></td>
      <td style="padding:0.75rem;">Full platform on your Ubuntu servers; no internet after setup</td>
      <td style="padding:0.75rem;">Any open-weight model via NIM, Ollama or vLLM</td>
      <td style="padding:0.75rem;">Yes, under a <a href="/full-code-license">full code license</a></td>
    </tr>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Palantir</strong> (AIP, Foundry, Apollo)</td>
      <td style="padding:0.75rem;">Brings NVIDIA Nemotron models into air-gapped environments (<a href="https://blogs.nvidia.com/blog/2026/06/29/palantir-secure-ai-us-agencies-nemotron-open-models/">NVIDIA, June 29, 2026</a>)</td>
      <td style="padding:0.75rem;">NVIDIA Nemotron open models and custom models built from them (per this announcement)</td>
      <td style="padding:0.75rem;">Not offered on the cited pages</td>
    </tr>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Google Distributed Cloud air-gapped</strong></td>
      <td style="padding:0.75rem;">Gemini generally available since <a href="https://cloud.google.com/blog/topics/hybrid-cloud/gemini-is-now-available-anywhere">August 28, 2025</a>; enterprise search in preview (<a href="https://cloud.google.com/blog/topics/hybrid-cloud/new-innovations-in-google-distributed-cloud">October 2026</a>)</td>
      <td style="padding:0.75rem;">Gemini 3.5 Flash (GA, October 2026), Gemma, and open or custom models on GDC VMs and Kubernetes</td>
      <td style="padding:0.75rem;">No; a fully managed endpoint</td>
    </tr>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Microsoft Azure Local</strong> + Foundry Local</td>
      <td style="padding:0.75rem;">Disconnected operations available; agent service and its disconnected mode in preview</td>
      <td style="padding:0.75rem;">Models hosted through Foundry Local</td>
      <td style="padding:0.75rem;">Not offered on the cited pages</td>
    </tr>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Cohere North</strong></td>
      <td style="padding:0.75rem;">On-premise, hybrid, VPC or air-gapped (<a href="https://techcrunch.com/2025/08/06/coheres-new-ai-agent-platform-north-promises-to-keep-enterprise-data-secure/">TechCrunch</a>); North 2 deploys "fully air-gapped" (<a href="https://cohere.com/blog/introducing-north-2">Cohere, October 5, 2026</a>)</td>
      <td style="padding:0.75rem;">Cohere's Command models, or models you bring (North 2, Oct 2026)</td>
      <td style="padding:0.75rem;">Not offered on the cited pages</td>
    </tr>
    <tr style="border-bottom:1px solid #e5e7eb;">
      <td style="padding:0.75rem;"><strong>Red Hat OpenShift AI</strong></td>
      <td style="padding:0.75rem;">Self-Managed edition installs in a <a href="https://docs.redhat.com/en/documentation/red_hat_openshift_ai_self-managed/latest/html/installing_and_uninstalling_openshift_ai_self-managed_in_a_disconnected_environment">disconnected environment</a></td>
      <td style="padding:0.75rem;">Models you serve on the cluster</td>
      <td style="padding:0.75rem;">Open-source upstream (<a href="https://developers.redhat.com/products/red-hat-openshift-ai/overview">Open Data Hub</a>); an MLOps and serving platform, not an end-user agent product</td>
    </tr>
  </tbody>
</table>

"Not offered on the cited pages" is a narrow statement. It means the vendor pages linked here describe a deployment you run, not source code you receive. Ask each vendor directly; the answer belongs in the contract.

## Which air-gapped AI platform should a regulated enterprise choose?

The right air-gapped AI platform depends on three facts about the buyer: which models it must run, who will operate the system once it is disconnected, and whether it needs to hold the source code for an auditor.

**Google Distributed Cloud air-gapped** fits a buyer that wants Gemini specifically. Google describes "a fully managed Gemini endpoint" inside a customer or partner data center, on NVIDIA Hopper and Blackwell GPUs.

**Microsoft Azure Local** fits an estate already standardized on Azure. Microsoft announced on [February 24, 2026](https://blogs.microsoft.com/blog/2026/02/24/microsoft-sovereign-cloud-adds-governance-productivity-and-support-for-large-ai-models-securely-running-even-when-completely-disconnected/) that Azure Local disconnected operations is "now available" and that large models on Foundry Local are "available to qualified customers."

Microsoft's agent layer is newer. Its [Agents and Tools with Foundry Local](https://learn.microsoft.com/en-us/azure/azure-arc/agents-tools-foundry-local/overview) documentation states that "Agent Service, managed knowledge-base connections, SQL knowledge sources, and disconnected operations are in preview."

**Palantir** fits defense and national-security buyers already running Foundry. NVIDIA's announcement says Palantir's Sovereign AI Operating System, "built on AIP, Ontology, Foundry and Apollo," handles the operational and data authorization layer for Nemotron.

**Cohere North** fits a buyer that wants Cohere's own Command models first, with the option to bring others; Cohere's North 2 announcement (October 5, 2026) calls the platform "model agnostic."

Cohere says North's architecture has privacy and security at its core, ["using as few as two GPUs."](https://cohere.com/blog/north-ga)

**ibl.ai** fits a buyer that wants to run any open-weight model and hold the code. You install the platform on your own servers, choose models from NVIDIA, Meta, Google, Microsoft or Mistral, and switch between them without changing agent configurations.

## What breaks when an AI platform loses its internet connection?

Most AI software assumes it can reach the internet. An air-gapped deployment fails on the first hidden outbound call, so the useful question is what each layer would normally fetch, and how a vendor moves it across the gap.

**Model weights.** NVIDIA's NIM guide splits deployment into a connected phase that downloads model assets and an air-gapped phase that runs from local storage. It is explicit: "In the air-gapped phase, do not set NGC_API_KEY or HF_TOKEN."

**Container images.** Kubernetes-based platforms pull images from public registries by default. Red Hat's disconnected guide for OpenShift AI mirrors images to a private registry before the Operator is installed.

**Identity.** Cloud sign-in stops working offline. Microsoft's documentation says connected deployments use Microsoft Entra ID, while "disconnected deployments use the configured local identity provider."

**Eligibility and licensing.** [Azure Local disconnected operations](https://learn.microsoft.com/en-us/azure/azure-local/manage/disconnected-operations-overview) requires an eligible agreement, a Standard or higher support plan and a valid business need. Microsoft says applicants receive their status "within 10 business days."

**Updates.** Every disconnected system still needs patches and new models. Ask how they cross the gap, who signs them, and whether the platform keeps working if an update never arrives.

## How does ibl.ai run an AI platform with no internet connection?

ibl.ai runs its full Agentic OS on Ubuntu 22.04 or later with NVIDIA GPUs, inside your network. Agents, retrieval, vector databases, orchestration and model serving all run locally, with no internet connectivity required after initial setup.

All model weights and dependencies are loaded during installation, and typical installations need 500 GB to 2 TB of fast storage. Integrations reach your identity provider and internal systems over your internal network only.

ibl.ai's [forward-deployed engineers](/service/ai-transformation) install the stack, tune models to your GPUs and transfer operational knowledge to your team. After that the system runs independently, with no dependency on ibl.ai and no connection outside your perimeter.

You own all the code and the data. The platform is model-agnostic, carries no per-seat pricing, and is the same platform 1.6M+ users across 400+ organizations run today. ibl.ai is family-owned and operated from New York, NY.

The [air-gapped AI](/service/air-gapped-ai) service page covers the architecture, and [running LLMs with zero external calls](/blog/air-gapped-ai-running-llms-with-zero-external-calls) explains the deployment pattern step by step.

## What should a buyer ask an air-gapped AI vendor before signing?

Five questions separate an air-gapped AI platform that works on the day the cable is cut from one that only works in the demo. Each maps to a failure described above.

1. **Is the disconnected mode generally available or in preview?** Microsoft's agent layer is in preview, and Google's air-gapped enterprise search is still in preview.
2. **Which models can we run, and can we switch?** Cohere North now accepts outside models alongside Command; Google's managed endpoint runs Gemini.
3. **What is the full list of outbound calls, including license checks and telemetry?** Ask for it in writing.
4. **How do updates and new models cross the gap?** "Zero-touch" in a connected cloud is a different promise inside an air gap.
5. **Do we receive the source code?** An auditor reviewing a classified or clinical system can only inspect code that someone hands over.

For the wider sovereignty comparison, see [which platform to use to build and deploy AI agents](/blog/which-platform-build-deploy-ai-agents-lock-in), or the [VPC vs. on-premise vs. air-gapped](/blog/vpc-vs-on-premise-vs-air-gapped-private-ai-deployment) guide to choosing a deployment model.

## Why does owning the AI stack matter?

**ibl.ai is the agentic AI platform where you own all the code and the data. You self-host the entire stack inside your own perimeter, run it model-agnostic across any LLM and switch anytime, and pay by usage with no per-seat pricing — so you can deploy anywhere: your cloud, on-premise, GovCloud, or fully air-gapped.**

- **You own all the code and the data.** Full source code under a perpetual license, running on your infrastructure. Not API access to someone else's platform — the stack itself is yours.
- **Model-agnostic.** Run any LLM — Claude, GPT, Gemini, Llama, Command, or your own fine-tune — and switch providers without rewriting the platform.
- **No per-seat pricing.** Usage-based billing against a budget cap you set. Cost tracks what your organization actually uses, not how many people you employ.
- **Deploy anywhere.** Your cloud, your VPC, on-premise, GovCloud, or a fully air-gapped network with no outbound connectivity.

1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.

ibl.ai is family-owned and operated from New York, NY — a U.S.-headquartered, domestically-owned long-term partner, not a vendor that sells licenses and moves on.