📅 Book a 30-min Demo📞 Call/text (571) 293-0242

Part I · The Bill Comes Due

Chapter 3What Sovereign Means in Engineering Terms

5 min readFrom Sovereign AI Engineering by Miguel AmigotLast updated
Share
Sovereignty is not a region on a cloud console. It is what you can still do when the vendor says no.

The word sovereign has been stretched to cover almost anything. Cloud providers sell sovereign regions. Vendors sell sovereign tiers of their hosted product. Governments publish sovereignty strategies that amount to a preference for domestic suppliers. Each of these means something, and none of them is what a CIO needs the word to mean when deciding how to run artificial intelligence inside an institution that holds other people's data.

I want to replace the adjective with a test. Four questions, each of which can be answered by an engineer in an afternoon with access to the system, and each of which has a yes or no answer.

Four questions you can verify

Can you read the source? Not a summary, not an architecture diagram, not an escrow arrangement that releases code to a lawyer if the vendor goes bankrupt. The complete source of the platform, including the backend services and the infrastructure definitions, available to your engineers now, under a license that lets them modify and run it. If the answer is no, every other sovereignty claim rests on trust.

Can you move the data? All of it, in a documented format, without a professional services engagement, and without losing the structure that makes it useful. More importantly, does the platform hold a copy of your data at all, or does it read your systems of record in place? A platform that never took custody has nothing to hand back.

Can you switch the model? Today, without a migration, by changing a configuration value. To a different commercial provider. To an open-weight model running on your own hardware. To a different model for a different data classification. If a model is wired into the product so deeply that replacing it is a project, you do not have a platform; you have a reseller.

Can you run it with the cable unplugged? Literally: can the entire system operate on a network with no route to the public internet? This is the strongest test because it subsumes the others. A system that runs air-gapped necessarily carries its own code, its own data path and its own models. Many institutions will never run that way. All of them should know whether they could.

Four yeses is sovereignty. Three is a negotiation. Fewer is a hosted product with a sovereignty section in the brochure.

The deployment tiers

In practice sovereign systems run in one of four ways, and the choice is a business decision rather than an architectural one, provided the architecture supports all four.

The vendor's cloud. The platform runs on infrastructure the vendor operates, but the institution owns the code and can leave with its configuration and data at any time. This is the fastest start and the right choice for a pilot, a small institution, or a department proving value before the central IT organization commits. The institution gives up nothing structurally; it defers the operating commitment.

The institution's own cloud account. The same platform deployed into the institution's AWS, Google Cloud or Azure tenancy, including government regions where required. Data never leaves an account the institution controls. The institution's security team applies its own controls, logging and identity policies. This is where most universities and companies end up, and where Syracuse, among others, runs today.

On-premise. Physical servers in the institution's data centre, usually chosen because of data classification, existing investment in hardware, or regulatory requirements that treat any cloud as a transfer. The GPU question becomes concrete here, and Chapter 7 addresses it directly.

Air-gapped. No outbound network at all. Models run locally, updates arrive as signed bundles, and nothing phones home. Defence, intelligence, some financial desks, some research facilities. Chapter 8 is a walk-through.

One codebase, four tiers

The engineering requirement that makes the tiers a business decision rather than four products is that they share one codebase. The platform that runs in the vendor's cloud must be, byte for byte, the platform that runs in the institution's account, on its servers, and behind its air gap. The differences are configuration: which model endpoints to call, which identity provider to trust, which network routes exist.

This matters for three reasons. The institution can start on the vendor's cloud and move inward without a migration, because nothing about the application changes. The vendor cannot quietly degrade the self-hosted version, because it is the same version. And the air-gapped tier, which almost nobody uses, keeps everybody honest, because any dependency on a vendor service would break it, and so no such dependency is allowed to exist.

A platform with a "cloud edition" and an "enterprise edition" that differ in code has already failed this test. The institution is being sold two products and told they are one.

What sovereignty is not

Sovereignty is not a data residency promise. Keeping data in a particular country's region of a hyperscaler tells you where the disks are. It tells you nothing about who can read them, which model processes the data, or whether you can leave.

It is not an escrow clause. Code released from escrow on a vendor's bankruptcy is code nobody on your team has ever run, delivered at the moment you are least able to learn it.

It is not open source by itself. Open source tells you that you may read and modify the code. It does not tell you whether the system can run without the vendor's hosted services, whether the model can be switched, or whether the data was ever yours. Many open-source AI products are a free client for a paid cloud.

And it is not a preference for domestic vendors. A foreign vendor whose platform passes all four questions leaves you more sovereign than a domestic one whose platform passes none. Where the company is headquartered matters, and I will say later why I think it does, but it is a separate question from whether you own the system.

A worked example

Consider an institution deciding between two offers for a campus-wide AI assistant.

Offer A is a hosted product from a large vendor. The interface is excellent. The data processing addendum is thorough. The price is $40 per user per month with a 5,000-seat minimum, $2.4 million a year. The vendor's model is the only model. The vendor's cloud is the only cloud. Source is not available. Export is a support ticket.

Offer B is a platform the institution deploys into its own cloud account. The source is delivered under a perpetual license. The institution connects its own model providers, pays them directly for tokens, and can add an open-weight model on its own GPUs for sensitive workloads. Connectors read the student information system in place. The price is a platform fee that does not depend on headcount, plus the tokens actually consumed, which for 5,000 real users of a campus assistant amounts to a small fraction of Offer A's figure.

Offer A fails all four questions. Offer B passes them. That is the whole evaluation, and it took one paragraph. Everything else, the feature comparison, the demo, the references, is detail. Useful detail, but detail. The architectural decision is the one that will still matter in year five, and it is the one the quote was designed to keep off the table.

Run the stack this book describes

ibl.ai is the agent operating system you run yourself: you own all the code and the data, in your cloud, on-premise or air-gapped, with any model, one identity across web, browser, desktop, mobile and terminal, and no per-seat pricing.