The Short Answer
Compliance AI is auditable only when you can reconstruct the exact prompt, retrieved context, model version, raw output, and human review for any filing — which requires holding those logs yourself. On ibl.ai you own all the code and the data, so the entire inference path runs and is recorded inside your own perimeter, model-agnostic across any LLM and with no per-seat pricing.
A court ordering a 125-year-old firm to explain hallucinated citations is the visible version of this problem. The invisible version is a fabricated figure in a filing that nobody checks for three years.
What actually went wrong in the law firm case?
A century-old firm submitted a brief containing citations the underlying model invented, and the court ordered it to explain them. The failure was not that a model produced a plausible-looking case reference — models do that, and it is well documented.
The failure was procedural: nothing in the workflow required the citation to be resolved against a real source before filing, and nothing preserved what the model was given at the moment it produced the text.
Courts catch this quickly because litigation is adversarial. Opposing counsel reads every citation, and a fabricated one surfaces within weeks. That adversarial check is the only reason these cases become public at all.
Why is a regulatory filing riskier than a court brief?
Because nobody is reading it adversarially, and the clock runs much longer.
SEC and FINRA filings are reviewed by examiners on a cycle, often years after submission. A hallucinated citation in a brief gets caught by an opponent with an incentive to find it.
A fabricated basis for a number in a filing sits until an examination asks how the figure was derived.
By then the model version that produced it may have been deprecated, the prompt template rewritten, and the retrieval corpus reindexed. The reviewer is asking a question about a system state that no longer exists.
The exposure is not the error rate. It is the gap between when the error is made and when anyone asks about it.
What does an auditable AI filing actually require?
Four artifacts, captured at generation time. None of them are things a model provides:
| Artifact | Question it answers | On a hosted API |
|---|---|---|
| Prompt + retrieved context | What did the model actually see? | Vendor retention setting |
| Model version + parameters | Which system produced this? | May be silently replaced |
| Raw output, pre-edit | What did the human change? | Usually not captured |
| Reviewer + revision trail | Who signed off? | Your system, if you built it |
| ibl.ai (self-hosted) | All four | Logs on your own disk |
The pattern is that three of the four are decisions someone else makes for you unless the inference path is yours.
Do existing model-risk rules already cover generative AI?
Yes, and this is the part most teams underestimate.
SR 11-7, the Federal Reserve and OCC model risk management guidance, has required documented model inventory, independent validation, and ongoing monitoring since 2011. Regulators have been explicit that AI models — including LLMs and agents — fall inside that framework.
That has a hard consequence. Validation requires reproducing a model's behavior on known inputs. If you cannot reconstruct what the model saw, you cannot validate it, which means it should not have been in a regulated workflow to begin with.
"We are still piloting" does not survive a second examination. The framework was already there; generative AI simply arrived inside it. Financial services AI reference architecture walks the control layers this implies.
Does privilege survive a third-party AI vendor?
For legal work this is the sharper question. Sending client material to a third-party model provider introduces a party that was not in the engagement, and privilege analysis turns on who had access and under what terms.
ABA Model Rule 1.6 obliges lawyers to make reasonable efforts to prevent unauthorized disclosure of client information. Whether a hosted API meets that standard depends on contract terms most firms never read closely — retention, subprocessing, training use, and jurisdiction.
ABA Model Rule 1.6-compliant AI covers the analysis.
Self-hosting removes the question rather than answering it. If the material never leaves the firm's environment, there is no third party whose terms need construing.
What does this change about how you deploy?
Move the inference path inside the boundary you already defend, and the audit artifacts become a logging decision rather than a negotiation.
ibl.ai is the agentic AI platform where you own all the code and the data.
You self-host the entire stack inside your own perimeter, run it model-agnostic across any LLM and switch anytime, and pay by usage with no per-seat pricing — so you can deploy anywhere: your cloud, on-premise, GovCloud, or fully air-gapped.
For firms comparing that against per-lawyer licensing, AI cost math for law firms shows the headcount-multiplied bill next to actual token cost.
1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.
Related: Why Kenya Wrote Clearer AI Liability Law Than the US — the same evidence problem, arriving through liability rather than examination.