ibl.ai Agentic AI Blog

Insights on building and deploying agentic AI systems. Our blog covers AI agent architectures, LLM infrastructure, MCP servers, enterprise deployment strategies, and real-world implementation guides. Whether you are a developer building AI agents, a CTO evaluating agentic platforms, or a technical leader driving AI adoption, you will find practical guidance here.

Topics We Cover

Featured Research and Reports

We analyze key research from leading institutions and labs including Google DeepMind, Anthropic, OpenAI, Meta AI, McKinsey, and the World Economic Forum. Our content includes detailed analysis of reports on AI agents, foundation models, and enterprise AI strategy.

For Technical Leaders

CTOs, engineering leads, and AI architects turn to our blog for guidance on agent orchestration, model evaluation, infrastructure planning, and building production-ready AI systems. We provide frameworks for responsible AI deployment that balance capability with safety and reliability.

Back to Blog

Fine-Tunes Beat Frontier Models. Not Junior Analysts.

Jaione AmigotOctober 16, 2026
Premium

The claim going around financial services is that open-weight fine-tunes now do the work banks pay junior analysts for. Half of that is measured and true: Bridgewater's Qwen3-235B fine-tune hit 84.7% accuracy at 13.8x lower inference cost than frontier models. The other half is also measured, and it is false β€” on GAUGE, the benchmark graded against 1,001 real professional valuations, the best agent scored 53.4 against a junior-analyst mean of 66.0.

The Short Answer

No. Open-weight fine-tunes in financial services have measurably beaten frontier models on narrow private tasks β€” Bridgewater's Qwen3-235B fine-tune hit 84.7% accuracy at 13.8x lower inference cost β€” but on GAUGE, the only benchmark graded against observed professional practice, the best agent scored 53.4 against a junior-analyst mean of 66.0. On ibl.ai you own all the code and the data.

The viral framing of this story says a small team open-sourced a model that does the work banks pay junior analysts six figures for. We could not identify any such team or model from primary sources, so this post does not name one.

What we could verify is the thesis underneath it, and the thesis splits cleanly in two.

The moat half is right and it is measured. The replacement half is also measured, by a benchmark published in July 2026, and it comes out the other way.

That gap between the two halves is this post's point: there is now published evidence for both the win and its limit, and almost every retelling cites only the win.

Does a fine-tuned model actually do the work of a junior financial analyst?

Not yet, on the one measurement built to answer that question. The benchmark is GAUGE, introduced in One Analyst Is Not Ground Truth: Grading Agent-Built Financial Models Against Observed Professional Practice (arXiv 2607.24889, submitted 27 July 2026, revised 26 September 2026).

GAUGE exists because of a measurement problem worth understanding before any of its numbers. Most financial benchmarks grade against one expert's solution.

The paper's own evidence for why that fails: when financial models built by different analysts for the same company are graded against one another, the median score is only 0.33 under standard tolerances. Single-reference grading confounds professional disagreement with error.

So GAUGE grades judgment-bearing quantities against ranges in professional practice instead. It is built from 1,001 professional valuations spanning 922 companies and all 25 GICS industry groups, and checks mechanical properties deterministically.

Then it put humans on the same scale. The panel was 12 senior analysts, 18 junior analysts and 25 finance students β€” 55 people.

GAUGE, mean score on the same scale Score
Senior analysts (12) 88.3
Junior analysts (18) 66.0
Best of 24 LM agents tested (Claude Fable 5) 53.4
Claude Opus 4.8 49.6
GPT-5.6-sol 46.5
Finance students (25) 43.2

The paper states the comparison plainly: the best agent's 53.4 sits above the student mean of 43.2 but below every one of the 12 senior analysts (minimum 83.8) and below 15 of the 18 juniors.

The shape of the failure matters more than the rank. The best agent passes 93% of mechanical facets but only 78% of judgment facets.

It can build the model. It struggles to derive the company-specific assumptions that make the model mean anything β€” and the abstract is explicit that this is "a gap that even persists after fine-tuning."

Two caveats the paper discloses and that any honest reading has to carry with it.

The humans were not racing. Each completed three GAUGE tasks under the agents' exact conditions and scored by the identical frozen stack, but at a median of 200 to 273 minutes per attempt against an agent median of 20 minutes. This is a quality comparison, not a throughput one.

And the fine-tuning the paper tested was trajectory fine-tuning on rollouts generated from GAUGE's own training split β€” benchmark-internal, self-generated supervision. It improved valuation performance without closing the gap.

That is a narrower claim than "fine-tuning does not fix judgment," and the distinction matters, because the next section's results come from fine-tuning on expert-labelled proprietary judgments, which is a different input entirely.

What GAUGE establishes is the task boundary, not a ceiling on fine-tuning: on open-ended, judgment-bearing valuation work, no agent tested reached junior-analyst quality, and nothing in the paper's own ablation closed it.

What have open-weight fine-tunes in financial services measurably beaten?

Narrow, high-volume, privately-graded tasks β€” and there the published results are strong enough that nobody needs to exaggerate them.

The cleanest one is Learning to Replicate Expert Judgment in Financial Tasks, published by Thinking Machines Lab with Bridgewater AIA Labs on 30 June 2026.

They fine-tuned Qwen3-235B, an open-weight model, on six financial information-filtering tasks: article relevancy classification, central bank document analysis, document truncation and related work.

The result, in the paper's own words: the trained model "improves average accuracy from 78.2% to 84.7%, meaning the trained model makes 29.8% fewer mistakes than the best frontier model we evaluated."

The comparison set was Gemini 3.1 Pro, Claude Opus 4.6, Claude Opus 4.8, GPT-5.2, GPT-5.4 and GPT-5.5.

"With our best prompts the frontier models we tested on still achieved less than 80% accuracy β€” the threshold investors expect from a system they could trust in their daily workflow."

The task was private. The signal lived in Bridgewater's own labelled judgments, not anywhere on the public web.

And the cost line is the one procurement should read twice: a 13.8x reduction in inference costs per task, on a chart whose axis is cost per 1,000 tasks in dollars.

Coinbase published the same pattern at the opposite end of the size range on 7–8 October 2026 β€” a post-trained 9B model beating Claude Opus 4.5 on its own private fraud benchmark for under $100 of training compute.

We covered it, including the part almost nobody quoted, in A 9B Fine-Tune Beat Opus 4.5. Who Holds the Weights?.

Put the two categories side by side and the boundary is not subtle.

Task type Published result
Narrow, verifiable, privately graded
document triage, relevancy filtering, fraud review
Fine-tuned open weights win. 84.7% vs 78.2% for the best frontier model β€” 29.8% fewer mistakes β€” at 13.8x lower cost per task (Bridgewater / Thinking Machines Lab).
Judgment-bearing, open-ended
deriving valuation assumptions in a financial model
Humans still win. Best agent 53.4 vs 66.0 junior-analyst mean, 88.3 senior; 78% of judgment facets passed (GAUGE).

Both rows come from named institutions publishing their own numbers. Neither row supports the headline the other one gets used for.

Is the finserv AI moat proprietary data, or access to frontier models?

It is the data, and the clearest proof is that frontier-grade finance capability stopped being scarce.

Ant Group open-sourced Ling-3.0-flash-Fin in September 2026: a finance-enhanced model at 124B total parameters with 5.1B activated, a 256K-token context window, under an MIT license, developed with financial institutions and domain experts.

It targets exactly the workflow the viral claim is about β€” source-grounded financial search, multi-document reasoning over regulatory filings, valuation modeling and spreadsheet operations.

Anyone can download it. That is the whole argument: a capability every competitor can also download is not a moat, however good it is.

Ant's own model card is admirably blunt about the limit, too: as its first finance-enhanced release, Ling-3.0-flash-Fin "still requires further validation in complex, long-horizon workflows."

The counter-example cuts the same way. OpenAI launched ChatGPT for Financial Services on 10 September 2026, developed with Morgan Stanley and Evercore as design partners and aimed squarely at junior-banker work, per CNBC.

Every bank that writes the cheque gets the same product.

Frontier access is a purchase order, not a differentiator β€” which is why Revolut went the other way and pre-trained its own foundation model on its own banking event sequences, covered in Revolut Built Its Own Foundation Model. Most Banks Can't.

So the defensible version of the brief's thesis is narrower than the brief's wording and stronger as an argument: what is scarce is labelled proprietary outcomes, the ability to train on them, and the right to keep the resulting artifact.

Does it take a frontier AI lab for a bank to get value out of open-weight models?

No. It takes engineers, a private corpus and a narrowly-scoped problem, and the clearest published example is a video archive rather than a trading desk.

Evident's Banking Brief reports that Commonwealth Bank of Australia was sitting on 12,000 hours of video that would have taken its five-person archive team at least a year to catalog by hand.

The bank built a searchable database of the footage instead, using two open-weight models β€” OpenAI's Whisper for audio transcription, Google's Gemma to describe what was visible in each frame β€” at a reported $1.31 per hour of video processed.

Be precise about who did what, because the viral version of this story is not precise. The five people are the archive team whose year of manual cataloging the system avoided.

The system was built by the bank's own engineers, named in the brief as Lachy Berry, Xun Wang and Yossi Frenkel, who wrote that "cost efficiency was the key point of optimization" and that "fitting the model size to the problem unlocks performance at price."

Per the same brief, the limitation they hit was a transcription miss on the phrase "Crocodile Dundee," not a research problem.

NatWest is doing the same thing one level up.

Its CIO Scott Marcar told diginomica in July 2026: "We've hired a team out of Meta to come to NatWest to do AI research, but essentially they're building us a set of proprietary models built on open source, so taking things like Llama or or Gemma from Google, and then building our own models on top of it."

Evident's brief also records JPMorgan CFO Jeremy Barnum saying the bank will "be smart about open source where appropriate."

Note what the CommBank case is not. It is not a bank open-sourcing a model, and it is not analyst work.

It is an ordinary engineering team applying open weights to a private corpus, which is the actual mechanism the viral claim gestures at β€” and it needs data and scoping discipline far more than it needs a research lab.

What does a junior financial analyst actually cost, and does the $150K figure hold?

The circulating "$150K/yr junior analyst" number has no single source we could find, and it conflates two very different seats, so it should not be used as a benchmark for anything.

The defensible public figure is the U.S. Bureau of Labor Statistics: the median annual wage for financial and investment analysts was $102,740 in May 2025, per the Occupational Outlook Handbook.

That is the whole occupation, nationally. A first-year investment-banking analyst in New York sits well above it; a credit analyst at a regional bank sits below. One number cannot stand in for both.

More importantly, the salary is the wrong axis. Nothing in the published evidence replaces a seat β€” GAUGE puts the best agent below 15 of 18 juniors on the judgment half of the job, and Coinbase's fraud agent was layered on top of its existing controls rather than replacing them.

What the evidence does support is a cost-per-task argument, and that is where the shape of the bill matters more than its size.

Pricing shape What the bill is indexed to
Per-seat enterprise AI Headcount. A 5,000-person firm pays 5,000 units whether 300 people or 4,000 use it this month. A document-triage pipeline has no seat to attach β€” nobody logs in.
Usage-based / self-hosted Work actually done. Bridgewater's fine-tune: a 13.8x reduction in inference costs per task. Coinbase: under $100 of total training compute, with fraud savings reported at roughly 3x inference cost.

For a workload measured in documents per day rather than people per org, per-seat is the wrong shape, not merely the wrong price. We work the arithmetic out for financial services in AI Cost Math for Financial Services: Per-Seat vs Usage.

What should a bank put in writing before it fine-tunes on its own data?

Three questions, and all three are procurement questions with contractual answers rather than technical ones.

Can we export the resulting weights or adapter? A fine-tune's entire value is the part your vendor does not have: your labelled outcomes. Once those are encoded into weights, the weights are an asset, and an asset you cannot export is one you are renting.

What happens to the artifact at renewal, at a price change, or at exit? On the open-weight route the answer is a file on storage you control. On a managed route it is an entitlement inside someone else's service.

If the base model is deprecated, do we retrain from our data or lose the capability? This is the question that decides whether a fine-tune is infrastructure or a subscription feature.

That is also the governance frame, not just the commercial one: a model that makes decisions inside a regulated control needs an owner, a documented lineage and a reproducible training path.

We set out the supervisory version in SR 11-7 Compliant AI for Banks and the deployment version in Self-Hosted AI for Financial Services: Compliance.

ibl.ai is the agentic AI platform where you own all the code and the data. You self-host the entire stack inside your own perimeter, run it model-agnostic across any LLM β€” including your own fine-tune β€” and pay by usage with no per-seat pricing, so you can deploy anywhere: your cloud, on-premise, GovCloud, or fully air-gapped.

That matters most for exactly the workloads above. A fine-tune trained on your own historical fraud outcomes or a decade of credit memos is the one component of the system a vendor upgrade cannot move without your consent.

1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.

ibl.ai is family-owned and operated from New York, NY β€” a U.S.-headquartered, domestically-owned long-term partner, not a vendor that sells licenses and moves on.

What this post deliberately does not claim

It does not claim a five-person team with no AI background and no venture funding open-sourced a model that replaces junior analysts. We went looking for that team across model cards, repositories, papers and company announcements, and could not identify it.

An unverifiable achievement claim with no named entity is not evidence, so we substituted named cases: Bridgewater AIA Labs with Thinking Machines Lab, Coinbase, Ant Group, Commonwealth Bank of Australia, Revolut.

It also does not claim fine-tuning is a solved path to analyst-grade judgment, and it does not claim the reverse. GAUGE's ablation used rollouts from its own training split, so it bounds that experiment rather than every fine-tuning route.

And it does not treat the human scores as a throughput comparison. GAUGE's analysts took a median of 200 to 273 minutes per attempt; the agents took 20.

What survives is the part worth acting on this quarter: the moat is your data and the artifact you keep, and the task boundary is narrow-and-verifiable versus open-and-judgment-bearing. Both halves are now measured. Quote both.

Why does owning the AI stack matter?

ibl.ai is the agentic AI platform where you own all the code and the data. You self-host the entire stack inside your own perimeter, run it model-agnostic across any LLM and switch anytime, and pay by usage with no per-seat pricing β€” so you can deploy anywhere: your cloud, on-premise, GovCloud, or fully air-gapped.

  • You own all the code and the data

    Full source code under a perpetual license, running on your infrastructure. Not API access to someone else's platform β€” the stack itself is yours.

  • Model-agnostic

    Run any LLM β€” Claude, GPT, Gemini, Llama, Command, or your own fine-tune β€” and switch providers without rewriting the platform.

  • No per-seat pricing

    Usage-based billing against a budget cap you set. Cost tracks what your organization actually uses, not how many people you employ.

  • Deploy anywhere

    Your cloud, your VPC, on-premise, GovCloud, or a fully air-gapped network with no outbound connectivity.

1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.

ibl.ai is family-owned and operated from New York, NY β€” a U.S.-headquartered, domestically-owned long-term partner, not a vendor that sells licenses and moves on.

Related Articles

A 9B Fine-Tune Beat Opus 4.5. Who Holds the Weights?

Coinbase post-trained Alibaba's open-weight Qwen3.5-9B on its own Onramp fraud data and reported beating Claude Opus 4.5 on all four metrics of its internal benchmark, with 55% lower serving latency and under $100 of training compute β€” and the more interesting half of the story is Part 2, where every newer frontier release scored worse than its predecessor on that same benchmark.

Mikel AmigotOctober 14, 2026

When Three Labs Pace the Frontier, Your Roadmap Slows

Dario Amodei published "We Must Pace the Frontier" on September 12, 2026 and Altman and Musk agreed within a day. He asks for slack rather than a halt, arguing a focused 1-2 year effort on interpretability and evaluation could close the gap; NIST measured open weights trailing by 8 months.

Miguel AmigotSeptember 17, 2026

Nvidia + Hugging Face Is a Lock-In Question

Nvidia has reportedly agreed to buy Hugging Face for $12.9B. Nothing is signed and both companies declined comment, but the strategic question is already live: open weights protect you from a model vendor, not from whoever owns the distribution layer.

Miguel AmigotAugust 31, 2026

Financial Services AI: Unify Data Silos With an Ontology

Self-hosted AI for financial services breaks when customer data is scattered across core banking, CRM, risk, and KYC/AML systems. The prerequisite is an ontology β€” a governed knowledge graph the institution owns and runs itself β€” that unifies those silos before any agent is deployed.

Miguel AmigotJune 23, 2026

See the ibl.ai AI Operating System in Action

Discover how leading universities and organizations are transforming education with the ibl.ai AI Operating System. Explore real-world implementations from Harvard, MIT, Stanford, and users from 400+ institutions worldwide.

View Case Studies
Work with our team

Pilots, deployment, and full ownership

Most enterprise engagements are one-time, not subscriptions. You integrate ibl.ai with your own data, deploy it on your own infrastructure, and the engineering hours scale with the work β€” so the price tracks the scope, not your headcount.

Start here

Pilot

from $15K

fixed scope Β· fixed timeline

A time-boxed proof of value on your real data β€” not a slide deck.

Best for: Teams that want to see ibl.ai working before committing.

  • Deployed on your infrastructure or our cloud
  • 1–2 production agents wired to a slice of your data
  • One integration (LMS / SIS / SSO / data source)
  • Weekly working sessions with our engineers
  • Pilot fee credits toward a full engagement
Scope a pilot
Most common

Integration & Deployment

$25K – $80K

one-time Β· not a subscription

Full deployment integrated with your data and systems. Engineering hours scale with scope.

Best for: Organizations rolling ibl.ai out across a department, campus, or business unit.

  • Platform deployed in your VPC, on-prem, or air-gapped
  • Integrated with your data + identity (SSO / SAML)
  • Multiple custom agents built to your workflows
  • Engineering hours proportional to scope
  • You own the data Β· run any LLM you choose
Plan a deployment
Full ownership

Codebase Transfer + Custom AI Engineering

Custom quote

perpetual license Β· you own the stack

We transfer the full source code. You own and self-host the entire platform β€” outright.

Best for: Organizations and enterprises that benefit from perpetual ownership and sovereignty.

  • Complete source-code transfer + perpetual license
  • Dedicated AI engineering team on your roadmap
  • Custom agents, models, and integrations to spec
  • Air-gapped capable Β· zero vendor lock-in
  • Family-owned, New York–based long-term partner
Talk about ownership
You own the code and data Run any LLM β€” Claude, GPT, Gemini, Llama Family-owned & operated from New York, NY