ibl.ai Agentic AI Blog

Insights on building and deploying agentic AI systems. Our blog covers AI agent architectures, LLM infrastructure, MCP servers, enterprise deployment strategies, and real-world implementation guides. Whether you are a developer building AI agents, a CTO evaluating agentic platforms, or a technical leader driving AI adoption, you will find practical guidance here.

Topics We Cover

Featured Research and Reports

We analyze key research from leading institutions and labs including Google DeepMind, Anthropic, OpenAI, Meta AI, McKinsey, and the World Economic Forum. Our content includes detailed analysis of reports on AI agents, foundation models, and enterprise AI strategy.

For Technical Leaders

CTOs, engineering leads, and AI architects turn to our blog for guidance on agent orchestration, model evaluation, infrastructure planning, and building production-ready AI systems. We provide frameworks for responsible AI deployment that balance capability with safety and reliability.

Back to Blog

Agent Infrastructure Went Open Source. The Record Didn't.

Miguel AmigotSeptember 24, 2026
Premium

Chutes and researchers at Harvard and Chicago released 6,122,413,756 production LLM requests across 9,174 models β€” in twelve metadata fields that hold no prompts, no responses and no tool calls.

The Short Answer

Chutes and researchers at Harvard and the University of Chicago published a year of production LLM traffic in September 2026 β€” 6,122,413,756 requests across 9,174 models, in twelve metadata fields that contain no prompts, no responses and no tool calls. Open frameworks ship capability, not a record of conduct. With ibl.ai you own all the code and the data, and that record stays inside your perimeter.

Three artifacts landed in the same month. Each settles the build question and leaves the governance question where it was.

What did Harvard and Chutes actually release in the production LLM traffic dataset?

A one-year serving trace from a commercial inference provider, published with a paper β€” not, strictly, a Harvard release.

The paper is A Year in LLM Serving: Workload Evolution, Caching and Load-Balancing, by William Nixon, Jon Durbin, Florian Standhartinger, Haryadi S. Gunawi and Juncheng Yang. Its arXiv history records v1 on 3 July 2026 and v2 on 7 September 2026.

The traffic is Chutes', the decentralized inference platform running as Bittensor's Subnet 64, whose founder Jon Durbin is a co-author. Juncheng Yang is an assistant professor at Harvard; Haryadi Gunawi is at the University of Chicago.

So a provider opened its logs, academics analyzed them, and Harvard hosts the bucket. The paper itself anonymizes the provider as "CompanyX".

The scale is genuine. The release repository documents 6,122,413,756 rows across 9,174 models; Crypto Briefing adds 314,970 anonymized users, 35.8 trillion input tokens and 2.52 trillion output tokens between 11 April 2025 and 12 April 2026.

It ships as a single 91 GB Parquet file, in a repository created on 4 September 2026.

Does the LLM serving paper find that organizations have no visibility into their models?

No, and the distinction matters more than the headline.

The claim circulating with this release is that most organizations running AI in production have zero visibility into what their models are doing. That is a gloss added in social coverage, not a result in the paper.

What the abstract says is that existing LLM serving workload studies "remain limited in scale and scope," observe short periods, and "provide limited visibility into how users interact with models in production."

That is a statement about the research literature β€” the reason to release a year-long trace at all. Nothing in the paper measures enterprise observability.

The narrower fact is in the dataset schema. The trace has twelve fields: invocation_id, function_name, chute_id, user_id, rehash_round, instance_id, started_at, completed_at, input tokens, output tokens, cached tokens and time to first token.

None of them is a prompt, a response, a tool call or a retrieved document.

The largest public record of production LLM serving ever assembled tells you what was served, how fast, and to which anonymized user β€” and nothing about what any model was asked or did.

That is the shape of the record open infrastructure produces by default.

Is Jack Dorsey's 34,000-star repository an AI agent framework?

Not quite, and the repository it is confused with is larger.

The project behind that star count is Buzz, released by Block on 21 July 2026 under Apache 2.0.

TechCrunch's launch coverage quotes Dorsey describing it as "model-agnostic, decentralized, self-sovereign, and open source," built to reduce Block's dependency on Slack and GitHub.

The repository shows 34,236 stars and 4,531 forks as of 24 September 2026, on a repo created 6 March 2026. Its README calls it "a self-hostable workspace where humans and AI agents share the same rooms," built as a Nostr relay.

That is a workspace, not an agent framework. Block's agent framework is goose, now at the Agentic AI Foundation and showing 54,612 stars under Apache 2.0.

Buzz deserves credit on this exact axis, because it is the partial counterexample.

Its README says "every message, reaction, workflow step, review approval, and git event is a signed event in one log," with agents holding their own keys, channel memberships and audit trail.

That is real governance, and it is scoped to the workspace.

A signed record of what an agent posted, reviewed and merged in Buzz is not a record of which documents its model retrieved, which tools it called against your systems of record, or with whose credentials.

Did Axis Robotics open-source all of its training data?

No. It released one dataset, on terms that are not open in the sense the claim implies.

Axis Robotics announced Axis Sim Dataset V1 on 4 September 2026: more than 50,000 human-teleoperated simulation trajectories across 207 manipulation tasks and 60,000+ scene variants on a simulated Franka Research 3 arm.

The release also says V2 is in development, which alone rules out "all training data."

The licence is the sharper correction. The Hugging Face dataset card lists the licence as "other," gates access behind approval for non-commercial academic use, and says commercial use, redistribution and resale are not permitted.

A gated, non-commercial, approval-required dataset is a publication, not an open-source release; the Chutes trace above ships under CC BY 4.0, which is what the open version looks like. Repeating the looser claim is how a team plans a deployment around terms it does not have.

What does an open-source agent stack still not record about your agents?

The four things an auditor asks for, none of which arrives with a licence.

  • What the agent retrieved. Which documents entered the context window for a given turn, from which source, at what time.
  • What the agent called. Each tool invocation with its inputs and outputs, not a summary that the run succeeded.
  • Which model answered. The provider and model behind a specific response, because in a model-agnostic stack that changes between turns.
  • What the agent was allowed to reach. A deny-by-default decision per call, made by something the agent cannot talk past.

Y Combinator's QM harness makes the point from the other direction: open-sourcing the harness turned it into infrastructure anyone can run, which is why the differentiation moved below it.

It is the same conclusion as DeerFlow 2.0's own README, which states it does not inspect tool arguments. A harness is a runtime, and the good ones say so.

This is why the capability layer keeps commoditizing while most vendors still ship only layer one. Frameworks depreciate on an 18-month cycle; the record of what your agents did has to outlive all of them.

How does ibl.ai record what your agents actually did?

By making the record a property of the platform you run, not of whichever framework is trending.

With ibl.ai you own all the code and the data.

It runs on your own infrastructure with full source code access, is model-agnostic across any LLM, is usage-based with no per-seat pricing, and deploys anywhere β€” your own cloud, on-premise, GovCloud, or a fully air-gapped network.

Every AI turn is inspectable. The September 2026 platform release surfaces the retrieved documents, the tool calls with their inputs and outputs, the model and provider that produced the answer, and the request context with credentials stripped.

The conversation list carries per-conversation rollups, so an operator can see which conversations used documents or called tools without opening each one.

Agent memory is scoped rather than ambient: memories default to the agent's own scope, temporary state carries an expiry and is purged nightly, and duplicate detection runs semantically across an agent's categories.

Underneath, the MCP broker is one control plane over many MCP servers, with deny-by-default RBAC, credential injection and audit logging. The harness is a sandboxed runtime with isolated execution and allowlisting, running on your infrastructure.

You can read the code that writes the audit trail rather than accept an assurance about it. 1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.

ibl.ai is family-owned and operated from New York, NY.

Related reading: DeerFlow 2.0 is free, your governance layer is not β€” the same boundary in an open harness's own README; and YC open-sourced QM and the harness became infrastructure β€” why giving the runtime away moves the value below it.

Sources: the paper, authors and submission history from arXiv; the row count, schema, file size and repository creation date from the release repository; the user count, token totals and traffic window from Crypto Briefing; the Buzz launch date and Dorsey quote from TechCrunch; the star counts, licence and README language from the Buzz repository and the goose repository; the Axis figures from GlobeNewswire and the access terms from the Hugging Face dataset card.

Why does owning the AI stack matter?

ibl.ai is the agentic AI platform where you own all the code and the data. You self-host the entire stack inside your own perimeter, run it model-agnostic across any LLM and switch anytime, and pay by usage with no per-seat pricing β€” so you can deploy anywhere: your cloud, on-premise, GovCloud, or fully air-gapped.

  • You own all the code and the data

    Full source code under a perpetual license, running on your infrastructure. Not API access to someone else's platform β€” the stack itself is yours.

  • Model-agnostic

    Run any LLM β€” Claude, GPT, Gemini, Llama, Command, or your own fine-tune β€” and switch providers without rewriting the platform.

  • No per-seat pricing

    Usage-based billing against a budget cap you set. Cost tracks what your organization actually uses, not how many people you employ.

  • Deploy anywhere

    Your cloud, your VPC, on-premise, GovCloud, or a fully air-gapped network with no outbound connectivity.

1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.

ibl.ai is family-owned and operated from New York, NY β€” a U.S.-headquartered, domestically-owned long-term partner, not a vendor that sells licenses and moves on.

See the ibl.ai AI Operating System in Action

Discover how leading universities and organizations are transforming education with the ibl.ai AI Operating System. Explore real-world implementations from Harvard, MIT, Stanford, and users from 400+ institutions worldwide.

View Case Studies
Work with our team

Pilots, deployment, and full ownership

Most enterprise engagements are one-time, not subscriptions. You integrate ibl.ai with your own data, deploy it on your own infrastructure, and the engineering hours scale with the work β€” so the price tracks the scope, not your headcount.

Start here

Pilot

from $15K

fixed scope Β· fixed timeline

A time-boxed proof of value on your real data β€” not a slide deck.

Best for: Teams that want to see ibl.ai working before committing.

  • Deployed on your infrastructure or our cloud
  • 1–2 production agents wired to a slice of your data
  • One integration (LMS / SIS / SSO / data source)
  • Weekly working sessions with our engineers
  • Pilot fee credits toward a full engagement
Scope a pilot
Most common

Integration & Deployment

$25K – $80K

one-time Β· not a subscription

Full deployment integrated with your data and systems. Engineering hours scale with scope.

Best for: Organizations rolling ibl.ai out across a department, campus, or business unit.

  • Platform deployed in your VPC, on-prem, or air-gapped
  • Integrated with your data + identity (SSO / SAML)
  • Multiple custom agents built to your workflows
  • Engineering hours proportional to scope
  • You own the data Β· run any LLM you choose
Plan a deployment
Full ownership

Codebase Transfer + Custom AI Engineering

Custom quote

perpetual license Β· you own the stack

We transfer the full source code. You own and self-host the entire platform β€” outright.

Best for: Organizations and enterprises that benefit from perpetual ownership and sovereignty.

  • Complete source-code transfer + perpetual license
  • Dedicated AI engineering team on your roadmap
  • Custom agents, models, and integrations to spec
  • Air-gapped capable Β· zero vendor lock-in
  • Family-owned, New York–based long-term partner
Talk about ownership
You own the code and data Run any LLM β€” Claude, GPT, Gemini, Llama Family-owned & operated from New York, NY