Skip to content
Insights·2026-05-30·Updated 2026-07-27·4 min read

Why AI pilots stall before production

Most enterprise AI pilots never ship. The blocker is almost never the model — it is ownership, integration, and the day-two work nobody scopes.

By Robin Fitzpatrick

Why AI pilots stall before production

What this article covers

Most enterprise AI pilots never ship. The blocker is almost never the model — it is ownership, integration, and the day-two work nobody scopes.

Most AI pilots do not fail. They succeed, get praised, and then quietly never ship.

That distinction matters, because it points at the real problem. The pilot did what it was asked to do — prove the idea was possible. What it was never asked to do was survive contact with the organisation that would have to run it.

The numbers, and why they disagree

The headline statistic doing the rounds is that 95% of enterprise GenAI pilots deliver no measurable return, from MIT's GenAI Divide report. It is a striking number and it is worth being careful with it.

The study defined success narrowly: deployment beyond pilot phase with measurable P&L impact six months after the pilot. Critics have pointed out that this excludes efficiency gains, quality improvements, churn reduction, and most second-order benefits — which is a fair objection, and the sample was 52 executive interviews plus 153 survey responses.

Other measures land in a similar neighbourhood by different routes:

You should not take any single one of these as gospel. What matters is that four organisations using four methodologies all found the same shape: a large majority of pilots stop before production, and the consistent explanation is not model capability.

The gap is organisational, not technical

A pilot and a production system are asked different questions.

A pilot answers: can this work? It runs on a curated dataset, usually with the person who built it sitting nearby, and it has no obligation to handle the awkward 8% of cases. Everyone involved is motivated for it to succeed.

Production answers: will this keep working when nobody is watching? That question has a different shape entirely:

  • Who owns it? Not who built it — who is accountable when it produces a wrong answer on a Tuesday.
  • What happens when the model is wrong? Not whether it will be. It will be.
  • How do exceptions get handled? Every real process has a long tail. The pilot almost certainly ignored it.
  • What gets logged, and who reads the log? Instrumentation nobody looks at is not instrumentation.
  • How does a user recover when the workflow breaks mid-task? Half-completed automated work is often worse than none.
  • What happens when the process changes? Because it will, usually within two quarters.

None of those are AI questions. They are operating questions. They are also, reliably, out of scope during a pilot — which is precisely why the pilot clears its bar and then stops.

Three specific ways pilots die

The owner was never named. A pilot sponsored by innovation, built by a vendor, and destined for operations has three parties and no owner. When it comes time to run the thing, the sponsor has moved to the next initiative, the vendor's statement of work has ended, and operations was not consulted about a system they are now expected to staff. Nobody killed it. It just had no one to keep it alive.

The integration was assumed. "We'll connect it to the CRM" is a sentence that hides between two weeks and nine months of work, depending on whether that CRM has a usable API, who controls it, what the data retention policy says, and whether security has opinions. Pilots typically run on an export. Production does not get an export.

The process underneath was not stable. AI applied to a process that changes every quarter produces a system that is wrong every quarter. If a team is mid-reorganisation, or the workflow is genuinely different across three regions, the automation encodes a snapshot of something that no longer exists by the time it ships. This is the failure mode that is hardest to see from inside a pilot, because the pilot runs too fast to notice the ground moving.

What changes if you plan for production first

The fix is not a better pilot. It is asking the production questions before the pilot rather than after it.

Concretely, that means agreeing four things up front:

  1. A named owner — a person, in operations, who knows they are inheriting a system and has agreed to it.
  2. One metric — the specific number this is supposed to move, agreed with the person who is measured on that number.
  3. A defined wrong-answer path — what the system does when it is not confident, and who receives it.
  4. An integration route that someone has actually looked at — not assumed, looked at.

If those four cannot be answered, the honest conclusion is that the organisation is not ready to run this system yet, and the pilot will be an expensive way to discover that. Better to find out during a scoping conversation.

That is also why we sequence implementation around the operating path rather than the model, and why an AI readiness assessment is worth doing before the build rather than after the pilot stalls.

The uncomfortable version

A pilot that stalls is not usually a technical failure. It is an organisation discovering, expensively and late, that it had not decided who would own the work.

That decision costs nothing to make at the start. It costs a full pilot budget to discover at the end.

Frequently asked questions

What percentage of AI pilots make it to production?
Estimates vary widely depending on how "production" is defined. Gartner's 2026 deployment survey puts it at 20–30% reaching meaningful scale, while its agent-specific data is harsher at roughly 11%. MIT's widely-cited GenAI Divide report found 95% of pilots delivered no measurable P&L impact, though that study measured a narrow definition of ROI six months post-pilot and has been fairly criticised for it. The honest read is that most pilots stall, and the range reflects genuine disagreement about what counts as success.
Why do AI pilots fail even when the technology works?
Because a pilot proves feasibility and production proves the organisation. A demo runs on curated data, with an engineer nearby, and no obligation to handle exceptions. Production requires a named owner, an integration path, a defined behaviour when the model is wrong, an escalation route, and someone accountable for the output at 2am. Those are operating questions, not model questions, and they are usually out of scope during the pilot.
How long should an AI pilot take?
Long enough to answer the production questions, which is usually two to six weeks. Pilots that run longer are typically avoiding a decision rather than gathering evidence. If a pilot has been running for six months, the useful question is not "is it working" but "who decided not to decide".
What should you do before starting an AI pilot?
Name the person who will own the system in production, agree what metric it must move, and confirm the underlying process is stable enough to improve. If the process changes every quarter or nobody will own the result, the pilot will produce a demo and nothing else — regardless of how well the model performs.