{"id":65740,"date":"2026-09-08T17:53:20","date_gmt":"2026-09-08T15:53:20","guid":{"rendered":"https:\/\/juvo.be\/?p=65740"},"modified":"2026-09-17T13:43:07","modified_gmt":"2026-09-17T11:43:07","slug":"why-ai-pilots-fail-and-what-makes-the-next-one-work","status":"publish","type":"post","link":"https:\/\/juvo.be\/en\/why-ai-pilots-fail-and-what-makes-the-next-one-work\/","title":{"rendered":"Why AI pilots fail (and what makes the next one work)"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row column_structure=&#8221;1_2,1_2&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;1_2&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<p>After an AI pilot that went nowhere, the easiest conclusion is that the technology wasn&#8217;t ready. In the pilots we see, the cause sits one layer down: <strong>in the data the model had to learn from<\/strong>.<\/p>\n<p>Six months, an enthusiastic team, an external partner, one use case everyone agreed on. Then comes the delivery, and the results don&#8217;t hold. The accuracy is too low to put the tool into production. Or it works in the demo but not on your own data. Or it stalls because nobody owns it any more. Nobody checked up front whether the data could carry it.<\/p>\n<p>Now you must decide whether a second attempt is meaningful. <strong>This is an investment decision, not a technology choice<\/strong>. Below are the causes listed, along with the characteristics of a pilot that avoids them.<\/p>\n<p><strong>Data is not the only cause<\/strong>: process, ownership, and scope are also included in this text. If you want to know where you stand, it starts with the question: <a href=\"https:\/\/juvo.be\/en\/data-ai-readiness\/\">is your data ready for AI?<\/a> How often does it go like this, and what exactly goes wrong?<\/p>\n<p>[\/et_pb_text][\/et_pb_column][et_pb_column type=&#8221;1_2&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_image src=&#8221;https:\/\/juvo.be\/wp-content\/uploads\/Gemini_Generated_Image_cdoooocdoooocdoo.jpeg&#8221; alt=&#8221;Artificial neural networks, ANN, connectionist systems. Abstract simple graphics scheme of neural machine mind with AI. Artificial intelligence, cybernetic net in computer learning. Science concept.   &#8221; title_text=&#8221;Gemini_Generated_Image_cdoooocdoooocdoo&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; border_radii=&#8221;on|6px|6px|6px|6px&#8221; global_colors_info=&#8221;{}&#8221;][\/et_pb_image][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; background_color=&#8221;RGBA(255,255,255,0)&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row make_equal=&#8221;on&#8221; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text admin_label=&#8221;Tekst&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; background_color=&#8221;#F2F2F2&#8243; min_height=&#8221;100%&#8221; custom_padding=&#8221;25px|25px|25px|25px|true|true&#8221; hover_enabled=&#8221;0&#8243; border_radii=&#8221;on|6px|6px|6px|6px&#8221; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h2>Why do AI pilots stall?<\/h2>\n<p>In January 2026, Gartner found that <a href=\"https:\/\/www.gartner.com\/en\/articles\/genai-project-failure\" target=\"_blank\" rel=\"noopener\">by the end of 2025 at least half of all generative AI projects had been abandoned after the proof of concept<\/a>. The reasons <strong>Gartner lists<\/strong>: poor data quality, inadequate risk controls, escalating costs and unclear business value. That figure is about generative AI, not about every AI pilot.<\/p>\n<p><strong>In the projects that we observe, &#8220;failed&#8221; seldom means that nothing works<\/strong>. It means that the functioning thing does not enter the organisation, and this occurs in four forms:<\/p>\n<p>&#8211; <strong>Technically<\/strong> it works, but it does not enter the organisation.<br \/>&#8211; <strong>Accuracy<\/strong> remains too low to rely on in production; &#8211; scaling after the pilot turns out too expensive;<br \/>&#8211; <strong>nobody can demonstrate<\/strong> what it returns and the budget disappears.<\/p>\n<p>In the pilots that we see, the cause is almost never in the technology, and that is not just our impression. <a href=\"https:\/\/www.rand.org\/pubs\/research_reports\/RRA2680-1.html\" target=\"_blank\" rel=\"noopener\">The RAND Corporation investigated in 2024 why AI projects fail<\/a>, based on 65 interviews with people doing the work.<\/p>\n<p><strong>Of their five main causes<\/strong>, a misunderstood problem at the management level is at the top. Data of insufficient quality or quantity is second, and immature technology is last. The question remains what lies beneath.<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row admin_label=&#8221;Row&#8221; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h2>The three data problems that make AI pilots fail<\/h2>\n<h3>Not enough training data<\/h3>\n<p><strong>A model doesn&#8217;t follow rules you write down<\/strong>; it generalises from examples. So what limits it is how many real cases with a known outcome you can show it. Ask it to flag orders that will run late, and it can only learn from orders that ran late and were recorded as such. Where those cases were never captured, the model still produces an answer, just not one that means anything.<\/p>\n<p><strong>How many cases you have is not the only thing that counts<\/strong>. The quality of your labelled dataset determines the accuracy of the model. In a small dataset, every mislabelled example carries weight: the model learns the error and repeats it systematically.<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row admin_label=&#8221;Row&#8221; _builder_version=&#8221;4.27.7&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h3>Inconsistent data<\/h3>\n<p><strong>If the same customer is spelled three ways in your CRM<\/strong>, nothing tells the model it is one customer. If the same product code means something different in your ERP than in your CRM, the model builds that contradiction into its pattern. It has no way to flag the conflict, so it learns it.<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row admin_label=&#8221;Row&#8221; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h3>Training data that doesn&#8217;t reflect reality<\/h3>\n<p><strong>Gartner describes AI-ready data<\/strong> as <a href=\"https:\/\/www.gartner.com\/en\/newsroom\/press-releases\/2025-02-26-lack-of-ai-ready-data-puts-ai-projects-at-risk\" target=\"_blank\" rel=\"noopener\">data that is representative of the use case<\/a>: of every pattern, error, outlier and unexpected emergence needed to train or run the model. Training data from your best period is not that. Such a model performs perfectly in training and poorly in production, because what it learned is a filtered version of your reality.<\/p>\n<p>Say you ask a model to predict which customers are about to leave. The training data comes from your CRM, and it only holds customers who are still active, since anyone who left has been cleaned out. <strong>The model can never learn what a departing customer looks like<\/strong>, because that pattern isn&#8217;t in the data. In production it predicts no churn. Not because the model falls short, but because nobody gave it the cases it could have learned from.<\/p>\n<p><strong>Fix the data<\/strong> and you have removed the cause that gets named first, but not all of them.<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row admin_label=&#8221;Row&#8221; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h2>Other pitfalls: process, ownership and scope<\/h2>\n<p><strong>A use case that is too broad.<\/strong> &#8220;AI for our customer service&#8221; is not a use case, it&#8217;s an ambition. &#8220;The model classifies incoming email and routes it to the right colleague&#8221; is one: a single task, a single system, a single team. In the pilots we see, that boundary is the difference between a pilot that returns something and a pilot that ends in an argument about what was promised.<\/p>\n<p><strong>No business owner.<\/strong> A pilot without someone on the business side who judges the output leaves the technical team to decide what good looks like. They then build something that is technically correct and commercially unusable, and they are right about the technical part. That is nobody&#8217;s failure; the role was never filled.<\/p>\n<p><strong>Success criteria nobody agreed on.<\/strong> What counts as &#8220;good enough&#8221;? Agree on it before the pilot starts, and agree on it in numbers. For example: the model classifies at least 85% of email correctly, and the remaining cases reach a colleague correctly. Without that bar, every outcome is a failure, because there is nothing to measure it against.<\/p>\n<p><strong>Scaling before proof.<\/strong> Models become outdated. <a href=\"https:\/\/www.nature.com\/articles\/s41598-022-15245-z\" target=\"_blank\" rel=\"noopener\">Researchers tested 128 combinations of model and dataset across four sectors and observed that quality declined in 91% of cases as time went by<\/a>. This is known as data drift: reality changes, but the model does not adapt. As such, the accuracy derived from your pilot is no guarantee for the following year, and rolling out to everyone before you understand this is costly.<\/p>\n<p><strong>These four pitfalls can all be avoided before the pilot begins<\/strong>. What does such a pilot look like?<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; background_color=&#8221;RGBA(255,255,255,0)&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row make_equal=&#8221;on&#8221; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text admin_label=&#8221;Tekst&#8221; _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; background_color=&#8221;#F2F2F2&#8243; min_height=&#8221;100%&#8221; custom_padding=&#8221;25px|25px|25px|25px|true|true&#8221; hover_enabled=&#8221;0&#8243; border_radii=&#8221;on|6px|6px|6px|6px&#8221; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h2>What a successful AI pilot looks like<\/h2>\n<p>What makes a pilot successful is less about the technology than about the agreements made in advance. Six characteristics make the difference:<\/p>\n<p>1. <strong>Limited use case.<\/strong> One task, one system, one team. You must be able to express the assignment in one sentence, without &#8220;and&#8221; in it.<\/p>\n<p><strong>2. Data audit before the start<\/strong>. Look at volume, quality, and representativeness, and do this on the data that the model will actually use. What is missing here, you will encounter later as a result that no one trusts.<\/p>\n<p><strong>3. Business owner<\/strong>. Someone from the company monitors the business case and assesses the output, with time in their diary and the mandate to stop.<\/p>\n<p><strong>4. Agreed success criteria<\/strong>. Documented before the pilot starts, in numbers, with the agreement on what happens if you do not meet the target.<\/p>\n<p><strong>5. Iterative adjustments<\/strong>. Review the results along the way instead of waiting for delivery. Then a wrong assumption is a correction and not a failure.<\/p>\n<p><strong>6. Limited scope for rollout<\/strong>. Prove it on a small scale, with one team or one process stream, and then scale up.<\/p>\n<p><strong>Five of these six characteristics can be agreed upon by yourself this week<\/strong>, without external parties. Characteristic 2 remains, and it is the only one that you cannot agree upon but must establish.<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.4&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px||0px||true|false&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row admin_label=&#8221;Row&#8221; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; width=&#8221;100%&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.17.6&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.27.8&#8243; _module_preset=&#8221;default&#8221; hover_enabled=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; sticky_enabled=&#8221;0&#8243;]<\/p>\n<h2>Where data readiness fits in<\/h2>\n<p><strong>Data readiness is not a nice-to-have next to an AI project<\/strong>. It is the condition for one. A model is only as good as the data it learns from, and only as good as the data it reacts to once it runs.<\/p>\n<p>That is also why the second characteristic behaves differently from the other five. Scope, ownership and criteria are agreements, and an agreement is <strong>something you settle once the right people are in the room<\/strong>. Readiness is a state of your systems, and a model cannot compensate for something your records never captured.<\/p>\n<p><strong>Thus, the question shifts<\/strong>. Not: have we chosen the right AI technology? But: can our data support what we wish to achieve? You know before you invest which applications are feasible today and which require data work first.<\/p>\n<p><a href=\"https:\/\/juvo.be\/en\/data-ai-readiness-assessment-know-where-you-stand-in-two-weeks\/\">The Data &amp; AI Readiness Scan<\/a> provides you with <strong>an honest picture of your data maturity and a concrete action plan within two weeks<\/strong>. It includes a priority list with the improvements that weigh most heavily and a go\/no-go recommendation. We honestly tell you where you stand, even if that means that you are better off not starting again right now. A no-go is also a valid outcome.<\/p>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>After an AI pilot that went nowhere, the easiest conclusion is that the technology wasn&#8217;t ready. In the pilots we see, the cause sits one layer down: in the data the model had to learn from. Six months, an enthusiastic team, an external partner, one use case everyone agreed on. Then comes the delivery, and [&hellip;]<\/p>\n","protected":false},"author":15,"featured_media":74997,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","_seopress_robots_follow":"","_seopress_robots_imageindex":"","_seopress_robots_snippet":"","_seopress_robots_primary_cat":"","_seopress_robots_breadcrumbs":"","_seopress_robots_freeze_modified_date":"","_seopress_robots_custom_modified_date":"","_seopress_robots_canonical":"","_seopress_social_fb_title":"","_seopress_social_fb_desc":"","_seopress_social_fb_img":"","_seopress_social_fb_img_attachment_id":0,"_seopress_social_fb_img_width":0,"_seopress_social_fb_img_height":0,"_seopress_social_twitter_title":"","_seopress_social_twitter_desc":"","_seopress_social_twitter_img":"","_seopress_social_twitter_img_attachment_id":0,"_seopress_social_twitter_img_width":0,"_seopress_social_twitter_img_height":0,"_seopress_redirections_value":"","_seopress_redirections_enabled":"","_seopress_redirections_enabled_regex":"","_seopress_redirections_logged_status":"","_seopress_redirections_param":"","_seopress_redirections_type":0,"_seopress_analysis_target_kw":"","_seopress_news_disabled":"","_seopress_video_disabled":"","_seopress_video":[],"_seopress_pro_schemas_manual":[],"_seopress_pro_rich_snippets_disable_all":"","_seopress_pro_rich_snippets_disable":[],"_seopress_pro_schemas":[],"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","content-type":"","footnotes":""},"categories":[84],"tags":[],"class_list":["post-65740","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai-readiness"],"acf":[],"_links":{"self":[{"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/posts\/65740","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/comments?post=65740"}],"version-history":[{"count":16,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/posts\/65740\/revisions"}],"predecessor-version":[{"id":76153,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/posts\/65740\/revisions\/76153"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/media\/74997"}],"wp:attachment":[{"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/media?parent=65740"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/categories?post=65740"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/juvo.be\/en\/wp-json\/wp\/v2\/tags?post=65740"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}