The AI data problem nobody talks about: Why more information isn't making better decisions

Wait 5 sec.

Commerce in the information age has thus far been one long quest to gather as much information as possible. Customer data, sales data, inventory data, system data, operational data, technical data, every facet of business can and has been tracked and quantified, guided by the idea that knowing more means decisions can be made faster and more conclusively.While sound in theory, that process has clearly hit a snag, as more and more companies abandon their AI projects after finding that the exponential explosion of data creation isn’t generating comparable value.Has AI peaked in its utility? Or is the issue one of interoperability? Why exactly has this monumental trend hit such a stumbling block? Expecting scale to produce clarityIt’s entirely understandable to assume that feeding more information into an AI increases the accuracy and quality of the output. Models need to train on data; after all, that is how they establish reason.But, like any computer system, input must be structured for it to be understood, and the issue many organizations now find themselves in has come as a result of them giving AI a decade's worth of unformatted, incomplete, non-standardized data and expecting it to read between the lines.Every system a company uses, from CRMs and internal emails to performance tracking spreadsheets and PDFs, stores different data points and operates on vastly different logic. What they host, why they host it, and how they host it were all purposeful decisions based on their desired function.While some support import and export options that translate material from one format into another, the developers behind these solutions never envisioned the need for a universal logic to tie everything together in a way that AI can easily parse. Each document and dataset contains a fragment of the overall picture. While AI excels at processing data, it cannot derive meaning and struggles to understand and incorporate unstructured data into its output, regardless of how many times it is asked to.An example of fragmentation in action We have largely solved the problem of data accessibility to the point that many public AI models have run out of new data and are now cannibalizing the output of other agents. The next step is in refining how AIs use the data they have.Real estate is an excellent showcase of this process in motion. To appraise and list a property, agents need access to ownership records, zoning information, environmental information, and neighborhood demographics, just to name a few. None of these systems was designed to communicate or cooperate, which has meant AI has historically struggled to find its footing in the industry. Newer approaches, however, prioritize the ability to find, interpret, and synthesize information from across different sources, aiding in the manual searches an analyst would otherwise do by hand. Data siloing and fragmentation slow down decision-making, and any systems that can account for them will command a premium going forward.Every industry has its own version of the same problem: a wealth of data at its disposal and no meaningful way to turn it into actionable insight. A generic, trend-inspired adoption of AI tools won’t necessarily solve these underlying issues, so it’s ultimately no surprise that many are abandoning their projects altogether. It will take models that prioritize context and connection, and companies paying more attention to how they store and format data, to address the glut in productivity and decision-driving insight AI is currently experiencing. Solving information overloadAI and the challenges it now faces are a classic example of the dangers of prioritizing quantity over quality. To be entirely fair to users, the companies behind these agents share some blame for this predicament.The technology is still in its infancy, and marketing hype continues to push scale and processing power as key features, while the much more valuable aspects, like contextual understanding and data integration, fly under the radar.This discrepancy will likely shift as more success stories highlight the competitive advantages of automating manual, time-consuming processes, as the real estate industry has with property research. It is this ability to understand what exists at a deeper, more comprehensive level that yields the greatest decision-supporting insight.We've featured the best AI website builder.This article was produced as part of TechRadar Pro Perspectives, our channel to feature the best and brightest minds in the technology industry today.The views expressed here are those of the author and are not necessarily those of TechRadarPro or Future plc. If you are interested in contributing find out more here: https://www.techradar.com/pro/perspectives-how-to-submit