September 9, 2019 By Kevin Oliver 4 min read

Artificial intelligence and machine learning (ML) have become very popular recently due to their ability to both optimize processes and provide the deep insights that push enterprises and industries forward. In fact, 68 percent of respondents in a recent 451 Research Report, Accelerating AI with Data Management; Accelerating Data Management with AI noted that they are either using machine learning or plan to within the next three years.

What’s more impressive is that 92 percent of those currently using machine learning – including companies that have it in proof of concept – “have positive opinions about the performance of their machine learning projects.” Yet, implementation challenges remain. Data management technologies that are themselves infused with AI can overcome these challenges and help enterprises get the most out of their plans for AI and ML.

Implementation Challenges

Three key barriers stood out in 451 Research’s report: a lack of skilled resources, accessing and preparing data and limited budget.

The lack of skilled resources was the top concern noted by respondents with 40 percent listing it as a barrier and 21 percent saying it was the most significant barrier.

That’s no surprise, given that there are only one to two million data scientists, compared to five to ten million business intelligence power users and two hundred to two hundred fifty knowledge workers. Simply put: there aren’t enough data scientists to go around for every company, or even to serve the needs of knowledge workers within individual companies.

Problems with accessing and preparing data, noted by 33 percent of respondents, can stop AI and ML in its tracks. A large body of data is required to deliver the depth of insight expected with these rising technologies. Lacking that data may reduce the accuracy of insight as well, due to missing crucial variables. The limited budgets mentioned by 32 percent of respondents can similarly act as a blocker to AI and ML projects from the start. Such projects will receive intense scrutiny and be able to show their worth from both a cost and value perspective up front. Their champions will need to show how they can increase efficiencies as well.

The role of data management

Data management is capable of helping with all of these challenges, particularly where data ingestion and preparation is concerned—a stage of the AI process 39 percent said they consider to be “the most demanding in relation to their underlying infrastructure.” Data management solutions should be infused with AI and part of a robust data management environment.

More than 66 percent of respondents agreed that “AI and ML are important components of data platforms and analytics initiatives.” That number increases to 88 percent among companies where “nearly all strategic decisions are data-driven.” In particular, ML can help increase efficiencies by optimizing the path a query takes to data. ML also can enable confidence-based querying where answers are returned in order of predicted accuracy, which is determined by looking at historical accuracy data.

The right data management environment is crucial. By choosing an environment with AI built in instead of stand-alone AI solutions, you can control management in a single system. Environments with integration and data virtualization capabilities also enable data to be queried where it resides, reducing the need for costly and time-consuming data movement.

How to overcome the AI challenges

A data management environment with the interconnected, AI-infused nature described above helps mitigate the challenges identified previously. The lack of skilled resources is offset in two ways. Data scientists and database administrators (DBAs) are given back valuable time through the inclusion of development languages and frameworks and automation of routine tasks like query optimization. Both result from building AI directly into data management solutions. Greater connectivity between data repositories in the environment can also help enable knowledge workers to pull some of their own data using intuitive data exploration tools, reducing the number of requests data scientists and DBAs must take on.

The challenges related to data access and preparation are directly affected by choosing the right data management environment. The connectivity created by data virtualization enables access across multiple repositories with different data types without data movement concerns. This should not only make data access and preparation easier than it would be in ecosystems where a reduced subset of siloed data is migrated to be used as part of AI and ML projects. It will also help increase accuracy by involving more data.

Finally, while no data management solution can solve up front budget limitations, it can demonstrate efficiencies and ROI that make investment more palatable. The 92 percent satisfaction rate is a good indicator that businesses are seeing the return they expect. The greater efficiencies which allow data scientists and DBAs to focus on value-additive tasks should also be encouraging. And, though hard to predict, the deeper, more accurate insights AI-infused data management can produce have the potential to open up new revenue-generating opportunities.

The Db2 family of data management solutions is focused on bringing AI-infused offerings capable of offsetting the common challenges described above. Learn more about data management and AI or Db2 11.5, the AI database, by reading:

Was this article helpful?
YesNo

More from Artificial intelligence

AI will change the world—the terms are up to us

3 min read - IBM at the B7 We are living in a watershed moment for AI: The European Parliament has just voted on the EU AI Act, which will regulate and govern the use and implications of this technology. In turn, governments and enterprises are getting ready to set their own standards around AI. AI featured in the G7 Ministerial Meeting in Verona, Italy, and in conversations happening in parallel in the Business Federations gatherings, or B7. I had the opportunity to bring…

IBM emerges as a Leader in the Forrester Wave™ for Digital Operations Planning and Analytics, Q4 2023

4 min read - Businesses have lost the luxury of time in decision-making. Thin margins and volatile market conditions demand AI-driven planning strategies. An unusually mild winter can saddle an apparel retailer with profit-killing overstocks of heavy coats; a supply chain pinch can leave a manufacturer without crucial parts. Consequently, the role of Digital Operations Planning and Analytics (DOPA) has become more crucial than ever. DOPA equips businesses with the tools and insights needed to navigate the complexities of today's market dynamics. By integrating…

No silver bullet: Closing the gender gap in the era of generative AI

5 min read - The gender representation gap didn’t happen overnight. There was no single event that created the current inequity. So, it’s reasonable to say that there won’t be a singular solution, either. There’s no silver bullet. It’s a puzzle, and we need all the pieces to come together for women to be equals in the workplace—and in leveraging the potential of generative AI. As my colleague Phaedra Boinodiris recently wrote, “The importance of diversity in AI isn’t opinion, it’s math.” Referencing the…

IBM Newsletters

Get our newsletters and topic updates that deliver the latest thought leadership and insights on emerging trends.
Subscribe now More newsletters