On 23 January 2024, Gartner® published Innovation Insight: How Generative AI Is Transforming Data Management Solutions.[1] We were excited to see that Illumex was mentioned as a Representative Provider along with 9 other vendors in the GenAI domain – AWS, Cambridge Semantics, Databricks, Dataiku, Google, IBM Labs, Informatica, Microsoft, and Stratio.
Gartner’s Recommendations in this report included:
- “Improve the accuracy of GenAI on top of enterprise data by building a strong metadata practice, including rich semantics.
- Build data literacy and GenAI skills within your organization to safely use these emerging data management technologies and detect pitfalls such as hallucinations.
- Evaluate and test the GenAI-enabled data management capabilities and roadmaps provided by the vendors and avoid building your solution unless a use case delivering strong business value has been identified
- Deploy only if the levels of accuracy, quality, security, and privacy are sufficient and your data management team is confident that it can cope with the ongoing validation of being the human in the loop.
- Quantify the near and midterm value of GenAI investments in data management technologies by comparing them with ongoing technology, personnel costs, and process improvements to decide when to include them in your technology roadmap.”
With a Strategic Planning Assumption that “Through 2026, GenAI will reduce manually intensive data management costs up to 20% each year while enabling four times as many new use cases.”
The renowned authors Roxane Edjlali, Mark Beyer, Ehtisham Zaidi, Melody Chien, Nina Showell stated:
“GenAI is transforming data management activities through natural language interfaces, making data management activities more widely accessible. Integration with metadata management tools and enrichment from semantic tools and knowledge graphs will be used to train large language models (LLMs) on enterprise- or industry-specific corpora. As a result, it will become possible to use natural language instructions to perform data management tasks. This will not only reduce the skills barrier to data management but will also increase the productivity of data management specialists, thereby significantly supporting cost optimization efforts.
To deliver on these objectives, an emerging design extends the data fabric by augmenting it with GenAI to support the following sets of activities:
- Teach GenAI data semantics and use GenAI to observe new data through metadata discovery, building, and maintaining contextual semantics.
- Leverage GenAI to correct and generate code hence augmenting data exploration, data engineering, data operationalization, and administration activities.”
There are countless benefits and uses for GenAI to improve Data Management practice. In the report, Gartner states four benefits and uses:
- “Metadata Discovery and Knowledge Graph Generation;”
- “Contextual Metadata Documentation to Support Glossaries and Code Repositories;”
- “Data Exploration and Code Generation and Correction;”
- “GenAI Augmented Data Operations and Optimization”
At illumex, we are committed to getting organizations AI-ready and facilitating efficacious data, analytics, AI, and GenAI interactions.
All quotes in this blog post are taken from:
[1] Gartner, “Innovation Insight: How Generative AI Is Transforming Data Management Solutions”, Roxane Edjlali, Mark Beyer, Ehtisham Zaidi, Melody Chien, Nina Showell, 23 January 2024.
Gartner® does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner® disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
* GARTNER® is a registered trademark and service mark of Gartner, Inc. and/or its affiliates in the U.S. and internationally and is used herein with permission. All rights reserved.