New ISG research predicts more than half of enterprises will embrace DataOps by 2026
“As enterprise use of AI moves from initial pilots and trial projects through deployment and into production at scale, many enterprises are realizing the critical importance of agile, responsive data processes”
DataOps is the use of agile development, DevOps and lean manufacturing techniques by data engineering professionals to support data production. The ISG Buyers Guides for DataOps, produced by ISG Software Research, predict more than half of enterprises will adopt agile and collaborative DataOps practices by the end of 2026 to enhance responsiveness, avoid repetitive tasks and deliver measurable data reliability improvements.
“As enterprise use of AI moves from initial pilots and trial projects through deployment and into production at scale, many enterprises are realizing the critical importance of agile, responsive data processes,” said Matt Aslett, director of research, Analytics and Data, for ISG Software Research. “DataOps enables enterprises to effectively monitor the quality of data used in analytics and governance projects and ensure the reliability and health of the data environment.”
Healthy data pipelines are necessary to ensure data is ingested, processed and loaded in the required sequence to generate business insights and AI, the report says. As data sources and requirements grow increasingly complex, enterprises are looking to automate and coordinate the creation, scheduling and monitoring of data pipelines as part of a DataOps approach to data management.
Such data orchestration automates and accelerates the flow of data to support operational and analytics initiatives and drive business value. By 2027, ISG says more than half of enterprises will adopt data orchestration technologies to automate and coordinate data workflows and increase efficiency and agility in data and analytics projects.
To fully deliver on the promise of DataOps, enterprises must adopt new approaches to people, processes and information, the report says. Processes and methodologies that support rapid innovation and experimentation, automation, collaboration, measurement and monitoring, and high data quality will improve the value generated by analytics and data initiatives.
ISG Software Research designates the top three software providers as Leaders in each category. For the 2024 study, the leading providers in ranked order are:
DataOps: Informatica, Microsoft and IBM
Data Observability: Monte Carlo, DQLabs and Acceldata
Data Orchestration: Databricks, Microsoft and Alteryx
Data Pipelines: Microsoft, Alteryx and Databricks
Data Products: Microsoft, Informatica and SAP
“Enterprises need to enable data operation activities across business and IT to improve the agility of data scientists and data analysts in their daily work,” said Mark Smith, partner, ISG Software Research. “Orchestrating and managing pipelines of data to streamline the development of AI requires the efficient processing of data and governance of analytical and operational processes.”