The State of Data Streaming

86% of IT leaders say data streaming is a priority for IT investment in 2024

London, UK, June 6, 2024 – Confluent, Inc. (NASDAQ:CFLT), the data streaming pioneer, unveiled its 2024 Data Streaming Report: Breaking Down the Barriers to Business Agility & Innovation. The report dives into how organisations use data streaming to innovate, accelerate AI adoption, improve business agility, power customer experiences, and overcome data accessibility and management challenges. Based on a survey of 4,110 IT leaders across 12 countries, the report shows the pivotal role data streaming plays in helping businesses maximise the full potential of their data. 


Responsiveness is the key to success in today’s dynamic business landscape – slow, inconsistent, outdated, or ungoverned data is detrimental to success because it’s unreliable and can lead to bad decision-making. It’s imperative to leverage continuously streaming data to discover customer learnings, improve business operations, and find insights so organisations can act efficiently and quickly. In fact, 86% of respondents cite data streaming as a strategic or important priority in IT investments this year.


“Many organisations have data siloed away in different systems and applications, making it impossible to find and benefit from one of their most critical business assets – their data,” said Shaun Clowes, Chief Product Officer at Confluent. “Data streaming acts as the central nervous system for businesses by connecting systems and applications so real-time data can be easily accessed for decision making and improving business processes and customer experiences.”


Key takeaways from the report include:


Data Streaming Platforms Power Faster AI Adoption

GenAI is top of mind for many companies, but for AI models to generate accurate and relevant results, the data must be trustworthy, in the right format, and as real-time as possible. Retrieval augmented generation (RAG) has emerged as a common pattern for building GenAI-enabled applications by connecting general-purpose LLM models to domain-specific data while allowing granular access controls and minimising hallucinations. Data streaming enriches RAG-enabled workloads with trustworthy and contextual data by tapping into a continuous stream of real-time data from systems that power the business. Data streaming can efficiently transform data into the right format to be used by vector databases for AI applications. 


– 74% state investments in GenAI will trend up in the coming two years.

– 63% cite data streaming platforms extensively or significantly fuel AI progress by building the real-time data foundation needed to propel these initiatives. 

– 90% note data streaming platforms keep track of data fed into models for governance purposes.

Data Streaming Simplifies the Development of Data Products and Encourages Reusability and Cost Savings

As organisations look to broaden and simplify data access and reusability, more are thinking about organising their data into data products. Data products are live, refined, fully governed, and ready-to-use data assets that are instantly discoverable, contextualised, trustworthy, and reusable for many use cases. Data products allow organisations to reuse data across a variety of use cases to save costs and time.

– 91% of IT leaders are investing in data streaming platforms to drive their data goals, which include data product creation.

– 72% cite significant benefits from embracing a data product approach. 

Notable benefits of data products are:

– 98% cite data products as compelling or worthwhile in enabling more confident data sharing across business units.

– 91% note more meaningful cost allocation or charging based on usage metrics.

– 90% state more robust risk management. 


Data Streaming Platforms Prevent Data Silos and Solve Data Accessibility Challenges

Tackling data access and management challenges head-on is crucial for businesses to maximise success in a data-driven world. The 2024 Data Streaming Report shows that data streaming platforms help organisations address many data accessibility challenges, including uncovering siloed data, that hinder real-time, data-driven operations. As the central nervous system for businesses, data streaming platforms connect applications and systems to ensure data is available in real-time, everywhere it’s needed. This allows companies to focus on accelerating innovation instead of navigating the maze of point-to-point connections. 

– 76% of IT leaders cite five or more data-related challenges impacting their organisations, including siloed data and governance-related problems. 

The most common problems data streaming can solve include:

– 93% say data streaming helps break down data silos in most or many situations

– 88% note data streaming helps to access existing data 

– 86% cite data streaming helps discover existing data

– 84% state data streaming helps address governance-related problems


Data Streaming Delivers Significant Benefits for Business Investments

As businesses learn to do more with less, proving the ROI of tech investments has become even more critical. This report shows that data streaming pays off across every industry and that organisations of all sizes are achieving value, despite limited resources. 

– 84% of IT leaders cite 2x to 10x return on data streaming investments.

– 95% stated that data streaming improved or is expected to improve cybersecurity and data-driven operations.

– 90% improved or expected to improve product and service innovation when using AI/ML.




Learn More About the Report

This report was based on a survey from Freeform Dynamics and Radma Research with responses from 4,110 IT leaders familiar with data streaming from companies with 500 or more employees. These respondents are from 12 different countries including Australia, Canada, France, Germany, India, Indonesia, Japan, Singapore, Spain, the United Arab Emirates, the United Kingdom, and the United States. The respondents work in a variety of industries, including technology, financial services, government/public sector, manufacturing, healthcare, media/entertainment, non-profit, professional services, research/education, retail, transportation/logistics, travel/hospitality, and utilities/telecom. 



Media Contact

Saheena Dhanda / Imogen Nichols

[email protected]


Confluent is the data streaming platform that is pioneering a fundamentally new category of data infrastructure that sets data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion—designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organisation. With Confluent, organisations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven back-end operations. To learn more, please visit

Unlocking productivity and efficiency gains with data management

Russ Kennedy • 04th July 2023

Enterprise data has been closely linked with hardware for numerous years, but an exciting transformation is underway as the era of the hardware businesses is gone. With advanced data services available through the cloud, organisations can forego investing in hardware and abandon infrastructure management in favour of data management.

The Future of Cloud: A Realistic Look at What’s Ahead

Erin Lanahan • 22nd March 2023

Cloud computing has transformed the way we work, communicate, and consume technology. From storing data to running applications, the cloud has become an essential part of our lives. But what does the future hold for this technology? In this article, we’ll take a realistic look at the future of the cloud and what we can...

Ab Initio partners with BT Group to deliver big data

Luke Conrad • 24th October 2022

AI is becoming an increasingly important element of the digital transformation of many businesses. As well as introducing new opportunities, it also poses a number of challenges for IT teams and the data teams supporting them. Ab Initio has announced a partnership with BT Group to implement its big data management solutions on BT’s internal...