In-Memory Database as a Service Market Outlook

As per our latest research, the global In-Memory Database as a Service (DBaaS) market size reached USD 3.85 billion in 2024, reflecting robust adoption across industries. The market is expected to grow at a strong CAGR of 25.4% from 2025 to 2033, reaching a projected value of USD 31.1 billion by 2033. This remarkable growth trajectory is driven by the increasing demand for ultra-fast data processing, real-time analytics, and the proliferation of cloud-based services across diverse sectors.

A key growth factor for the In-Memory DBaaS market is the exponential increase in data generation and the need for real-time data processing. Organizations are increasingly relying on data-driven decision-making, which necessitates rapid access to and analysis of large datasets. In-memory databases, by storing data directly in the main memory rather than on disk, offer significantly faster data retrieval and transaction processing. This capability is particularly vital for applications in financial services, telecommunications, retail, and healthcare, where milliseconds can make a substantial difference in outcomes. As enterprises continue to digitalize operations and customer expectations for instantaneous services grow, the demand for in-memory database solutions delivered as a service is expected to surge.

Another major driver is the widespread adoption of cloud computing and the shift towards hybrid and multi-cloud strategies. In-Memory DBaaS platforms offer organizations the flexibility to scale resources up or down based on workload demands, without the need for significant capital investment in physical infrastructure. The cloud-based delivery model also simplifies database management, maintenance, and disaster recovery, making it an attractive proposition for both small and large enterprises. Additionally, the integration of advanced technologies such as artificial intelligence, machine learning, and IoT with in-memory databases is enhancing their capabilities, enabling more sophisticated analytics and supporting complex, data-intensive applications.

Furthermore, the increasing focus on digital transformation initiatives across industries is propelling the adoption of In-Memory DBaaS solutions. Companies are seeking to modernize their IT infrastructures to stay competitive, improve operational efficiency, and deliver enhanced customer experiences. In-memory databases provide the performance, scalability, and reliability required for next-generation applications, such as personalized recommendations, fraud detection, and real-time supply chain optimization. The availability of managed DBaaS offerings from leading cloud providers is further lowering the barriers to entry, enabling organizations of all sizes to leverage the benefits of in-memory computing without the need for specialized in-house expertise.

From a regional perspective, North America currently holds the largest share of the global In-Memory DBaaS market, driven by the presence of major technology companies, early adoption of cloud services, and significant investments in digital infrastructure. However, the Asia Pacific region is expected to exhibit the highest growth rate over the forecast period, fueled by rapid digitalization, expanding IT and telecom sectors, and increasing investments in cloud computing across countries such as China, India, and Japan. Europe and Latin America are also witnessing growing adoption, supported by favorable regulatory environments and the rising need for agile, real-time data solutions in sectors like BFSI, healthcare, and retail.

Database Type Analysis

The In-Memory Database as a Service market is segmented by database type into Relational, NoSQL, and NewSQL databases. Relational databases continue to dominate the market, owing to their widespread use in enterprise applications that require robust transactional integrity and structured data management. The familiarity of SQL and the maturity of relational database management systems make them a preferred choice for organizations migrating mission-critical workloads to the cloud. Many leading DBaaS providers offer fully managed relational in-memory solutions, enabling seamless integration with existing enterprise ecosystems and supporting a wide range of business applications.

NoSQL in-memory databases are gaining significant traction, particularly among organizations dealing with unstructured or semi-structured data and requiring h

The size of the In Memory Database Industry market was valued at USD XX Million in 2024 and is projected to reach USD XXX Million by 2033, with an expected CAGR of 19.00% during the forecast period. Recent developments include: May 2022: IBM and SAP announced the extension of their collaboration as IBM embarks on a corporate transformation initiative to optimize its business operations using RISE and SAP S/4HANA Cloud. To execute work for over 1,000 legal entities in more than 120 countries and multiple IBM companies supporting hardware, software, consulting, and finance, IBM said it is transferring to SAP S/4HANA, SAP's most recent ERP system, as part of the extended relationship. The replacement for SAP R/3 and SAP ERP, SAP S/4HANA, is SAP's ERP system for large businesses. It is intended to work optimally with SAP's in-memory database, SAP HANA., November 2022: Redis, a provider of real-time in-memory databases, and Amazon Web Services have announced a multi-year strategic alliance. Redis is a networked, open-source NoSQL system that stores data on disk for durability before moving it to DRAM as necessary. It can function as a streaming engine, message broker, database, or cache. The business claims that when Redis is used as a database, apps may instantly search across tens of millions of rows of customer data to locate information specific to one particular customer. A managed database-as-a-service product on AWS is called the real-time Redis Enterprise Cloud., December 2022: The National Stock Exchange, the largest stock exchange in India, chose the Raima Database Manager (RDM) Workgroup 12.0 in-memory system as a foundational component for the next iterations of its trading platform front-end, the National Exchange for Automated Trading (NEAT).. Key drivers for this market are: Decreasing Hardware Cost, Increasing Penetration Of Trends Like Big Data And IOT; Increase In The Volume Of Data Generated And Shift Of Enterprise Operations. Potential restraints include: Resilience In Integration With VLDB'S. Notable trends are: Telecommunication End-User Industry to Hold Significant Market Share.

In-Memory Database as a Service Market Outlook

According to our latest research, the Global In-Memory Database as a Service market size was valued at $2.7 billion in 2024 and is projected to reach $13.4 billion by 2033, expanding at an impressive CAGR of 19.8% during the forecast period of 2025–2033. This robust growth is primarily driven by the accelerating digital transformation across industries, which has heightened the demand for real-time analytics, ultra-low latency data processing, and scalable cloud-native database solutions. Organizations are increasingly prioritizing agility and responsiveness in their IT operations, leading to a surge in adoption of in-memory database as a service (IMDBaaS) platforms that deliver instant data access and seamless scalability, thereby fueling market expansion on a global scale.

Regional Outlook

North America currently commands the largest share of the global In-Memory Database as a Service market, accounting for over 38% of total revenue in 2024. This dominance is attributed to the region’s mature enterprise IT ecosystem, widespread adoption of cloud infrastructure, and the presence of leading technology giants and cloud service providers. The United States, in particular, is a hub for innovation, with early adoption of advanced analytics, artificial intelligence, and IoT applications that require real-time data processing capabilities. Favorable regulatory frameworks, strong investment in R&D, and a highly skilled workforce further reinforce North America’s leadership in the IMDBaaS landscape. The region’s enterprises, especially in BFSI, healthcare, and IT sectors, are leveraging these platforms to drive digital transformation and gain competitive advantages.

The Asia Pacific region is poised to be the fastest-growing market for In-Memory Database as a Service, with a projected CAGR exceeding 22.5% through 2033. Rapid digitization, expanding cloud adoption, and burgeoning e-commerce and fintech sectors in countries like China, India, Japan, and South Korea are key growth drivers. Governments in the region are investing heavily in smart city projects, digital infrastructure, and data-driven governance, creating robust demand for real-time analytics and high-performance database solutions. Furthermore, the proliferation of mobile devices, IoT deployments, and a growing base of tech-savvy SMEs are accelerating the shift to IMDBaaS platforms. Strategic partnerships between global cloud providers and local enterprises are also catalyzing market penetration and innovation in the region.

Emerging economies in Latin America, Middle East, and Africa are experiencing a gradual but steady uptake of In-Memory Database as a Service solutions. While these regions collectively hold a smaller share of the global market, their growth trajectory is promising, driven by increasing cloud adoption, digital banking initiatives, and modernization of legacy IT infrastructures. However, challenges such as limited access to advanced cloud infrastructure, data sovereignty concerns, and regulatory uncertainties can impede rapid adoption. Localized demand, language barriers, and the need for region-specific compliance also impact the pace of IMDBaaS deployment. Nevertheless, as cloud service providers expand their footprint and governments introduce supportive digital policies, these regions are expected to contribute significantly to the market’s long-term growth.

Report Scope

The global in-memory database market is projected to reach USD 3480.1 million by 2033, exhibiting a CAGR of 14.9% during the forecast period. Rising demand for real-time analytics and data processing capabilities across various industries, such as BFSI, retail, healthcare, and manufacturing, is fueling market growth. Additionally, the increasing adoption of cloud computing and big data solutions further drives market expansion. North America holds a significant market share due to the presence of major technology hubs and high technology adoption rates. Asia Pacific is expected to witness notable growth due to the increasing investment in data analytics and infrastructure development in emerging economies. Key market players include Microsoft, IBM, Oracle, SAP, Teradata, and Amazon Web Services. These companies offer a range of in-memory database solutions tailored to address the needs of different industries and applications.

The Structured Query Language (SQL) server transformation market is experiencing robust growth, projected to reach $15 million in 2025 and maintain a Compound Annual Growth Rate (CAGR) of 9.4% from 2025 to 2033. This expansion is fueled by several key drivers. The increasing adoption of cloud-based solutions and the rising demand for real-time data analytics are significantly impacting the market. Businesses are increasingly migrating their on-premise SQL servers to cloud platforms like AWS, Azure, and Google Cloud, driven by scalability, cost efficiency, and enhanced accessibility. Furthermore, the growing need for faster data processing and improved database performance is pushing organizations to adopt advanced SQL server technologies, including in-memory databases and distributed SQL solutions. The market is segmented by deployment model (cloud, on-premise), database type (relational, NoSQL), and industry vertical (finance, healthcare, retail). Major players like Oracle, IBM, Microsoft, and Amazon Web Services are actively investing in research and development, launching new products and services to solidify their market positions. Competitive pressures are driving innovation and pushing the market towards more efficient, scalable, and secure solutions. The restraining factors impacting the market include the complexities associated with migrating existing SQL servers to new platforms, the high initial investment required for cloud-based solutions, and security concerns related to data breaches. However, the long-term benefits of improved efficiency, scalability, and cost optimization are outweighing these challenges, leading to sustained market growth. The ongoing trend of big data adoption and the demand for advanced analytics are creating new opportunities for vendors. We anticipate that the market will see increased adoption of serverless SQL databases and the development of more sophisticated tools for data integration and management in the coming years. This will likely reshape the competitive landscape and accelerate the transformation of the SQL server market.

Storage Class Memory Market Outlook

According to our latest research, the global Storage Class Memory (SCM) market size reached USD 4.3 billion in 2024, demonstrating robust momentum driven by the increasing demand for high-performance computing and next-generation data storage solutions. The market is forecasted to expand at a CAGR of 35.7% during the period of 2025 to 2033, reaching an estimated USD 58.9 billion by 2033. This remarkable growth trajectory is primarily attributed to the surging adoption of data-centric applications, proliferation of cloud services, and rapid advancements in memory technologies.

One of the major growth factors propelling the Storage Class Memory market is the exponential rise in data generation from various digital platforms, IoT devices, and enterprise applications. Organizations are increasingly seeking memory solutions that bridge the gap between traditional volatile memory like DRAM and non-volatile storage such as NAND flash. SCM technologies, including 3D XPoint, ReRAM, and advanced NAND, offer a unique combination of high speed, endurance, and persistence, making them ideal for applications demanding real-time analytics, in-memory databases, and AI-driven workloads. The growing necessity for faster data access and reduced latency in sectors such as finance, healthcare, and e-commerce is further accelerating SCM adoption.

Additionally, the expansion of cloud computing and edge data centers is fueling the demand for innovative memory architectures. Cloud service providers and hyperscalers are investing significantly in SCM to enhance their infrastructure’s performance and reliability. The ability of SCM to enable faster boot times, improved caching, and enhanced data integrity is positioning it as a critical component in modern storage hierarchies. Furthermore, the ongoing digital transformation across industries, coupled with the integration of AI and machine learning processes, is creating new opportunities for SCM deployment, particularly in hybrid and multi-cloud environments.

The proliferation of connected devices, autonomous vehicles, and smart factories is also contributing to the growth of the Storage Class Memory market. Automotive and industrial sectors are leveraging SCM to support mission-critical applications that require instant data retrieval and long-term retention. The increasing complexity of automotive electronics, including advanced driver-assistance systems (ADAS) and infotainment platforms, necessitates memory solutions that combine speed, durability, and non-volatility. Similarly, industrial automation and robotics are driving the need for real-time data processing, further boosting SCM uptake.

From a regional perspective, North America currently dominates the Storage Class Memory market, benefiting from the presence of leading technology companies, substantial R&D investments, and early adoption of advanced memory solutions. However, Asia Pacific is rapidly emerging as a key growth region, owing to the expansion of electronics manufacturing, increasing penetration of cloud computing, and rising investments in AI and IoT infrastructure. Europe, Latin America, and the Middle East & Africa are also witnessing steady adoption of SCM technologies, supported by digitalization initiatives and the growing need for high-performance storage in various sectors.

Type Analysis

The Storage Class Memory market is segmented by type into DRAM, NAND, ReRAM, 3D XPoint, and Others, each offering distinct advantages and catering to diverse application requirements. DRAM continues to be a foundational technology for volatile memory applications, offering high speed and low latency, but its limitations in terms of data persistence and scalability have led to the exploration of alternative SCM technologies. NAND flash, widely used in SSDs and consumer devices, provides non-volatility and cost-effectiveness, but struggles with endurance and write latency when compar

The Database as a Service (DaaS) platform market is experiencing robust growth, driven by the increasing adoption of cloud computing, the need for scalable and cost-effective database solutions, and the rising demand for real-time data processing. Let's assume, for illustrative purposes, a 2025 market size of $50 billion with a Compound Annual Growth Rate (CAGR) of 15% for the forecast period of 2025-2033. This implies significant expansion, reaching an estimated market value exceeding $150 billion by 2033. This growth is fueled by several key trends including the proliferation of big data analytics, the expanding adoption of serverless architectures, and the growing preference for managed services that reduce operational overhead for businesses. Major players like AWS, Microsoft Azure, Google Cloud Platform, and others are heavily investing in enhancing their DaaS offerings, fostering competition and innovation. However, challenges remain, including security concerns related to data stored in the cloud, vendor lock-in, and the complexity of migrating existing databases to a DaaS environment. The competitive landscape is intensely dynamic, with established tech giants alongside specialized DaaS providers vying for market share. The segmentation of the market is likely based on deployment model (public, private, hybrid), database type (SQL, NoSQL), and industry vertical. Future growth will be influenced by factors such as advancements in database technologies (e.g., graph databases, in-memory databases), increasing adoption of artificial intelligence and machine learning for database management, and the growing demand for data sovereignty and compliance solutions. The market's continued expansion is assured, but the precise trajectory will depend on the evolution of cloud technologies, regulatory changes, and the ability of providers to address security and scalability challenges effectively. This robust growth presents significant opportunities for both established and emerging players within the DaaS landscape.

The NEWSQL In-Memory Database market is rapidly evolving, providing businesses with the high-speed performance of in-memory processing combined with the strong consistency and reliability typical of traditional SQL databases. As organizations increasingly seek to harness real-time analytics and streamline operations

Managed Memgraph Services Market Outlook

According to our latest research, the global managed Memgraph services market size in 2024 stands at USD 412.8 million, reflecting robust interest in real-time graph database solutions across key industries. The market is expected to expand at a compound annual growth rate (CAGR) of 26.4% from 2025 to 2033. By the end of 2033, the managed Memgraph services market is forecasted to reach USD 3,470.2 million. This remarkable growth is driven by increasing adoption of advanced analytics, surge in data-driven decision-making, and the growing complexity of enterprise datasets that demand high-performance, scalable, and managed graph database solutions.

A primary growth factor for the managed Memgraph services market is the exponential rise in data generation and the need for sophisticated data modeling. As businesses across sectors like BFSI, healthcare, and telecommunications generate vast volumes of interconnected data, traditional relational databases often fall short in delivering real-time insights. Managed Memgraph services, built on in-memory graph databases, offer superior performance and scalability, enabling organizations to visualize, analyze, and act on complex data relationships instantly. The proliferation of IoT devices, social networks, and digital transformation initiatives further amplify the demand for graph-based analytics, as enterprises seek to harness actionable intelligence from intricate data webs.

Another significant driver is the escalating demand for real-time analytics and fraud detection capabilities. In industries such as finance and e-commerce, the ability to detect anomalies, predict fraudulent activities, and personalize customer experiences in real time is critical. Managed Memgraph services excel in these scenarios by providing low-latency data processing and seamless integration with existing IT infrastructures. The managed aspect relieves organizations from the burdens of database maintenance, security, and scalability, allowing them to focus on core business objectives. Additionally, advancements in artificial intelligence and machine learning are synergizing with graph databases, unlocking new possibilities in recommendation engines, network analysis, and predictive modeling.

Furthermore, the shift towards cloud-based deployment models is accelerating market expansion. Cloud-managed Memgraph services offer unparalleled flexibility, cost-effectiveness, and global accessibility, making them attractive to both large enterprises and SMEs. As organizations embrace hybrid and multi-cloud strategies, managed service providers are enhancing their offerings with robust security, compliance, and disaster recovery features. This evolution is fostering greater trust among businesses to offload their mission-critical graph database operations to specialized vendors, which, in turn, is fueling market growth. The increasing emphasis on data privacy and regulatory compliance is also prompting organizations to adopt managed services that ensure adherence to evolving legal frameworks.

From a regional perspective, North America leads the managed Memgraph services market, driven by technological maturity, high adoption rates of cloud solutions, and a strong presence of leading service providers. Europe follows closely, benefitting from stringent data regulations and a burgeoning ecosystem of digital enterprises. The Asia Pacific region is emerging as a high-growth market, propelled by rapid digitalization, expanding internet penetration, and government initiatives supporting smart infrastructure. Latin America and the Middle East & Africa are also witnessing gradual uptake, particularly in sectors like BFSI, telecommunications, and manufacturing, where real-time data analytics is becoming a competitive differentiator.

In the realm of graph databases, Managed ArangoDB Services are gaining traction as a versatile solution for handling complex data relationships. ArangoDB, known for its multi-model capabilities, allows organizations to manage document, key/value, and graph data within a single database system. This flexibility is particularly beneficial for enterprises looking to streamline their data architecture and reduce the overhead of managing multiple database systems. Managed ArangoDB Services provide the added advantage of expert support and maintenance, ensuring that organizatio

Managed Memgraph Services Market Outlook

According to our latest research, the global Managed Memgraph Services market size reached USD 512.4 million in 2024, reflecting robust demand for high-performance graph database management solutions. The market is expected to witness a strong compound annual growth rate (CAGR) of 18.6% from 2025 to 2033. By the end of 2033, the market is forecasted to reach USD 2,468.7 million, driven by the increasing adoption of real-time analytics, the proliferation of connected data, and the growing need for scalable and flexible database infrastructure across various industries. As per our latest research, these trends are shaping the competitive landscape and fueling the expansion of managed Memgraph services globally.

The primary growth factor propelling the managed Memgraph services market is the surge in demand for advanced graph database technologies that can efficiently handle complex and interconnected data. Organizations across sectors such as BFSI, healthcare, and telecommunications are realizing the limitations of traditional relational databases when it comes to real-time analytics, fraud detection, recommendation engines, and network analysis. Managed Memgraph services offer a high-performance, in-memory graph database solution that enables organizations to derive actionable insights from vast and dynamic datasets. The managed service model further alleviates the operational burden on IT teams, allowing enterprises to focus on core business objectives while leveraging the expertise of specialized service providers for database management, security, and scalability.

Another significant driver for the managed Memgraph services market is the widespread adoption of cloud computing and the need for scalable, flexible, and cost-effective data infrastructure. As businesses accelerate their digital transformation journeys, the demand for cloud-based managed services has surged, offering seamless integration, elastic scalability, and reduced total cost of ownership. Managed Memgraph services delivered via the cloud enable organizations to quickly deploy, manage, and scale their graph database environments without the need for extensive on-premises infrastructure or specialized personnel. Furthermore, the cloud deployment model supports global accessibility and collaboration, making it an attractive option for enterprises with distributed teams and multi-regional operations.

Technological advancements and the rise of AI-powered analytics are further fueling the growth of the managed Memgraph services market. With the increasing use of artificial intelligence and machine learning algorithms, organizations require database technologies that can support high-speed data ingestion, real-time querying, and complex relationship mapping. Managed Memgraph services are uniquely positioned to meet these requirements, offering advanced features such as parallel processing, efficient graph traversal, and seamless integration with data science tools. The growing ecosystem of partners, developers, and integrators around Memgraph is also accelerating innovation, driving the adoption of managed services across new industry verticals and use cases.

From a regional perspective, North America continues to dominate the managed Memgraph services market, accounting for the largest share in 2024, followed by Europe and Asia Pacific. The high concentration of technology-driven enterprises, early adoption of advanced database solutions, and strong presence of market leaders are key factors contributing to North America's leadership. Meanwhile, Asia Pacific is expected to register the highest CAGR during the forecast period, fueled by rapid digitalization, expanding IT infrastructure, and increasing investments in data analytics across emerging economies. Europe remains a significant market, particularly in sectors such as financial services, healthcare, and manufacturing, where regulatory compliance and data security are paramount.

Service Type Analysis

The managed Memgraph services market is segmented by service type into consulting, implementation, support & maintenance, and training. Consulting services play a vital role in helping organizations assess their data management needs, design optimal database architectures, and develop strategies for integrating Memgraph into existing IT ecosystems. With the complexity of modern data environments and the evolving nature of graph database techn

This is the first data release from the Public Utility Data Liberation (PUDL) project. It can be referenced & cited using https://doi.org/10.5281/zenodo.3653159

For more information about the free and open source software used to generate this data release, see Catalyst Cooperative's PUDL repository on Github, and the associated documentation on Read The Docs. This data release was generated using v0.3.1 of the catalystcoop.pudl python package.

Included Data Packages

This release consists of three tabular data packages, conforming to the standards published by Frictionless Data and the Open Knowledge Foundation. The data are stored in CSV files (some of which are compressed using gzip), and the associated metadata is stored as JSON. These tabular data can be used to populate a relational database.

• pudl-eia860-eia923:
  Data originally collected and published by the US Energy Information Administration (US EIA). The data from EIA Form 860 covers the years 2011-2018. The Form 923 data covers 2009-2018. A large majority of the data published in the original data sources has been included, but some parts, like fuel stocks on hand, and EIA 923 schedules 6, 7, & 8 have not yet been integrated.
• pudl-eia860-eia923-epacems:
  This data package contains all of the same data as the pudl-eia860-eia923 package above, as well as the Hourly Emissions data from the US Environmental Protection Agency's (EPA's) Continuous Emissions Monitoring System (CEMS) from 1995-2018. The EPA CEMS data covers thousands of power plants at hourly resolution for decades, and contains close to a billion records.
• pudl-ferc1:
  Seven data tables from FERC Form 1 are included, primarily relating to individual power plants, and covering the years 1994-2018 (the entire span of time for which FERC provides this data). These tables are the only ones which have been subjected to any cleaning or organization for programmatic use within PUDL. The complete, raw FERC Form 1 database contains 116 different tables with many thousands of columns of mostly financial data. We will archive a complete copy of the multi-year FERC Form 1 Database as a file-based SQLite database at Zenodo, independent of this data release. It can also be re-generated using the catalystcoop.pudl Python package and the original source data files archived as part of this data release.

Contact Us

If you're using PUDL, we would love to hear from you! Even if it's just a note to let us know that you exist, and how you're using the software or data. You can also:

• Subscribe to our announcements list for email updates.
• Use the Github issue tracker to file bugs, suggest improvements, or ask for help.
• Email the project team at pudl@catalyst.coop for private communications.
• Follow @CatalystCoop on Twitter.

Using the Data

The data packages are just CSVs (data) and JSON (metadata) files. They can be used with a variety of tools on many platforms. However, the data is organized primarily with the idea that it will be loaded into a relational database, and the PUDL Python package that was used to generate this data release can facilitate that process. Once the data is loaded into a database, you can access that DB however you like.

Make sure conda is installed

None of these commands will work without the conda Python package manager installed, either via Anaconda or miniconda:

• Install Anaconda
• Install miniconda

Download the data

First download the files from the Zenodo archive into a new empty directory. A couple of them are very large (5-10 GB), and depending on what you're trying to do you may not need them.

• If you don't want to recreate the data release from scratch by re-running the entire ETL process yourself, and you don't want to create a full clone of the original FERC Form 1 database, including all of the data that has not yet been integrated into PUDL, then you don't need to download pudl-input-data.tgz.
• If you don't need the EPA CEMS Hourly Emissions data, you do not need to download pudl-eia860-eia923-epacems.tgz.

Load All of PUDL in a Single Line

Use cd to get into your new directory at the terminal (in Linux or Mac OS), or open up an Anaconda terminal in that directory if you're on Windows.

If you have downloaded all of the files from the archive, and you want it all to be accessible locally, you can run a single shell script, called load-pudl.sh:

bash pudl-load.sh

This will do the following:

• Load the FERC Form 1, EIA Form 860, and EIA Form 923 data packages into an SQLite database which can be found at sqlite/pudl.sqlite.
• Convert the EPA CEMS data package into an Apache Parquet dataset which can be found at parquet/epacems.
• Clone all of the FERC Form 1 annual databases into a single SQLite database which can be found at sqlite/ferc1.sqlite.

Selectively Load PUDL Data

If you don't want to download and load all of the PUDL data, you can load each of the above datasets separately.

Create the PUDL conda Environment

This installs the PUDL software locally, and a couple of other useful packages:

conda create --yes --name pudl --channel conda-forge \
  --strict-channel-priority \
  python=3.7 catalystcoop.pudl=0.3.1 dask jupyter jupyterlab seaborn pip
conda activate pudl

Create a PUDL data management workspace

Use the PUDL setup script to create a new data management environment inside this directory. After you run this command you'll see some other directories show up, like parquet, sqlite, data etc.

pudl_setup ./

Extract and load the FERC Form 1 and EIA 860/923 data

If you just want the FERC Form 1 and EIA 860/923 data that has been integrated into PUDL, you only need to download pudl-ferc1.tgz and pudl-eia860-eia923.tgz. Then extract them in the same directory where you ran pudl_setup:

tar -xzf pudl-ferc1.tgz
tar -xzf pudl-eia860-eia923.tgz

To make use of the FERC Form 1 and EIA 860/923 data, you'll probably want to load them into a local database. The datapkg_to_sqlite script that comes with PUDL will do that for you:

datapkg_to_sqlite \
  datapkg/pudl-data-release/pudl-ferc1/datapackage.json \
  datapkg/pudl-data-release/pudl-eia860-eia923/datapackage.json \
  -o datapkg/pudl-data-release/pudl-merged/

Now you should be able to connect to the database (~300 MB) which is stored in sqlite/pudl.sqlite.

Extract EPA CEMS and convert to Apache Parquet

If you want to work with the EPA CEMS data, which is much larger, we recommend converting it to an Apache Parquet dataset with the included epacems_to_parquet script. Then you can read those files into dataframes directly. In Python you can use the pandas.DataFrame.read_parquet() method. If you need to work with more data than can fit in memory at one time, we recommend using Dask dataframes. Converting the entire dataset from datapackages into Apache Parquet may take an hour or more:

tar -xzf pudl-eia860-eia923-epacems.tgz
epacems_to_parquet datapkg/pudl-data-release/pudl-eia860-eia923-epacems/datapackage.json

You should find the Parquet dataset (~5 GB) under parquet/epacems, partitioned by year and state for easier querying.

Clone the raw FERC Form 1 Databases

If you want to access the entire set of original, raw FERC Form 1 data (of which only a small subset has been cleaned and integrated into PUDL) you can extract the original input data that's part of the Zenodo archive and run the ferc1_to_sqlite script using the same settings file that was used to generate the data release:

tar -xzf pudl-input-data.tgz
ferc1_to_sqlite data-release-settings.yml

You'll find the FERC Form 1 database (~820 MB) in sqlite/ferc1.sqlite.

Data Quality Control

We have performed basic sanity checks on much but not all of the data compiled in PUDL to ensure that we identify any major issues we might have introduced through our processing

Additional file 3. R codes for the statistical analyses are provided (The R Project for Statistical Computing; https://www.R-project.org/ ).

Snapshot img

Data Warehouse As A Service Market Size 2024-2028

The data warehouse as a service market size is forecast to increase by USD 12.32 billion at a CAGR of 24.49% between 2023 and 2028.

The market is experiencing significant growth due to several key trends. One major trend is the shift from traditional on-premises data warehouses to cloud-based DWaaS solutions. Advanced storage technologies, such as columnar databases, in-memory storage, and cloud storage, are also driving market growth. 
However, data privacy and security risks are challenges that need to be addressed, as organizations move their data to the cloud. DWaaS providers are responding by implementing data security and data encryption techniques to mitigate these risks. Overall, the DWaaS market is poised for continued growth as more businesses seek to leverage the benefits of cloud-based data warehousing solutions.

What will be the Size of the Data Warehouse As A Service Market During the Forecast Period?

Request Free Sample

The market represents a significant shift in how businesses manage their data environments. DWaaS offers flexibility and scalability, enabling organizations to focus on their core competencies while leveraging cloud computing for their data warehousing needs. This market is driven by the increasing demand for Business Intelligence (BI) that can handle large data volumes and provide advanced analytics capabilities. 
Technological developments in cloud computing, software, computing, and storage have made DWaaS a viable alternative to traditional on-premises data warehouses. However, the adoption of DWaaS is not without challenges. Security issues and integration complexities are key concerns for businesses considering a move to the cloud.
Restricted customization is another challenge, as some organizations require specific configurations for their data warehouses. Despite these challenges, the benefits of DWaaS, such as reduced IT infrastructure complexity and improved data accessibility, continue to drive market growth. The DWaaS market is expected to expand as more businesses seek to harness the power of their data for enterprise management, visualization, and data analytics.

How is this Data Warehouse As A Service Industry segmented and which is the largest segment?

The DWaaS industry research report provides comprehensive data (region-wise segment analysis), with forecasts and estimates in 'USD billion' for the period 2024-2028, as well as historical data from 2018-2022 for the following segments.

End-user

  BFSI
  Government
  Healthcare
  E-commerce and retail
  Others


Type

  Enterprise DWaaS
  Operational data storage


Geography

  North America

    US


  Europe

    Germany
    France


  APAC

    China
    Japan


  Middle East and Africa



  South America

By End-user Insights

The BFSI segment is estimated to witness significant growth during the forecast period.

The BFSI sector's reliance on managing and analyzing large financial data volumes has fueled the adoption of Data Warehouse as a Service (DWaaS) solutions. DWaaS offers flexibility and scalability, enabling BFSI companies to efficiently manage data from retail banking institutions, lending operations, credit underwriting procedures, and financial consulting firms. DWaaS solutions provide core competencies in cloud computing, business intelligence (BI), data analytics, enterprise management, visualization, and BI solutions. Technological developments, such as IoT technology and AI technology, further enhance DWaaS capabilities. However, challenges persist, including security issues, integration challenges, and restricted customization. Cloud solutions, including cloud data warehouses, offer a data environment that is software, computing, and storage-intensive.

DWaaS companies address concerns with service disruptions, latency, data integration, and data access. Security measures, such as data encryption and data masking, ensure data privacy. Despite these challenges, DWaaS adoption continues to grow, offering decision support services, data categorization, and data assessment to mid-size businesses and large enterprises.

Get a glance at the Data Warehouse As A Service Industry report of share of various segments Request Free Sample

The BFSI segment was valued at USD 665.10 million in 2018 and showed a gradual increase during the forecast period.

Regional Analysis

North America is estimated to contribute 35% to the growth of the global market during the forecast period.

Technavio’s analysts have elaborately explained the regional trends and drivers that shape the market during the forecast period.

For more insights on the market share of various regions, Request Free Sample

The North American market for Data Warehouse as a Service (DWaaS) is experiencing significant growth due to the region's early adoption of advanced techn

Managed Redis Services Market Outlook

According to our latest research, the global managed Redis services market size reached USD 1.05 billion in 2024, driven by the rising demand for high-performance, low-latency data management solutions across diverse industries. The market is projected to grow at a robust CAGR of 17.8% from 2025 to 2033, reaching a forecasted value of USD 5.63 billion by 2033. This rapid expansion is primarily fueled by the increasing adoption of real-time analytics, cloud-native application development, and the growing need for scalable, managed database solutions. As organizations continue to modernize their IT infrastructure and leverage cloud technologies, the managed Redis services market is poised for sustained growth and innovation over the coming decade.

One of the most significant growth factors in the managed Redis services market is the surging demand for real-time data processing and analytics. Modern enterprises are increasingly reliant on instant access to data for decision-making, customer engagement, and operational efficiency. Redis, known for its in-memory data storage and low-latency performance, has become a preferred choice for applications requiring real-time analytics, such as recommendation engines, fraud detection, and IoT platforms. Managed Redis services enable organizations to deploy and scale these capabilities without the complexity of manual infrastructure management, thereby accelerating time-to-market and reducing operational overhead. This trend is particularly pronounced in sectors such as e-commerce, financial services, and telecommunications, where milliseconds can translate into significant business value.

Another key driver propelling the managed Redis services market is the widespread shift toward cloud-based solutions and digital transformation initiatives. As businesses migrate their workloads to the cloud, the need for managed database services that offer scalability, high availability, and automated maintenance has become paramount. Managed Redis services, offered by major cloud providers and specialized vendors, address these requirements by delivering fully managed, enterprise-grade Redis clusters with robust security, monitoring, and backup features. This not only simplifies database administration for IT teams but also ensures optimal performance and reliability for mission-critical applications. The proliferation of cloud-native architectures, microservices, and containerization further amplifies the adoption of managed Redis services, as organizations seek to build agile, resilient, and future-proof digital ecosystems.

The increasing focus on cost optimization and resource efficiency is also contributing to the growth of the managed Redis services market. By outsourcing the management and maintenance of Redis databases to specialized service providers, organizations can significantly reduce their total cost of ownership (TCO) and free up internal resources for strategic initiatives. Managed Redis services eliminate the need for dedicated database administrators, reduce infrastructure costs, and minimize downtime through automated failover and scaling capabilities. This value proposition resonates strongly with small and medium enterprises (SMEs) that may lack the in-house expertise to manage complex database environments, as well as large enterprises seeking to streamline their IT operations and improve service levels. As a result, managed Redis services are increasingly viewed as a strategic enabler of digital transformation and business agility.

From a regional perspective, the managed Redis services market exhibits strong growth potential across all major geographies, with North America leading the charge due to its advanced cloud infrastructure, high adoption of digital technologies, and concentration of major cloud service providers. Europe and Asia Pacific are also witnessing rapid uptake, driven by the digitalization of businesses, expanding e-commerce sector, and increasing investments in cloud computing and data analytics. Emerging markets in Latin America and the Middle East & Africa are gradually catching up, supported by improving internet penetration, government initiatives, and the growing presence of global technology vendors. Overall, the global managed Redis services market is characterized by robust demand, technological innovation, and a dynamic competitive landscape that is shaping the future of real-time data management.

Number-of-Days-of-Payables Time Series for Shenzhen Tianyuan Dic Info Tech. Shenzhen Tianyuan DIC Information Technology Co., Ltd. provides products and solutions to the telecommunications, government, financial, and other industries. The company offers platform products, such as Diyicai-digital supply chain solutions; multi-cloud management (D-Cloud); distributed in-memory database products; location application; visual reporting tool; distributed data acquisition system (fisherman) products; cloud computing; unified rules management; capability open platform system software; AI platform; big data capability open; text mining; data asset management; real-time computing development; spatiotemporal big data; self-service modeling; self-service data application tools; mobile OA platform; internet purchasing; and mobile application. it also provides asynchronous cache; DCA-distributed cache; cloud-based billing products; security services; analysis of abnormal user behavior; application security gateway; data security gateway; integrated resource management; cloud-network fusion design and orchestration; wireless network optimization support platform; wireless network big data analysis platform; sales assistant; electronic channel operation; precision marketing; housekeepers; internet distribution system; marketing consultant; sales management; channel operation support; small-scale contracting; data gateway; and online operation platform. In addition, the company offers intelligent customer service; big data solutions; e-commerce smart shopping guide; data aggregation; and marketing baby group solutions. Further, it provides knowledge graph platform; smart building solutions; event detection center; new generation of intelligent operation CRM3.0; digital capability open platform; 5G converged billing; big data abnormal behavior analysis; data lifecycle security protection; radio and TV big data; and distributed internet data collection solutions. The company was founded in 1993 and is headquartered in Shenzhen, China.