The global big data market is forecasted to grow to 103 billion U.S. dollars by 2027, more than double its expected market size in 2018. With a share of 45 percent, the software segment would become the large big data market segment by 2027.

What is Big data?

Big data is a term that refers to the kind of data sets that are too large or too complex for traditional data processing applications. It is defined as having one or some of the following characteristics: high volume, high velocity or high variety. Fast-growing mobile data traffic, cloud computing traffic, as well as the rapid development of technologies such as artificial intelligence (AI) and the Internet of Things (IoT) all contribute to the increasing volume and complexity of data sets.

Big data analytics

Advanced analytics tools, such as predictive analytics and data mining, help to extract value from the data and generate new business insights. The global big data and business analytics market was valued at 169 billion U.S. dollars in 2018 and is expected to grow to 274 billion U.S. dollars in 2022. As of November 2018, 45 percent of professionals in the market research industry reportedly used big data analytics as a research method.

Snapshot img

Big Data Market Size 2024-2028

The big data market size is forecast to increase by USD 508.73 billion at a CAGR of 21.46% between 2023 and 2028.

The market is experiencing significant growth due to the growth in data generation from various sources, including IoT platforms and digital transformation services. This data deluge presents opportunities for businesses to leverage advanced analytics tools for applications such as fraud detection and prevention, workforce analytics, and business intelligence. However, the increasing adoption of big data implementation also brings challenges, including the need for data security and privacy measures. Quantum computing and blockchain technology are emerging trends In the big data landscape, offering potential solutions to complex data processing and security issues. In healthcare analytics, data protection regulations are driving the need for secure data management and sharing.
Additionally, supply chain optimization is another area where big data can bring significant value, enabling real-time monitoring and predictive analytics. Overall, the market is poised for continued growth, driven by the need to extract valuable insights from the vast amounts of data being generated.

What will be the Size of the Big Data Market During the Forecast Period?

Request Free Sample

The market is experiencing growth as businesses increasingly leverage information from vast datasets to drive strategic decision-making, enhance customer experiences, and improve operational efficiency. The digital revolution has led to an exponential increase in data creation, fueling demand for advanced analytics capabilities, real-time processing, and data protection and privacy solutions. Hardware and software companies offer on-premise and cloud-based systems to accommodate various industry needs, including customer analytics in retail and e-commerce, supply chain analytics in manufacturing, marketing analytics, pricing analytics, spatial analytics, workforce analytics, risk and credit analytics, transportation analytics, healthcare, energy and utilities, and IT and telecom. Big data applications span numerous sectors, enabling organizations to gain valuable insights from their data to optimize operations, mitigate risks, and innovate new products and services.

How is this Big Data Industry segmented and which is the largest segment?

The big data industry research report provides comprehensive data (region-wise segment analysis), with forecasts and estimates in 'USD billion' for the period 2024-2028, as well as historical data from 2018-2022 for the following segments.

Deployment

  On-premises
  Cloud-based
  Hybrid


Type

  Services
  Software


Geography

  North America

    Canada
    US


  Europe

    Germany
    UK


  APAC

    China


  South America



  Middle East and Africa

By Deployment Insights

The on-premises segment is estimated to witness significant growth during the forecast period. On-premises big data software solutions involve the installation of hardware and software by the end-user, granting them complete control over the system. Despite the high upfront costs, on-premises solutions offer advantages such as full ownership and operational efficiency. In contrast, cloud-based solutions require recurring monthly payments and involve data storage on companies' servers, increasing security concerns. Advanced analytics, real-time processing, and integrated analytics are key features driving the market. Data creation from digital transformation, customer experiences, and various industries like retail, healthcare, and finance, fuel the demand for scalable infrastructure and user-friendly interfaces. Technologies such as quantum computing, blockchain, AI-driven analytics platforms, and automation are transforming business intelligence solutions.

Ensuring data protection and privacy, accessibility, and seamless data transactions are crucial in this data-driven era. Key technologies include distributed computing, visualization tools, and social media. Target audiences range from decision-makers to various industries, including transportation, energy, and consumer engagement.

Get a glance at the market report of share of various segments Request Free Sample

The On-premises segment was valued at USD 86.53 billion in 2018 and showed a gradual increase during the forecast period.

Regional Analysis

North America is estimated to contribute 47% to the growth of the global market during the forecast period. Technavio's analysts have elaborately explained the regional trends and drivers that shape the market during the forecast period.

For more insights on the market size of various regions, Request Free Sample

The market in North America is experiencing significant growth due to digital transformation initiatives by enterprises in sectors such as healthcare, retail

According to the source's data, the market value of big data analytics in Italy increased steadily over the period considered, growing from 790 million euros in 2015 to approximately 1.8 billion euros in 2020.

The Hadoop Big Data Analytics Market is segmented Solution (Data Discovery and Visualization (DDV), Advanced Analytics (AA)) End-User Industry (BFSI, Retail, IT and Telecom, Healthcare and Life Sciences, Manufacturing, Media and Entertainment), and Geography (North America (United States, Canada), Europe (United Kingdom, Germany), Asia Pacific (China, Japan), Latin America, Middle East, and Africa).The market sizes and forecasts are provided in terms of value (USD billion) for all the above segments.

The global big data and business analytics (BDA) market was valued at 168.8 billion U.S. dollars in 2018 and is forecast to grow to 215.7 billion U.S. dollars by 2021. In 2021, more than half of BDA spending will go towards services. IT services is projected to make up around 85 billion U.S. dollars, and business services will account for the remainder. Big data High volume, high velocity and high variety: one or more of these characteristics is used to define big data, the kind of data sets that are too large or too complex for traditional data processing applications. Fast-growing mobile data traffic, cloud computing traffic, as well as the rapid development of technologies such as artificial intelligence (AI) and the Internet of Things (IoT) all contribute to the increasing volume and complexity of data sets. For example, connected IoT devices are projected to generate 79.4 ZBs of data in 2025. Business analytics Advanced analytics tools, such as predictive analytics and data mining, help to extract value from the data and generate business insights. The size of the business intelligence and analytics software application market is forecast to reach around 16.5 billion U.S. dollars in 2022. Growth in this market is driven by a focus on digital transformation, a demand for data visualization dashboards, and an increased adoption of cloud.

The USDA Agricultural Research Service (ARS) recently established SCINet , which consists of a shared high performance computing resource, Ceres, and the dedicated high-speed Internet2 network used to access Ceres. Current and potential SCINet users are using and generating very large datasets so SCINet needs to be provisioned with adequate data storage for their active computing. It is not designed to hold data beyond active research phases. At the same time, the National Agricultural Library has been developing the Ag Data Commons, a research data catalog and repository designed for public data release and professional data curation. Ag Data Commons needs to anticipate the size and nature of data it will be tasked with handling. The ARS Web-enabled Databases Working Group, organized under the SCINet initiative, conducted a study to establish baseline data storage needs and practices, and to make projections that could inform future infrastructure design, purchases, and policies. The SCINet Web-enabled Databases Working Group helped develop the survey which is the basis for an internal report. While the report was for internal use, the survey and resulting data may be generally useful and are being released publicly. From October 24 to November 8, 2016 we administered a 17-question survey (Appendix A) by emailing a Survey Monkey link to all ARS Research Leaders, intending to cover data storage needs of all 1,675 SY (Category 1 and Category 4) scientists. We designed the survey to accommodate either individual researcher responses or group responses. Research Leaders could decide, based on their unit's practices or their management preferences, whether to delegate response to a data management expert in their unit, to all members of their unit, or to themselves collate responses from their unit before reporting in the survey.
Larger storage ranges cover vastly different amounts of data so the implications here could be significant depending on whether the true amount is at the lower or higher end of the range. Therefore, we requested more detail from "Big Data users," those 47 respondents who indicated they had more than 10 to 100 TB or over 100 TB total current data (Q5). All other respondents are called "Small Data users." Because not all of these follow-up requests were successful, we used actual follow-up responses to estimate likely responses for those who did not respond. We defined active data as data that would be used within the next six months. All other data would be considered inactive, or archival. To calculate per person storage needs we used the high end of the reported range divided by 1 for an individual response, or by G, the number of individuals in a group response. For Big Data users we used the actual reported values or estimated likely values.

Resources in this dataset:Resource Title: Appendix A: ARS data storage survey questions. File Name: Appendix A.pdfResource Description: The full list of questions asked with the possible responses. The survey was not administered using this PDF but the PDF was generated directly from the administered survey using the Print option under Design Survey. Asterisked questions were required. A list of Research Units and their associated codes was provided in a drop down not shown here. Resource Software Recommended: Adobe Acrobat,url: https://get.adobe.com/reader/ Resource Title: CSV of Responses from ARS Researcher Data Storage Survey. File Name: Machine-readable survey response data.csvResource Description: CSV file includes raw responses from the administered survey, as downloaded unfiltered from Survey Monkey, including incomplete responses. Also includes additional classification and calculations to support analysis. Individual email addresses and IP addresses have been removed. This information is that same data as in the Excel spreadsheet (also provided).Resource Title: Responses from ARS Researcher Data Storage Survey. File Name: Data Storage Survey Data for public release.xlsxResource Description: MS Excel worksheet that Includes raw responses from the administered survey, as downloaded unfiltered from Survey Monkey, including incomplete responses. Also includes additional classification and calculations to support analysis. Individual email addresses and IP addresses have been removed.Resource Software Recommended: Microsoft Excel,url: https://products.office.com/en-us/excel

The statistic shows the value of the German big data market from 2015 to 2020. In 2016, Germany's big data market is predicted to reach approximately 1.8 billion euros in size.

Please cite the following paper when using this dataset:N. Thakur, "Twitter Big Data as a Resource for Exoskeleton Research: A Large-Scale Dataset of about 140,000 Tweets from 2017–2022 and 100 Research Questions", Journal of Analytics, Volume 1, Issue 2, 2022, pp. 72-97, DOI: https://doi.org/10.3390/analytics1020007AbstractThe exoskeleton technology has been rapidly advancing in the recent past due to its multitude of applications and diverse use cases in assisted living, military, healthcare, firefighting, and industry 4.0. The exoskeleton market is projected to increase by multiple times its current value within the next two years. Therefore, it is crucial to study the degree and trends of user interest, views, opinions, perspectives, attitudes, acceptance, feedback, engagement, buying behavior, and satisfaction, towards exoskeletons, for which the availability of Big Data of conversations about exoskeletons is necessary. The Internet of Everything style of today’s living, characterized by people spending more time on the internet than ever before, with a specific focus on social media platforms, holds the potential for the development of such a dataset by the mining of relevant social media conversations. Twitter, one such social media platform, is highly popular amongst all age groups, where the topics found in the conversation paradigms include emerging technologies such as exoskeletons. To address this research challenge, this work makes two scientific contributions to this field. First, it presents an open-access dataset of about 140,000 Tweets about exoskeletons that were posted in a 5-year period from 21 May 2017 to 21 May 2022. Second, based on a comprehensive review of the recent works in the fields of Big Data, Natural Language Processing, Information Retrieval, Data Mining, Pattern Recognition, and Artificial Intelligence that may be applied to relevant Twitter data for advancing research, innovation, and discovery in the field of exoskeleton research, a total of 100 Research Questions are presented for researchers to study, analyze, evaluate, ideate, and investigate based on this dataset.

The Big Data Analytics in Banking Market is Segmented by Type of Solutions (Data Discovery and Visualization (DDV) and Advanced Analytics (AA)), and Geography (North America, Europe, Asia-Pacific, Latin America, Middle East and Africa). The Market Sizes and Forecasts are Provided in Terms of Value (USD Million) for all the Above Segments.

Snapshot img

Big Data as a Service Market Size 2024-2028

The big data as a service market size is forecast to increase by USD 41.20 billion at a CAGR of 28.45% between 2023 and 2028.

The market is experiencing significant growth due to the increasing volume of data and the rising demand for advanced data insights. Machine learning algorithms and artificial intelligence are driving product quality and innovation in this sector. Hybrid cloud solutions are gaining popularity, offering the benefits of both private and public cloud platforms for optimal data storage and scalability. Industry standards for data privacy and security are increasingly important, as large amounts of data pose unique risks. The BDaaS market is expected to continue its expansion, providing valuable data insights to businesses across various industries.

What will be the Big Data as a Service Market Size During the Forecast Period?

Request Free Sample

Big Data as a Service (BDaaS) has emerged as a game-changer in the business world, enabling organizations to harness the power of big data without the need for extensive infrastructure and expertise. This service model offers various components such as data management, analytics, and visualization tools, enabling businesses to derive valuable insights from their data. BDaaS encompasses several key components that drive market growth. These include Business Intelligence (BI), Data Science, Data Quality, and Data Security. BI provides organizations with the ability to analyze data and gain insights to make informed decisions.



Data Science, on the other hand, focuses on extracting meaningful patterns and trends from large datasets using advanced algorithms. Data Quality is a critical component of BDaaS, ensuring that the data being analyzed is accurate, complete, and consistent. Data Security is another essential aspect, safeguarding sensitive data from cybersecurity threats and data breaches. Moreover, BDaaS offers various data pipelines, enabling seamless data integration and data lifecycle management. Network Analysis, Real-time Analytics, and Predictive Analytics are other essential components, providing businesses with actionable insights in real-time and enabling them to anticipate future trends. Data Mining, Machine Learning Algorithms, and Data Visualization Tools are other essential components of BDaaS.

How is this market segmented and which is the largest segment?

The market research report provides comprehensive data (region-wise segment analysis), with forecasts and estimates in 'USD billion' for the period 2024-2028, as well as historical data from 2018-2022 for the following segments.

Type

  Data analytics-as-a-Service
  Hadoop-as-a-service
  Data-as-a-service


Deployment

  Public cloud
  Hybrid cloud
  Private cloud


Geography

  North America

    Canada
    US


  APAC

    China


  Europe

    Germany
    UK


  South America



  Middle East and Africa

By Type Insights

The data analytics-as-a-service segment is estimated to witness significant growth during the forecast period.

Big Data as a Service (BDaaS) is a significant market segment, highlighted by the availability of Hadoop-as-a-Service solutions. These offerings enable businesses to access essential datasets on-demand without the burden of expensive infrastructure. DAaaS solutions facilitate real-time data analysis, empowering organizations to make informed decisions. The DAaaS landscape is expanding rapidly as companies acknowledge its value in enhancing internal data. Integrating DAaaS with big data systems amplifies analytics capabilities, creating a vibrant market landscape. Organizations can leverage diverse datasets to gain a competitive edge, driving the growth of the global BDaaS market. In the context of digital transformation, cloud computing, IoT, and 5G technologies, BDaaS solutions offer optimal resource utilization.

However, regulatory scrutiny poses challenges, necessitating stringent data security measures. Retail and other industries stand to benefit significantly from BDaaS, particularly with distributed computing solutions. DAaaS adoption is a strategic investment for businesses seeking to capitalize on the power of external data for valuable insights.

Get a glance at the market report of share of various segments Request Free Sample

The Data analytics-as-a-Service segment was valued at USD 2.59 billion in 2018 and showed a gradual increase during the forecast period.

Regional Analysis

North America is estimated to contribute 35% to the growth of the global market during the forecast period.

Technavio's analysts have elaborately explained the regional trends and drivers that shape the market during the forecast period.

For more insights on the market share of various regions Request Free Sample

Big Data as a Service Market analysis, North America is experiencing signif

In terms of value, the global storage in big data market is expected to expand at a CAGR of 20.4% over the forecast period (2016 – 2026) and is expected to be valued at US$ 61.44 Bn by 2026 end.

The Data Analytics in Retail Industry is segmented by Application (Merchandising and Supply Chain Analytics, Social Media Analytics, Customer Analytics, Operational Intelligence, Other Applications), by Business Type (Small and Medium Enterprises, Large-scale Organizations), and Geography. The market size and forecasts are provided in terms of value (USD billion) for all the above segments.

The Report Covers Global Big Data Services Market Size & Industry Share and It is Segmented by Deployment Type (On-Premise and Cloud), End-User (Telecom and IT, Energy and Power, BFSI, Healthcare, Retail, and Other End-Users), and Geography (North America, Europe, Asia Pacific, Latin America, and Middle East and Africa). The Market Size and Forecasts are Provided in Terms of Value (USD) for all the Above Segments.

According to Cognitive Market Research, the global SME Big Data market size is USD xx million in 2024. It will expand at a compound annual growth rate (CAGR) of 4.60% from 2024 to 2031. North America held the major market share for more than 40% of the global revenue with a market size of USD xx million in 2024 and will grow at a compound annual growth rate (CAGR) of 2.8% from 2024 to 2031. Europe accounted for a market share of over 30% of the global revenue with a market size of USD xx million. Asia Pacific held a market share of around 23% of the global revenue with a market size of USD xx million in 2024 and will grow at a compound annual growth rate (CAGR) of 6.6% from 2024 to 2031. Latin America had a market share for more than 5% of the global revenue with a market size of USD xx million in 2024 and will grow at a compound annual growth rate (CAGR) of 4.0% from 2024 to 2031. Middle East and Africa had a market share of around 2% of the global revenue and was estimated at a market size of USD xx million in 2024 and will grow at a compound annual growth rate (CAGR) of 4.3% from 2024 to 2031. The Software held the highest SME Big Data market revenue share in 2024. Market Dynamics of SME Big Data Market Key Drivers for SME Big Data Market Growing Recognition of Data-Driven Decision Making The growing recognition of data-driven decision making is a key driver in the SME Big Data market as businesses increasingly understand the value of leveraging data for strategic decisions. This shift enables SMEs to optimize operations, enhance customer experiences, and gain competitive advantages. Access to affordable big data technologies and analytics tools has democratized data usage, making it feasible for smaller enterprises to adopt these solutions. SMEs can now analyze market trends, customer behaviors, and operational inefficiencies, leading to more informed and agile business strategies. This recognition propels demand for big data solutions, as SMEs seek to harness data insights to improve outcomes, innovate, and stay competitive in a rapidly evolving business landscape. Growing Number of Affordable Big Data Solutions The growing number of affordable big data solutions is driving the SME Big Data market by lowering the entry barrier for smaller enterprises to adopt advanced analytics. Cost-effective technologies, particularly cloud-based services, allow SMEs to access powerful data analytics tools without substantial upfront investments in infrastructure. This affordability enables SMEs to harness big data to gain insights into customer behavior, streamline operations, and enhance decision-making processes. As a result, more SMEs are integrating big data into their business models, leading to improved efficiency, innovation, and competitiveness. The availability of scalable and flexible solutions tailored to SME needs further accelerates adoption, making big data analytics an accessible and valuable resource for small and medium-sized businesses aiming for growth and success. Restraint Factor for the SME Big Data Market High Initial Investment Cost to Limit the Sales High initial costs are a significant restraint on the SME Big Data market, as they can deter smaller businesses from adopting big data technologies. Implementing big data solutions often requires substantial investment in hardware, software, and skilled personnel, which can be prohibitively expensive for SMEs with limited budgets. These costs include purchasing or subscribing to analytics platforms, upgrading IT infrastructure, and hiring data scientists or analysts. The financial burden associated with these initial expenses can make SMEs hesitant to commit to big data projects, despite the potential long-term benefits. Consequently, high initial costs limit the accessibility of big data analytics for SMEs, slowing the market's overall growth and the widespread adoption of these transformative technologies among smaller enterprises. Impact of Covid-19 on the SME Big Data Market The COVID-19 pandemic significantly impacted the SME Big Data market, accelerating digital transformation as businesses sought to adapt to rapidly changing conditions. With disruptions in traditional operations and a shift towards remote work, SMEs increasingly turned to big data analytics to maintain efficiency, manage supply chains, and understand evolving customer behaviors. The pandemic underscored the importance of real-time data insights for agile decision-making, dr...

This document, Innovating the Data Ecosystem: An Update of The Federal Big Data Research and Development Strategic Plan, updates the 2016 Federal Big Data Research and Development Strategic Plan. This plan updates the vision and strategies on the research and development needs for big data laid out in the 2016 Strategic Plan through the six strategies areas (enhance the reusability and integrity of data; enable innovative, user-driven data science; develop and enhance the robustness of the federated ecosystem; prioritize privacy, ethics, and security; develop necessary expertise and diverse talent; and enhance U.S. leadership in the international context) to enhance data value and reusability and responsiveness to federal policies on data sharing and management.

The Report Covers Global Big Data Analytics in Healthcare Market Trends and is Segmented by Component (Software and Services), Deployment (On-Premise and Cloud-Based), Application (Financial Analytics, Clinical Data Analytics, Operational Analytics, and Population Health Analytics), and Geography (North America, Europe, Asia-Pacific, Middle East, and Africa, and South America). The Value is Provided (in USD Million) for the Above-Mentioned Segments.

The advanced analytics market size is projected to be worth US$ 15,149.8 million in 2024. The market is likely to reach US$ 26,688.0 million by 2034. The market is further expected to surge at a CAGR of 5.8% during the forecast period 2024 to 2034.

Attributes	Key Insights
Advanced Analytics Market Estimated Size in 2024	US$ 15,149.8 million
Projected Market Value in 2034	US$ 26,688.0 million
Value-based CAGR from 2024 to 2034	5.8%

2019 to 2023 Historical Analysis vs. 2024 to 2034 Market Forecast Projections

Report Attributes	Details
Market Value in 2019	US$ 11,954.1 million
Market Value in 2023	US$ 14,355.5 million
CAGR from 2019 to 2023	5.5%

Country-wise Insights

The United States	2.3%
The United Kingdom	3.2%
India	7.6%
China	6.7%
Japan	8.8%

Category-wise Insights

Category	Shares in 2024
Big Data Analytics	23.3%
BFSI	22.6%

Report Scope

Attribute	Details
Estimated Market Size in 2024	US$ 15,149.8 million
Projected Market Valuation in 2034	US$ 26,688.0 million
Value-based CAGR 2024 to 2034	5.8%
Forecast Period	2024 to 2034
Historical Data Available for	2019 to 2023
Market Analysis	Value in US$ million
Key Regions Covered	North America Latin America Western Europe Eastern Europe South Asia and Pacific East Asia The Middle East & Africa
Key Market Segments Covered	Solution Industry Region
Key Countries Profiled	The United States Canada Brazil Mexico Germany France France Spain Italy Russia Poland Czech Republic Romania India Bangladesh Australia New Zealand China Japan South Korea GCC countries South Africa Israel
Key Companies Profiled	Altair Engineering, Inc. Fair Isaac Corporation International Business Machines Corporation KNIME Microsoft Corporation Oracle Corporation RapidMiner, Inc. SAP SE SAS Institute Inc. Trianz Infor Teradata

The global big data in healthcare market size is estimated to grow from USD 78 billion in 2024 to USD 540 billion by 2035, representing a CAGR of 19.20% during the forecast period till 2035.

Introduction: With the increasing fluctuations in the current domestic and international economic situation and the rapid iteration of macroeconomic regulation and control demands, the inadequacy of the existing economic data statistical system in terms of agility has been exposed. It has become a primary task to closely track and accurately predict the domestic and international economic situation using effective tools and measures to compensate for the inadequate economic early warning system and promote stable and orderly industrial production.Methods: Against this background, this paper takes industrial added value as the forecasting object, uses electricity consumption to predict industrial added value, selects factors influencing industrial added value based on grounded theory, and constructs a big data forecasting model using a combination of “expert interviews + big data technology” for economic forecasting.Results: The forecasting accuracy on four provincial companies has reached over 90%.Discussion: The final forecast results can be submitted to government departments to provide suggestions for guiding macroeconomic development.

This is the updated version of the dataset from 10.5281/zenodo.6320761 Information The diverse publicly available compound/bioactivity databases constitute a key resource for data-driven applications in chemogenomics and drug design. Analysis of their coverage of compound entries and biological targets revealed considerable differences, however, suggesting benefit of a consensus dataset. Therefore, we have combined and curated information from five esteemed databases (ChEMBL, PubChem, BindingDB, IUPHAR/BPS and Probes&Drugs) to assemble a consensus compound/bioactivity dataset comprising 1144648 compounds with 10915362 bioactivities on 5613 targets (including defined macromolecular targets as well as cell-lines and phenotypic readouts). It also provides simplified information on assay types underlying the bioactivity data and on bioactivity confidence by comparing data from different sources. We have unified the source databases, brought them into a common format and combined them, enabling an ease for generic uses in multiple applications such as chemogenomics and data-driven drug design. The consensus dataset provides increased target coverage and contains a higher number of molecules compared to the source databases which is also evident from a larger number of scaffolds. These features render the consensus dataset a valuable tool for machine learning and other data-driven applications in (de novo) drug design and bioactivity prediction. The increased chemical and bioactivity coverage of the consensus dataset may improve robustness of such models compared to the single source databases. In addition, semi-automated structure and bioactivity annotation checks with flags for divergent data from different sources may help data selection and further accurate curation. This dataset belongs to the publication: https://doi.org/10.3390/molecules27082513 Structure and content of the dataset Dataset structure ChEMBL ID PubChem ID IUPHAR ID Target Activity type Assay type Unit Mean C (0) ... Mean PC (0) ... Mean B (0) ... Mean I (0) ... Mean PD (0) ... Activity check annotation Ligand names Canonical SMILES C ... Structure check (Tanimoto) Source The dataset was created using the Konstanz Information Miner (KNIME) (https://www.knime.com/) and was exported as a CSV-file and a compressed CSV-file. Except for the canonical SMILES columns, all columns are filled with the datatype ‘string’. The datatype for the canonical SMILES columns is the smiles-format. We recommend the File Reader node for using the dataset in KNIME. With the help of this node the data types of the columns can be adjusted exactly. In addition, only this node can read the compressed format. Column content: ChEMBL ID, PubChem ID, IUPHAR ID: chemical identifier of the databases Target: biological target of the molecule expressed as the HGNC gene symbol Activity type: for example, pIC50 Assay type: Simplification/Classification of the assay into cell-free, cellular, functional and unspecified Unit: unit of bioactivity measurement Mean columns of the databases: mean of bioactivity values or activity comments denoted with the frequency of their occurrence in the database, e.g. Mean C = 7.5 *(15) -> the value for this compound-target pair occurs 15 times in ChEMBL database Activity check annotation: a bioactivity check was performed by comparing values from the different sources and adding an activity check annotation to provide automated activity validation for additional confidence no comment: bioactivity values are within one log unit; check activity data: bioactivity values are not within one log unit; only one data point: only one value was available, no comparison and no range calculated; no activity value: no precise numeric activity value was available; no log-value could be calculated: no negative decadic logarithm could be calculated, e.g., because the reported unit was not a compound concentration Ligand names: all unique names contained in the five source databases are listed Canonical SMILES columns: Molecular structure of the compound from each database Structure check (Tanimoto): To denote matching or differing compound structures in different source databases match: molecule structures are the same between different sources; no match: the structures differ. We calculated the Jaccard-Tanimoto similarity coefficient from Morgan Fingerprints to reveal true differences between sources and reported the minimum value; 1 structure: no structure comparison is possible, because there was only one structure available; no structure: no structure comparison is possible, because there was no structure available. Source: From which databases the data come from