Dataset Card for synthetic-data-generation-with-llama3-405B

This dataset has been created with distilabel.

  Dataset Summary

This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI: distilabel pipeline run --config "https://huggingface.co/datasets/lukmanaj/synthetic-data-generation-with-llama3-405B/raw/main/pipeline.yaml"

or explore the configuration: distilabel pipeline info… See the full description on the dataset page: https://huggingface.co/datasets/lukmanaj/synthetic-data-generation-with-llama3-405B.

Motivation

This dataset was created to pilot techniques for creating synthetic data from datasets containing sensitive and protected information in the local government context. Synthetic data generation replaces actual data with representative data generated from statistical models; this preserves the key data properties that allow insights to be drawn from the data while protecting the privacy of the people included in the data. We invite you to read the Understanding Synthetic Data white paper for a concise introduction to synthetic data.

This effort was a collaboration of the Urban Institute, Allegheny County’s Department of Human Services (DHS) and CountyStat, and the University of Pittsburgh’s Western Pennsylvania Regional Data Center.

Collection

The source data for this project consisted of 1) month-by-month records of services included in Allegheny County's data warehouse and 2) demographic data about the individuals who received the services. As the County’s data warehouse combines this service and client data, this data is referred to as “Integrated Services data”. Read more about the data warehouse and the kinds of services it includes here.

Preprocessing

Synthetic data are typically generated from probability distributions or models identified as being representative of the confidential data. For this dataset, a model of the Integrated Services data was used to generate multiple versions of the synthetic dataset. These different candidate datasets were evaluated to select for publication the dataset version that best balances utility and privacy. For high-level information about this evaluation, see the Synthetic Data User Guide.

For more information about the creation of the synthetic version of this data, see the technical brief for this project, which discusses the technical decision making and modeling process in more detail.

Recommended Uses

This disaggregated synthetic data allows for many analyses that are not possible with aggregate data (summary statistics). Broadly, this synthetic version of this data could be analyzed to better understand the usage of human services by people in Allegheny County, including the interplay in the usage of multiple services and demographic information about clients.

Known Limitations/Biases

Some amount of deviation from the original data is inherent to the synthetic data generation process. Specific examples of limitations (including undercounts and overcounts for the usage of different services) are given in the Synthetic Data User Guide and the technical report describing this dataset's creation.

Feedback

Please reach out to this dataset's data steward (listed below) to let us know how you are using this data and if you found it to be helpful. Please also provide any feedback on how to make this dataset more applicable to your work, any suggestions of future synthetic datasets, or any additional information that would make this more useful. Also, please copy wprdc@pitt.edu on any such feedback (as the WPRDC always loves to hear about how people use the data that they publish and how the data could be improved).

Further Documentation and Resources

1) A high-level overview of synthetic data generation as a method for protecting privacy can be found in the Understanding Synthetic Data white paper.
2) The Synthetic Data User Guide provides high-level information to help users understand the motivation, evaluation process, and limitations of the synthetic version of Allegheny County DHS's Human Services data published here.
3) Generating a Fully Synthetic Human Services Dataset: A Technical Report on Synthesis and Evaluation Methodologies describes the full technical methodology used for generating the synthetic data, evaluating the various options, and selecting the final candidate for publication.
4) The WPRDC also hosts the Allegheny County Human Services Community Profiles dataset, which provides annual updates on human-services usage, aggregated by neighborhood/municipality. That data can be explored using the County's Human Services Community Profile web site.

Dataset Description

Overview: This dataset contains three distinct fake datasets generated using the Faker and Mimesis libraries. These libraries are commonly used for generating realistic-looking synthetic data for testing, prototyping, and data science projects. The datasets were created to simulate real-world scenarios while ensuring no sensitive or private information is included.

Data Generation Process: The data creation process is documented in the accompanying notebook, Creating_simple_Sintetic_data.ipynb. This notebook showcases the step-by-step procedure for generating synthetic datasets with customizable structures and fields using the Faker and Mimesis libraries.

File Contents:

Datasets: CSV files containing the three synthetic datasets. Notebook: Creating_simple_Sintetic_data.ipynb detailing the data generation process and the code used to create these datasets.

BackgroundClinical data is instrumental to medical research, machine learning (ML) model development, and advancing surgical care, but access is often constrained by privacy regulations and missing data. Synthetic data offers a promising solution to preserve privacy while enabling broader data access. Recent advances in large language models (LLMs) provide an opportunity to generate synthetic data with reduced reliance on domain expertise, computational resources, and pre-training.ObjectiveThis study aims to assess the feasibility of generating realistic tabular clinical data with OpenAI’s GPT-4o using zero-shot prompting, and evaluate the fidelity of LLM-generated data by comparing its statistical properties to the Vital Signs DataBase (VitalDB), a real-world open-source perioperative dataset.MethodsIn Phase 1, GPT-4o was prompted to generate a dataset with qualitative descriptions of 13 clinical parameters. The resultant data was assessed for general errors, plausibility of outputs, and cross-verification of related parameters. In Phase 2, GPT-4o was prompted to generate a dataset using descriptive statistics of the VitalDB dataset. Fidelity was assessed using two-sample t-tests, two-sample proportion tests, and 95% confidence interval (CI) overlap.ResultsIn Phase 1, GPT-4o generated a complete and structured dataset comprising 6,166 case files. The dataset was plausible in range and correctly calculated body mass index for all case files based on respective heights and weights. Statistical comparison between the LLM-generated datasets and VitalDB revealed that Phase 2 data achieved significant fidelity. Phase 2 data demonstrated statistical similarity in 12/13 (92.31%) parameters, whereby no statistically significant differences were observed in 6/6 (100.0%) categorical/binary and 6/7 (85.71%) continuous parameters. Overlap of 95% CIs were observed in 6/7 (85.71%) continuous parameters.ConclusionZero-shot prompting with GPT-4o can generate realistic tabular synthetic datasets, which can replicate key statistical properties of real-world perioperative data. This study highlights the potential of LLMs as a novel and accessible modality for synthetic data generation, which may address critical barriers in clinical data access and eliminate the need for technical expertise, extensive computational resources, and pre-training. Further research is warranted to enhance fidelity and investigate the use of LLMs to amplify and augment datasets, preserve multivariate relationships, and train robust ML models.

Snapshot img

Synthetic Data Generation Market Size 2025-2029

The synthetic data generation market size is forecast to increase by USD 4.39 billion, at a CAGR of 61.1% between 2024 and 2029.

The market is experiencing significant growth, driven by the escalating demand for data privacy protection. With increasing concerns over data security and the potential risks associated with using real data, synthetic data is gaining traction as a viable alternative. Furthermore, the deployment of large language models is fueling market expansion, as these models can generate vast amounts of realistic and diverse data, reducing the reliance on real-world data sources. However, high costs associated with high-end generative models pose a challenge for market participants. These models require substantial computational resources and expertise to develop and implement effectively. Companies seeking to capitalize on market opportunities must navigate these challenges by investing in research and development to create more cost-effective solutions or partnering with specialists in the field. Overall, the market presents significant potential for innovation and growth, particularly in industries where data privacy is a priority and large language models can be effectively utilized.

What will be the Size of the Synthetic Data Generation Market during the forecast period?

Explore in-depth regional segment analysis with market size data - historical 2019-2023 and forecasts 2025-2029 - in the full report.
Request Free SampleThe market continues to evolve, driven by the increasing demand for data-driven insights across various sectors. Data processing is a crucial aspect of this market, with a focus on ensuring data integrity, privacy, and security. Data privacy-preserving techniques, such as data masking and anonymization, are essential in maintaining confidentiality while enabling data sharing. Real-time data processing and data simulation are key applications of synthetic data, enabling predictive modeling and data consistency. Data management and workflow automation are integral components of synthetic data platforms, with cloud computing and model deployment facilitating scalability and flexibility. Data governance frameworks and compliance regulations play a significant role in ensuring data quality and security. Deep learning models, variational autoencoders (VAEs), and neural networks are essential tools for model training and optimization, while API integration and batch data processing streamline the data pipeline. Machine learning models and data visualization provide valuable insights, while edge computing enables data processing at the source. Data augmentation and data transformation are essential techniques for enhancing the quality and quantity of synthetic data. Data warehousing and data analytics provide a centralized platform for managing and deriving insights from large datasets. Synthetic data generation continues to unfold, with ongoing research and development in areas such as federated learning, homomorphic encryption, statistical modeling, and software development. The market's dynamic nature reflects the evolving needs of businesses and the continuous advancements in data technology.

How is this Synthetic Data Generation Industry segmented?

The synthetic data generation industry research report provides comprehensive data (region-wise segment analysis), with forecasts and estimates in 'USD million' for the period 2025-2029, as well as historical data from 2019-2023 for the following segments. End-userHealthcare and life sciencesRetail and e-commerceTransportation and logisticsIT and telecommunicationBFSI and othersTypeAgent-based modellingDirect modellingApplicationAI and ML Model TrainingData privacySimulation and testingOthersProductTabular dataText dataImage and video dataOthersGeographyNorth AmericaUSCanadaMexicoEuropeFranceGermanyItalyUKAPACChinaIndiaJapanRest of World (ROW)

By End-user Insights

The healthcare and life sciences segment is estimated to witness significant growth during the forecast period.In the rapidly evolving data landscape, the market is gaining significant traction, particularly in the healthcare and life sciences sector. With a growing emphasis on data-driven decision-making and stringent data privacy regulations, synthetic data has emerged as a viable alternative to real data for various applications. This includes data processing, data preprocessing, data cleaning, data labeling, data augmentation, and predictive modeling, among others. Medical imaging data, such as MRI scans and X-rays, are essential for diagnosis and treatment planning. However, sharing real patient data for research purposes or training machine learning algorithms can pose significant privacy risks. Synthetic data generation addresses this challenge by producing realistic medical imaging data, ensuring data privacy while enabling research and development. Moreover

Synthetic Evaluation Data Generation Market Outlook

According to our latest research, the synthetic evaluation data generation market size reached USD 1.4 billion globally in 2024, reflecting robust growth driven by the increasing need for high-quality, privacy-compliant data in AI and machine learning applications. The market demonstrated a remarkable CAGR of 32.8% from 2025 to 2033. By the end of 2033, the synthetic evaluation data generation market is forecasted to attain a value of USD 17.7 billion. This surge is primarily attributed to the escalating adoption of AI-driven solutions across industries, stringent data privacy regulations, and the critical demand for diverse, scalable, and bias-free datasets for model training and validation.

One of the primary growth factors propelling the synthetic evaluation data generation market is the rapid acceleration of artificial intelligence and machine learning deployments across various sectors such as healthcare, finance, automotive, and retail. As organizations strive to enhance the accuracy and reliability of their AI models, the need for diverse and unbiased datasets has become paramount. However, accessing large volumes of real-world data is often hindered by privacy concerns, data scarcity, and regulatory constraints. Synthetic data generation bridges this gap by enabling the creation of realistic, scalable, and customizable datasets that mimic real-world scenarios without exposing sensitive information. This capability not only accelerates the development and validation of AI systems but also ensures compliance with data protection regulations such as GDPR and HIPAA, making it an indispensable tool for modern enterprises.

Another significant driver for the synthetic evaluation data generation market is the growing emphasis on data privacy and security. With increasing incidents of data breaches and the rising cost of non-compliance, organizations are actively seeking solutions that allow them to leverage data for training and testing AI models without compromising confidentiality. Synthetic data generation provides a viable alternative by producing datasets that retain the statistical properties and utility of original data while eliminating direct identifiers and sensitive attributes. This allows companies to innovate rapidly, collaborate more openly, and share data across borders without legal impediments. Furthermore, the use of synthetic data supports advanced use cases such as adversarial testing, rare event simulation, and stress testing, further expanding its applicability across verticals.

The synthetic evaluation data generation market is also experiencing growth due to advancements in generative AI technologies, including Generative Adversarial Networks (GANs) and large language models. These technologies have significantly improved the fidelity, diversity, and utility of synthetic datasets, making them nearly indistinguishable from real data in many applications. The ability to generate synthetic text, images, audio, video, and tabular data has opened new avenues for innovation in model training, testing, and validation. Additionally, the integration of synthetic data generation tools into cloud-based platforms and machine learning pipelines has simplified adoption for organizations of all sizes, further accelerating market growth.

From a regional perspective, North America continues to dominate the synthetic evaluation data generation market, accounting for the largest share in 2024. This is largely due to the presence of leading technology vendors, early adoption of AI technologies, and a strong focus on data privacy and regulatory compliance. Europe follows closely, driven by stringent data protection laws and increased investment in AI research and development. The Asia Pacific region is expected to witness the fastest growth during the forecast period, fueled by rapid digital transformation, expanding AI ecosystems, and increasing government initiatives to promote data-driven innovation. Latin America and the Middle East & Africa are also emerging as promising markets, albeit at a slower pace, as organizations in these regions begin to recognize the value of synthetic data for AI and analytics applications.

Synthetic Data Generation for Training LE AI Market Outlook

According to our latest research, the global market size for Synthetic Data Generation for Training LE AI was valued at USD 1.42 billion in 2024, with a robust compound annual growth rate (CAGR) of 33.8% projected through the forecast period. By 2033, the market is expected to reach an impressive USD 18.4 billion, reflecting the surging demand for scalable, privacy-compliant, and cost-effective data solutions. The primary growth factor underpinning this expansion is the increasing need for high-quality, diverse datasets to train large enterprise artificial intelligence (LE AI) models, especially as real-world data becomes more restricted due to privacy regulations and ethical considerations.

One of the most significant growth drivers for the Synthetic Data Generation for Training LE AI market is the escalating adoption of artificial intelligence across multiple sectors such as healthcare, finance, automotive, and retail. As organizations strive to build and deploy advanced AI models, the requirement for large, diverse, and unbiased datasets has intensified. However, acquiring and labeling real-world data is often expensive, time-consuming, and fraught with privacy risks. Synthetic data generation addresses these challenges by enabling the creation of realistic, customizable datasets without exposing sensitive information, thereby accelerating AI development cycles and improving model performance. This capability is particularly crucial for industries dealing with stringent data regulations, such as healthcare and finance, where synthetic data can be used to simulate rare events, balance class distributions, and ensure regulatory compliance.

Another pivotal factor propelling the growth of the Synthetic Data Generation for Training LE AI market is the technological advancements in generative models, including Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and other deep learning techniques. These innovations have significantly enhanced the fidelity, scalability, and versatility of synthetic data, making it nearly indistinguishable from real-world data in many applications. As a result, organizations can now generate high-resolution images, complex tabular datasets, and even nuanced audio and video samples tailored to specific use cases. Furthermore, the integration of synthetic data solutions with cloud-based platforms and AI development tools has democratized access to these technologies, allowing both large enterprises and small-to-medium businesses to leverage synthetic data for training, testing, and validation of LE AI models.

The increasing focus on data privacy and security is also fueling market growth. With regulations such as the General Data Protection Regulation (GDPR) in Europe and the California Consumer Privacy Act (CCPA) in the United States, organizations are under immense pressure to safeguard personal and sensitive information. Synthetic data offers a compelling solution by allowing businesses to generate artificial datasets that retain the statistical properties of real data without exposing any actual personal information. This not only mitigates the risk of data breaches and compliance violations but also enables seamless data sharing and collaboration across departments and organizations. As privacy concerns continue to mount, the adoption of synthetic data generation technologies is expected to accelerate, further driving the growth of the market.

From a regional perspective, North America currently dominates the Synthetic Data Generation for Training LE AI market, accounting for the largest share in 2024, followed by Europe and Asia Pacific. The presence of leading technology companies, robust R&D investments, and a mature AI ecosystem have positioned North America as a key innovation hub for synthetic data solutions. Meanwhile, Asia Pacific is anticipated to witness the highest CAGR during the forecast period, driven by rapid digital transformation, government initiatives supporting AI adoption, and a burgeoning startup landscape. Europe, with its strong emphasis on data privacy and security, is also emerging as a significant market, particularly in sectors such as healthcare, automotive, and finance.

Component Analysis

The Component segment of the Synthetic Data Generation for Training LE AI market is primarily divided into Software and

Synthetic Data for Khmer Word Detection

This dataset contains 10,000 synthetic images and corresponding bounding box labels for training object detection models to detect Khmer words.

The dataset is generated using a custom tool designed to create diverse and realistic training data for computer vision tasks, especially where real annotated data is scarce.

✨ Highlights

• 100,000 images (.png) with random backgrounds and styles.
• Bounding boxes provided in YOLO (.txt) and Pascal VOC (.xml) formats.
• 50+ real background images + unlimited random background colors.
• 250+ different Khmer fonts.
• Randomized effects: brightness, contrast, blur, color jitter, and more.
• Wide variety of text sizes, positions, and layouts.

📂 Folder Structure

/
├── synthetic_images/   # Synthetic images (.png)
├── synthetic_labels/   # YOLO format labels (.txt)
├── synthetic_xml_labels/ # Pascal VOC format labels (.xml)

Each image has corresponding .txt and .xml files with the same filename.

📏 Annotation Formats

• YOLO Format (.txt):
  Each line represents a word, with format: class_id center_x center_y width height All values are normalized between 0 and 1.
  Example: 0 0.235 0.051 0.144 0.081

• Pascal VOC Format (.xml):
  Standard XML structure containing image metadata and bounding box coordinates (absolute pixel values).
  Example: ```xml

🖼️ Image Samples

Each image contains random Khmer words placed naturally over backgrounds, with different font styles, sizes, and visual effects.
The dataset was carefully generated to simulate real-world challenges like:

• Different lighting conditions
• Different text sizes
• Motion blur and color variations

🧠 Use Cases

• Train YOLOv5, YOLOv8, EfficientDet, and other object detection models.
• Fine-tune OCR (Optical Character Recognition) systems for Khmer language.
• Research on low-resource language computer vision tasks.
• Data augmentation for scene text detection.

⚙️ How It Was Generated

1. A random real-world background or random color is chosen.
2. Random Khmer words are selected from a large cleaned text file.
3. Words are rendered with random font, size, color, spacing, and position.
4. Image effects like motion blur and color jitter are randomly applied.
5. Bounding boxes are automatically generated for each word.

🧹 Data Cleaning

• Words were sourced from a cleaned Khmer corpus to avoid duplicates and garbage data.
• Fonts were tested to make sure they render Khmer characters properly.

📢 Important Notes

• This dataset is synthetic. While it simulates real-world conditions, it may not fully replace real-world labeled data for final model evaluation.
• All labels assume one class only (i.e., "word" = class_id 0).

❤️ Credits

• Khmer text data collected from open-source projects such as khmer-text-data.
• Khmer fonts collected from free and open repositories like Khmer Fonts Project.

📈 Future Updates

We plan to release:

• Datasets with rotated bounding boxes for detecting skewed text.
• More realistic mixing of real-world backgrounds and synthetic text.
• Advanced distortions (e.g., handwriting-like simulation).

Stay tuned!

📜 License

This project is licensed under MIT license.

Please credit the original authors when using this data and provide a link to this dataset.

✉️ Contact

If you have any questions or want to collaborate, feel free to reach out:

• 📧 Email: veasnaec@gmail.com
• 🌐 GitHub: Chanveasna ENG

This study includes a synthetically-generated version of the Ministry of Justice Data First cross-justice system linking dataset. Synthetic versions of all 43 tables in the MoJ Data First data ecosystem have been created. These versions can be used / joined in the same way as the real datasets. As well as underpinning training, synthetic datasets should enable researchers to explore research questions and to design research proposals prior to submitting these for approval. The code created during this exploration and design process should then enable initial results to be obtained as soon as data access is granted.

The cross-justice system linking datasets allows users to join up information from data sources across the justice system (courts, prisons, probation) and should be used in conjunction with other datasets shared as part of the Data First Programme.

Records relating to individual justice system users can be linked using unique identifiers provided for people involved. This connects people involved in different parts of the criminal justice system or that have interacted with the civil or family courts. This allows for longitudinal analysis and investigation of repeat appearances and interactions with multiple justice services, which will increase understanding around users, their pathways and outcomes.

This dataset does not itself contain information about people or their interactions with the justice system, but acts as a lookup to identify where records in other datasets are believed to relate to the same person, using our probabilistic record linkage package, Splink.

The person link table contains rows with references to all records in the individual datasets that have been linked to date plus new identifiers, generated in the linking process, which enables these records to be grouped and linked across the datasets.

Datasets currently linkable using this dataset are:

• Ministry of Justice Data First magistrates’ court defendant - England and Wales
• Ministry of Justice Data First Crown Court defendant - England and Wales
• Ministry of Justice Data First prisoner custodial journey - England and Wales
• Ministry of Justice Data First probation- England and Wales
• Ministry of Justice Data First family court - England and Wales
• Ministry of Justice Data First civil court - England and Wales

It is expected that this table will be extended to include more datasets in future.

The case link table links cases between the criminal courts only (for example identifying cases that began in the magistrates' court and have been committed to the Crown Court for trial or sentence, or on appeal). This allows users to follow cases from start to finish and prevent double counting.

Objective: Biomechanical Machine Learning (ML) models, particularly deep-learning models, demonstrate the best performance when trained using extensive datasets. However, biomechanical data are frequently limited due to diverse challenges. Effective methods for augmenting data in developing ML models, specifically in the human posture domain, are scarce. Therefore, this study explored the feasibility of leveraging generative artificial intelligence (AI) to produce realistic synthetic posture data by utilizing three-dimensional posture data.Methods: Data were collected from 338 subjects through surface topography. A Variational Autoencoder (VAE) architecture was employed to generate and evaluate synthetic posture data, examining its distinguishability from real data by domain experts, ML classifiers, and Statistical Parametric Mapping (SPM). The benefits of incorporating augmented posture data into the learning process were exemplified by a deep autoencoder (AE) for automated feature representation.Results: Our findings highlight the challenge of differentiating synthetic data from real data for both experts and ML classifiers, underscoring the quality of synthetic data. This observation was also confirmed by SPM. By integrating synthetic data into AE training, the reconstruction error can be reduced compared to using only real data samples. Moreover, this study demonstrates the potential for reduced latent dimensions, while maintaining a reconstruction accuracy comparable to AEs trained exclusively on real data samples.Conclusion: This study emphasizes the prospects of harnessing generative AI to enhance ML tasks in the biomechanics domain.

Synthetic Data Generation for AI Market Outlook

According to our latest research, the Global Synthetic Data Generation for AI market size was valued at $1.2 billion in 2024 and is projected to reach $8.7 billion by 2033, expanding at a CAGR of 24.1% during 2024–2033. The primary driver for this remarkable growth is the escalating demand for high-quality, privacy-compliant datasets to fuel artificial intelligence and machine learning models across industries. As organizations face increasing regulatory scrutiny and data privacy concerns, synthetic data generation emerges as a pivotal solution, enabling robust AI development without compromising sensitive real-world information. This capability is particularly vital in sectors such as healthcare, finance, and automotive, where data privacy is paramount yet the need for diverse, representative datasets is critical for innovation and competitive advantage.

Regional Outlook

North America currently holds the largest share of the Synthetic Data Generation for AI market, accounting for approximately 38% of the global market value in 2024. This dominance is attributed to the region's mature technology ecosystem, significant investments by leading AI companies, and proactive regulatory frameworks that encourage innovation while safeguarding data privacy. The presence of global tech giants, robust venture capital activity, and a high concentration of AI talent further bolster North America’s leadership position. Moreover, U.S. federal initiatives and public-private partnerships have accelerated the adoption of synthetic data solutions in critical sectors such as BFSI, healthcare, and government services, driving sustained market expansion and fostering a vibrant innovation landscape.

The Asia Pacific region is projected to be the fastest-growing market for synthetic data generation, with a forecasted CAGR of 27.8% between 2024 and 2033. This rapid expansion is fueled by surging investments in AI infrastructure by emerging economies like China, India, South Korea, and Singapore. Government-led digital transformation programs, along with the proliferation of AI startups, are catalyzing demand for synthetic data solutions tailored to local languages, contexts, and regulatory requirements. Additionally, the region’s massive and diverse population presents unique data challenges, making synthetic data generation an attractive alternative to traditional data collection. Strategic collaborations between global technology providers and regional enterprises are further accelerating adoption, especially in the healthcare, automotive, and retail sectors.

In emerging economies across Latin America, the Middle East, and Africa, the adoption of synthetic data generation technologies is gaining momentum, albeit from a lower base. Market growth in these regions is shaped by a combination of localized demand for AI-driven solutions, evolving data protection regulations, and varying levels of digital infrastructure maturity. Challenges include limited awareness, skill gaps, and budget constraints, which can slow the pace of adoption. However, targeted government initiatives and international partnerships are helping to bridge these gaps, introducing synthetic data generation as a means to leapfrog traditional data acquisition hurdles. As these economies continue to digitize and modernize, the demand for cost-effective, scalable, and privacy-compliant data solutions is expected to rise significantly.

Report Scope

Abstract

The dataset is a relational dataset of 8,000 households households, representing a sample of the population of an imaginary middle-income country. The dataset contains two data files: one with variables at the household level, the other one with variables at the individual level. It includes variables that are typically collected in population censuses (demography, education, occupation, dwelling characteristics, fertility, mortality, and migration) and in household surveys (household expenditure, anthropometric data for children, assets ownership). The data only includes ordinary households (no community households). The dataset was created using REaLTabFormer, a model that leverages deep learning methods. The dataset was created for the purpose of training and simulation and is not intended to be representative of any specific country.

The full-population dataset (with about 10 million individuals) is also distributed as open data.

Geographic coverage

The dataset is a synthetic dataset for an imaginary country. It was created to represent the population of this country by province (equivalent to admin1) and by urban/rural areas of residence.

Analysis unit

Household, Individual

Universe

The dataset is a fully-synthetic dataset representative of the resident population of ordinary households for an imaginary middle-income country.

Kind of data

ssd

Sampling procedure

The sample size was set to 8,000 households. The fixed number of households to be selected from each enumeration area was set to 25. In a first stage, the number of enumeration areas to be selected in each stratum was calculated, proportional to the size of each stratum (stratification by geo_1 and urban/rural). Then 25 households were randomly selected within each enumeration area. The R script used to draw the sample is provided as an external resource.

Mode of data collection

other

Research instrument

The dataset is a synthetic dataset. Although the variables it contains are variables typically collected from sample surveys or population censuses, no questionnaire is available for this dataset. A "fake" questionnaire was however created for the sample dataset extracted from this dataset, to be used as training material.

Cleaning operations

The synthetic data generation process included a set of "validators" (consistency checks, based on which synthetic observation were assessed and rejected/replaced when needed). Also, some post-processing was applied to the data to result in the distributed data files.

Response rate

This is a synthetic dataset; the "response rate" is 100%.

This repository stores synthetic datasets derived from the database of the UK Biobank (UKB) cohort.

The datasets were generated for illustrative purposes, in particular for reproducing specific analyses on the health risks associated with long-term exposure to air pollution using the UKB cohort. The code used to create the synthetic datasets is available and documented in a related GitHub repo, with details provided in the section below. These datasets can be freely used for code testing and for illustrating other examples of analyses on the UKB cohort.

The synthetic data have been used so far in two analyses described in related peer-reviewed publications, which also provide information about the original data sources:

• Vanoli J, et al. Long-term associations between time-varying exposure to ambient PM2.5 and mortality: an analysis of the UK Biobank. Epidemiology. 2025;36(1):1-10. DOI: 10.1097/EDE.0000000000001796 [freely available here, with code provided in this GitHub repo]
• Vanoli J, et al. Confounding issues in air pollution epidemiology: an empirical assessment with the UK Biobank cohort. International Journal of Epidemiology. 2025;54(5):dyaf163. DOI: 10.1093/ije/dyaf163 [freely available here, with code provided in this GitHub repo]

Note: while the synthetic versions of the datasets resemble the real ones in several aspects, the users should be aware that these data are fake and must not be used for testing and making inferences on specific research hypotheses. Even more importantly, these data cannot be considered a reliable description of the original UKB data, and they must not be presented as such.

The work was supported by the Medical Research Council-UK (Grant ID: MR/Y003330/1).

Content

The series of synthetic datasets (stored in two versions with csv and RDS formats) are the following:

• synthbdcohortinfo: basic cohort information regarding the follow-up period and birth/death dates for 502,360 participants.
• synthbdbasevar: baseline variables, mostly collected at recruitment.
• synthpmdata: annual average exposure to PM_2.5 for each participant reconstructed using their residential history.
• synthoutdeath: death records that occurred during the follow-up with date and ICD-10 code.

In addition, this repository provides these additional files:

• codebook: a pdf file with a codebook for the variables of the various datasets, including references to the fields of the original UKB database.
• asscentre: a csv file with information on the assessment centres used for recruitment of the UKB participants, including code, names, and location (as northing/easting coordinates of the British National Grid).
• Countries_December_2022_GB_BUC: a zip file including the shapefile defining the boundaries of the countries in Great Britain (England, Wales, and Scotland), used for mapping purposes [source].

Generation of the synthetic data

The datasets resemble the real data used in the analysis, and they were generated using the R package synthpop (www.synthpop.org.uk). The generation process involves two steps, namely the synthesis of the main data (cohort info, baseline variables, annual PM_2.5 exposure) and then the sampling of death events. The R scripts for performing the data synthesis are provided in the GitHub repo (subfolder Rcode/synthcode).

The first part merges all the data, including the annual PM_2.5 levels, into a single wide-format dataset (with a row for each subject), generates a synthetic version, adds fake IDs, and then extracts (and reshapes) the single datasets. In the second part, a Cox proportional hazard model is fitted on the original data to estimate risks associated with various predictors (including the main exposure represented by PM_2.5), and then these relationships are used to simulate death events in each year. Details on the modelling aspects are provided in the article.

This process guarantees that the synthetic data do not hold specific information about the original records, thus preserving confidentiality. At the same time, the multivariate distribution and correlation across variables, as well as the mortality risks, resemble those of the original data, so the results of descriptive and inferential analyses are similar to those in the original assessments. However, as noted above, the data are used only for illustrative purposes, and they must not be used to test other research hypotheses.

Synthetic Data Generation Market Outlook

According to our latest research, the Global Synthetic Data Generation market size was valued at $1.2 billion in 2024 and is projected to reach $8.7 billion by 2033, expanding at a robust CAGR of 24.6% during the forecast period of 2025–2033. One of the major factors propelling the growth of the synthetic data generation market globally is the increasing reliance on artificial intelligence and machine learning models, which require vast, diverse, and unbiased datasets for training and validation. The demand for synthetic data is surging as organizations seek to overcome data privacy concerns, regulatory restrictions, and the scarcity of high-quality, labeled real-world data. As industries across BFSI, healthcare, automotive, and retail accelerate their digital transformation journeys, synthetic data generation is emerging as an essential enabler for innovation, compliance, and operational efficiency.

Regional Outlook

North America commands the largest share of the global synthetic data generation market, accounting for over 38% of the total market value in 2024. The region’s dominance is attributed to its mature technology ecosystem, widespread adoption of AI and machine learning across verticals, and a proactive regulatory landscape encouraging data privacy and innovation. The presence of leading synthetic data solution providers, robust venture capital activity, and a high concentration of tech-savvy enterprises have fueled market expansion. Additionally, stringent data protection laws such as CCPA and HIPAA have driven organizations to seek synthetic data solutions for compliance and risk mitigation, further consolidating North America’s leadership in this market.

The Asia Pacific region is emerging as the fastest-growing market, with a projected CAGR of 29.1% between 2025 and 2033. Rapid digitization, government-led AI initiatives, and the explosive growth of sectors such as e-commerce, fintech, and healthcare are major drivers in this region. Countries like China, India, Japan, and South Korea are making significant investments in AI infrastructure, and local enterprises are leveraging synthetic data to accelerate model development, enhance data privacy, and address data localization requirements. The region’s large, diverse population and the proliferation of connected devices generate vast amounts of data, increasing the need for synthetic data solutions to augment and anonymize real-world datasets for advanced analytics and AI applications.

In emerging economies across Latin America, the Middle East, and Africa, the adoption of synthetic data generation is gradually gaining traction, albeit at a slower pace compared to developed regions. Key challenges include limited awareness of synthetic data benefits, budget constraints, and a shortage of skilled professionals. However, localized demand is rising in sectors like banking, government, and telecommunications, where data privacy and regulatory compliance are becoming critical. Policy reforms aimed at digital transformation and increasing foreign investments in technology infrastructure are expected to drive future growth. Strategic collaborations between global vendors and regional players are also helping to bridge the adoption gap and tailor solutions to local market needs.

Report Scope

Synthetic Data Generation for Analytics Market Outlook

According to our latest research, the synthetic data generation for analytics market size reached USD 1.42 billion in 2024, reflecting robust momentum across industries seeking advanced data solutions. The market is poised for remarkable expansion, projected to achieve USD 12.21 billion by 2033 at a compelling CAGR of 27.1% during the forecast period. This exceptional growth is primarily fueled by the escalating demand for privacy-preserving data, the proliferation of AI and machine learning applications, and the increasing necessity for high-quality, diverse datasets for analytics and model training.

One of the primary growth drivers for the synthetic data generation for analytics market is the intensifying focus on data privacy and regulatory compliance. With the implementation of stringent data protection regulations such as GDPR, CCPA, and HIPAA, organizations are under immense pressure to safeguard sensitive information. Synthetic data, which mimics real data without exposing actual personal details, offers a viable solution for companies to continue leveraging analytics and AI without breaching privacy laws. This capability is particularly crucial in sectors like healthcare, finance, and government, where data sensitivity is paramount. As a result, enterprises are increasingly adopting synthetic data generation technologies to facilitate secure data sharing, innovation, and collaboration while mitigating regulatory risks.

Another significant factor propelling the growth of the synthetic data generation for analytics market is the rising adoption of machine learning and artificial intelligence across diverse industries. High-quality, labeled datasets are essential for training robust AI models, yet acquiring such data is often expensive, time-consuming, or even infeasible due to privacy concerns. Synthetic data bridges this gap by providing scalable, customizable, and bias-free datasets that can be tailored for specific use cases such as fraud detection, customer analytics, and predictive modeling. This not only accelerates AI development but also enhances model performance by enabling broader scenario coverage and data augmentation. Furthermore, synthetic data is increasingly used to test and validate algorithms in controlled environments, reducing the risk of real-world failures and improving overall system reliability.

The continuous advancements in data generation technologies, including generative adversarial networks (GANs), variational autoencoders (VAEs), and other deep learning methods, are further catalyzing market growth. These innovations enable the creation of highly realistic synthetic datasets that closely resemble actual data distributions across various formats, including tabular, text, image, and time series data. The integration of synthetic data solutions with cloud platforms and enterprise analytics tools is also streamlining adoption, making it easier for organizations to deploy and scale synthetic data initiatives. As businesses increasingly recognize the strategic value of synthetic data for analytics, competitive differentiation, and operational efficiency, the market is expected to witness sustained investment and innovation throughout the forecast period.

Regionally, North America commands the largest share of the synthetic data generation for analytics market, driven by early technology adoption, a mature analytics ecosystem, and a strong regulatory focus on data privacy. Europe follows closely, benefiting from strict data protection laws and a vibrant AI research community. The Asia Pacific region is emerging as a high-growth market, fueled by rapid digitalization, expanding AI investments, and increasing awareness of data privacy challenges. Meanwhile, Latin America and the Middle East & Africa are gradually catching up, with growing interest in advanced analytics and digital transformation initiatives. The global landscape is characterized by dynamic regional trends, with each market presenting unique opportunities and challenges for synthetic data adoption.

Component Analysis

The synthetic data generation for analytics market is segmented by component into software and services, each playing a pivotal role in enabling organizations to harness the power of synthetic data. The software segment dominates the market, accounting for the majority of rev

Synthetic Data Generation for AI Market Outlook

According to our latest research, the global synthetic data generation for AI market size reached USD 1.42 billion in 2024, demonstrating robust momentum driven by the accelerating adoption of artificial intelligence across multiple industries. The market is projected to expand at a CAGR of 35.6% from 2025 to 2033, with the market size expected to reach USD 20.19 billion by 2033. This extraordinary growth is primarily attributed to the rising demand for high-quality, diverse datasets for training AI models, as well as increasing concerns around data privacy and regulatory compliance.

One of the key growth factors propelling the synthetic data generation for AI market is the surging need for vast, unbiased, and representative datasets to train advanced machine learning models. Traditional data collection methods are often hampered by privacy concerns, data scarcity, and the risk of bias, making synthetic data an attractive alternative. By leveraging generative models such as GANs and VAEs, organizations can create realistic, customizable datasets that enhance model accuracy and performance. This not only accelerates AI development cycles but also enables businesses to experiment with rare or edge-case scenarios that would be difficult or costly to capture in real-world data. The ability to generate synthetic data on demand is particularly valuable in highly regulated sectors such as finance and healthcare, where access to sensitive information is restricted.

Another significant driver is the rapid evolution of AI technologies and the growing complexity of AI-powered applications. As organizations increasingly deploy AI in mission-critical operations, the need for robust testing, validation, and continuous model improvement becomes paramount. Synthetic data provides a scalable solution for augmenting training datasets, testing AI systems under diverse conditions, and ensuring resilience against adversarial attacks. Moreover, as regulatory frameworks like GDPR and CCPA impose stricter controls on personal data usage, synthetic data offers a viable path to compliance by enabling the development and validation of AI models without exposing real user information. This dual benefit of innovation and compliance is fueling widespread adoption across industries.

The market is also witnessing considerable traction due to the rise of edge computing and the proliferation of IoT devices, which generate enormous volumes of heterogeneous data. Synthetic data generation tools are increasingly being integrated into enterprise AI workflows to simulate device behavior, user interactions, and environmental variables. This capability is crucial for industries such as automotive (for autonomous vehicles), healthcare (for medical imaging), and retail (for customer analytics), where the diversity and scale of data required far exceed what can be realistically collected. As a result, synthetic data is becoming an indispensable enabler of next-generation AI solutions, driving innovation and operational efficiency.

From a regional perspective, North America continues to dominate the synthetic data generation for AI market, accounting for the largest revenue share in 2024. This leadership is underpinned by the presence of major AI technology vendors, substantial R&D investments, and a favorable regulatory environment. Europe is also emerging as a significant market, driven by stringent data protection laws and strong government support for AI innovation. Meanwhile, the Asia Pacific region is expected to witness the fastest growth rate, propelled by rapid digital transformation, burgeoning AI startups, and increasing adoption of cloud-based solutions. Latin America and the Middle East & Africa are gradually catching up, supported by government initiatives and the expansion of digital infrastructure. The interplay of these regional dynamics is shaping the global synthetic data generation landscape, with each market presenting unique opportunities and challenges.

Component Analysis

The synthetic data gen

AI in Synthetic Data Market Outlook

According to our latest research, the AI in Synthetic Data market size reached USD 1.32 billion in 2024, reflecting an exceptional surge in demand across various industries. The market is poised to expand at a CAGR of 36.7% from 2025 to 2033, with the forecasted market size expected to reach USD 21.38 billion by 2033. This remarkable growth trajectory is driven by the increasing necessity for privacy-preserving data solutions, the proliferation of AI and machine learning applications, and the rapid digital transformation across sectors. As per our latest research, the market’s robust expansion is underpinned by the urgent need to generate high-quality, diverse, and scalable datasets without compromising sensitive information, positioning synthetic data as a cornerstone for next-generation AI development.

One of the primary growth factors for the AI in Synthetic Data market is the escalating demand for data privacy and compliance with stringent regulations such as GDPR, HIPAA, and CCPA. Enterprises are increasingly leveraging synthetic data to circumvent the challenges associated with using real-world data, particularly in industries like healthcare, finance, and government, where data sensitivity is paramount. The ability of synthetic data to mimic real-world datasets while ensuring anonymity enables organizations to innovate rapidly without breaching privacy laws. Furthermore, the adoption of synthetic data significantly reduces the risk of data breaches, which is a critical concern in today’s data-driven economy. As a result, organizations are not only accelerating their AI and machine learning initiatives but are also achieving compliance and operational efficiency.

Another significant driver is the exponential growth in AI and machine learning adoption across diverse sectors. These technologies require vast volumes of high-quality data for training, validation, and testing purposes. However, acquiring and labeling real-world data is often expensive, time-consuming, and fraught with privacy concerns. Synthetic data addresses these challenges by enabling the generation of large, labeled datasets that are tailored to specific use cases, such as image recognition, natural language processing, and fraud detection. This capability is particularly transformative for sectors like automotive, where synthetic data is used to train autonomous vehicle algorithms, and healthcare, where it supports the development of diagnostic and predictive models without exposing patient information.

Technological advancements in generative AI models, such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), have further propelled the market. These innovations have significantly improved the realism, diversity, and utility of synthetic data, making it nearly indistinguishable from real-world data in many applications. The synergy between synthetic data generation and advanced AI models is enabling new possibilities in areas like computer vision, speech synthesis, and anomaly detection. As organizations continue to invest in AI-driven solutions, the demand for synthetic data is expected to surge, fueling further market expansion and innovation.

From a regional perspective, North America currently leads the AI in Synthetic Data market due to its early adoption of AI technologies, strong presence of leading technology companies, and supportive regulatory frameworks. Europe follows closely, driven by its rigorous data privacy regulations and a burgeoning ecosystem of AI startups. The Asia Pacific region is emerging as a lucrative market, propelled by rapid digitalization, government initiatives, and increasing investments in AI research and development. Latin America and the Middle East & Africa are also witnessing steady growth, albeit at a slower pace, as organizations in these regions begin to recognize the value of synthetic data for digital transformation and innovation.

Component Analysis

The AI in Synthetic Data market is segmented by component into Software and Services, each playing a pivotal role in the industry’s growth. Software solutions dominate the market, accounting for the largest share in 2024, as organizations increasingly adopt advanced platforms for data generation, management, and integration. These software platforms leverage state-of-the-art generative AI models that enable users to create highly realistic and customizab

📌 Context Parkinson’s Disease (PD) is a progressive neurological disorder affecting movement, motor control, and speech. Due to privacy and data scarcity challenges, synthetic datasets offer an ideal alternative for developing, testing, and benchmarking machine learning models. This dataset simulates realistic patient records to help researchers and data scientists analyze patterns and build predictive models for Parkinson’s Disease detection.

📦 Dataset Features This dataset contains 23,000 records and 15 attributes related to medical, neurological, and behavioral indicators of Parkinson’s Disease.

Column Name Description Age Age of the patient (40–85 years) Sex Biological sex (Male, Female) Tremor_Intensity Measured intensity of tremor (0.0–10.0 scale) Voice_Pitch Vocal pitch frequency in Hz (100–300 Hz) Voice_Jitter Variation in vocal frequency (0.1–5.0) Voice_Shimmer Variation in vocal amplitude (0.1–5.0) Bradykinesia_Score Score measuring slowness of movement (0.0–10.0) Postural_Instability Degree of postural/balance issues (0.0–10.0) Rigidity_Level Muscle stiffness score (0.0–10.0) UPDRS_Score Unified Parkinson’s Disease Rating Scale (0–100) Handwriting_Change Score based on observed handwriting alterations (0.0–10.0) Walking_Difficulty Gait and walking difficulty score (0.0–10.0) Family_History Family history of Parkinson’s (Yes, No) MRI_Score Simulated brain scan score reflecting abnormalities (0.0–100.0) Parkinsons_Status Disease presence: 0 = No Parkinson’s, 1 = Diagnosed with Parkinson’s

🎯 Use Cases Exploratory Data Analysis (EDA)

Feature engineering and selection

Binary classification tasks

Supervised machine learning (Logistic Regression, Random Forest, XGBoost, etc.)

Deep learning model experimentation

Healthcare dashboard prototypes

Educational purposes (students and instructors)

🔐 Note This dataset is synthetically generated using probabilistic distributions and does not represent real patient data. It is designed purely for academic, research, and prototyping purposes.

Data Description

We release the synthetic data generated using the method described in the paper Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models (ACL 2024 Findings). The external knowledge we use is based on LLM-generated topics and writing styles.

  Generated Datasets

The original train/validation/test data, and the generated synthetic training data are listed as follows. For each dataset, we generate 5000… See the full description on the dataset page: https://huggingface.co/datasets/ritaranx/clinical-synthetic-text-llm.

📘 Dataset Overview

This dataset was created as part of the Uplimit course "Synthetic Data Generation for Fine-Tuning." It represents a cleaned and filtered subset of a real instruction-tuning dataset, intended for experimentation with supervised fine-tuning (SFT). The goal was to produce a high-quality synthetic dataset by curating and filtering real-world instruction-response data using semantic deduplication and automated quality scoring.

  🔄 Data Preparation Steps… See the full description on the dataset page: https://huggingface.co/datasets/mimartin1234/uplimit-synthetic-data-week-1-filtered.