Dataset Card for test-data-generator

This dataset has been created with distilabel.

  Dataset Summary

This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI: distilabel pipeline run --config "https://huggingface.co/datasets/franciscoflorencio/test-data-generator/raw/main/pipeline.yaml"

or explore the configuration: distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/franciscoflorencio/test-data-generator.

Creating a robust employee dataset for data analysis and visualization involves several key fields that capture different aspects of an employee's information. Here's a list of fields you might consider including: Employee ID: A unique identifier for each employee. Name: First name and last name of the employee. Gender: Male, female, non-binary, etc. Date of Birth: Birthdate of the employee. Email Address: Contact email of the employee. Phone Number: Contact number of the employee. Address: Home or work address of the employee. Department: The department the employee belongs to (e.g., HR, Marketing, Engineering, etc.). Job Title: The specific job title of the employee. Manager ID: ID of the employee's manager. Hire Date: Date when the employee was hired. Salary: Employee's salary or compensation. Employment Status: Full-time, part-time, contractor, etc. Employee Type: Regular, temporary, contract, etc. Education Level: Highest level of education attained by the employee. Certifications: Any relevant certifications the employee holds. Skills: Specific skills or expertise possessed by the employee. Performance Ratings: Ratings or evaluations of employee performance. Work Experience: Previous work experience of the employee. Benefits Enrollment: Information on benefits chosen by the employee (e.g., healthcare plan, retirement plan, etc.). Work Location: Physical location where the employee works. Work Hours: Regular working hours or shifts of the employee. Employee Status: Active, on leave, terminated, etc. Emergency Contact: Contact information of the employee's emergency contact person. Employee Satisfaction Survey Responses: Data from employee satisfaction surveys, if applicable.

Code Url: https://github.com/intellisenseCodez/faker-data-generator

Dataset used in the article entitled 'Synthetic Datasets Generator for Testing Information Visualization and Machine Learning Techniques and Tools'. These datasets can be used to test several characteristics in machine learning and data processing algorithms.

Sandbox Data Generator Market Outlook

According to our latest research, the global Sandbox Data Generator market size reached USD 1.41 billion in 2024 and is projected to grow at a robust CAGR of 11.2% from 2025 to 2033. By the end of the forecast period, the market is expected to attain a value of USD 3.71 billion by 2033. This remarkable growth is primarily driven by the increasing demand for secure, reliable, and scalable test data generation solutions across industries such as BFSI, healthcare, and IT and telecommunications, as organizations strive to enhance their data privacy and compliance capabilities in an era of heightened regulatory scrutiny and digital transformation.

A major growth factor propelling the Sandbox Data Generator market is the intensifying focus on data privacy and regulatory compliance across global enterprises. With stringent regulations such as GDPR, CCPA, and HIPAA becoming the norm, organizations are under immense pressure to ensure that non-production environments do not expose sensitive information. Sandbox data generators, which enable the creation of realistic yet anonymized or masked data sets for testing and development, are increasingly being adopted to address these compliance challenges. Furthermore, the rise of DevOps and agile methodologies has led to a surge in demand for efficient test data management, as businesses seek to accelerate software development cycles without compromising on data security. The integration of advanced data masking, subsetting, and anonymization features within sandbox data generation platforms is therefore a critical enabler for organizations aiming to achieve both rapid innovation and regulatory adherence.

Another significant driver for the Sandbox Data Generator market is the exponential growth of digital transformation initiatives across various industry verticals. As enterprises migrate to cloud-based infrastructures and adopt advanced technologies such as AI, machine learning, and big data analytics, the need for high-quality, production-like test data has never been more acute. Sandbox data generators play a pivotal role in supporting these digital initiatives by supplying synthetic yet realistic datasets that facilitate robust testing, model training, and system validation. This, in turn, helps organizations minimize the risks associated with deploying new applications or features, while reducing the time and costs associated with traditional data provisioning methods. The rise of microservices architecture and API-driven development further amplifies the necessity for dynamic, scalable, and automated test data generation solutions.

Additionally, the proliferation of data breaches and cyber threats has underscored the importance of robust data protection strategies, further fueling the adoption of sandbox data generators. Enterprises are increasingly recognizing that using real production data in test environments can expose them to significant security vulnerabilities and compliance risks. By leveraging sandbox data generators, organizations can create safe, de-identified datasets that maintain the statistical properties of real data, enabling comprehensive testing without jeopardizing sensitive information. This trend is particularly pronounced in sectors such as BFSI and healthcare, where data sensitivity and compliance requirements are paramount. As a result, vendors are investing heavily in enhancing the security, scalability, and automation capabilities of their sandbox data generation solutions to cater to the evolving needs of these high-stakes industries.

From a regional perspective, North America is anticipated to maintain its dominance in the global Sandbox Data Generator market, driven by the presence of leading technology providers, a mature regulatory landscape, and high digital adoption rates among enterprises. However, the Asia Pacific region is poised for the fastest growth, fueled by rapid digitalization, increasing investments in IT infrastructure, and growing awareness of data privacy and compliance issues. Europe also represents a significant market, supported by stringent data protection regulations and a strong focus on innovation across key industries. As organizations worldwide continue to prioritize data security and agile development, the demand for advanced sandbox data generation solutions is expected to witness sustained growth across all major regions.

Component Analysis

The Sandbox Data Genera

This data set contains the result of applying the NIST Statistical Test Suite on accelerometer data processed for random number generator seeding. The NIST Statistical Test Suite can be downloaded from: http://csrc.nist.gov/groups/ST/toolkit/rng/documentation_software.html. The format of the output is explained in http://csrc.nist.gov/publications/nistpubs/800-22-rev1a/SP800-22rev1a.pdf.

Synthetic Data Generation Market size was valued at USD 0.4 Billion in 2024 and is projected to reach USD 9.3 Billion by 2032, growing at a CAGR of 46.5 % from 2026 to 2032.The Synthetic Data Generation Market is driven by the rising demand for AI and machine learning, where high-quality, privacy-compliant data is crucial for model training. Businesses seek synthetic data to overcome real-data limitations, ensuring security, diversity, and scalability without regulatory concerns. Industries like healthcare, finance, and autonomous vehicles increasingly adopt synthetic data to enhance AI accuracy while complying with stringent privacy laws.Additionally, cost efficiency and faster data availability fuel market growth, reducing dependency on expensive, time-consuming real-world data collection. Advancements in generative AI, deep learning, and simulation technologies further accelerate adoption, enabling realistic synthetic datasets for robust AI model development.

The Space-based Imaging Spectroscopy and Thermal pathfindER (SISTER) activity originated in support of the NASA Earth System Observatory's Surface Biology and Geology (SBG) mission to develop prototype workflows with community algorithms and generate prototype data products envisioned for SBG. SISTER focused on developing a data system that is open, portable, scalable, standards-compliant, and reproducible. This collection contains EXPERIMENTAL workflows and sample data products, including (a) the Common Workflow Language (CWL) process file and a Jupyter Notebook that run the entire SISTER workflow capable of generating experimental sample data products spanning terrestrial ecosystems, inland and coastal aquatic ecosystems, and snow, (b) the archived algorithm steps (as OGC Application Packages) used to generate products at each step of the workflow, (c) a small number of experimental sample data products produced by the workflow which are based on the Airborne Visible/Infrared Imaging Spectrometer-Classic (AVIRIS or AVIRIS-CL) instrument, and (d) instructions for reproducing the sample products included in this dataset. DISCLAIMER: This collection contains experimental workflows, experimental community algorithms, and experimental sample data products to demonstrate the capabilities of an end-to-end processing system. The experimental sample data products provided have not been fully validated and are not intended for scientific use. The community algorithms provided are placeholders which can be replaced by any user's algorithms for their own science and application interests. These algorithms should not in any capacity be considered the algorithms that will be implemented in the upcoming Surface Biology and Geology mission.

Synthetic Test Data Generation Market Outlook

According to our latest research, the global synthetic test data generation market size reached USD 1.85 billion in 2024 and is projected to grow at a robust CAGR of 31.2% during the forecast period, reaching approximately USD 21.65 billion by 2033. The marketÂ’s remarkable growth is primarily driven by the increasing demand for high-quality, privacy-compliant data to support software testing, AI model training, and data privacy initiatives across multiple industries. As organizations strive to meet stringent regulatory requirements and accelerate digital transformation, the adoption of synthetic test data generation solutions is surging at an unprecedented rate.

A key growth factor for the synthetic test data generation market is the rising awareness and enforcement of data privacy regulations such as GDPR, CCPA, and HIPAA. These regulations have compelled organizations to rethink their data management strategies, particularly when it comes to using real data in testing and development environments. Synthetic data offers a powerful alternative, allowing companies to generate realistic, risk-free datasets that mirror production data without exposing sensitive information. This capability is particularly vital for sectors like BFSI and healthcare, where data breaches can have severe financial and reputational repercussions. As a result, businesses are increasingly investing in synthetic test data generation tools to ensure compliance, reduce liability, and enhance data security.

Another significant driver is the explosive growth in artificial intelligence and machine learning applications. AI and ML models require vast amounts of diverse, high-quality data for effective training and validation. However, obtaining such data can be challenging due to privacy concerns, data scarcity, or labeling costs. Synthetic test data generation addresses these challenges by producing customizable, labeled datasets that can be tailored to specific use cases. This not only accelerates model development but also improves model robustness and accuracy by enabling the creation of edge cases and rare scenarios that may not be present in real-world data. The synergy between synthetic data and AI innovation is expected to further fuel market expansion throughout the forecast period.

The increasing complexity of software systems and the shift towards DevOps and continuous integration/continuous deployment (CI/CD) practices are also propelling the adoption of synthetic test data generation. Modern software development requires rapid, iterative testing across a multitude of environments and scenarios. Relying on masked or anonymized production data is often insufficient, as it may not capture the full spectrum of conditions needed for comprehensive testing. Synthetic data generation platforms empower development teams to create targeted datasets on demand, supporting rigorous functional, performance, and security testing. This leads to faster release cycles, reduced costs, and higher software quality, making synthetic test data generation an indispensable tool for digital enterprises.

In the realm of synthetic test data generation, Synthetic Tabular Data Generation Software plays a crucial role. This software specializes in creating structured datasets that resemble real-world data tables, making it indispensable for industries that rely heavily on tabular data, such as finance, healthcare, and retail. By generating synthetic tabular data, organizations can perform extensive testing and analysis without compromising sensitive information. This capability is particularly beneficial for financial institutions that need to simulate transaction data or healthcare providers looking to test patient management systems. As the demand for privacy-compliant data solutions grows, the importance of synthetic tabular data generation software is expected to increase, driving further innovation and adoption in the market.

From a regional perspective, North America currently leads the synthetic test data generation market, accounting for the largest share in 2024, followed closely by Europe and Asia Pacific. The dominance of North America can be attributed to the presence of major technology providers, early adoption of advanced testing methodologies, and a strong regulatory focus on data privacy. EuropeÂ’s stringent privacy regulations an

The Test Data Generation Tools market is poised for significant expansion, projected to reach an estimated USD 1.5 billion in 2025 and exhibit a robust Compound Annual Growth Rate (CAGR) of approximately 15% through 2033. This growth is primarily fueled by the escalating complexity of software applications, the increasing demand for agile development methodologies, and the critical need for comprehensive and realistic test data to ensure application quality and performance. Enterprises across all sizes, from large corporations to Small and Medium-sized Enterprises (SMEs), are recognizing the indispensable role of effective test data management in mitigating risks, accelerating time-to-market, and enhancing user experience. The drive for cost optimization and regulatory compliance further propels the adoption of advanced test data generation solutions, as manual data creation is often time-consuming, error-prone, and unsustainable in today's fast-paced development cycles. The market is witnessing a paradigm shift towards intelligent and automated data generation, moving beyond basic random or pathwise techniques to more sophisticated goal-oriented and AI-driven approaches that can generate highly relevant and production-like data. The market landscape is characterized by a dynamic interplay of established technology giants and specialized players, all vying for market share by offering innovative features and tailored solutions. Prominent companies like IBM, Informatica, Microsoft, and Broadcom are leveraging their extensive portfolios and cloud infrastructure to provide integrated data management and testing solutions. Simultaneously, specialized vendors such as DATPROF, Delphix Corporation, and Solix Technologies are carving out niches by focusing on advanced synthetic data generation, data masking, and data subsetting capabilities. The evolution of cloud-native architectures and microservices has created a new set of challenges and opportunities, with a growing emphasis on generating diverse and high-volume test data for distributed systems. Asia Pacific, particularly China and India, is emerging as a significant growth region due to the burgeoning IT sector and increasing investments in digital transformation initiatives. North America and Europe continue to be mature markets, driven by strong R&D investments and a high level of digital adoption. The market's trajectory indicates a sustained upward trend, driven by the continuous pursuit of software excellence and the critical need for robust testing strategies. This report provides an in-depth analysis of the global Test Data Generation Tools market, examining its evolution, current landscape, and future trajectory from 2019 to 2033. The Base Year for analysis is 2025, with the Estimated Year also being 2025, and the Forecast Period extending from 2025 to 2033. The Historical Period covered is 2019-2024. We delve into the critical aspects of this rapidly growing industry, offering insights into market dynamics, key players, emerging trends, and growth opportunities. The market is projected to witness substantial growth, with an estimated value reaching several million by the end of the forecast period.

This dataset contains 56,964 conversations between een AI assistant and a (fake) "Human" (generated) in Dutch, specifically in the domain of programming (Stack Overflow). They are translations of Baize's machine-generated answers to the Stack Overflow dataset.

Data Instances

{'id': 9, 'input': 'Het gesprek tussen de mens en de AI-assistent. ' '[|Human|] Ik heb wat hulp nodig met Spark SQL union en het ordenen ' 'van kolommen. ' '[|AI|] Natuurlijk, ik help je graag. Waar heb je specifiek hulp ' 'bij nodig? ' '[|Human|] Ik wil de output van een UNION-query ordenen op een ' 'kolom die niet aanwezig is in de SELECT-instructie. Is dat ' 'mogelijk? ' '[|AI|] Ja, het is mogelijk met Spark SQL. Je kunt de ordinale ' 'positie van de kolom in de ORDER BY-clausule gebruiken in plaats ' 'van de kolomnaam. Als je bijvoorbeeld wilt ordenen op de derde ' 'kolom in de SELECT-instructie, kun je ORDER BY 3 gebruiken. ' '[|Human|] Dat is nuttig. Kan ik ook een alias gebruiken in de ' 'ORDER BY-clausule? ' '[|AI|] Ja, je kunt een alias gebruiken in de ORDER BY-clausule. De ' 'alias moet worden gedefinieerd in de SELECT-instructie. Als je ' 'bijvoorbeeld de derde kolom als "col3" alias geeft, kun je ordenen ' 'met ORDER BY col3. ' '[|Human|] Oké, ik denk dat ik het begrijp. Kan ik dezelfde alias ' 'gebruiken voor kolommen uit beide tabellen in de UNION? ' '[|AI|] Nee, je kunt dezelfde alias niet gebruiken voor kolommen ' 'uit beide tabellen in de UNION. Elke tabel in de UNION moet een ' 'unieke alias hebben voor de kolommen. ' '[|Human|] ', 'topic': 'Spark SQL UNION - ORDER BY kolom niet in SELECT'},

Data Fields

id: the ID of the item. The following 82 IDs are not included because they could not be translated: [1713, 1937, 1960, 4326, 4356, 8357, 8542, 8827, 9137, 9782, 11560, 11961, 12244, 12362, 12488, 13259, 13621, 14445, 14835, 15006, 17746, 18808, 19285, 19426, 19491, 21270, 21661, 22098, 23352, 23840, 23869, 25148, 25928, 27102, 27856, 28387, 29942, 30041, 30251, 32396, 32742, 32941, 33628, 34116, 34648, 34859, 35977, 35987, 36035, 36456, 37028, 37238, 37640, 38107, 38735, 39015, 40984, 41115, 41567, 42397, 43219, 43783, 44599, 44980, 45239, 47676, 48922, 49534, 50282, 50683, 50804, 50919, 51076, 51211, 52000, 52183, 52489, 52595, 53884, 54726, 55795, 56992]

input: the machine-generated conversation between AI and "Human". Always starts with Het gesprek tussen de mens en de AI-assistent. and has at least one occurrence of both [|AI|] and [|Human|].

topic: the topic description

Dataset Creation

Both the translations and the topics were translated with OpenAI's API for gpt-3.5-turbo. max_tokens=1024, temperature=0 as parameters.

The prompt template to translate the input is (where src_lang was English and tgt_lang Dutch):

CONVERSATION_TRANSLATION_PROMPT = """You are asked to translate a conversation between an AI assistant and a human from {src_lang} into {tgt_lang}.

Here are the requirements that you should adhere to: 1. maintain the format: the conversation consists of the AI (marked as [|AI|]) and the human ([|Human|]) talking in turns and responding to each other; 2. do not translate the speaker identifiers [|AI|] and [|Human|] but always copy them into the translation in appropriate places; 3. ensure accurate translation and keep the correctness of the conversation; 4. make sure that text is fluent to read and does not contain grammatical errors. Use standard {tgt_lang} without regional bias; 5. translate the human's text using informal, but standard, language; 6. make sure to avoid biases (such as gender bias, grammatical bias, social bias); 7. if the human asks to correct grammar mistakes or spelling mistakes then you have to generate a similar mistake in {tgt_lang}, and then also generate a corrected output version for the AI in {tgt_lang}; 8. if the human asks to translate text from one to another language, then you only translate the human's question to {tgt_lang} but you keep the translation that the AI provides in the language that the human requested; 9. do not translate code fragments but copy them as they are. If there are English examples, variable names or definitions in code fragments, keep them in English.

Now translate the following conversation with the requirements set out above. Do not provide an explanation and do not add anything else.

"""

The prompt to translate the topic is:

TOPIC_TRANSLATION_PROMPT = "Translate the following title of a conversation from {src_lang} to {tgt_lang} in a succinct,"
" summarizing manner. Translate accurately and formally. Do not provide any explanation"
" about the translation and do not include the original title.

"

The system message was:

You are a helpful assistant that translates English to Dutch to the requirements that are given to you.

Note that 82 items (0.1%) were not successfully translated. The translation was missing the AI identifier [|AI|] and/or the human one [|Human|]. The IDs for the missing items are [1713, 1937, 1960, 4326, 4356, 8357, 8542, 8827, 9137, 9782, 11560, 11961, 12244, 12362, 12488, 13259, 13621, 14445, 14835, 15006, 17746, 18808, 19285, 19426, 19491, 21270, 21661, 22098, 23352, 23840, 23869, 25148, 25928, 27102, 27856, 28387, 29942, 30041, 30251, 32396, 32742, 32941, 33628, 34116, 34648, 34859, 35977, 35987, 36035, 36456, 37028, 37238, 37640, 38107, 38735, 39015, 40984, 41115, 41567, 42397, 43219, 43783, 44599, 44980, 45239, 47676, 48922, 49534, 50282, 50683, 50804, 50919, 51076, 51211, 52000, 52183, 52489, 52595, 53884, 54726, 55795, 56992].

The translation quality has not been verified. Use at your own risk!

Licensing Information

Licensing info for Stack Overflow Questions is listed as Apache 2.0. If you use the current dataset, you should also adhere to the original license.

This text was generated (either in part or in full) with GPT-3 (gpt-3.5-turbo), OpenAI’s large-scale language-generation model. Upon generating draft language, the author reviewed, edited, and revised the language to their own liking and takes ultimate responsibility for the content of this publication.

If you use this dataset, you must also follow the Sharing and Usage policies.

As clearly stated in their Terms of Use, specifically 2c.iii, "[you may not] use output from the Services to develop models that compete with OpenAI". That means that you cannot use this dataset to build models that are intended to commercially compete with OpenAI. As far as I am aware, that is a specific restriction that should serve as an addendum to the current license.

This dataset is also available on the Hugging Face hub with the same DOI and license. See that README for more info.

AI Training Data | Annotated Checkout Flows for Retail, Restaurant, and Marketplace Websites Overview

Unlock the next generation of agentic commerce and automated shopping experiences with this comprehensive dataset of meticulously annotated checkout flows, sourced directly from leading retail, restaurant, and marketplace websites. Designed for developers, researchers, and AI labs building large language models (LLMs) and agentic systems capable of online purchasing, this dataset captures the real-world complexity of digital transactions—from cart initiation to final payment.

Key Features

Breadth of Coverage: Over 10,000 unique checkout journeys across hundreds of top e-commerce, food delivery, and service platforms, including but not limited to Walmart, Target, Kroger, Whole Foods, Uber Eats, Instacart, Shopify-powered sites, and more.

Actionable Annotation: Every flow is broken down into granular, step-by-step actions, complete with timestamped events, UI context, form field details, validation logic, and response feedback. Each step includes:

Page state (URL, DOM snapshot, and metadata)

User actions (clicks, taps, text input, dropdown selection, checkbox/radio interactions)

System responses (AJAX calls, error/success messages, cart/price updates)

Authentication and account linking steps where applicable

Payment entry (card, wallet, alternative methods)

Order review and confirmation

Multi-Vertical, Real-World Data: Flows sourced from a wide variety of verticals and real consumer environments, not just demo stores or test accounts. Includes complex cases such as multi-item carts, promo codes, loyalty integration, and split payments.

Structured for Machine Learning: Delivered in standard formats (JSONL, CSV, or your preferred schema), with every event mapped to action types, page features, and expected outcomes. Optional HAR files and raw network request logs provide an extra layer of technical fidelity for action modeling and RLHF pipelines.

Rich Context for LLMs and Agents: Every annotation includes both human-readable and model-consumable descriptions:

“What the user did” (natural language)

“What the system did in response”

“What a successful action should look like”

Error/edge case coverage (invalid forms, OOS, address/payment errors)

Privacy-Safe & Compliant: All flows are depersonalized and scrubbed of PII. Sensitive fields (like credit card numbers, user addresses, and login credentials) are replaced with realistic but synthetic data, ensuring compliance with privacy regulations.

Each flow tracks the user journey from cart to payment to confirmation, including:

Adding/removing items

Applying coupons or promo codes

Selecting shipping/delivery options

Account creation, login, or guest checkout

Inputting payment details (card, wallet, Buy Now Pay Later)

Handling validation errors or OOS scenarios

Order review and final placement

Confirmation page capture (including order summary details)

Why This Dataset?

Building LLMs, agentic shopping bots, or e-commerce automation tools demands more than just page screenshots or API logs. You need deeply contextualized, action-oriented data that reflects how real users interact with the complex, ever-changing UIs of digital commerce. Our dataset uniquely captures:

The full intent-action-outcome loop

Dynamic UI changes, modals, validation, and error handling

Nuances of cart modification, bundle pricing, delivery constraints, and multi-vendor checkouts

Mobile vs. desktop variations

Diverse merchant tech stacks (custom, Shopify, Magento, BigCommerce, native apps, etc.)

Use Cases

LLM Fine-Tuning: Teach models to reason through step-by-step transaction flows, infer next-best-actions, and generate robust, context-sensitive prompts for real-world ordering.

Agentic Shopping Bots: Train agents to navigate web/mobile checkouts autonomously, handle edge cases, and complete real purchases on behalf of users.

Action Model & RLHF Training: Provide reinforcement learning pipelines with ground truth “what happens if I do X?” data across hundreds of real merchants.

UI/UX Research & Synthetic User Studies: Identify friction points, bottlenecks, and drop-offs in modern checkout design by replaying flows and testing interventions.

Automated QA & Regression Testing: Use realistic flows as test cases for new features or third-party integrations.

What’s Included

10,000+ annotated checkout flows (retail, restaurant, marketplace)

Step-by-step event logs with metadata, DOM, and network context

Natural language explanations for each step and transition

All flows are depersonalized and privacy-compliant

Example scripts for ingesting, parsing, and analyzing the dataset

Flexible licensing for research or commercial use

Sample Categories Covered

Grocery delivery (Instacart, Walmart, Kroger, Target, etc.)

Restaurant takeout/delivery (Ub...

The Synthetic Data Generation Market is estimated to be valued at USD 0.4 billion in 2025 and is projected to reach USD 4.4 billion by 2035, registering a compound annual growth rate (CAGR) of 25.9% over the forecast period.

A simple parabolic dataset with data generation code attached

This training data was generated using GPT-4o as part of the 'Drawing with LLM' competition (https://www.kaggle.com/competitions/drawing-with-llms). It can be used to fine-tune small language models for the competition or serve as an augmentation dataset alongside other data sources.

The dataset is generated in two steps using the GPT-4o model. - In the first step, topic descriptions relevant to the competition are generated using a specific prompt. By running this prompt multiple times, over 3,000 descriptions were collected.

 
prompt=f""" I am participating in an SVG code generation competition.
  
   The competition involves generating SVG images based on short textual descriptions of everyday objects and scenes, spanning a wide range of categories. The key guidelines are as follows:
  
   - Descriptions are generic and do not contain brand names, trademarks, or personal names.
   - No descriptions include people, even in generic terms.
   - Descriptions are concise—each is no more than 200 characters, with an average length of about 50 characters.
   - Categories cover various domains, with some overlap between public and private test sets.
  
   To train a small LLM model, I am preparing a synthetic dataset. Could you generate 100 unique topics aligned with the competition style?
  
   Requirements:
   - Each topic should range between **20 and 200 characters**, with an **average around 60 characters**.
   - Ensure **diversity and creativity** across topics.
   - **50% of the topics** should come from the categories of **landscapes**, **abstract art**, and **fashion**.
   - Avoid duplication or overly similar phrasing.
  
   Example topics:
                 a purple forest at dusk, gray wool coat with a faux fur collar, a lighthouse overlooking the ocean, burgundy corduroy, pants with patch pockets and silver buttons, orange corduroy overalls, a purple silk scarf with tassel trim, a green lagoon under a cloudy sky, crimson rectangles forming a chaotic grid,  purple pyramids spiraling around a bronze cone, magenta trapezoids layered on a translucent silver sheet,  a snowy plain, black and white checkered pants,  a starlit night over snow-covered peaks, khaki triangles and azure crescents,  a maroon dodecahedron interwoven with teal threads.
  
   Please return the 100 topics in csv format.
   """
 

• In the second step, SVG code is generated by prompting the GPT-4o model. The following prompt is used to query the model to generate svg.

 
  prompt = f"""
      Generate SVG code to visually represent the following text description, while respecting the given constraints.
      
      Allowed Elements: `svg`, `path`, `circle`, `rect`, `ellipse`, `line`, `polyline`, `polygon`, `g`, `linearGradient`, `radialGradient`, `stop`, `defs`
      Allowed Attributes: `viewBox`, `width`, `height`, `fill`, `stroke`, `stroke-width`, `d`, `cx`, `cy`, `r`, `x`, `y`, `rx`, `ry`, `x1`, `y1`, `x2`, `y2`, `points`, `transform`, `opacity`
      

      Please ensure that the generated SVG code is well-formed, valid, and strictly adheres to these constraints. 
      Focus on a clear and concise representation of the input description within the given limitations. 
      Always give the complete SVG code with nothing omitted. Never use an ellipsis.

      The code is scored based on similarity to the description, Visual question anwering and aesthetic components.
      Please generate a detailed svg code accordingly.

      input description: {text}
      """
 

The raw SVG output is then cleaned and sanitized using a competition-specific sanitization class. After that, the cleaned SVG is scored using the SigLIP model to evaluate text-to-SVG similarity. Only SVGs with a score above 0.5 are included in the dataset. On average, out of three SVG generations, only one meets the quality threshold after the cleaning, sanitization, and scoring process.

A dataset with ~50,000 samples for SVG code generation is publicly available at: https://huggingface.co/datasets/vinoku89/svg-code-generation

Synthetic Data Generator for Telco AI Market Outlook

According to our latest research, the global Synthetic Data Generator for Telco AI market size reached USD 1.48 billion in 2024, reflecting the growing adoption of artificial intelligence and machine learning technologies across the telecommunications sector. The market is projected to expand at a robust CAGR of 33.2% from 2025 to 2033, reaching a forecasted value of USD 16.45 billion by 2033. This remarkable growth is primarily fueled by the increasing demand for high-quality, privacy-compliant training data to power AI-driven telco solutions, alongside the rapid digital transformation initiatives being undertaken by telecom operators worldwide.

One of the primary growth drivers for the Synthetic Data Generator for Telco AI market is the exponential rise in data privacy regulations and concerns surrounding the use of real customer data for AI model training. As telecom operators handle massive volumes of sensitive user information, compliance with regulations such as GDPR, CCPA, and other local data protection laws has become paramount. Synthetic data generators provide a viable solution by creating realistic, anonymized datasets that mimic real-world scenarios without exposing actual customer information. This enables telcos to accelerate AI development, enhance model accuracy, and reduce the risk of data breaches, thus fostering the widespread adoption of synthetic data generation tools across the industry.

Another significant factor propelling market growth is the increasing complexity of telco networks and the need for advanced analytics to optimize operations. With the deployment of 5G, IoT, and edge computing, telecommunications infrastructure has become more intricate, generating vast amounts of structured and unstructured data. Synthetic data generators empower telcos to simulate rare network events, test AI algorithms under diverse scenarios, and improve predictive maintenance, fraud detection, and customer analytics. This capability not only enhances operational efficiency but also reduces downtime and improves customer satisfaction, further driving the integration of synthetic data solutions in telco AI workflows.

Furthermore, the shift towards digital transformation and the adoption of cloud-native technologies by telecom operators are accelerating the demand for scalable, flexible synthetic data generation platforms. As telcos modernize their IT infrastructure and embrace cloud-based AI solutions, the need for on-demand, customizable synthetic datasets has surged. Synthetic data generators enable seamless integration with cloud platforms, support agile development cycles, and facilitate collaboration across distributed teams. This trend is expected to continue as telecom operators invest in next-generation AI applications to stay competitive, improve service delivery, and unlock new revenue streams.

Regionally, North America currently dominates the Synthetic Data Generator for Telco AI market, accounting for the largest revenue share in 2024, followed closely by Europe and Asia Pacific. The strong presence of leading telecom operators, advanced AI research capabilities, and a mature regulatory environment in these regions contribute to the rapid adoption of synthetic data solutions. Asia Pacific is poised for the fastest growth over the forecast period, driven by the expansion of 5G networks, increasing investments in AI, and the proliferation of connected devices. Meanwhile, Latin America and the Middle East & Africa are witnessing steady growth as telcos in these regions accelerate their digital transformation journeys, albeit from a smaller base.

Component Analysis

The Synthetic Data Generator for Telco AI market is segmented by component into Software and Services. Software solutions form the backbone of this market, offering advanced tools for data synthesis, simulation, and integration with existing telco AI workflows. These platforms are designed to generate high-fid

A simple linear dataset with data generation code attached

Static torque, no load, constant speed, and sinusoidal oscillation test data for a 10hp, 300rpm magnetically-geared generator prototype using either an adjustable load bank for a fixed resistance or an output power converter.

This is a program that takes in a description of a cryptographic algorithm implementation's capabilities, and generates test vectors to ensure the implementation conforms to the standard. After generating the test vectors, the program also validates the correctness of the responses from the user.

Synthetic ISO 20022 Test Data Generation Market Outlook

Based on our latest research and analysis, the global Synthetic ISO 20022 Test Data Generation market size reached USD 682 million in 2024, reflecting a robust surge in demand driven by the rapid adoption of ISO 20022 messaging standards across the financial ecosystem. The market is poised for remarkable expansion, with a projected CAGR of 14.7% from 2025 to 2033. By the end of 2033, the market size is forecasted to reach approximately USD 2.16 billion. This growth is underpinned by regulatory mandates, the need for enhanced interoperability, and the increasing complexity of financial transactions globally.

The primary growth factor for the Synthetic ISO 20022 Test Data Generation market lies in the accelerating transition of global financial institutions toward ISO 20022 messaging standards. Regulatory bodies such as SWIFT, the European Central Bank, and other major payment market infrastructures have mandated the adoption of ISO 20022, spurring banks, payment service providers, and other financial entities to overhaul legacy systems. This transition necessitates extensive testing to ensure compliance, seamless integration, and operational continuity, thereby fueling demand for synthetic test data generation solutions. These solutions enable organizations to simulate a wide variety of transaction scenarios, identify interoperability issues, and validate system behaviors without exposing sensitive customer data, which is critical in an era of stringent data privacy regulations.

Another pivotal driver is the increasing complexity and volume of financial transactions, particularly in the realms of cross-border payments, securities settlement, and trade finance. As financial products and services diversify, the need for robust and scalable test data generation tools intensifies. Synthetic ISO 20022 Test Data Generation tools offer the capability to generate vast datasets that mimic real-world transaction flows, supporting rigorous testing for both functional and non-functional requirements. This capability is indispensable for large-scale financial institutions and fintechs that must ensure their systems can handle high transaction volumes, complex message structures, and evolving regulatory requirements. Furthermore, the integration of AI and machine learning into test data generation platforms is enhancing the ability to create more realistic and diverse test scenarios, further driving market growth.

The growing focus on cybersecurity and data privacy presents another significant growth catalyst for the market. Financial organizations are increasingly wary of using production data in test environments due to the risk of data breaches and regulatory penalties. Synthetic ISO 20022 Test Data Generation solutions provide a secure alternative by generating anonymized, non-sensitive data that mirrors production data characteristics. This approach not only mitigates compliance risks but also accelerates the testing process, enabling organizations to bring new products and services to market faster. The convergence of digital transformation initiatives, regulatory compliance, and the imperative for secure testing environments is expected to sustain high demand for synthetic test data solutions throughout the forecast period.

From a regional perspective, North America and Europe currently dominate the Synthetic ISO 20022 Test Data Generation market, driven by early adoption of ISO 20022 standards, a mature financial services sector, and proactive regulatory frameworks. The Asia Pacific region is emerging as a high-growth market, propelled by rapid digitalization of banking services, expanding fintech ecosystems, and increasing cross-border transactions. Latin America and the Middle East & Africa are also witnessing steady growth, albeit from a lower base, as regional financial institutions modernize their payment infrastructures and align with global messaging standards. Regional disparities in regulatory timelines, technological maturity, and market readiness are expected to shape the competitive landscape and growth trajectories in the coming years.

Introduction

This repository hosts the Testing Roads for Autonomous VEhicLes (TRAVEL) dataset. TRAVEL is an extensive collection of virtual roads that have been used for testing lane assist/keeping systems (i.e., driving agents) and data from their execution in state of the art, physically accurate driving simulator, called BeamNG.tech. Virtual roads consist of sequences of road points interpolated using Cubic splines.

Along with the data, this repository contains instructions on how to install the tooling necessary to generate new data (i.e., test cases) and analyze them in the context of test regression. We focus on test selection and test prioritization, given their importance for developing high-quality software following the DevOps paradigms.

This dataset builds on top of our previous work in this area, including work on

test generation (e.g., AsFault, DeepJanus, and DeepHyperion) and the SBST CPS tool competition (SBST2021),

test selection: SDC-Scissor and related tool

test prioritization: automated test cases prioritization work for SDCs.

Dataset Overview

The TRAVEL dataset is available under the data folder and is organized as a set of experiments folders. Each of these folders is generated by running the test-generator (see below) and contains the configuration used for generating the data (experiment_description.csv), various statistics on generated tests (generation_stats.csv) and found faults (oob_stats.csv). Additionally, the folders contain the raw test cases generated and executed during each experiment (test..json).

The following sections describe what each of those files contains.

Experiment Description

The experiment_description.csv contains the settings used to generate the data, including:

Time budget. The overall generation budget in hours. This budget includes both the time to generate and execute the tests as driving simulations.

The size of the map. The size of the squared map defines the boundaries inside which the virtual roads develop in meters.

The test subject. The driving agent that implements the lane-keeping system under test. The TRAVEL dataset contains data generated testing the BeamNG.AI and the end-to-end Dave2 systems.

The test generator. The algorithm that generated the test cases. The TRAVEL dataset contains data obtained using various algorithms, ranging from naive and advanced random generators to complex evolutionary algorithms, for generating tests.

The speed limit. The maximum speed at which the driving agent under test can travel.

Out of Bound (OOB) tolerance. The test cases' oracle that defines the tolerable amount of the ego-car that can lie outside the lane boundaries. This parameter ranges between 0.0 and 1.0. In the former case, a test failure triggers as soon as any part of the ego-vehicle goes out of the lane boundary; in the latter case, a test failure triggers only if the entire body of the ego-car falls outside the lane.

Experiment Statistics

The generation_stats.csv contains statistics about the test generation, including:

Total number of generated tests. The number of tests generated during an experiment. This number is broken down into the number of valid tests and invalid tests. Valid tests contain virtual roads that do not self-intersect and contain turns that are not too sharp.

Test outcome. The test outcome contains the number of passed tests, failed tests, and test in error. Passed and failed tests are defined by the OOB Tolerance and an additional (implicit) oracle that checks whether the ego-car is moving or standing. Tests that did not pass because of other errors (e.g., the simulator crashed) are reported in a separated category.

The TRAVEL dataset also contains statistics about the failed tests, including the overall number of failed tests (total oob) and its breakdown into OOB that happened while driving left or right. Further statistics about the diversity (i.e., sparseness) of the failures are also reported.

Test Cases and Executions

Each test..json contains information about a test case and, if the test case is valid, the data observed during its execution as driving simulation.

The data about the test case definition include:

The road points. The list of points in a 2D space that identifies the center of the virtual road, and their interpolation using cubic splines (interpolated_points)

The test ID. The unique identifier of the test in the experiment.

Validity flag and explanation. A flag that indicates whether the test is valid or not, and a brief message describing why the test is not considered valid (e.g., the road contains sharp turns or the road self intersects)

The test data are organized according to the following JSON Schema and can be interpreted as RoadTest objects provided by the tests_generation.py module.

{ "type": "object", "properties": { "id": { "type": "integer" }, "is_valid": { "type": "boolean" }, "validation_message": { "type": "string" }, "road_points": { §\label{line:road-points}§ "type": "array", "items": { "$ref": "schemas/pair" }, }, "interpolated_points": { §\label{line:interpolated-points}§ "type": "array", "items": { "$ref": "schemas/pair" }, }, "test_outcome": { "type": "string" }, §\label{line:test-outcome}§ "description": { "type": "string" }, "execution_data": { "type": "array", "items": { "$ref" : "schemas/simulationdata" } } }, "required": [ "id", "is_valid", "validation_message", "road_points", "interpolated_points" ] }

Finally, the execution data contain a list of timestamped state information recorded by the driving simulation. State information is collected at constant frequency and includes absolute position, rotation, and velocity of the ego-car, its speed in Km/h, and control inputs from the driving agent (steering, throttle, and braking). Additionally, execution data contain OOB-related data, such as the lateral distance between the car and the lane center and the OOB percentage (i.e., how much the car is outside the lane).

The simulation data adhere to the following (simplified) JSON Schema and can be interpreted as Python objects using the simulation_data.py module.

{ "$id": "schemas/simulationdata", "type": "object", "properties": { "timer" : { "type": "number" }, "pos" : { "type": "array", "items":{ "$ref" : "schemas/triple" } } "vel" : { "type": "array", "items":{ "$ref" : "schemas/triple" } } "vel_kmh" : { "type": "number" }, "steering" : { "type": "number" }, "brake" : { "type": "number" }, "throttle" : { "type": "number" }, "is_oob" : { "type": "number" }, "oob_percentage" : { "type": "number" } §\label{line:oob-percentage}§ }, "required": [ "timer", "pos", "vel", "vel_kmh", "steering", "brake", "throttle", "is_oob", "oob_percentage" ] }

Dataset Content

The TRAVEL dataset is a lively initiative so the content of the dataset is subject to change. Currently, the dataset contains the data collected during the SBST CPS tool competition, and data collected in the context of our recent work on test selection (SDC-Scissor work and tool) and test prioritization (automated test cases prioritization work for SDCs).

SBST CPS Tool Competition Data

The data collected during the SBST CPS tool competition are stored inside data/competition.tar.gz. The file contains the test cases generated by Deeper, Frenetic, AdaFrenetic, and Swat, the open-source test generators submitted to the competition and executed against BeamNG.AI with an aggression factor of 0.7 (i.e., conservative driver).

    Name
    Map Size (m x m)
    Max Speed (Km/h)
    Budget (h)
    OOB Tolerance (%)
    Test Subject




    DEFAULT
    200 × 200
    120
    5 (real time)
    0.95
    BeamNG.AI - 0.7


    SBST
    200 × 200
    70
    2 (real time)
    0.5
    BeamNG.AI - 0.7

Specifically, the TRAVEL dataset contains 8 repetitions for each of the above configurations for each test generator totaling 64 experiments.

SDC Scissor

With SDC-Scissor we collected data based on the Frenetic test generator. The data is stored inside data/sdc-scissor.tar.gz. The following table summarizes the used parameters.

    Name
    Map Size (m x m)
    Max Speed (Km/h)
    Budget (h)
    OOB Tolerance (%)
    Test Subject




    SDC-SCISSOR
    200 × 200
    120
    16 (real time)
    0.5
    BeamNG.AI - 1.5

The dataset contains 9 experiments with the above configuration. For generating your own data with SDC-Scissor follow the instructions in its repository.

Dataset Statistics

Here is an overview of the TRAVEL dataset: generated tests, executed tests, and faults found by all the test generators grouped by experiment configuration. Some 25,845 test cases are generated by running 4 test generators 8 times in 2 configurations using the SBST CPS Tool Competition code pipeline (SBST in the table). We ran the test generators for 5 hours, allowing the ego-car a generous speed limit (120 Km/h) and defining a high OOB tolerance (i.e., 0.95), and we also ran the test generators using a smaller generation budget (i.e., 2 hours) and speed limit (i.e., 70 Km/h) while setting the OOB tolerance to a lower value (i.e., 0.85). We also collected some 5, 971 additional tests with SDC-Scissor (SDC-Scissor in the table) by running it 9 times for 16 hours using Frenetic as a test generator and defining a more realistic OOB tolerance (i.e., 0.50).

Generating new Data

Generating new data, i.e., test cases, can be done using the SBST CPS Tool Competition pipeline and the driving simulator BeamNG.tech.

Extensive instructions on how to install both software are reported inside the SBST CPS Tool Competition pipeline Documentation;