Projects in Awesome Lists tagged with data-generation

https://github.com/idea-research/grounded-segment-anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

3d-whole-body-pose-estimation automatic-labeling-system caption data-generation image-editing open-vocabulary-detection open-vocabulary-segmentation speech

Last synced: 23 Apr 2025

https://github.com/IDEA-Research/Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

3d-whole-body-pose-estimation automatic-labeling-system caption data-generation image-editing open-vocabulary-detection open-vocabulary-segmentation speech

Last synced: 20 Mar 2025

https://github.com/sdv-dev/sdv

Synthetic data generation for tabular data

data-generation deep-learning gan gans generative-adversarial-network generative-ai generative-model generativeai machine-learning multi-table relational-datasets sdv synthetic-data synthetic-data-generation time-series

Last synced: 02 Apr 2026

https://github.com/sdv-dev/SDV

Synthetic data generation for tabular data

data-generation deep-learning gan gans generative-adversarial-network generative-ai generative-model generativeai machine-learning multi-table relational-datasets sdv synthetic-data synthetic-data-generation time-series

Last synced: 26 Mar 2025

https://github.com/benkeen/generatedata

A powerful, feature-rich, random test data generator.

data data-generation data-generator data-generators human-data json random random-generation randomization rest-api test-data test-data-generator testing

Last synced: 13 May 2025

https://github.com/agamiko/data-augmentation-review

List of useful data augmentation resources. You will find here some not common techniques, libraries, links to GitHub repos, papers, and others.

audio-augmentation augmentation-policies autoaugment data-augmentation data-augmentations data-generation data-synthesis generative-adversarial-network graph-data-augmentation image-augmentation machine-learning nlp-augmentation review style-transfer survey

Last synced: 28 Jan 2026

https://github.com/AgaMiko/data-augmentation-review

List of useful data augmentation resources. You will find here some not common techniques, libraries, links to GitHub repos, papers, and others.

audio-augmentation augmentation-policies autoaugment data-augmentation data-augmentations data-generation data-synthesis generative-adversarial-network graph-data-augmentation image-augmentation machine-learning nlp-augmentation review style-transfer survey

Last synced: 20 Mar 2025

https://github.com/shuttle-hq/synth

The Declarative Data Generator

data-generation hacktoberfest json postgres realistic-data rust synthetic-data test-data-generator

Last synced: 15 May 2025

https://github.com/sdv-dev/ctgan

Conditional GAN for generating synthetic tabular data.

data-generation generative-adversarial-network synthetic-data synthetic-data-generation tabular-data

Last synced: 13 May 2025

https://github.com/sdv-dev/CTGAN

Conditional GAN for generating synthetic tabular data.

data-generation generative-adversarial-network synthetic-data synthetic-data-generation tabular-data

Last synced: 02 May 2025

https://github.com/whatyouhide/stream_data

Data generation and property-based testing for Elixir. 🔮

data-generation elixir property-based-testing property-testing quickcheck

Last synced: 13 May 2025

https://github.com/sdv-dev/Copulas

A library to model multivariate data using copulas.

copulas data-generation generative-ai generative-model machine-learning synthetic-data synthetic-data-generation tabular-data

Last synced: 18 Jan 2026

https://github.com/sdv-dev/copulas

A library to model multivariate data using copulas.

copulas data-generation generative-ai generative-model machine-learning synthetic-data synthetic-data-generation tabular-data

Last synced: 05 Feb 2026

https://github.com/open-sciencelab/GraphGen

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

ai4science data-generation data-synthesis graphgen knowledge-graph llama-factory llm llm-training pretrain pretraining qa question-answering qwen sft sft-data xtuner

Last synced: 29 Nov 2025

https://github.com/nomemory/mockneat

MockNeat - the modern faker lib.

arbitrary-data big-data csv data-generation data-generator fake-data faker faker-generator faker-library java java-8 lorem-ipsum mocking random-generation random-number-generators randomization randomizer sample-data sample-data-generator sql-insert

Last synced: 13 Apr 2025

https://github.com/tom-lord/regexp-examples

Generate strings that match a given regular expression

data-generation mri random-string regexp ruby

Last synced: 06 Jul 2025

https://github.com/mtg/deepconvsep

Deep Convolutional Neural Networks for Musical Source Separation

audio-synthesis convolutional-neural-networks data-augmentation data-generation deep-learning sample-querying score-synthesis signal-processing source-separation theano

Last synced: 26 Jun 2025

https://github.com/cieslarmichal/faker-cxx

C++ Faker library for generating fake (but realistic) data.

cpp cpp20 data-generation fake fake-data faker

Last synced: 04 Feb 2026

https://github.com/databrickslabs/dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

data-generation databricks datagen datageneration datagenerator delta-live-tables deltalake faker pyspark python spark spark-streaming synthetic-data

Last synced: 07 Jul 2025

https://github.com/microsoft/genalog

Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and text alignment capabilities.

data-generation data-science machine-learning ner ocr-recognition python synthetic-data synthetic-data-generation synthetic-images text-alignment

Last synced: 04 Apr 2025

https://github.com/tabularis-ai/be_great

A novel approach for synthesizing tabular data using pretrained large language models

data-generation deep-learning synthetic-data synthetic-dataset-generation tabular-data transformers

Last synced: 12 Jun 2025

https://github.com/tirthajyoti/pydbgen

Random dataframe and database table generator

data-generation data-science database fake-data generator pandas-dataframe python random-generation sqlite sqlite3 synthetic-data synthetic-dataset-generation

Last synced: 05 Apr 2025

https://github.com/trinker/wakefield

Generate random data sets

data-generation r wakefield

Last synced: 04 Apr 2025

https://github.com/worldbank/REaLTabFormer

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.

data-generation deep-learning gpt gpt-2 seq2seq-model synthetic-data synthetic-dataset-generation tabular-data transformers

Last synced: 17 Aug 2025

https://github.com/worldbank/realtabformer

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.

data-generation deep-learning gpt gpt-2 seq2seq-model synthetic-data synthetic-dataset-generation tabular-data transformers

Last synced: 04 Jan 2026

https://github.com/finos/datahelix

The DataHelix generator allows you to quickly create data, based on a JSON profile that defines fields and the relationships between them, for the purpose of testing and validation

data-engineering data-generation data-generator java test-data-generator

Last synced: 27 Feb 2025

https://github.com/tinybirdco/mockingbird

Mockingbird is a mock streaming data generator

data-generation data-generator fakerjs generator http kafka streaming-data tinybird typescript

Last synced: 16 May 2025

https://github.com/sdv-dev/deepecho

Synthetic Data Generation for mixed-type, multivariate time series.

data-generation deep-learning generative-adversarial-network sdv synthetic-data synthetic-data-generation time-series

Last synced: 12 Feb 2026

https://github.com/sdv-dev/DeepEcho

Synthetic Data Generation for mixed-type, multivariate time series.

data-generation deep-learning generative-adversarial-network sdv synthetic-data synthetic-data-generation time-series

Last synced: 04 Apr 2025

https://github.com/louisYen/Gen4Gen

🏞️ Official implementation of "Gen4Gen: Generative Data Pipeline for Generative Multi-Concept Composition"

data-generation llm personalization stable-diffusion text-to-image-generation

Last synced: 27 Mar 2025

https://github.com/mjkvaak/ImageDataAugmentor

Custom image data generator for TF Keras that supports the modern augmentation module albumentations

augmentation augmentations data-generation deep-learning image-augmentation image-classification machine-learning python tensorflow2

Last synced: 08 May 2025

https://github.com/kgoldfeld/simstudy

simstudy: Illuminating research methods through data generation

data-generation data-simulation r simulation statistical-models

Last synced: 22 Oct 2025

https://github.com/br0kej/bin2ml

A command line tool for extracting machine learning ready data from software binaries powered by Radare2

binary-analysis data-generation graph-neural-networks machine-learning ml4sec nlp radare2 reverse-engineering

Last synced: 22 Jan 2026

https://github.com/dmey/synthia

📈 🐍 Multidimensional synthetic data generation with Copula and fPCA models in Python

augmentation climate copula data-augmentation data-generation data-generator data-modelling data-science dependency-analysis dependency-modeling finance fpca functional-data machine-learning oversampling principal-component-analysis statistics synthetic-data weather xarray

Last synced: 01 Feb 2026

https://github.com/microsoft/codemixed-text-generator

This tool helps automatic generation of grammatically valid synthetic Code-mixed data by utilizing linguistic theories such as Equivalence Constant Theory and Matrix Language Theory.

code-mixing code-switching data-generation language-modeling linguistics natural-language-processing python3 synthetic-data-generation

Last synced: 29 May 2026

https://github.com/smartcat-labs/ranger

Ranger is contextual data generator used to make sensible data for integration tests or to play with it in the database

contextual-data data-generation data-generator test-data

Last synced: 12 Aug 2025

https://github.com/rasinmuhammed/misata

High-performance open-source synthetic data engine. Uses LLMs for schema design and vectorized NumPy for deterministic, scalable generation.

data-engineering data-generation database-seeding developer-tools generative-ai llm mock-data numpy pandas python synthetic synthetic-data synthetic-dataset-generation testing

Last synced: 10 May 2026

https://github.com/grafana/k6-example-data-generation

Example repository showing how to utilise k6 and faker to load test using generated data

data-generation examples load-testing performance-testing

Last synced: 30 Apr 2025

https://github.com/edyan/neuralyzer

Neuralyzer is a library and a command line tool to anonymize databases (by updating existing data or populating a table with fake data)

anonymisation anonymization anonymize data-generation data-generator data-privacy database dgpr private-life rgpd

Last synced: 04 Apr 2025

https://github.com/Stranger6667/hypothesis-graphql

Generate arbitrary queries matching your GraphQL schema, and use them to verify your backend implementation.

data-generation graphql hypothesis python testing

Last synced: 11 May 2025

https://github.com/goodarzmehr/simbev

[ITSC 2026] SimBEV is a configurable and scalable synthetic driving data generation tool and dataset based on the CARLA Simulator.

3d-object-detection autonomous-driving bev bev-perception bev-segmentation carla-simulator computer-vision data-generation dataset depth-estimation semantic semantic-occupancy-prediction semantic-segmentation

Last synced: 30 May 2026

https://github.com/yuriyivon/databasebenchmark

A universal database query benchmark tool

benchmark benchmarking data-generation data-generator database-benchmarking

Last synced: 15 Apr 2025

https://github.com/stranger6667/hypothesis-graphql

Generate arbitrary queries matching your GraphQL schema, and use them to verify your backend implementation.

data-generation graphql hypothesis python testing

Last synced: 20 Aug 2025

https://github.com/eliabntt/GRADE-RR

GRADE: Generating Animated Dynamic Environments for Robotics Research

animals data-generation dataset dynamic-environments dynamic-humans framework generator humans isaac isaac-sim isaacsim omniverse realistic research robotics ros simulation simulator

Last synced: 09 May 2025

https://github.com/fuelen/seed_factory

A toolkit for test data generation

data-generation elixir exunit factories factory fixtures schema testing testing-tools

Last synced: 24 Jul 2025

https://github.com/gretelai/trainer

Simple interface to synthesize complex and highly dimensional datasets using Gretel APIs.

data-generation deep-learning gan gans language-model machine-learning synthetic-data

Last synced: 04 Apr 2025

https://github.com/glynnbird/datamaker

Data generator command-line tool and library. Create JSON, CSV, XML data from templates.

cli csv data-generation json nodejs xml

Last synced: 08 May 2025

https://github.com/farlee2121/fsspec

FsSpec represents value constraints as data to reuse one constraint declaration for validation, data generation, error explanation, and more.

data-generation type-driven-development validation

Last synced: 15 Apr 2025

https://github.com/synthesized-io/tdk-demo

This is a collection of TDK demo projects that use different databases and options

data-generation data-generator db2 mysql oracle postgresql synthetic-data synthetic-dataset-generation test-data-generator vault

Last synced: 24 Jun 2025

https://github.com/smtlaissezfaire/fixturereplacement

FixtureReplacement rails plugin

data-generation factory factory-bot factory-girl factorybot fixturereplacment fixtures ruby rubygems test testing testing-tools thoughtbot

Last synced: 12 Apr 2025

https://github.com/tarantool/sdvg

Synthetic Data Values Generator

csv-generator data data-generation data-generator generation generator http-generator parquet-generator random-data random-data-generation synthetic-data synthetic-data-generation synthetic-dataset-generation test-data test-data-generator

Last synced: 12 Jan 2026

https://github.com/stefanheng/proggen

Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models"

data-generation efficient-nlp few-shot-learning large-language-models low-resource-nlp named-entity-recognition natural-language-processing training-data-generation

Last synced: 13 Apr 2025

https://github.com/dfki-ni/syclops

Syclops is a tool for creating synthetic data from 3D virtual environments with photorealistic renderings and pixel-perfect annotations.

3d-rendering annotation asset-management bounding-boxes computer-vision data-generation dataset-creation depth-estimation instance-segmentation keypoints machine-learning photorealistic point-clouds randomization semantic-segmentation structured-light synthetic-data virtual-environments

Last synced: 14 Jan 2026

https://github.com/matousc89/signalz

Data generators in Python

data data-generation signals test-data-generator

Last synced: 14 Jan 2026

https://github.com/hammoudiproject/SuperpixelGridMasks

SuperpixelGridMasks is an approach for sensor-based data augmentation towards image classification tasks and so on.

artificial-intelligence cnn data-augmentation data-augmentations data-generation datascience deep-learning image-augmentation image-classification image-recognition imagery imaging machine-learning sensor-data training-dataset

Last synced: 06 May 2025

https://github.com/daffidwilde/edo

A library for generating artificial datasets through genetic evolution.

data-generation evolutionary-algorithms optimisation

Last synced: 05 May 2025

https://github.com/ma7555/kerasgen

A Keras/Tensorflow compatible image data generator for TripletLoss

data-generation data-generator data-generators data-science keras keras-tensorflow tensorflow triplet triplet-loss triplet-neural-network

Last synced: 11 Mar 2025

https://github.com/infineon/streamgen

Python framework for generating streams of labeled data.

continual-learning data-generation data-streams data-structures function-composition python

Last synced: 24 Jun 2025

https://github.com/data-catering/data-caterer

Data generation and validation tool for any data source

data-generation data-quality data-test data-testing data-validation java scala testing-automation ui yaml

Last synced: 02 Sep 2025

https://github.com/shaoyijia/cmg

Code for ECML-PKDD 2022 Paper --- CMG: A Class-Mixed Generation Approach to Out-of-Distribution Detection

anomaly-detection data-generation novelty-detection out-of-distribution-detection

Last synced: 04 Apr 2025

https://github.com/ipjohnson/simplefixture

Testing fixture for .Net

c-sharp data-generation fixtures testing

Last synced: 15 Aug 2025

https://github.com/buaadreamer/spn4cir

[ACM MM 2024] Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives

acmmm2024 blip blip2 clip composed-image-retrieval cross-modal-retrieval data-generation image-retrieval llama llava memory-bank multi-modal-retrieval multimodal-learning transformer

Last synced: 14 Mar 2026

https://github.com/ironcev/public-talks

My public talks, their abstracts, code snippets, and sample projects

agile-development asp-net-core aspnet-web-api aspnetcore aspnetcore2 catch catch2 conan conan-io cpp csharp7 data-generation package-manager performance roslyn software-craftsmanship

Last synced: 23 Oct 2025

https://github.com/chaturv3di/absynthe

A (branching) Behaviour Synthesiser -- Simulates the generation of application or process logs, where multiple modules (or processes) can execute simultaneously, in a distributed deployment, and dump the log messages in an interleaved manner in a single log file.

control-flow-graph data-generation gitflow-workflow labelled-data log-analysis log-generator python3

Last synced: 09 Apr 2026

https://github.com/munichpavel/fake-data-for-learning

Sample interesting fake data for machine and human learning

data-generation data-science fake-data fake-data-generator machine-learning python statistics

Last synced: 08 Apr 2026

https://github.com/yifanfeng97/multi-modal-generation-for-shrec22

Multi-modal data generation for 3D objects.

3d blender data-generation multi-modal multi-view pointclouds voxel

Last synced: 21 Jan 2026

https://github.com/matherealize/simdata

An R package for simulating data

data-generation r-package regression simulation statistics

Last synced: 22 Oct 2025

https://github.com/fastent/fastent

custom models for named-entity recognition

data-annotation data-generation named-entities named-entity-recognition natural-language-processing nlp spacy

Last synced: 09 Apr 2025

https://github.com/sarathm09/vibranium

API testing and data generation made easy

api api-testing api-testing-framework assertions data-generation functional-testing json json-schema node-js nodejs regression-testing test-automation test-driven-development test-framework testing-framework testing-tools vibranium vibranium-tests

Last synced: 21 Mar 2025

https://github.com/tensorsense/vlm_databuilder

This SDK generates datasets for training Video LLMs from youtube videos.

data-generation data-science llm video-llms vlm

Last synced: 11 Sep 2025

https://github.com/team-enderio/regilite

Registration and Data Generation Utility for NeoForge.

data-generation minecraft minecraft-mod minecraft-neoforge

Last synced: 25 Jul 2025

https://github.com/markusjx/datagen

Random data generator based on JSON schemas

data-generation hacktoberfest json rust test-data-generator

Last synced: 07 Sep 2025

https://github.com/valencian-digital/planter

Blazingly fast data generation for MongoDB

data-generation database mongodb rust seeding

Last synced: 31 Mar 2025

https://github.com/tom-draper/persona

Probabilistic generation of character profiles using real-world demographic data.

api character-creation character-generator data-api data-generation dataset demographic demographics demographics-data fastapi generator probabilistic-models profile profile-builder random-generation rest-api sample story-creation survey

Last synced: 23 Mar 2025

https://github.com/abdur75648/urdu-synth

High-quality synthetic text data generation for Urdu Text Recognition

computer-vision data-generation dataset deep-learning document-analysis icdar icdar2023 machine-learning ocr synthetic-data text-recognition urdu urdu-datasets urdu-nlp urdu-ocr urdu-synth utrnet

Last synced: 15 Mar 2026

https://github.com/datahappy1/dummy_file_generator

Dummy csv, flat text or json files generator written in Python 3.7

csv data-generation data-generator dummy-csv dummy-json dummy-text file-generator flat-file json python python3 txt-files

Last synced: 12 Apr 2025

https://github.com/nfdi4health/docker-vambn

A containerized implementation of the VAMBN approach by TA6.4.

data-generation differential-privacy synthetic-data

Last synced: 20 Feb 2026

https://github.com/cosmincatalin/shaper

DSL for generating basic images

data-generation dsl synthetic-data training-data

Last synced: 16 Jan 2026

https://github.com/fillol/iiot-simulator

An advanced Industrial IoT (IIoT) simulator for Smart Factory 4.0 environments using Python, MQTT, and Docker. Emulates configurable production lines with realistic sensor data (vibration, temperature, quality) and predictive alerts.

data-generation digital-twin docker docker-compose iiot industrial-automation industry-4-0 manufacturing mosquitto mqtt python sensor-simulation simulator smart-factory

Last synced: 04 Aug 2025

https://github.com/psfried/dgen

Generate evil test data

csv data data-generation data-generator language testing-tools

Last synced: 18 Mar 2025

https://github.com/codelion/ellora

Enhancing LLMs with LoRA

accuracy-analysis chain-of-thought chain-of-thought-reasoning data-generation distillation fine-tune fine-tuning fine-tuning-llm finetuning finetuning-llms lora qlora quantization quantization-aware-training reasoning reinforcement-learning self-correction self-distillation supervised-finetuning training

Last synced: 23 Jul 2025

https://github.com/jaehyeon-kim/dynamic-des

Real-time SimPy control plane to dynamically update parameters and stream outputs via external systems like Kafka, Redis, or Postgres. Built for event-driven digital twins.

data-generation descrete-event-simulation digital-twin industry-4 kafka postgres python redis simpy simulation

Last synced: 21 Apr 2026

https://github.com/kaos599/apollo-synthetic-data-generator

Apollo is a Python GUI application designed to simplify the complex process of generating random data based on fixed values. It allows users to generate various types of binary datasets, such as Yes/No type questions, by specifying probabilities.

data data-engineering data-generation data-generator data-science faker-library machine-learning tkinter-gui

Last synced: 22 Jul 2025

https://github.com/dilumdesilva/daugmentor

DAugmentor: Automating Generative Adversarial Network Tuning for Data Augmentation

data-generation deep-learning deep-neural-networks gan

Last synced: 08 May 2026

https://github.com/ihebbelhadj/synthetic-time-series-hr-data

A Python project that transforms a static HR employee snapshot into a rich, historized dataset of event logs, perfect for powering HR analytics and testing ELT/ETL pipelines.

data-generation hr-analytics pandas python simulation timeseries

Last synced: 30 Apr 2026

https://github.com/mtctx/zappy

annotation-processing compile-time data-generation declarative fake-data faker kotlin kotlin-library ksp mock test-automation testing type-safe zappy-pattern-language zpl

Last synced: 30 Oct 2025

https://github.com/cobluestars/dataherd-raika

"Dataherd-Raika is a library designed to simulate large-scale user behavior datasets. It takes a single user event (like a click or keyword input) and, by applying simple probability distributions and custom variables, expands it into a vast dataset."

big-data data data-generation data-generator data-science front-end javascript machine-learning npm-package simulator statistics typescript user-behavior user-experience