https://github.com/data-prep-kit/data-prep-kit

Open source project for data preparation for GenAI applications

code-quality data data-prep data-preparation data-preprocessing data-preprocessing-pipelines datacuration datarecipes deduplication finetuning large-language-models large-scale-data-processing llm llmapps malware python ray spark

Last synced: 11 Feb 2026