{"id":35649703,"url":"https://github.com/dross20/tuatara","last_synced_at":"2026-01-05T14:04:38.096Z","repository":{"id":315465160,"uuid":"1050827853","full_name":"dross20/tuatara","owner":"dross20","description":"Generates high-quality fine-tuning pairs for large language models (LLMs) from unstructured documents.","archived":false,"fork":false,"pushed_at":"2025-10-05T21:18:18.000Z","size":74,"stargazers_count":0,"open_issues_count":2,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-10-05T23:29:04.740Z","etag":null,"topics":["dataset-generation","fine-tuning","graph","knowledge-extraction","llm","nlp","ocr","python","sft","synthetic-data"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dross20.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-09-05T02:22:10.000Z","updated_at":"2025-10-05T21:18:22.000Z","dependencies_parsed_at":"2025-09-18T20:32:40.556Z","dependency_job_id":"a1859ea5-f243-4def-a175-8fc8fa0e12d0","html_url":"https://github.com/dross20/tuatara","commit_stats":null,"previous_names":["dross20/tuatara"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dross20/tuatara","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dross20%2Ftuatara","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dross20%2Ftuatara/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dross20%2Ftuatara/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dross20%2Ftuatara/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dross20","download_url":"https://codeload.github.com/dross20/tuatara/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dross20%2Ftuatara/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28217171,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2026-01-05T02:00:06.358Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dataset-generation","fine-tuning","graph","knowledge-extraction","llm","nlp","ocr","python","sft","synthetic-data"],"created_at":"2026-01-05T14:02:50.344Z","updated_at":"2026-01-05T14:04:38.089Z","avatar_url":"https://github.com/dross20.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\" style=\"margin-bottom: 0\"\u003e\n  \u003cpicture style=\"display: block; height: auto;\"\u003e\n    \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"https://i.imgur.com/001BRhf.png\"\u003e\n    \u003csource media=\"(prefers-color-scheme: light)\" srcset=\"https://i.imgur.com/X0Qq560.png\"\u003e\n    \u003cimg src=\"https://i.imgur.com/X0Qq560.png\" width=\"200\" style=\"height: auto;\" alt=\"Tuatara logo\"\u003e\u003c/img\u003e\n  \u003c/picture\u003e\n\u003c/p\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n  \u003ca href=\"https://www.python.org/\"\u003e![Static Badge](https://img.shields.io/badge/python-3.9+-green)\u003c/a\u003e\n  \u003ca href=\"https://github.com/dross20/tuatara/blob/main/LICENSE\"\u003e![GitHub license](https://img.shields.io/badge/license-MIT-brown.svg)\u003c/a\u003e\n  \u003ca href=\"https://github.com/astral-sh/ruff\"\u003e![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)\u003c/a\u003e\n\n\u003c/div\u003e\n\n---\n\n\u003cp align=\"center\"\u003e\n\u003cem\u003e\"Artificial intelligence is only as good as the data it learns from.\"\u003c/em\u003e\u003cbr\u003e\n- Unknown\n\u003c/p\u003e\n\n\n## 🦎 What is Tuatara?\n\nTuatara is a library for generating fine-tuning pairs for large language model (LLM) post training.\n\n## 🤔 Why Tuatara?\n\nFine-tuning large language models requires high-quality training data pairs that are well grounded in their source documents. Creating these pairs manually is laborious and error-prone, and existing tools often lack flexibility or fail to scale across different document types and domains. Tuatara addresses these challenges directly.\n\n## 📦 Installation\nRun the following command to install Tuatara:\n\n```sh\npip install git+https://github.com/dross20/tuatara\n```\n\n## 🚀 Quickstart\nThe following example demonstrates how to use Tuatara's preconfigured pipeline for creating fine tuning pairs from multiple documents. By default, `default_pipeline` will use the OpenAI API for LLM inference and search for your OpenAI API key in the environment variables.\n\n```python\nfrom tuatara import default_pipeline\n\ndocuments = [\n  \"./document1.pdf\",\n  \"./document2.pdf\",\n  \"./document3.txt\"\n]\n\npipeline = default_pipeline(model=\"gpt-4o\")\npairs, history = pipeline(documents)\n```\n\n## 📜 License\nThis project is licensed under the [MIT license](https://github.com/dross20/tuatara/blob/2ab8b458f0d6d3109d7e5381c58961c9df992449/LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdross20%2Ftuatara","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdross20%2Ftuatara","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdross20%2Ftuatara/lists"}