{"id":40665197,"url":"https://github.com/fdmorison/tiozin","last_synced_at":"2026-04-26T03:01:27.392Z","repository":{"id":333790490,"uuid":"1107143403","full_name":"fdmorison/tiozin","owner":"fdmorison","description":"Tiozin, your friendly ETL framework","archived":false,"fork":false,"pushed_at":"2026-04-20T01:42:04.000Z","size":10800,"stargazers_count":6,"open_issues_count":1,"forks_count":2,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-04-20T02:42:12.992Z","etag":null,"topics":["data","declarative","etl","framework","pipeline"],"latest_commit_sha":null,"homepage":"https://pypi.org/project/tiozin/","language":"Python","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fdmorison.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"docs/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":"agents.md","dco":null,"cla":null}},"created_at":"2025-11-30T16:58:10.000Z","updated_at":"2026-04-20T01:40:58.000Z","dependencies_parsed_at":null,"dependency_job_id":"06b4230a-0444-4cc0-bc09-9758b3b45358","html_url":"https://github.com/fdmorison/tiozin","commit_stats":null,"previous_names":["fdmorison/tiozin"],"tags_count":7,"template":false,"template_full_name":null,"purl":"pkg:github/fdmorison/tiozin","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fdmorison%2Ftiozin","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fdmorison%2Ftiozin/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fdmorison%2Ftiozin/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fdmorison%2Ftiozin/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fdmorison","download_url":"https://codeload.github.com/fdmorison/tiozin/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fdmorison%2Ftiozin/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32284333,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-25T18:29:39.964Z","status":"online","status_checked_at":"2026-04-26T02:00:05.962Z","response_time":129,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","declarative","etl","framework","pipeline"],"created_at":"2026-01-21T09:08:04.788Z","updated_at":"2026-04-26T03:01:27.385Z","avatar_url":"https://github.com/fdmorison.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Tiozin\n\n\u003cp align=\"center\"\u003e\n  \u003cimg\n    src=\"https://raw.githubusercontent.com/fdmorison/tiozin/main/docs/img/tiozin.png\"\n    alt=\"Tiozin - Your friendly ETL framework\"\n  /\u003e\n\u003c/p\u003e\n\n---\n\nETL shouldn't require 80 files, 50 YAMLs, and a PhD in complexity.\n\nTiozin brings it back to basics: **Transform. Input. Output.** Nothing more, nothing less.\n\nA lightweight Python framework that makes data jobs declarative, testable, and actually enjoyable to write.\n\n## Philosophy\n\nYour uncle's advice: keep it simple, readable, and testable.\n\nTiozin is built around a small set of principles that are not features but constraints that shape the design.\n\n- **Declarative**: Define what, not how\n- **Pluggable**: Swap runners, registries, and plugins when needed\n- **Metadata-native**: Execution and metadata walk together\n- **Observable**: Logs that actually help\n- **Testable**: Mock anything, validate everything\n\n## One-Minute Example\n\n```bash\npip install tiozin\n```\n\n**Define a declarative job**\n\n```yaml\nkind: LinearJob\nname: example_job\nowner: tiozin@tiozin.com\nmaintainer: tiozin\ncost_center: tio_scrooge\n\norg: tiozin\nregion: latam\ndomain: marketing\nsubdomain: campaigns\nlayer: refined\nproduct: users\nmodel: customers\n\nrunner:\n  kind: NoOpRunner\n  name: postgres\n  log_level: \"{{ ENV.LOG_LEVEL }}\"\n  db_url: postgres://user:{{ SECRET.FAKE_PASSWORD }}@host:5432/dbname\n\ninputs:\n  - kind: NoOpInput\n    name: load_it\n    layer: raw\n    path: .output/lake-{{domain}}-{{layer}}/{{product}}/{{model}}/date={{ DAY[-1] }}\n\ntransforms:\n  - kind: NoOpTransform\n    name: process_it\n    strategy: sha256\n\noutputs:\n  - kind: NoOpOutput\n    name: save_it\n    path: .output/lake-{{domain}}-{{layer}}/{{product}}/{{model}}/{{ today }}\n```\n\nRun it:\n\n```bash\n$ tiozin run examples/jobs/dummy.yaml\n```\n\n**Using Python directly**\n\n```python\nfrom tiozin import TiozinApp\n\napp = TiozinApp()\napp.run(\"examples/jobs/dummy.yaml\")\n```\nDone. No ceremony, no boilerplate.\n\n## Who is Tiozin for?\nTiozin is human-readable and machine-generatable:\n\n- Data engineers who want reusable pipeline components\n- Teams that value declarative jobs\n- Projects that require testable ETL logic\n- Pipelines where metadata is connected to the execution model\n- Teams leveraging AI agents 🤖 to author and maintain data jobs\n\n## Documentation\n\n### Writing Declarative Jobs\n- [Quick Start](https://github.com/fdmorison/tiozin/blob/main/docs/quick-start.md)\n- [Working with Jobs](https://github.com/fdmorison/tiozin/blob/main/docs/working-with-jobs.md)\n- [Examples](https://github.com/fdmorison/tiozin/blob/main/docs/examples.md)\n\n### Concepts\n- [Family Model: Tios and Tiozins](https://github.com/fdmorison/tiozin/blob/main/docs/concepts/family.md)\n- [Jobs](https://github.com/fdmorison/tiozin/blob/main/docs/concepts/jobs.md)\n- [Runners](https://github.com/fdmorison/tiozin/blob/main/docs/concepts/runners.md)\n- [Inputs, Transforms \u0026 Outputs](https://github.com/fdmorison/tiozin/blob/main/docs/concepts/steps.md)\n- [Registries](https://github.com/fdmorison/tiozin/blob/main/docs/concepts/registries.md)\n\n### Extending Tiozin\n- [Creating a Provider Family](https://github.com/fdmorison/tiozin/blob/main/docs/extending/families.md)\n- [Creating Pluggable Tiozins](https://github.com/fdmorison/tiozin/blob/main/docs/extending/tiozins.md)\n- [Tio Proxy: Adding Cross Cutting Family Features](https://github.com/fdmorison/tiozin/blob/main/docs/extending/proxies.md)\n- [Tio Kernel - The Core Family](https://github.com/fdmorison/tiozin/blob/main/docs/tio_kernel/index.md)\n- [Tio Spark - Spark Family Example](https://github.com/fdmorison/tiozin/blob/main/docs/tio_spark/index.md)\n- [Tio Duckdb - DuckDB Family Example](https://github.com/fdmorison/tiozin/blob/main/docs/tio_duckdb/index.md)\n\n### How-to Guides\n- [How to Configure OpenLineage](https://github.com/fdmorison/tiozin/blob/main/docs/how-to/openlineage.md)\n- [How to Use Schemas in Jobs](https://github.com/fdmorison/tiozin/blob/main/docs/how-to/schemas.md)\n- [How to Use Secrets in Jobs](https://github.com/fdmorison/tiozin/blob/main/docs/how-to/secrets.md)\n\n### Reference\n- [Settings Reference: tiozin.yaml](https://github.com/fdmorison/tiozin/blob/main/docs/settings.md)\n- [Templates Reference](https://github.com/fdmorison/tiozin/blob/main/docs/templates.md)\n- [API Reference](https://github.com/fdmorison/tiozin/blob/main/docs/api.md)\n\n## Contributing\n\nContributions are welcome! See [CONTRIBUTING.md](https://github.com/fdmorison/tiozin/blob/main/docs/CONTRIBUTING.md) for guidelines.\n\n## License\n\nThis project is licensed under the [Mozilla Public License 2.0](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffdmorison%2Ftiozin","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffdmorison%2Ftiozin","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffdmorison%2Ftiozin/lists"}