{"id":20389514,"url":"https://github.com/getdozer/dozer-python","last_synced_at":"2025-04-12T10:51:54.737Z","repository":{"id":154901586,"uuid":"605948256","full_name":"getdozer/dozer-python","owner":"getdozer","description":null,"archived":false,"fork":false,"pushed_at":"2023-11-03T09:14:59.000Z","size":2870,"stargazers_count":6,"open_issues_count":3,"forks_count":1,"subscribers_count":7,"default_branch":"main","last_synced_at":"2025-03-26T05:41:56.445Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/getdozer.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-02-24T08:53:12.000Z","updated_at":"2024-05-26T17:25:06.000Z","dependencies_parsed_at":null,"dependency_job_id":"d4e8dd11-cde7-44d9-9803-e56ceef7ea78","html_url":"https://github.com/getdozer/dozer-python","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getdozer%2Fdozer-python","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getdozer%2Fdozer-python/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getdozer%2Fdozer-python/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getdozer%2Fdozer-python/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/getdozer","download_url":"https://codeload.github.com/getdozer/dozer-python/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248557844,"owners_count":21124165,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-15T03:18:23.658Z","updated_at":"2025-04-12T10:51:54.718Z","avatar_url":"https://github.com/getdozer.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n    \u003ca target=\"_blank\" href=\"https://getdozer.io/\"\u003e\n        \u003cbr\u003e\u003cimg src=\"https://dozer-assets.s3.ap-southeast-1.amazonaws.com/logo-blue.svg\" width=40%\u003e\u003cbr\u003e\n    \u003c/a\u003e\n\u003c/div\u003e\n\n\u003cp align=\"center\"\u003e\n    \u003cbr /\u003e\n    \u003cb\u003e\n    Connect any data source, combine them in real-time and instantly get low-latency gRPC and REST APIs.\u003cbr\u003e\n    ⚡ All with just a simple configuration! ⚡️\n    \u003c/b\u003e\n\u003c/p\u003e\n\u003cbr /\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/getdozer/dozer/actions/workflows/dozer.yaml\" target=\"_blank\"\u003e\u003cimg src=\"https://github.com/getdozer/dozer/actions/workflows/dozer.yaml/badge.svg\" alt=\"CI\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://coveralls.io/github/getdozer/dozer?branch=main\" target=\"_blank\"\u003e\u003cimg src=\"https://coveralls.io/repos/github/getdozer/dozer/badge.svg?branch=main\u0026t=kZMYaV\u0026style=flat\" alt=\"Coverage Status\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://getdozer.io/docs/dozer\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/doc-reference-green\" alt=\"Docs\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://discord.com/invite/3eWXBgJaEQ\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/join-on%20discord-primary\" alt=\"Join on Discord\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/getdozer/dozer-python/blob/main/LICENSE\" target=\"_blank\"\u003e\u003cimg src=\"https://img.shields.io/badge/license-MIT-informational\" alt=\"License\"\u003e\u003c/a\u003e\n\n\u003c/p\u003e\n\u003cbr\u003e\n\n## Overview\nThis repository is a python wrapper over gRPC APIs that are automatically when you run [Dozer](https://github.com/getdozer/dozer).\n\n## Installation\n\n```bash\npoetry add git+ssh://git@github.com:getdozer/dozer-python.git#main\n\n# or \npip install pydozer\n```\n## Dependencies\n\n- [Dozer](https://github.com/getdozer/dozer)\n- [Poetry](https://python-poetry.org/docs/)\n\n\n### Querying\n\nIntialize Users Endpoint\n```python\napi_client = ApiClient(\"users\")\n\napi_client.query()\n\n# Query using $limit, $order_by, $filter\napi_client.query({\"$limit\": 1})\n\n#Count\napi_client.count()\n```\n\n\ngRPC methods\n```python\napi_client.describe()\n\n#Health\napi_client.health()\n```\n\n\n### Ingestion\n\nInitialize Ingestion Client\n```\nfrom dozer.ingest import IngestClient\ningestion_client = IngestClient()\n```\n\nIngest a data frame\n\n```python\ndf = pl.read_parquet('tests/trips_small.parquet')\ningestion_client.ingest_df('trips', df, seq_no=1)\n```\n\nUse [Arrow Format](https://github.com/apache/arrow) for ingestion\n```python\ningestion_client.ingest_df_arrow('trips', df, seq_no=1)\n```\n\nIngest raw records\n```python\nfrom pydozer.ingest_pb2 import IngestRequest\nfrom pydozer.types_pb2 import Record, Value\n\nuser = IngestRequest(\n    schema_name=\"users\",\n    typ=0,\n    old=None,\n    new=[Value(int_value=1), Value(string_value=\"vivek\")],\n    seq_no=1\n)\ningestor.ingest(user)\n```\n\nIngest in Arrow format\n\nCheck out our [Docs](https://getdozer.io/docs/dozer/) for more information.\n### Testing\n```\npytest\n```\n\n## Contributing\n\nPlease refer to [Contributing](https://getdozer.io/docs/contributing/overview) for more details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgetdozer%2Fdozer-python","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgetdozer%2Fdozer-python","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgetdozer%2Fdozer-python/lists"}