{"id":21721376,"url":"https://github.com/informaticsmatters/data-manager-job-template","last_synced_at":"2026-02-25T14:40:28.902Z","repository":{"id":80604799,"uuid":"484535068","full_name":"InformaticsMatters/data-manager-job-template","owner":"InformaticsMatters","description":"Template repo for Data Manager Job implementations","archived":false,"fork":false,"pushed_at":"2024-08-15T11:02:33.000Z","size":75,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-06-02T16:10:14.439Z","etag":null,"topics":["squonk2-jobs"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/InformaticsMatters.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-04-22T18:31:51.000Z","updated_at":"2023-09-13T14:40:47.000Z","dependencies_parsed_at":null,"dependency_job_id":"522602b9-35f8-44ac-9832-f90e595cb03d","html_url":"https://github.com/InformaticsMatters/data-manager-job-template","commit_stats":null,"previous_names":[],"tags_count":3,"template":true,"template_full_name":null,"purl":"pkg:github/InformaticsMatters/data-manager-job-template","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InformaticsMatters%2Fdata-manager-job-template","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InformaticsMatters%2Fdata-manager-job-template/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InformaticsMatters%2Fdata-manager-job-template/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InformaticsMatters%2Fdata-manager-job-template/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/InformaticsMatters","download_url":"https://codeload.github.com/InformaticsMatters/data-manager-job-template/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InformaticsMatters%2Fdata-manager-job-template/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265801583,"owners_count":23830438,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["squonk2-jobs"],"created_at":"2024-11-26T02:16:11.130Z","updated_at":"2025-10-25T22:20:11.854Z","avatar_url":"https://github.com/InformaticsMatters.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# data-manager-job-template\n\n![Data Manager Job: 2021.1](https://img.shields.io/badge/data%20manager%20job-2021.1-000000?labelColor=dc332e)\n\n```\nFORK THIS REPOSITORY\nAND REPLACE THE FOLLOWING\nWITH YOUR OWN README/JOB DOCUMENTATION\n```\n\n![Architecture](https://img.shields.io/badge/architecture-amd64%20%7C%20arm64-lightgrey)\n\n[![build](https://github.com/InformaticsMatters/data-manager-job-template/actions/workflows/build.yaml/badge.svg)](https://github.com/InformaticsMatters/data-manager-job-template/actions/workflows/build.yaml)\n[![publish-tag](https://github.com/InformaticsMatters/data-manager-job-template/actions/workflows/publish-tag.yaml/badge.svg)](https://github.com/InformaticsMatters/data-manager-job-template/actions/workflows/publish-tag.yaml)\n[![publish-stable](https://github.com/InformaticsMatters/data-manager-job-template/actions/workflows/publish-stable.yaml/badge.svg)](https://github.com/InformaticsMatters/data-manager-job-template/actions/workflows/publish-stable.yaml)\n\n![GitHub](https://img.shields.io/github/license/informaticsmatters/data-manager-job-template)\n\n![GitHub tag (latest SemVer)](https://img.shields.io/github/v/tag/informaticsmatters/data-manager-job-template)\n\nA GitHub Template Repository that you can [use] for Data Manager Job\nimplementations.\n\nThis repository is a minimal template for Data Manager Jobs. Although it contains\nscaffolding to test and build a Python-based Job, including GitHub actions to\nbuild and publish the implementation container image you can replace the\n`src` files and associated `Dockerfile` to support any language you choose.\nUltimately the Job is published as a container image, you simply have to\nprovide the implementation and a suitable `data-manager/jobs.yaml`\ndefinition.\n\nFrom a fork you should be able to build and run the tests for the example\nJob that it defines, start with this, and you'll know you're starting with\na working framework: -\n\n    python -m venv venv\n    source venv/bin/activate\n    python -m pip install -r build-requirements.txt\n\n    docker-compose build\n    jote\n\n    deactivate   \n\n\u003e Note: You MUST provide at least one test for every Job your repository\ndefines, and you MUST use our Job Tester ([im-jote]) to run those tests -\nit's what we will use and if it fails the Job Tester we are unlikely\nto deploy the image.\n\nYou must have at least one manifest file and at least one job definition file.\nThis template contains a single working example.\n\nAs well as replacing this README with your own you will want to\nadjust the following additional files: -\n\n1. `DEVELOPER-READEM.md` to name the repository you've forked to\n2. `data-manager/manifest.yaml`\n3. `data-manager/job.yaml`\n4. The GitHub Actions, which expects repository secrets `DOCKERHUB_USERNAME`\n   and `DOCKERHUB_TOKEN`\n5. Adjust the `.gitignore` to satisfy your won tooling\n6. Add tests (and test data)\n\n## ARM64 (M1) processor support\nTo assist in local execution on the ARM64 (Apple M1) series of processors\nyour job container image must compile for its architecture. The GitHub actions\nsupplied in this template do that for you by employing the Docker [buildx]\nactions.\n\nYou can test that your intended mage builds for the ARM64 processor using the\nnotes in this public [buildx gist].\n\n---\n\n[buildx]: https://docs.docker.com/buildx/working-with-buildx\n[buildx gist]: https://gist.github.com/alanbchristie/14da3444f3fed6f0adcf877a82b56804.js\n[im-jote]: https://pypi.org/project/im-jote\n[use]: https://docs.github.com/en/repositories/creating-and-managing-repositories/creating-a-repository-from-a-template\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finformaticsmatters%2Fdata-manager-job-template","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finformaticsmatters%2Fdata-manager-job-template","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finformaticsmatters%2Fdata-manager-job-template/lists"}