{"id":17924388,"url":"https://github.com/anna-geller/prefect-deployment-patterns","last_synced_at":"2025-06-22T00:34:35.516Z","repository":{"id":49800125,"uuid":"517304626","full_name":"anna-geller/prefect-deployment-patterns","owner":"anna-geller","description":"Code examples showing flow deployment to various types of infrastructure","archived":false,"fork":false,"pushed_at":"2023-01-11T16:58:30.000Z","size":255,"stargazers_count":104,"open_issues_count":1,"forks_count":10,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-19T02:38:56.814Z","etag":null,"topics":["automation","aws","data","data-engineering","data-engineering-infrastructure","data-engineering-pipeline","data-engineering-team","data-products","data-science","dataflow","dataflow-ops","orchestration","pipeline","prefect","python","serverless","serverless-framework"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/anna-geller.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-07-24T11:28:23.000Z","updated_at":"2024-12-19T02:36:39.000Z","dependencies_parsed_at":"2023-02-09T04:00:56.944Z","dependency_job_id":null,"html_url":"https://github.com/anna-geller/prefect-deployment-patterns","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anna-geller%2Fprefect-deployment-patterns","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anna-geller%2Fprefect-deployment-patterns/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anna-geller%2Fprefect-deployment-patterns/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anna-geller%2Fprefect-deployment-patterns/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/anna-geller","download_url":"https://codeload.github.com/anna-geller/prefect-deployment-patterns/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245199094,"owners_count":20576488,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["automation","aws","data","data-engineering","data-engineering-infrastructure","data-engineering-pipeline","data-engineering-team","data-products","data-science","dataflow","dataflow-ops","orchestration","pipeline","prefect","python","serverless","serverless-framework"],"created_at":"2024-10-28T20:48:37.585Z","updated_at":"2025-03-24T02:33:41.472Z","avatar_url":"https://github.com/anna-geller.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# DataflowOps Best Practices \u0026 Examples\nCode examples showing:\n- how to use Prefect\n- flow deployments to various types of infrastructure\n\n## Blog posts about using and deploying Prefect\n- [Declarative Dataflow Deployments with Prefect Make CI/CD a Breeze](https://medium.com/the-prefect-blog/declarative-dataflow-deployments-with-prefect-make-ci-cd-a-breeze-fe77bdbb58d4)\n- [Prefect 2.3.0 adds support for flows defined in Docker Images and GitHub Repositories](https://medium.com/the-prefect-blog/prefect-2-3-0-adds-support-for-flows-defined-in-docker-images-and-github-repositories-79a8797a7371)\n- [Scheduled vs. Event-driven Data Pipelines — Orchestrate Anything with Prefect](https://medium.com/the-prefect-blog/scheduled-vs-event-driven-data-pipelines-orchestrate-anything-with-prefect-b915e6adc3ba)\n- [Event-driven Data Pipelines with AWS Lambda, Prefect and GitHub Actions](https://medium.com/the-prefect-blog/event-driven-data-pipelines-with-aws-lambda-prefect-and-github-actions-b3d9f84b1309)\n- [Serverless Real-Time Data Pipelines on AWS with Prefect, ECS and GitHub Actions](https://medium.com/the-prefect-blog/serverless-real-time-data-pipelines-on-aws-with-prefect-ecs-and-github-actions-1737c80da3f5)\n- [Deploy Prefect Pipelines with Python | by Jeff Hale](https://medium.com/the-prefect-blog/deploy-prefect-pipelines-with-python-perfect-68c944a3a89f)\n- [Orchestrate Your Data Science Project with Prefect 2.0 | by Khuyen Tran](https://medium.com/the-prefect-blog/orchestrate-your-data-science-project-with-prefect-2-0-4118418fd7ce)\n- [Sending Slack Notifications in Python with Prefect | by Khuyen Tran](https://medium.com/the-prefect-blog/sending-slack-notifications-in-python-with-prefect-840a895f81c)\n- [Orchestrating Airbyte with Prefect 2.0 | by Nate Nowack](https://medium.com/the-prefect-blog/orchestrating-airbyte-with-prefect-2-0-35501997a974)\n- [Migrating Databricks Tasks from Prefect 1 to Prefect 2 | by Andrew Huang](https://medium.com/the-prefect-blog/migrating-databricks-tasks-from-prefect-1-to-prefect-2-6f1187145d18)\n\n\n## Repository templates with CI/CD workflows\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=anna-geller\u0026repo=dataflow-ops)](https://github.com/anna-geller/dataflow-ops)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=anna-geller\u0026repo=dataflow-ops-aws-eks)](https://github.com/anna-geller/dataflow-ops-aws-eks)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=anna-geller\u0026repo=prefect-aws-lambda)](https://github.com/anna-geller/prefect-aws-lambda)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=anna-geller\u0026repo=prefect-streaming)](https://github.com/anna-geller/prefect-streaming)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=anna-geller\u0026repo=prefect-docker-deployment)](https://github.com/anna-geller/prefect-docker-deployment)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=rpeden\u0026repo=prefect-docker-compose)](https://github.com/rpeden/prefect-docker-compose)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=khuyentran1401\u0026repo=prefect-mlops-recipes)](https://github.com/khuyentran1401/prefect-mlops-recipes)\n\n[![Readme Card](https://github-readme-stats.vercel.app/api/pin/?username=khuyentran1401\u0026repo=prefect-course)](https://github.com/khuyentran1401/prefect-course)\n\n## Useful Discourse topics\n\n- [Prefect Deployments FAQ](https://discourse.prefect.io/t/prefect-deployments-faq/1467)\n- [Prefect Logging FAQ](https://discourse.prefect.io/t/prefect-logging-faq/1476)\n- [Prefect Agents and Work-Queues FAQ](https://discourse.prefect.io/t/agents-and-work-queues-faq/1468/5)\n\n## Questions?\n\nReach out via [Discourse](https://discourse.prefect.io/) or [Slack](https://prefect.io/slack)\n\n![](img.jpeg)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanna-geller%2Fprefect-deployment-patterns","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fanna-geller%2Fprefect-deployment-patterns","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanna-geller%2Fprefect-deployment-patterns/lists"}