https://github.com/anna-geller/prefect-aws-lambda

Deploy a Prefect flow to serverless AWS Lambda function
https://github.com/anna-geller/prefect-aws-lambda

automation aws aws-lambda cicd data-engineering data-engineering-infrastructure data-engineering-pipeline data-science dataflow dataflow-ops event-driven event-driven-architecture lambda pipeline python serverless serverless-framework

Last synced: 16 days ago
JSON representation

Deploy a Prefect flow to serverless AWS Lambda function

• Host: GitHub
• URL: https://github.com/anna-geller/prefect-aws-lambda
• Owner: anna-geller
• License: apache-2.0
• Created: 2022-08-02T02:50:41.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2022-09-27T18:35:51.000Z (about 2 years ago)
• Last Synced: 2023-04-27T19:33:17.394Z (over 1 year ago)
• Topics: automation, aws, aws-lambda, cicd, data-engineering, data-engineering-infrastructure, data-engineering-pipeline, data-science, dataflow, dataflow-ops, event-driven, event-driven-architecture, lambda, pipeline, python, serverless, serverless-framework
• Language: Python
• Homepage:
• Size: 19.5 KB
• Stars: 29
• Watchers: 3
• Forks: 5
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Event-driven Dataflow with AWS Lambda and Prefect

This project demonstrates how to deploy several Prefect flows to serverless AWS Lambda functions.

Some of those are scheduled, others are triggered by S3 put object event - all of that can be easily configured via YAML configuration thanks to the serverless framework.

[Blog post](https://medium.com/the-prefect-blog/event-driven-data-pipelines-with-aws-lambda-prefect-and-github-actions-b3d9f84b1309)