https://github.com/steinfletcher/step-function-workers
An example of a fork join workflow using AWS Step Functions, Go and Terraform
https://github.com/steinfletcher/step-function-workers
aws aws-lambda golang step-functions terraform
Last synced: about 2 months ago
JSON representation
An example of a fork join workflow using AWS Step Functions, Go and Terraform
- Host: GitHub
- URL: https://github.com/steinfletcher/step-function-workers
- Owner: steinfletcher
- Created: 2020-05-24T21:48:25.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2021-07-07T10:15:57.000Z (almost 5 years ago)
- Last Synced: 2025-03-28T10:12:44.560Z (about 1 year ago)
- Topics: aws, aws-lambda, golang, step-functions, terraform
- Language: HCL
- Homepage:
- Size: 9.37 MB
- Stars: 3
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Dynamic parallelism using AWS Step Functions
This repo contains an example of a simple fork join process using lambda and step functions.
The controller will generate "work", where each "work" item is processed by a worker. The worker will output the processed result, then the collector will consume the result of each worker and produce a final aggregated result.
## Run the examples
This assumes you are using the default AWS profile.
### Terraform
Enter the tf directory and run terraform plan/apply, e.g.
```sh
cd tf
terraform init
terraform plan
terraform apply
```
### Deploy lambdas
Edit the `artifacts_s3_bucket_name` variable in the `scripts/deploy.sh` file to refer to a bucket you own.
```sh
make build && make deploy
```