An open API service indexing awesome lists of open source software.

https://github.com/subhamay-cloudworks/0069-celosia-cft

Transfer Data Records (Lambda, DynamoDB, Amazon SQS) - Step Function using AWS CloudFormation
https://github.com/subhamay-cloudworks/0069-celosia-cft

aws-cloudformation aws-cloudwatch aws-iam-policies aws-iam-roles aws-kms aws-lambda-python aws-sns-topic aws-sqs aws-step-functions

Last synced: 9 months ago
JSON representation

Transfer Data Records (Lambda, DynamoDB, Amazon SQS) - Step Function using AWS CloudFormation

Awesome Lists containing this project

README

          

# Project Celosia: A Setp Function Demo - Transfer Data Records (Lambda, DynamoDB, Amazon SQS)

This is a simple demo of an AWS Step function using Lambda, DynamoDB, SQS Queue to show looping within a workflow.

## Description

This is a demo of a step function to loop through a list of items. In the first state a Lambda function inserts some quotes (with is passed as an input) to the DynamoDB table and returns a list of patrtition keys. The state machine then loops through the list and in each iteration fetches the quote from the DynamoDB table and pushes it to a SQS Queue.

The entire stack is created using CloudFormation.

![Project Celosia - Design Diagram](https://subhamay-projects-repository-us-east-1.s3.amazonaws.com/0069-celosia/celosia-architecture-diagram.png?)

![Project Celosia - Services Used](https://subhamay-projects-repository-us-east-1.s3.amazonaws.com/0069-celosia/celosia-services-used-cft.png?)

![Project Celosia - Workflow](https://subhamay-projects-repository-us-east-1.s3.amazonaws.com/0069-celosia/celosia-step-function.png?)

### Installing

* Clone the repository.
* Create a S3 bucket and make it public.
* Create the folders - celosia/cft/nested-stacks, celosia/code
* Upload the following YAML templates to celosia/cft/nested-stacks
* cloudwatch-stack.yaml
* dynamodb-stack.yaml
* iam-role-stack.yaml
* lambda-function-stack.yaml
* sns-stack.yaml
* sqs-stack.yaml
* Upload the following YAML templates to celosia/cft/
* celosia-root-stack.yaml
* Zip and Upload the Python file celosia_code.zip to celosia/code/python
* Create the entire using by using the root stack template celosia-root-stack.yaml and passing the required parameters.

### Executing program

* Go to the Step Function Console and use the sample input and start the execution
* Step-by-step bullets
```
{
"quotes":[
"Age is an issue of mind over matter. If you don't mind, it doesn't matter.- Mark Twain",
"Anyone who stops learning is old, whether at twenty or eighty. Anyone who keeps learning stays young. The greatest thing in life is to keep your mind young.- Henry Ford",
"Wrinkles should merely indicate where smiles have been.- Mark Twain",
"True terror is to wake up one morning and discover that your high school class is running the country.- Kurt Vonnegut",
"A diplomat is a man who always remembers a woman's birthday but never remembers her age.- Robert Frost",
"As I grow older, I pay less attention to what men say. I just watch what they do.- Andrew Carnegie",
"How incessant and great are the ills with which a prolonged old age is replete.- C. S. Lewis",
"Old age, believe me, is a good and pleasant thing. It is true you are gently shouldered off the stage, but then you are given such a comfortable front stall as spectator.- Confucius",
"Old age has deformities enough of its own. It should never add to them the deformity of vice.- Eleanor Roosevelt",
"Nobody grows old merely living a number of years. We grow old deserting our ideals. Years may wrinkle the skin, but to give up enthusiasm wrinkles the soul.- Samuel Ullman",
"An archaeologist is the best husband a woman can have. The older she gets the more interested he is in her.- Agatha Christie",
"All diseases run into one, old age.- Ralph Waldo Emerson",
"Bashfulness is an ornament to youth, but a reproach to old age.- Aristotle",
"Like everyone else who makes the mistake of getting older, I begin each day with coffee and obituaries.- Bill Cosby",
"Age appears to be best in four things old wood best to burn, old wine to drink, old friends to trust, and old authors to read.- Francis Bacon",
"None are so old as those who have outlived enthusiasm.- Henry David Thoreau",
"Every man over forty is a scoundrel.- George Bernard Shaw",
"Forty is the old age of youth fifty the youth of old age.- Victor Hugo",
"You can't help getting older, but you don't have to get old.- George Burns",
"Alas, after a certain age every man is responsible for his face.- Albert Camus",
"Youth is when you're allowed to stay up late on New Year's Eve. Middle age is when you're forced to.- Bill Vaughan",
"Old age is like everything else. To make a success of it, you've got to start young.- Theodore Roosevelt",
"A comfortable old age is the reward of a well-spent youth. Instead of its bringing sad and melancholy prospects of decay, it would give us hopes of eternal youth in a better world.- Maurice Chevalier",
"A man growing old becomes a child again.- Sophocles",
"I will never be an old man. To me, old age is always 15 years older than I am.- Francis Bacon",
"Age considers youth ventures.- Rabindranath Tagore"
]
}
```

## Help

Post message in my blog (https://blog.subhamay.com)

## Authors

Contributors names and contact info

Subhamay Bhattacharyya - [subhamay.aws@gmail.com](https://blog.subhamay.com)

## Reference
https://docs.aws.amazon.com/step-functions/latest/dg/sample-project-transfer-data-sqs.html

## Version History

* 0.1
* Initial Release

## License

None

## Acknowledgments
AWS