https://github.com/pogzyb/flask-elk-and-localstack

Sample Flask application with JSON logging, Elasticsearch, and the AWS services Kinesis, Lambda, SQS, SES, and DynamoDB (via localstack)
https://github.com/pogzyb/flask-elk-and-localstack

boilerplate-application elk flask kinesis localstack sqs

Last synced: 25 days ago
JSON representation

Sample Flask application with JSON logging, Elasticsearch, and the AWS services Kinesis, Lambda, SQS, SES, and DynamoDB (via localstack)

• Host: GitHub
• URL: https://github.com/pogzyb/flask-elk-and-localstack
• Owner: pogzyb
• Created: 2020-02-07T20:15:01.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2023-09-26T11:39:03.000Z (about 1 year ago)
• Last Synced: 2023-09-26T14:32:07.814Z (about 1 year ago)
• Topics: boilerplate-application, elk, flask, kinesis, localstack, sqs
• Language: Python
• Homepage:
• Size: 16.2 MB
• Stars: 5
• Watchers: 3
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
Building Apps with Flask, ELK, and Localstack

---

![Repo-Overview](docs/img/flask-elk-localstack.png)

#### I. Overview

This repo contains a simple "Wikipedia Scraper" application. What it does is not necessarily

important as this code and framework could be applied to any business problem. The purpose is to 

showcase how the different components of the app can leverage AWS services via `localstack` such as:

- SQS (Simple Queue Service) for distributing messages

- SES (Simple Email Service) for emailing users

- DynamoDB for storing "scraper task" results

- Kinesis for real-time event processing

- Lambda for handling events

Moreover, the application utilizes various Flask "plugin" modules such as:

- `Flask-Caching` for interacting with Redis

- ~~`Flask-Compress` for faster template loads~~

- `Flask-Login` for user login management

- `Flask-Migrate` for data and schema migrations

- `Flask-SocketIO` for client/server polling

- `Flask-SQLAlchemy` as a database ORM

#### II. Todo:

- ~~Add Flask Migrate~~

- ~~Add socketio polling~~

- Add css and js "Bundles"

- Integrate with ELK stack

- ~~Add User "roles"~~

- Implement Caching with Redis

  - Session cache tokens

- Upgrade UI to Bootstrap v5.0

    - v5 form validation

    - ~~flash message alerts~~

- ~~Implement Kinesis streams~~

- Create Lambda to further process results