https://github.com/quanduongduc/iot-data-tracking

Realtime iot data tracking
https://github.com/quanduongduc/iot-data-tracking

aws dynamodb ecs iac kafka mosquitto mqtt pulumi python redis

Last synced: 20 days ago
JSON representation

Realtime iot data tracking

• Host: GitHub
• URL: https://github.com/quanduongduc/iot-data-tracking
• Owner: quanduongduc
• Created: 2024-03-22T11:35:23.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-06-09T10:09:54.000Z (8 months ago)
• Last Synced: 2024-06-10T04:37:33.042Z (8 months ago)
• Topics: aws, dynamodb, ecs, iac, kafka, mosquitto, mqtt, pulumi, python, redis
• Language: Python
• Homepage:
• Size: 10.2 MB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        


[![Contributors][contributors-shield]][contributors-url]

[![Forks][forks-shield]][forks-url]

[![Stargazers][stars-shield]][stars-url]

[![Issues][issues-shield]][issues-url]

[![LinkedIn][linkedin-shield]][linkedin-url]



  

    

  

  
Rtdt

  


    Real-time Data tracking

    


    Check the Documentation »

    


    View a Live Demo

    •

    Report a Bug

    •

    Request a Feature

  


  Table of Contents

  


    
About This Project

    
Getting Started

    
Usage Guidelines

    
TODOS

    
Contribution Guidelines

    
Contact Details

  


## About This Project

![image](https://github.com/quanduongduc/iot-data-tracking/assets/59951771/0e5e9237-5c3f-46c1-a001-d43b50afd1c2)

[🔝 Back to Top](#readme-top-anchor)

## Getting Started

To get the project up and running 

**Prerequisite**

Before proceeding, ensure you meet the following requirements:

1. Add your AWS credentials to the AWS configuration.

1. Install Pulumi. You can find installation instructions [here](https://www.pulumi.com/docs/get-started/install/).

3. Install the dependencies listed in `requirements/local.txt`.

**Usage**

Once you've fulfilled these prerequisites, you can proceed with deploying the infrastructure using Pulumi.

To deploy the infrastructure, you need to have Pulumi installed and configured with your AWS credentials. Then, you can run the following command in the infrastructure directory:

This command will preview the changes to be made and, after confirmation, apply the changes. You can see the status of your stack at any time with the `pulumi stack` command.

```

cmd pulumi up

```

**Topology**

![image](https://github.com/quanduongduc/iot-data-tracking/assets/59951771/73440cc0-1029-4c86-ac4a-b89a978f9860)

### Setting up:

* Install the required tools:

## To-Do List

- [x] Change to Fargate

- [x] Use SPOT instances with robust unavailability management for saving cost

- [ ] Replace the NAT with VPC endpoints

- [ ] Adopt Spark for data processor (Experiment only)

- [ ] Try Kafka source and sink connectors (Experiment only)

[contributors-shield]: https://img.shields.io/github/contributors/othneildrew/Best-README-Template.svg?style=for-the-badge

[contributors-url]: https://github.com/quanduongduc/iot-data-tracking/graphs/contributors

[forks-shield]: https://img.shields.io/github/forks/othneildrew/Best-README-Template.svg?style=for-the-badge

[forks-url]: https://github.com/quanduongduc/iot-data-tracking/network/members

[stars-shield]: https://img.shields.io/github/stars/othneildrew/Best-README-Template.svg?style=for-the-badge

[stars-url]: https://github.com/quanduongduc/iot-data-tracking/stargazers

[issues-shield]: https://img.shields.io/github/issues/othneildrew/Best-README-Template.svg?style=for-the-badge

[issues-url]: https://github.com/quanduongduc/iot-data-tracking/issues

[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555

[linkedin-url]: https://linkedin.com