{"id":24041821,"url":"https://github.com/quanduongduc/iot-data-tracking","last_synced_at":"2026-04-11T17:39:40.017Z","repository":{"id":229402757,"uuid":"775954338","full_name":"quanduongduc/iot-data-tracking","owner":"quanduongduc","description":"Realtime iot data tracking ","archived":false,"fork":false,"pushed_at":"2024-06-17T04:34:25.000Z","size":10710,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-08T22:12:54.118Z","etag":null,"topics":["aws","dynamodb","ecs","iac","kafka","mosquitto","mqtt","pulumi","python","redis"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/quanduongduc.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-22T11:35:23.000Z","updated_at":"2024-06-09T10:09:55.000Z","dependencies_parsed_at":"2024-05-21T04:41:12.107Z","dependency_job_id":"57024512-5831-4317-bccd-148bb31978b4","html_url":"https://github.com/quanduongduc/iot-data-tracking","commit_stats":null,"previous_names":["quanduongduc/fastapi-ecs","quanduongduc/iot-data-tracking"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanduongduc%2Fiot-data-tracking","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanduongduc%2Fiot-data-tracking/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanduongduc%2Fiot-data-tracking/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quanduongduc%2Fiot-data-tracking/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/quanduongduc","download_url":"https://codeload.github.com/quanduongduc/iot-data-tracking/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240814857,"owners_count":19861958,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","dynamodb","ecs","iac","kafka","mosquitto","mqtt","pulumi","python","redis"],"created_at":"2025-01-08T22:12:40.472Z","updated_at":"2026-04-11T17:39:34.985Z","avatar_url":"https://github.com/quanduongduc.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ca name=\"readme-top\"\u003e\u003c/a\u003e\n\n\u003c!-- PROJECT SHIELDS --\u003e\n\u003c!--\n*** I'm using markdown \"reference style\" links for readability.\n*** Reference links are enclosed in brackets [ ] instead of parentheses ( ).\n*** See the bottom of this document for the declaration of the reference variables\n*** for contributors-url, forks-url, etc. This is an optional, concise syntax you may use.\n*** https://www.markdownguide.org/basic-syntax/#reference-style-links\n--\u003e\n[![Contributors][contributors-shield]][contributors-url]\n[![Forks][forks-shield]][forks-url]\n[![Stargazers][stars-shield]][stars-url]\n[![Issues][issues-shield]][issues-url]\n[![LinkedIn][linkedin-shield]][linkedin-url]\n\n\n\u003c!-- PROJECT LOGO AND TITLE --\u003e\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/quanduongduc/iot-data-tracking\"\u003e\n    \u003cimg src=\"images/logo.png\" alt=\"Logo\" width=\"100\" height=\"100\"\u003e\n  \u003c/a\u003e\n\n  \u003ch2 align=\"center\"\u003eRtdt\u003c/h2\u003e\n  \u003cp align=\"center\"\u003e\n    Real-time Data tracking\n    \u003cbr /\u003e\n    \u003ca href=\"https://github.com/quanduongduc/iot-data-tracking\"\u003e\u003cstrong\u003eCheck the Documentation »\u003c/strong\u003e\u003c/a\u003e\n    \u003cbr /\u003e\n    \u003ca href=\"https://github.com/quanduongduc/iot-data-tracking\"\u003eView a Live Demo\u003c/a\u003e\n    •\n    \u003ca href=\"https://github.com/quanduongduc/iot-data-tracking/issues/new?template=bug_report.md\"\u003eReport a Bug\u003c/a\u003e\n    •\n    \u003ca href=\"https://github.com/quanduongduc/iot-data-tracking/issues/new?template=feature_request.md\"\u003eRequest a Feature\u003c/a\u003e\n  \u003c/p\u003e\n\u003c/p\u003e\n\n\u003c!-- TABLE OF CONTENTS --\u003e\n\u003cdetails open=\"open\"\u003e\n  \u003csummary\u003eTable of Contents\u003c/summary\u003e\n  \u003col\u003e\n    \u003cli\u003e\u003ca href=\"#about\"\u003eAbout This Project\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#start\"\u003eGetting Started\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#use\"\u003eUsage Guidelines\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#todos-section\"\u003eTODOS\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#contrib-section\"\u003eContribution Guidelines\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#contact-section\"\u003eContact Details\u003c/a\u003e\u003c/li\u003e\n  \u003c/ol\u003e\n\u003c/details\u003e\n\n\u003c!-- ABOUT THE PROJECT --\u003e\n## \u003ca name=\"about\"\u003e\u003c/a\u003eAbout This Project\n![image](https://github.com/quanduongduc/iot-data-tracking/assets/59951771/0e5e9237-5c3f-46c1-a001-d43b50afd1c2)\n\n[🔝 Back to Top](#readme-top-anchor)\n\n\u003c!-- GETTING STARTED --\u003e\n## \u003ca name=\"start\"\u003e\u003c/a\u003eGetting Started\n\nTo get the project up and running \n**Prerequisite**\n\nBefore proceeding, ensure you meet the following requirements:\n\n1. Add your AWS credentials to the AWS configuration.\n1. Install Pulumi. You can find installation instructions [here](https://www.pulumi.com/docs/get-started/install/).\n3. Install the dependencies listed in `requirements/local.txt`.\n\n**Usage**\n\nOnce you've fulfilled these prerequisites, you can proceed with deploying the infrastructure using Pulumi.\nTo deploy the infrastructure, you need to have Pulumi installed and configured with your AWS credentials. Then, you can run the following command in the infrastructure directory:\n\nThis command will preview the changes to be made and, after confirmation, apply the changes. You can see the status of your stack at any time with the `pulumi stack` command.\n\n```\ncmd pulumi up\n```\n\n**Topology**\n\n![image](https://github.com/quanduongduc/iot-data-tracking/assets/59951771/73440cc0-1029-4c86-ac4a-b89a978f9860)\n\n### Setting up:\n\n* Install the required tools:\n\n\n\u003c!-- TODOS --\u003e\n## \u003ca name=\"todos-section\"\u003e\u003c/a\u003eTo-Do List\n- [x] Change to Fargate\n- [x] Use SPOT instances with robust unavailability management for saving cost\n- [ ] Replace the NAT with VPC endpoints\n- [ ] Adopt Spark for data processor (Experiment only)\n- [ ] Try Kafka source and sink connectors (Experiment only)\n\n\n\u003c!-- MARKDOWN LINKS \u0026 IMAGES --\u003e\n\u003c!-- https://www.markdownguide.org/basic-syntax/#reference-style-links --\u003e\n[contributors-shield]: https://img.shields.io/github/contributors/othneildrew/Best-README-Template.svg?style=for-the-badge\n[contributors-url]: https://github.com/quanduongduc/iot-data-tracking/graphs/contributors\n[forks-shield]: https://img.shields.io/github/forks/othneildrew/Best-README-Template.svg?style=for-the-badge\n[forks-url]: https://github.com/quanduongduc/iot-data-tracking/network/members\n[stars-shield]: https://img.shields.io/github/stars/othneildrew/Best-README-Template.svg?style=for-the-badge\n[stars-url]: https://github.com/quanduongduc/iot-data-tracking/stargazers\n[issues-shield]: https://img.shields.io/github/issues/othneildrew/Best-README-Template.svg?style=for-the-badge\n[issues-url]: https://github.com/quanduongduc/iot-data-tracking/issues\n[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge\u0026logo=linkedin\u0026colorB=555\n[linkedin-url]: https://linkedin.com\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquanduongduc%2Fiot-data-tracking","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquanduongduc%2Fiot-data-tracking","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquanduongduc%2Fiot-data-tracking/lists"}