{"id":25689368,"url":"https://github.com/zcemycl/systemdeploy","last_synced_at":"2026-02-18T19:03:08.513Z","repository":{"id":114281898,"uuid":"601366708","full_name":"zcemycl/systemDeploy","owner":"zcemycl","description":"Build systems based on containisation and cloud infrastructure.","archived":false,"fork":false,"pushed_at":"2025-11-24T18:55:35.000Z","size":5590,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-12-30T05:14:13.975Z","etag":null,"topics":["application-load-balancer","aws","azure","bicep","docker","docker-compose","dynamodb","ecr","ecs","grafana","helm","kubernetes","prometheus","python","rds","route53","sagemaker","terraform","typescript","vpn"],"latest_commit_sha":null,"homepage":"","language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zcemycl.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-02-13T23:05:02.000Z","updated_at":"2025-11-24T18:55:39.000Z","dependencies_parsed_at":"2023-09-04T06:01:55.713Z","dependency_job_id":"48f17317-8262-450c-8a77-fa6e64406328","html_url":"https://github.com/zcemycl/systemDeploy","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/zcemycl/systemDeploy","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zcemycl%2FsystemDeploy","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zcemycl%2FsystemDeploy/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zcemycl%2FsystemDeploy/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zcemycl%2FsystemDeploy/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zcemycl","download_url":"https://codeload.github.com/zcemycl/systemDeploy/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zcemycl%2FsystemDeploy/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29590684,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-18T18:54:29.675Z","status":"ssl_error","status_checked_at":"2026-02-18T18:50:50.517Z","response_time":162,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["application-load-balancer","aws","azure","bicep","docker","docker-compose","dynamodb","ecr","ecs","grafana","helm","kubernetes","prometheus","python","rds","route53","sagemaker","terraform","typescript","vpn"],"created_at":"2025-02-24T22:01:07.494Z","updated_at":"2026-02-18T19:03:08.476Z","avatar_url":"https://github.com/zcemycl.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"# System Deployments\n\n## Tech stack\n1. AWS + Terraform\n    ```mermaid\n    flowchart LR;\n        subgraph A[VPC];\n            subgraph AA[Public Subnet]\n            end\n            subgraph AB[Private Subnet]\n                direction LR;\n                subgraph ABA[Fargate]\n                    direction TB;\n                    ABA1[ECS]\n                    ABA2[ECS]\n                    ABA3[ECS]\n                end\n                ABB[NLB] --\u003e ABA;\n                ABC[APIGW] --\u003e ABB;\n            end\n            AC[Internet Gateway] --\u003e AA;\n            AA --\u003e AD[NAT];\n            AD --\u003e AB;\n        end;\n        B[ECR] --\u003e AC;\n        C[Cognito] --\u003e AC;\n    ```\n2. Azure bicep\n    ```mermaid\n    flowchart LR;\n        subgraph B[Azure Cloud]\n            direction TB;\n            B1[ACR];\n            B2[Key Vault];\n            subgraph BA[Container Apps]\n                BA1[frontend] --\u003e BA2[backend];\n            end\n            subgraph BB[Serverless]\n                BB1[EventGrid] --\u003e BB2[Function Apps];\n                BB2 --\u003e BB3[OCR];\n            end\n            subgraph BC[Storage]\n                BC1[Blob]\n                BC2[CosmosDB]\n            end\n            B1 --\u003e BA;\n            BA --\u003e BC;\n            BC --\u003e BA;\n            BC --\u003e BB;\n            BB --\u003e BC;\n            BB --\u003e BA2;\n        end\n        subgraph A[Azure Devops]\n            subgraph AA[Repository]\n                subgraph AAA[CICD Pipeline]\n                    AAA1[CI Testings]\n                end\n                AAA --\u003e|package| AAB[Artefacts]\n\n            end\n        end\n        A --\u003e|docker image| B1;\n        A --\u003e|iac| B;\n        BA2 --\u003e|install package| A;\n        C((User)) --\u003e BA1;\n    ```\n3. Dockers + Helm + Kubernetes\n    ```mermaid\n    flowchart LR;\n        subgraph AA[Node]\n            direction LR;\n            subgraph A[Deployment]\n                A1[Pod];\n                A2[Pod];\n                A3[Pod];\n            end\n        end\n        B[NodeIP] --\u003e AA;\n    ```\n4. Google Cloud Platform\n    ```mermaid\n    flowchart LR;\n        A[Artifact Registry] --\u003e B[Cloud Run];\n    ```\n5. FastAPI + Prometheus + Grafana\n    ```mermaid\n    flowchart LR;\n        A[FastAPI] --\u003e|/metrics| B[Prometheus];\n        B --\u003e C[Grafana]\n    ```\n    ![fastapi-prometheus-grafana](docs/resources/grafana_fastapi_prometheus.png)\n\n## Archive\n- API calls\n    ```mermaid\n    sequenceDiagram\n        participant app;\n        participant api;\n        participant location_api;\n        participant sensor_api;\n        participant prediction_api;\n        Note over app: requirements \u003cbr\u003e- delay: 2s;\n        app-\u003e\u003e+api: GET;\n        Note over location_api: \u003cbr\u003e- endpoint: /location \u003cbr\u003e- delay: 0.5s;\n        api-\u003e\u003e+location_api: GET /location;\n        location_api--\u003e\u003e-api: return (lat,lng);\n        Note over sensor_api: \u003cbr\u003e- endpoint: /sensor \u003cbr\u003e- delay: 2s;\n        api-\u003e\u003e+sensor_api: GET /sensor?lat,lng;\n        sensor_api--\u003e\u003e-api: return (timestamp, sensor_data);\n        Note over prediction_api: \u003cbr\u003e- endpoint: /predict \u003cbr\u003e- delay: 4s;\n        api-\u003e\u003e+prediction_api: GET /sensor?lat,lng,sensor_data;\n        prediction_api--\u003e\u003e-api: return (prediction_data);\n        api--\u003e\u003e-app: ;\n    ```\n- MLOps\n    ```mermaid\n    flowchart TB;\n        subgraph A[Continuous Integration]\n            direction TB\n            subgraph AA[Data]\n                AAB[Database] --- AAA[Artefacts];\n            end\n            subgraph AB[Preprocessing]\n                ABA[Exploration] --\u003e ABB[Processing];\n                ABB--\u003eABC[Feature Extraction];\n            end\n            subgraph AC[Model]\n                ACA[Model Selection]--\u003eACB[Train];\n                ACB--\u003eACC[Validate];\n                ACC--\u003eACD[Model Registration];\n                ACD--\u003eACA;\n            end\n            AA--\u003e|batch/stream processing|AB;\n            AB--\u003e|features|AA;\n            AC--\u003e|model artefacts|AA;\n            AA--\u003eAC;\n        end\n        a((client));\n        a--\u003e|raw data|AA;\n        subgraph B[Continuous Deployment]\n            direction LR\n            subgraph BA[Deploy]\n                BAA[Containers]--\u003eBAB[Servers];\n                BAB--\u003eBAC[Load Balancer] \u0026 BAD[Logging];\n            end\n            subgraph BB[Monitoring]\n                BBA[Visualisation Tool];\n            end\n            BAD--\u003eBBA;\n        end\n        AC--\u003eB;\n        B--\u003e|endpoints, kpis|a;\n    ```\n    |Role|Responsibilities|\n    |---|---|\n    |Data engineer|Data, Preprocessing|\n    |Data scientist|Preprocessing, Model|\n    |ML engineer|Preprocessing, Model, Deploy|\n    |Devops|Deploy, Monitoring|\n\n    |Responsibility|Skills|\n    |---|---|\n    |Data|SQL, Postgresql, Pgadmin, SQLAlchemy, SQLModel, Alembic|\n    |Preprocessing|Spark, Pandas, Databricks|\n    |Model|Tensorflow, Pytorch, MLflow|\n    |Deploy|FastAPI, Tensorflow, Pytorch, Prometheus|\n    |Monitoring|Prometheus, Grafana|\n\n- Kafka Broker and Database Crash\n    ```mermaid\n    flowchart LR;\n        A[Collectors]--\u003eB[Kafka Broker];\n        subgraph C[Workers]\n            C1[Worker1];\n            C2[Worker2];\n        end\n        B--\u003e|work1 topic|C1;\n        B--\u003e|work2 topic|C2;\n        subgraph D[Database]\n            D1[Table1];\n            D2[Table2];\n        end\n        C1--\u003e|1. write|D1;\n        D--\u003e|2. crash|D;\n        C2--\u003e|3. disconnect, can't write|D2;\n    ```\n    ```mermaid\n    ---\n    displayMode: compact\n    ---\n    gantt\n        title Workers Timetable\n        dateFormat HH:mm\n        axisFormat %H:%M\n        tickInterval 1hour\n\n        section Worker 1\n        w1: a1, 00:20, 15m\n        w1: a1, 02:20, 15m\n        w1: a1, 04:20, 15m\n        w1: a1, 06:20, 15m\n        w1: a1, 08:20, 15m\n        w1: a1, 10:20, 15m\n\n        section Worker 2\n        w2: a2, 00:00, 1h\n        w2: a2, 04:00, 1h\n        w2: a2, 08:00, 1h\n    ```\n\n## Others\n1. Compnay Hierarchy\n    ```mermaid\n    flowchart TB;\n        A[root]--\u003eB;\n        subgraph B[scope];\n            direction TB;\n                B1[service-publisher];\n                B2[infra-builder];\n                B3[developer];\n        end\n\n        subgraph C[service];\n            direction TB\n                C1[ecr];\n                C2[ecs];\n                C3[s3];\n        end\n\n        E[(credentials)];\n        F[(AWS Management Console)];\n\n        D[Leo]--\u003eB3;\n        B1 --\u003e|push| C1;\n        B2 --\u003e|build| C1 \u0026 C2 \u0026 C3;\n        B3 --\u003e|read| C1 \u0026 C3;\n        D --\u003e E;\n        B1 --\u003e E;\n        B2 --\u003e E;\n        D \u0026 A --\u003e|access| F;\n    ```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzcemycl%2Fsystemdeploy","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzcemycl%2Fsystemdeploy","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzcemycl%2Fsystemdeploy/lists"}