{"id":25838041,"url":"https://github.com/wfamous/fiv_update-data","last_synced_at":"2026-02-17T21:01:56.042Z","repository":{"id":260672647,"uuid":"871673941","full_name":"wfamous/fiv_update-data","owner":"wfamous","description":"This project automates the retrieval, processing, and publishing of digital product data for our Shopify store. It integrates Google Cloud Platform (GCP), Amazon Web Service (AWS), Terraform (Tofu), Python, Bash, Ansible and GitHub Actions to manage data pipelines efficiently.","archived":false,"fork":false,"pushed_at":"2025-03-03T15:09:01.000Z","size":73,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-03T18:03:48.086Z","etag":null,"topics":["ansible","aws","bash","data","data-analysis","data-science","devops","gcp","python","pythonpackage","shopify","terraform","tofu"],"latest_commit_sha":null,"homepage":"https://famousinvogue.com","language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/wfamous.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-12T16:10:55.000Z","updated_at":"2025-03-01T18:38:10.000Z","dependencies_parsed_at":"2025-01-19T21:27:10.263Z","dependency_job_id":"66fcc67c-0615-4761-93c9-2572679d7f5e","html_url":"https://github.com/wfamous/fiv_update-data","commit_stats":null,"previous_names":["wfamous/fiv_update-data"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/wfamous/fiv_update-data","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wfamous%2Ffiv_update-data","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wfamous%2Ffiv_update-data/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wfamous%2Ffiv_update-data/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wfamous%2Ffiv_update-data/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/wfamous","download_url":"https://codeload.github.com/wfamous/fiv_update-data/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wfamous%2Ffiv_update-data/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29558100,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-17T20:52:40.164Z","status":"ssl_error","status_checked_at":"2026-02-17T20:48:10.325Z","response_time":100,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ansible","aws","bash","data","data-analysis","data-science","devops","gcp","python","pythonpackage","shopify","terraform","tofu"],"created_at":"2025-03-01T03:31:18.542Z","updated_at":"2026-02-17T21:01:56.038Z","avatar_url":"https://github.com/wfamous.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Automated digital product updates with Panda, GCP, Terraform, and Shopify and more 🚀\r\n\r\n## Overview\r\n\r\nIf you're looking to automate digital product updates efficiently, this project is for you!\r\nIt automates the retrieval, processing, and publishing of digital product data for a Shopify store and thus, \r\nhelps reduce manual work, and ensures seamless product updates. It integrates Google Cloud Platform (GCP), Amazon \r\nWeb Service (AWS), Terraform (Tofu), Ansible, Python, Bash and GitHub Actions to manage data pipelines efficiently.\r\n\r\n## Key Features\r\n\r\n✅ Data Extraction \u0026 Cleaning:\r\n- Uses Google Cloud Storage to store raw product datasets.\r\n- Python \u0026 Pandas process, clean, and update product information.\r\n\r\n✅ Automation \u0026 Infrastructure:\r\n\r\n- Terraform (Tofu) provisions GCP resources (buckets, IAM, etc.).\r\n- GitHub Actions automates Terraform deployments and Python scripts.\r\n\r\n✅ Product Updates \u0026 Publishing:\r\n\r\n- Data is transformed and published back to GCP for further use.\r\n- Shopify API integration allows automated product updates.\r\n- AWS Lambda triggers automate workflows.\r\n\r\n- Tech Stack\r\n  \r\n    🔹 **Cloud**: Google Cloud Storage, IAM, AWS Lambda\r\n  \r\n    🔹 **IaC**: Terraform (Tofu), Ansible \r\n\r\n    🔹 **Automation**: GitHub Actions \r\n\r\n    🔹 **Data Processing**: Python, Pandas\r\n\r\n    🔹 **E-commerce**: Shopify API\r\n\r\n## Goal\r\n🚀 Automate \u0026 streamline digital product updates for an existing online store (it's been upt for 4 years !), reducing \r\nmanual work and improving data accuracy.\r\n\r\n## About Us\r\nWe are a DevOps Engineer (@aglorhythm) and a Data Analyst (@azezu), entrepreneurs, working together to build efficient, automated solutions for \r\nour e-commerce. Passionate about cloud infrastructure, data processing, and automation, we created this project to \r\nstreamline digital product updates for Shopify. You probably guessed, we are very busy ! Our goal is to eliminate \r\nmanual work, improve data accuracy, and optimize workflows using modern DevOps and data engineering practices.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwfamous%2Ffiv_update-data","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwfamous%2Ffiv_update-data","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwfamous%2Ffiv_update-data/lists"}