Projects in Awesome Lists tagged with mage-ai

https://github.com/nathadriele/mlops-zoomcamp

The Zoomcamp MLOps Course covers tools like MLflow, Mage, Flask, Prometheus, Evidently, Grafana, Prefect, Terraform, and GitHub Actions. It emphasizes experiment tracking, model deployment, monitoring, CI/CD, and orchestration, culminating in an end-to-end project integrating best practices in MLOps.

aws batch-processing flask grafana mage-ai mlflow mlops model mongodb monitoring orchestration prefect streaming

Last synced: 10 Apr 2025

https://github.com/olajideolagunju/gcp_mage_data_pipeline

An end-to-end data engineering pipeline that processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.

automation bigquery cloud compute-engine data data-engineering database database-schema docker-compose excel gcp mage-ai maintenance mariadb orchestration python sql virtual-machine visualization-dashboard work-orders

Last synced: 07 Mar 2025

https://github.com/jasontanx/data-engineer-project-1

End-to-end data engineering project

airline bigquery data-engineering etl-pipeline looker-studio mage-ai

Last synced: 26 Mar 2025

https://github.com/jbris/mage_ai_docker

Docker image for Mage AI deployment using Docker

mage-ai mage-ai-docker mage-ai-pipeline mageai mageai-docker

Last synced: 09 Apr 2025

https://github.com/jxareas/de-zoomcamp-2024

Solutions for @datatalksclub's Data Engineering Zoomcamp 2024.

data-analysis data-engineering data-science database datascience de-zoomcamp docker docker-compose etl etl-pipeline mage-ai orchestration python workflow

Last synced: 14 Mar 2025

https://github.com/tuancamtbtx/py-datalake

Python Lib to build and process data in Datalake - Cloud Function, Cloud Run, Lambda

mage-ai prefect python

Last synced: 22 Feb 2025

https://github.com/quicksilvershanks/mlopsalchemy

A collection of codes and mini projects that bridge the gap between machine learning and operational excellence.

mage-ai mlflow mlops

Last synced: 04 Apr 2025

https://github.com/tknishh/travelmeter

Performed data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.

data-engineering gcp mage-ai modern-project uber-data-analysis

Last synced: 18 Mar 2025

https://github.com/nathadriele/cnpj-data-pipeline

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.

amazon-s3 cloud-computing cnpj-data data-engineering data-pipeline data-processing data-storage etl-pipeline mage-ai public-data script-automation

Last synced: 24 Mar 2025

https://github.com/ruru-lyy/nyc-taxi-service-pipeline

In this project, I built a data pipeline using Mage.ai for ETL, GCP for storage, BigQuery for querying, and Looker Studio for analytics. This project helped me learn how to process, store, and visualize data effectively using modern tools.

bigquery data-engineering data-modeling etl-pipeline looker mage-ai python

Last synced: 16 Mar 2025

https://github.com/pperrinn/final-thesis

This repository contains the research, code, and examples related to the orchestration of data pipelines using a microservices architecture. The project explores the challenges of constructing modern data-centric pipelines and evaluates the role of orchestration tools in Data Science workflows.

data-science docker etl-pipeline mage-ai python

Last synced: 27 Mar 2025