https://github.com/andre-marcos-perez/ifood-arch-readme

The application is the documentation of my solution for the iFood data architect test.
https://github.com/andre-marcos-perez/ifood-arch-readme

aws aws-athena aws-cloudwatch aws-emr aws-lambda aws-rds aws-redshift aws-s3 aws-step-functions

Last synced: 8 months ago
JSON representation

The application is the documentation of my solution for the iFood data architect test.

• Host: GitHub
• URL: https://github.com/andre-marcos-perez/ifood-arch-readme
• Owner: andre-marcos-perez
• License: mit
• Created: 2020-08-24T23:33:13.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2020-09-30T19:30:14.000Z (over 5 years ago)
• Last Synced: 2025-04-04T05:11:47.474Z (about 1 year ago)
• Topics: aws, aws-athena, aws-cloudwatch, aws-emr, aws-lambda, aws-rds, aws-redshift, aws-s3, aws-step-functions
• Homepage: https://github.com/andre-marcos-perez/ifood-arch-readme
• Size: 454 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# iFood Arch - Readme

> The application is the documentation of my solution for the **[iFood data architect test](https://github.com/ifood/ifood-data-architect-test)**.

![aws-emr](https://img.shields.io/badge/aws-emr-blue)

![aws-lambda](https://img.shields.io/badge/aws-lambda-blue)

![aws-s3](https://img.shields.io/badge/aws-s3-red)

![aws-rds](https://img.shields.io/badge/aws-rds-red)

![aws-athena](https://img.shields.io/badge/aws-athena-green)

![aws-redshift](https://img.shields.io/badge/aws-redshift-green)

![aws-stepfunctions](https://img.shields.io/badge/aws-stepfunctions-yellow)

![aws-cloudwatch](https://img.shields.io/badge/aws-cloudwatch-yellow)

## TL;DR

![ifood-arch](media/ifood-arch.png)

## Contents

- [**1 - Introduction**](chapters/1-Introduction.md)

  - [1.1 - Overview](chapters/1-Introduction.md#11---overview)

  - [1.2 - Features](chapters/1-Introduction.md#12---features)

- [**2 - Architecture**](chapters/2-Architecture.md)

  - [2.1 - Overview](chapters/2-Architecture.md#21---overview)

  - [2.2 - Orchestration Layer](chapters/2-Architecture.md#22---orchestration-layer)

  - [2.3 - Stage #1: Raw Processing](chapters/2-Architecture.md#23---stage-1-raw-processing)

  - [2.4 - Stage #2: Trusted Processing](chapters/2-Architecture.md#24---stage-2-trusted-processing)

  - [2.5 - Stage #3: Measure Processing](chapters/2-Architecture.md#25---stage-3-measure-processing)

  - [2.6 - Visualization Layer](chapters/2-Architecture.md#26---visualization-layer)

- [**3 - Applications**](chapters/3-Applications.md)

  - [3.1 - iFood Arch Lambda ETL](chapters/3-Applications.md#31---ifood-arch-lambda-etl)

  - [3.2 - iFood Arch EMR ETL](chapters/3-Applications.md#32---ifood-arch-emr-etl)

  - [3.3 - iFood Arch Infra](chapters/3-Applications.md#33---ifood-arch-infra)

- [**4 - Data Model**](chapters/4-DataModel.md)

  - [4.1 - OLTP Database](chapters/4-DataModel.md#41---oltp-database)

  - [4.2 - OLAP Database](chapters/4-DataModel.md#42---olap-database)

  - [4.3 - Raw Data Layer](chapters/4-DataModel.md#43---raw-data-layer)

  - [4.4 - Trusted Data Layer](chapters/4-DataModel.md#44---trusted-data-layer)

- [**Appendix**](#appendix)

  - [A - Applications](#a---applications)

  - [B - Author](#b---authors)

## Appendix

### A - Applications

  - **[iFood Arch Lambda ETL](https://github.com/andre-marcos-perez/ifood-arch-lambda-etl)** - (Private) - Serverless application to inexpensively perform orchestration tasks;

  - **[iFood Arch EMR ETL](https://github.com/andre-marcos-perez/ifood-arch-emr-etl)** - (Private) - Serverless application to perform high volume ETL tasks;

  - **[iFood Arch Infra](https://github.com/andre-marcos-perez/ifood-arch-infra)** - (Private) - Application to centre infrastructure related scripts.

  

**Note**: All applications are **private** since they contain sensitive data. To ask for a read permission, please use the contact info bellow.

### B - Author

- **Andre Perez** - **[twitter](https://twitter.com/dekoperez)** - **[email](mailto:andre.marcos.perez@gmail.com)**