Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists by faizpuad
A curated list of projects in awesome lists by faizpuad .
https://github.com/faizpuad/dataengineeringproject-documentstreamingwithdata
The core objective of this project is to build an end-to-end data streaming pipeline that processes this dataset in real-time. By leveraging modern data engineering tools and techniques, we aim to connect, buffer, process, store, and visualize streaming data. This allows for better understanding of data flows, handling of large-scale real-time data
data-engineering document-streaming fastapi kafka mon spark-streaming-kafka streamlit
Last synced: 18 Dec 2024
https://github.com/faizpuad/datascienceproject-datacampcompletedprojectcollection
Last synced: 11 Jan 2025
https://github.com/faizpuad/tutorial
my self note, boilerplate on setup basic components for DE,DS
Last synced: 11 Jan 2025
https://github.com/faizpuad/project1-guide-note
This is conceptual guide to assist on handling any python project
Last synced: 15 Dec 2024
https://github.com/faizpuad/dataengineeringproject-awsrealtimecreditcardtrxpipeline
Real-time OLTP system for credit card fraud detection using AWS API Gateway, Kinesis, and RDS PostgreSQL. Features a scalable, serverless pipeline for secure and low-latency transaction processing
aws-cdk kinesis-stream lambda-con rds-postgres streaming-data
Last synced: 15 Dec 2024
https://github.com/faizpuad/dataengineeringproject-scalableolapsystemforcreditcradtransaction
Scalable OLAP system for credit card transaction analysis, leveraging AWS S3, Databricks, and dbt. Features end-to-end batch processing pipeline, medallion architecture, and interactive fraud detection dashboards. Demonstrates expertise in cloud-based data engineering and advanced analytical modeling for financial data.
batch-processing databricks dbt dbt-core pyspark python
Last synced: 11 Jan 2025
https://github.com/faizpuad/datascienceproject-selflearnprojectcollection
My collection of personal project based on self learn and certifications attended
Last synced: 11 Jan 2025
https://github.com/faizpuad/datascienceproject-loandefaultassessmentusingclassificationalgorithm
Last synced: 11 Jan 2025