Projects in Awesome Lists tagged with lambda-architecture

https://github.com/OryxProject/oryx

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

apache-kafka apache-spark cloudera java kafka lambda-architecture machine-learning oryx

Last synced: 27 Mar 2025

https://github.com/oryxproject/oryx

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

apache-kafka apache-spark cloudera java kafka lambda-architecture machine-learning oryx

Last synced: 22 Jan 2025

https://github.com/Azure/azure-cosmosdb-spark

Apache Spark Connector for Azure Cosmos DB

apache-spark azure-cosmos-db azure-databricks changefeed connector cosmos-db databricks databricks-notebooks jupyter-notebook lambda-architecture pyspark spark

Last synced: 10 May 2025

https://github.com/azure/azure-cosmosdb-spark

Apache Spark Connector for Azure Cosmos DB

apache-spark azure-cosmos-db azure-databricks changefeed connector cosmos-db databricks databricks-notebooks jupyter-notebook lambda-architecture pyspark spark

Last synced: 02 Mar 2025

https://github.com/kyleross/node-lambda-log

Basic logging mechanism for Node.js Lambda Functions and other AWS services, which produces logs in JSON format for easier reading through Cloudwatch Logs.

aws aws-lambda cloud cloudwatch error-handling json lambda lambda-architecture lambda-functions lambda-log log logger logging metadata node nodejs serverless

Last synced: 04 Apr 2025

https://github.com/KyleRoss/node-lambda-log

Basic logging mechanism for Node.js Lambda Functions and other AWS services, which produces logs in JSON format for easier reading through Cloudwatch Logs.

aws aws-lambda cloud cloudwatch error-handling json lambda lambda-architecture lambda-functions lambda-log log logger logging metadata node nodejs serverless

Last synced: 01 Apr 2025

https://github.com/redcanari/canari3

Canari v3 - next gen Maltego framework for rapid remote and local transform development

aws-lambda canari docker framework lambda-architecture maltego maltego-transformations python python3 rapid-development tds

Last synced: 02 May 2025

https://github.com/malleum-inc/canari3

Canari v3 - next gen Maltego framework for rapid remote and local transform development

aws-lambda canari docker framework lambda-architecture maltego maltego-transformations python python3 rapid-development tds

Last synced: 07 Apr 2025

https://github.com/dwyl/phoenix-ecto-append-only-log-example

📝 A step-by-step example/tutorial showing how to build a Phoenix (Elixir) App where all data is immutable (append only). Precursor to Blockchain, IPFS or Solid!

append-only elixir elixir-lang elixir-phoenix howto kappa-architecture lambda-architecture learn phoenix tutorial

Last synced: 10 May 2025

https://github.com/nashtech-labs/lambda-arch-spark

apache-spark cassandra kafka lambda-architecture spark

Last synced: 14 Feb 2025

https://github.com/sanchitvj/sports_betting_analytics_engine

A data and analytics engineering platform designed for real-time sports betting analytics.

airflow analytics-engineering aws betflow cdc data-engineering dbt druid grafana kafka lambda-architecture olap-database snowflake spark-streaming sports-betting

Last synced: 15 Feb 2025

https://github.com/hmmhmmhm/serverless-ts-template

Serverless Typescript Template

javascript lambda lambda-architecture lambda-functions nodejs npm serverless serverless-examples serverless-framework serverless-functions typescript

Last synced: 16 Apr 2025

https://github.com/aymane-maghouti/big-data-project

This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.

apache-airflow apache-kafka apache-spark batch-processing big-data-projects hbase hdfs ingestion java lambda-architecture machine-learning postgresql-database powerbi pyspark python spring-boot streaming

Last synced: 14 Feb 2025

https://github.com/dgkanatsios/gameanalyticseventhubfunctionscosmosdatalake

Big data reference architecture and implementation for an online multiplayer game

big-data big-data-analytics data-lake-analytics event-hubs lambda-architecture

Last synced: 14 Apr 2025

https://github.com/nuald/lambda-sample

A Sample of Lambda Architecture Project

cassandra lambda-architecture mqtt redis scala

Last synced: 26 Mar 2025

https://github.com/smsraj2001/stream-batch-processing-kafka-spark

A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing

batch-processing kafka kafka-topics lambda-architecture mysql-database no-api pub-sub pyspark python3 realtime spark streaming ubuntu2204 zookeeper