Ecosyste.ms: Awesome

Projects in Awesome Lists tagged with apache-iceberg

A curated list of projects in awesome lists tagged with apache-iceberg .

• Sort

  • Recently synced
  • Stars

https://github.com/matanolabs/matano

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

alerting apache-iceberg aws aws-security big-data cloud cloud-native cloud-security cybersecurity detection-engineering dfir log-analytics log-management rust secops security security-tools serverless siem threat-hunting

Last synced: 01 Oct 2024

https://github.com/apache/incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

apache-hudi apache-iceberg delta-lake

Last synced: 30 Sep 2024

https://github.com/cuebook/cuelake

Use SQL to build ELT pipelines on a data lakehouse.

apache-iceberg apache-spark data-engineering data-ingestion data-integration data-lake data-pipeline data-transfer datalake delta elt etl incremental-updates lakehouse pipelines spark-sql sql upsert zeppelin-notebook

Last synced: 28 Sep 2024

https://github.com/lhbench/lhbench

Lakehouse storage system benchmark

apache-hudi apache-iceberg benchmark cidr database databricks delta-lake lakehouse

Last synced: 01 Aug 2024

https://github.com/aws-samples/monitoring-apache-iceberg-table-metadata-layer

Sample code to collect Apache Iceberg metrics for table monitoring

apache-iceberg apache-spark aws aws-cloudwatch aws-glue aws-lambda data-quality monitoring pyiceberg sam-cli

Last synced: 28 Sep 2024

https://github.com/aws-samples/iceberg-streaming-examples

This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.

apache-iceberg apache-spark structured-streaming

Last synced: 28 Sep 2024

https://github.com/theades/serverless-data-lakehouse

This is an example project how to build a serverless data lakehouse on AWS using Terraform, Apache Iceberg and Spark.

apache-iceberg apache-spark aws data-engineering data-lakehouse terraform

Last synced: 28 Sep 2024