https://github.com/UrbanOS-Public/kdp

Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store
https://github.com/UrbanOS-Public/kdp

hive-metastore kubernetes minio prestodb

Last synced: 3 months ago
JSON representation

Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store

• Host: GitHub
• URL: https://github.com/UrbanOS-Public/kdp
• Owner: UrbanOS-Public
• License: apache-2.0
• Created: 2018-12-03T15:16:40.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2022-10-20T17:38:44.000Z (over 2 years ago)
• Last Synced: 2024-05-19T03:22:28.472Z (9 months ago)
• Topics: hive-metastore, kubernetes, minio, prestodb
• Language: Dockerfile
• Homepage:
• Size: 341 KB
• Stars: 16
• Watchers: 3
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-hive - KDP - Kubernets-Data-Platform

README

        
# Kubernets-Data-Platform

Big data platform components without Hadoop (HDFS, name services, etc.)

## Hive / Metastore

Creates the hive metastore service to provide metadata services for both Hive and PrestoDB.

https://github.com/apache/hive

## Minio

Creates optional S3-compatible object store, chiefly for local development.

https://github.com/minio/minio

## Presto

Abstraction layer for querying structured data of varying types with varying backends. Includes Hive tables (managed by Hive Metastore), Cassandra, local files, etc.

https://github.com/prestodb/presto

## Spark

Provides a Docker image definition for running spark workloads dynamically against the kubernetes cluster, or to pass to Hive for running hive insert queries (via the hive-site.xml settings).