https://github.com/ahmetfurkandemir/minio-hive-example

Kubernetes Hive Minio connection example
https://github.com/ahmetfurkandemir/minio-hive-example

apache-hive hadoop hive hive-metastore hive-server k8s kubernetes kubernetes-cluster kubernetes-deployment minio postgresql s3 s3-bucket

Last synced: 4 days ago
JSON representation

Kubernetes Hive Minio connection example

• Host: GitHub
• URL: https://github.com/ahmetfurkandemir/minio-hive-example
• Owner: AhmetFurkanDEMIR
• Created: 2024-03-17T08:20:48.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-03-19T06:27:38.000Z (8 months ago)
• Last Synced: 2024-05-07T18:17:02.752Z (7 months ago)
• Topics: apache-hive, hadoop, hive, hive-metastore, hive-server, k8s, kubernetes, kubernetes-cluster, kubernetes-deployment, minio, postgresql, s3, s3-bucket
• Language: Shell
• Homepage:
• Size: 17.6 KB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
## Kubernetes Hive Minio connection example

![1 jqVzqVQ1gu6UJqbb9PTL7A](https://github.com/AhmetFurkanDEMIR/minio-hive-example/assets/54184905/4cec1c3c-e8fe-44e4-8437-8ea2cca8e84d)

Edit the file with your own information. [hivems-hadoop-metastore-config.yaml](/hivems-hadoop-metastore-config.yaml)

```yaml

    

      fs.s3a.endpoint

      http://192.168.64.5:9000

    

     

    

      fs.s3a.access.key

      1uBoa5gtgiSm8DQ8JOyB

    

     

    

      fs.s3a.secret.key

      9irs4ZoYSKDORxbb9zQpX9sbdbXioSAEZSdsq6GK

    

```

```bash

bash run.sh

```

Article Link: https://medium.com/@ahmetfurkandemir/kubernetes-with-data-engineering-approach-2-querying-to-object-storage-minio-with-trino-using-ae68ffbde9f9