https://github.com/getindata/hive-metastore
Hive-metastore helm chart
https://github.com/getindata/hive-metastore
Last synced: 5 months ago
JSON representation
Hive-metastore helm chart
- Host: GitHub
- URL: https://github.com/getindata/hive-metastore
- Owner: getindata
- License: apache-2.0
- Created: 2024-02-26T08:12:44.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-02-21T11:10:54.000Z (over 1 year ago)
- Last Synced: 2025-02-21T12:22:20.740Z (over 1 year ago)
- Language: Dockerfile
- Size: 81.1 KB
- Stars: 7
- Watchers: 8
- Forks: 3
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# hive-metastore
Hive-metastore helm chart
## Installation
Hive metastore requires Postgres DB. It can be configured with values e.g.:
```
postgres:
host: "postgresql"
port: 5432
db: metastore
username: admin
password: pass
```
It is possible to use an existing secret from another source. The createSecret flag in values.yaml is used for this purpose.If we are using an existing secret, its name should look like this: `{{ .Release.Name }}-pgauth`. If we want the secret to be generated from the data provided in the postgres section, the `createSecret` flag in values.yaml should be set to `true`.
The docker image is published on github repository (ghcr.io). Login to github repository to pull image:
```
docker login ghcr.io -u [github_username]
```
To install hive-metastore:
```
helm repo add getindata-hms https://getindata.github.io/hive-metastore
helm install hms getindata-hms/hive-metastore
```
Essential libraries for Flink 1.19.1
(/opt/flink/lib)
- https://repo1.maven.org/maven2/org/apache/thrift/libfb303/0.9.3/libfb303-0.9.3.jar
- https://repo1.maven.org/maven2/org/apache/hive/hive-exec/3.1.3/hive-exec-3.1.3.jar
- https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/flink/flink-shaded-hadoop-3-uber/3.1.1.7.0.3.0-79-7.0/flink-shaded-hadoop-3-uber-3.1.1.7.0.3.0-79-7.0.jar
- https://repo1.maven.org/maven2/org/apache/flink/flink-connector-hive_2.12/1.19.1/flink-connector-hive_2.12-1.19.1.jar
- https://repo1.maven.org/maven2/commons-cli/commons-cli/1.4/commons-cli-1.4.jar
Example hive-site.xml
```
javax.jdo.option.ConnectionURL
jdbc:postgresql://postgres-postgresql:5432/metastore
Metadata is stored in a PostgreSQL server
javax.jdo.option.ConnectionDriverName
org.postgresql.Driver
PostgreSQL JDBC driver class
javax.jdo.option.ConnectionUserName
admin
Username for connecting to the PostgreSQL server
javax.jdo.option.ConnectionPassword
pass
Password for connecting to the PostgreSQL server
hive.metastore.uris
thrift://hms-hive-metastore:9083
IP address (or fully-qualified domain name) and port of the metastore host
hive.metastore.schema.verification
true
```