https://github.com/fedomn/iceberg-toolkit

iceberg toolkit to inspect table internal
https://github.com/fedomn/iceberg-toolkit

Last synced: 14 days ago
JSON representation

iceberg toolkit to inspect table internal

• Host: GitHub
• URL: https://github.com/fedomn/iceberg-toolkit
• Owner: Fedomn
• License: apache-2.0
• Created: 2023-07-15T10:29:48.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-07-17T09:29:31.000Z (over 1 year ago)
• Last Synced: 2024-11-03T14:58:05.141Z (about 2 months ago)
• Language: Java
• Size: 13.7 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# iceberg-toolkit

iceberg toolkit to inspect table internal, currently only support kerberos enabled hive metastore.

build from source: `mvn clean package -DskipTests`

## security

To use Kerberos enabled HMS you must prepare the config file (~/.iceberg_toolkit.yaml):

```yaml

metastoreUri: thrift://localhost:9083

metastoreWarehouseDir: /user/hive/warehouse

servicePrincipal: hive/[email protected]

clientPrincipal: 

clientKeytab: 

krb5Conf: /etc/krb5.conf

configResources:

  - /etc/hive/conf/hive-site.xml

  - /etc/hadoop/conf/core-site.xml

  - /etc/hadoop/conf/hdfs-site.xml

```

## usage

```shell

java -jar iceberg-toolkit-1.0.0.jar checkFileInManagement file.parquet db table

java -jar iceberg-toolkit-1.0.0.jar showSnapshotFiles snapshotId db table

```

## others

use `mvn dependency:tree -Dverbose -Dincludes=org.slf4j:slf4j-\*` to check the dependency tree.