https://github.com/bernhard-42/kerberos-hdfs
A podman pod with kdc, kereberized hdfs and spark
https://github.com/bernhard-42/kerberos-hdfs
Last synced: 2 months ago
JSON representation
A podman pod with kdc, kereberized hdfs and spark
- Host: GitHub
- URL: https://github.com/bernhard-42/kerberos-hdfs
- Owner: bernhard-42
- Created: 2019-10-03T19:43:22.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2019-10-03T19:55:45.000Z (about 6 years ago)
- Last Synced: 2025-06-23T05:38:08.305Z (4 months ago)
- Language: Shell
- Size: 7.81 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: Readme.md
Awesome Lists containing this project
README
# A tiny kerberized hdfs cluster (pseudo distributed)
## Images
### KDC image
Uses [sssd-kerberos-server-clients](https://github.com/bernhard-42/sssd-kerberos-server-clients)
```bash
git clone git@github.com:bernhard-42/sssd-kerberos-server-clients.git
cd sssd-kerberos-server-clients
```
Edit `config-standalone.sh`
```bash
sudo ./podman-build 1.0.0
```
### Hadoop image
Uses [tiny-hadoop](https://github.com/bernhard-42/tiny-hadoop)
```bash
git clone git@github.com:bernhard-42/tiny-hadoop.git
cd tiny-hadoop
git checkout kerberos
```
Edit `config.sh`
```bash
sudo ./podman-build
```
### Result
```bash
sudo podman images
REPOSITORY TAG IMAGE ID CREATED SIZE
localhost/tiny-hadoop 1.0.0 1c92e17201d4 22 seconds ago 1.49 GB
localhost/ldap-kdc-acme.localdomain 1.0.0 bca53efe6594 8 minutes ago 248 MB
docker.io/library/ubuntu 18.04 2ca708c1c9cc 2 weeks ago 66.6 MB
```
## The kerberos-hdfs pod
```bash
rm -f hadoop.keytab krb5.conf client-installer.tgz
```
```bash
cp ../sssd-kerberos-server-clients/target/client-installer.tgz .
```
```bash
1-create-pod.sh
```
```bash
2-run-kdc.sh
```
```bash
3-create-hadoop-keytab.sh
ls -l hadoop.keytab krb5.conf
```
```bash
4-start-hadoop.sh
```
```bash
5-configure-kerberos.sh
```
```bash
6-kerberize-hdfs.sh
```