https://github.com/factorhouse/factorhouse-local
Local environment for running Factor House products (Kpow and Flex) along with supporting infrastructure using Docker Compose
https://github.com/factorhouse/factorhouse-local
database developer-tools docker docker-compose flink flink-cluster iceberg kafka kafka-cluster kpow lakehouse management monitoring pinot postgresql spark streams ui
Last synced: 22 days ago
JSON representation
Local environment for running Factor House products (Kpow and Flex) along with supporting infrastructure using Docker Compose
- Host: GitHub
- URL: https://github.com/factorhouse/factorhouse-local
- Owner: factorhouse
- Created: 2025-04-22T23:47:17.000Z (26 days ago)
- Default Branch: main
- Last Pushed: 2025-04-23T00:58:10.000Z (26 days ago)
- Last Synced: 2025-04-23T01:35:12.232Z (26 days ago)
- Topics: database, developer-tools, docker, docker-compose, flink, flink-cluster, iceberg, kafka, kafka-cluster, kpow, lakehouse, management, monitoring, pinot, postgresql, spark, streams, ui
- Homepage:
- Size: 141 KB
- Stars: 0
- Watchers: 4
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Factor House Local
## Set up Environment
```bash
## set up environment
./resources/setup-env.sh
# downloading kafka connectors ...
# downloading flink connectors ...
# downloading iceberg flink runtime and iceberg aws bundle ...
# downloading s3 hadoop and presto plugins ...
# building a custom docker image (factorhouse/flink) for PyFlink support ...
# sha256:9941ebf0a422e8ffc52971da280866db20b7d4d684f14e29740a157d557bee34
```
## Start Resources
```bash
## Start Kpow, Flex and associated resources
## - Kpow should be started first
## because it creates the Docker network that is shared across all resources
## - Set different project names to avoid the following warning
## WARN[0002] Found orphan containers ([kpow-ee connect schema_registry kafka-2 kafka-1 kafka-3 zookeeper]) for this project.
docker compose -p kpow -f compose-kpow-trial.yml up -d \
&& docker compose -p flex -f compose-flex-trial.yml up -d \
&& docker compose -p analytics -f compose-analytics.yml up -d
## Start individual services
## - USE_EXT=false if not kpow
docker compose -f compose-kpow-trial.yml up -d
USE_EXT=false docker compose -f compose-flex-trial.yml up -d
USE_EXT=false docker compose -p analytics -f compose-analytics.yml up -d
```
## Stop/Remove Resources
```bash
## Stop and remove Kpow, Flex and associated resources
## - Kpow should be removed last because it contains the Docker network
## - Ensure to use the same project names
docker compose -p analytics -f compose-analytics.yml down \
&& docker compose -p flex -f compose-flex-trial.yml down \
&& docker compose -p kpow -f compose-kpow-trial.yml down
## Stop and remove Flex on its own by setting USE_EXT=false
docker compose -f compose-kpow-trial.yml down
USE_EXT=false docker compose -f compose-flex-trial.yml down
USE_EXT=false docker compose -p analytics -f compose-analytics.yml down
```