An open API service indexing awesome lists of open source software.

https://github.com/jzillmann/tweaky

Pieces of a traditional master-node cluster setup with modern technology
https://github.com/jzillmann/tweaky

cluster-computing dagger grpc-java

Last synced: 7 months ago
JSON representation

Pieces of a traditional master-node cluster setup with modern technology

Awesome Lists containing this project

README

          

# Tweaky

Pieces of a traditional master-node cluster setup with modern technology.

## Build

- `./gradlew generateProto` - Generate protbuf sources
- `./gradlew cleanEclipse eclipse` - Create Eclipse files

## TODO

- √GRPC sample
- √Logging
- √NodeRegistrationValidator
- √Junit5 ExternalResource
- √Implement Node registration
- √Dagger example
- Remove log4j impl from pom.xml
- NodeAcceptor
- Dagger for nodes
- Push node-name to node
- Convert Node/Conductor into pure GRPC services (with proto files, Component & Component.Builder interfaces ?)
- stuff like serverServices() would come out of the GRPC module
- Think about how that influence advanced stuff like node communication (strategies), listener, event-bus, etc...

## Thoughts

- Example projects:
- Distributed Map
- Task Queue
- Node Role Support
- Conductor assigns role(s) to node on registration
- Node starts services based on roles
- Services
- Monitoring
- Monitoring-UI
- Utils
- CallTracing (from client, to conductor including all node calls. Use metadata. Check https://github.com/grpc-ecosystem/grpc-opentracing)
- Profiling (custom for apps. just have generic proto files available. Nodes can track their individual work steps)