https://github.com/blewater/tlex
Multi Docker Containers Logger & Stats Aggregator
https://github.com/blewater/tlex
datastream docker go golang logging
Last synced: about 1 month ago
JSON representation
Multi Docker Containers Logger & Stats Aggregator
- Host: GitHub
- URL: https://github.com/blewater/tlex
- Owner: blewater
- Created: 2019-07-05T15:51:28.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2019-07-20T09:18:26.000Z (almost 7 years ago)
- Last Synced: 2025-01-06T11:45:32.407Z (over 1 year ago)
- Topics: datastream, docker, go, golang, logging
- Language: Go
- Homepage:
- Size: 1.52 MB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: Readme.md
Awesome Lists containing this project
README
# Multi Docker Containers Logger & Stats Aggregator #
Tool for meeting these requirements:
* Create a **lean** Docker Image from the *Dockefile* in this repo.
* Tracking left over containers from a previous launch at ids.gob file so to stop them at next launch
* To launch concurrently config.RequestedLiveContainers containers of the http://github.com/nethatix/echopathws http listener that echoes back the requested url path i.e., localhost:8770/1/2/3/ -> 1/2/3/.
* Supporting a configurable number of live containers creation.
* Supporting liveness both as an app and through few unit tests.
* Consuming the Docker statistics streams for each live container. Optional persistence to an aggregated text file separate from the logs.
* Displaying and aggregating all the logging input streams of the live containers similarly to the statistics streams.
* Concurrently remove all live instances.
### Deliverable ###
This is a statically configured command line application that is efficient and scalable.
### Testing ###
This *workflow/workflow_test.go->Test_Continuous_Logs_Http_Requests_100_Containers* requires a large timeout to as the 30 seconds are not even sufficient to launch 100 instances. Υου may run it go test -run Test_Continuous_Logs_Http_Requests_100_Containers -timeout 100000s
##### Workflow Unit tests #####
within *github.com/nethatix/tlex/workflow$*
go test -run Test_Workflow_0_Containers
go test -run Test_Workflow_3_Containers_No_Stats
go test -run Test_Workflow_1_Containers
go test -run Test_Workflow_5_Containers
go test -run Test_Workflow_20_Containers -timeout 50s
go test -run Test_Continuous_Logs_Http_Requests_100_Containers -timeout 100000s
#### Tests harnesses ####
workflow/ // the unit tests root folder.
workflow/testdata/Dockerfile // the unit tests Dockerfile
workflow/testdata/logFile.log // the unit tests log file.
workflow/testdata/StatsLogFile.log // the stats unit tests file.
logger/logger_test.go // simple test case
dockerapi/ // has no test file but a few logic assert functions in .dockerapi/dockerapi.go employed at runtime
- - - -
##### Windows getting along with 100 docker containers just fine! #####
### Installation ###
Preferably within **$gopath\src**
`git clone https://github.com/nethatix/tlex`
`cd tlex`
`./install.sh` (tested with windows bash) or `install.cmd` (windows)
Note the application builds and runs both *on* and *off* the **gopath** within the root *tlex* folder:
These commands worked in both locations on/off gopath locations:
`go build ./...`
`go vet`
`go` `build` `-race` producing `tlex` or `tlex.exe` executables....
`go run tlex`
### Interesting Paths & Files ###
Dockerfile // (The employed docker image spec in root folder. )
logFile.log // is the application log file.
StatsLogFile.log // is the application stats file.
ids.gob // binary serialization of left over live containers.
#### The Containerized Simple Echo Path HTTP Server ####
https://github.com/nethatix/echopathws