Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/gocardless/logjam

a log shipping tool
https://github.com/gocardless/logjam

Last synced: about 2 months ago
JSON representation

a log shipping tool

Awesome Lists containing this project

README

        

Logjam
------

Logjam is a log forwarder designed to listen on a local port, receive log entries over UDP, and forward
these messages on to a log collection server (such as logstash).

The motivation for logjam was a move to containerising our applications, and a need to get logs from these
applications out of the containers. We configure logjam to listen on the `docker0` (172.16.42.1) interface which is
accessible to applications running within docker.

Logjam supports collecting logs using the following methods:

- UDP Socket
- File

Logjam will pipe all entries as a JSON object terminated with "\n" to a remote server.

Usage
-----

### Config File

{
"bind": "127.0.0.1", // interface on host to bind (0.0.0.0 for all)
"port": 1470, // port to listen on locally
"server": "10.1.1.10:1470", // logstash server to forward to
"buffer": "/tmp/buffer.log", // file to use for on-disk buffer
"buffer_size": 1024, // entries to keep in memory buffer
"truncate": 3600 // clean out disk buffer every x seconds
}

### Execution

$ logjam --config config.json

Pipeline
--------

![logjam pipeline](https://i.imgur.com/4e5sowg.png)