https://github.com/cosmo0920/fluent-bit-go-loki

[Deprecated] The predessor of fluent-bit output plugin for Loki. https://github.com/grafana/loki
https://github.com/cosmo0920/fluent-bit-go-loki

cloud-native fluent-bit fluentd golang grafana loki plugin

Last synced: 3 months ago
JSON representation

[Deprecated] The predessor of fluent-bit output plugin for Loki. https://github.com/grafana/loki

• Host: GitHub
• URL: https://github.com/cosmo0920/fluent-bit-go-loki
• Owner: cosmo0920
• License: apache-2.0
• Created: 2019-03-15T13:00:05.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2019-10-05T10:21:40.000Z (over 5 years ago)
• Last Synced: 2024-10-13T08:13:23.464Z (3 months ago)
• Topics: cloud-native, fluent-bit, fluentd, golang, grafana, loki, plugin
• Language: Go
• Homepage:
• Size: 8.32 MB
• Stars: 40
• Watchers: 4
• Forks: 6
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# fluent-bit loki output plugin

**NOTICE!**

**fluent-bit-go-loki is now merged in [loki repository](https://github.com/grafana/loki).**

[![Build Status](https://travis-ci.org/cosmo0920/fluent-bit-go-loki.svg?branch=master)](https://travis-ci.org/cosmo0920/fluent-bit-go-loki)

[![Build status](https://ci.appveyor.com/api/projects/status/6s9itaxvrkos11sx/branch/master?svg=true)](https://ci.appveyor.com/project/cosmo0920/fluent-bit-go-loki/branch/master)

Windows binaries are available in [release pages](https://github.com/cosmo0920/fluent-bit-go-loki/releases).

DockerHub base images is available in [DockerHub](https://hub.docker.com/r/cosmo0920/fluent-bit-go-loki).

This plugin works with fluent-bit's go plugin interface. You can use fluent-bit loki to ship logs into grafana datasource with loki.

The configuration typically looks like:

```graphviz

fluent-bit → loki → grafana ← other grafana sources

```

# Usage

```bash

$ fluent-bit -e /path/to/built/out_loki.so -c fluent-bit.conf

```

Or,

```bash

$ docker build . -t fluent-bit/loki-plugin

```

and then, specify Url parameter as environment variable:

```bash

$ docker run -it -e="LOKI_URL=http://[YOURHOST]:[YOURPORT]/loki/api/v1/push" fluent-bit/loki-plugin

```

Using docker image from docker hub.

```bash

$ docker pull cosmo0920/fluent-bit-go-loki:latest

```

Other released images are available in [DockerHub's fluent-bit-go-loki image tags](https://hub.docker.com/r/cosmo0920/fluent-bit-go-loki/tags).

# Prerequisites

* Go 1.11+

* gcc (for cgo)

* make (for Makefile)

## Building

```bash

$ make

```

### Configuration Options

| Key           | Description                                   | Default                             |

| --------------|-----------------------------------------------|-------------------------------------|

| Url           | Url of loki server API endpoint               | http://localhost:3100/loki/api/v1/push |

| BatchWait     | Time to wait before send a log batch to Loki, full or not. (unit: sec) | 1 second   |

| BatchSize     | Log batch size to send a log batch to Loki (unit: Bytes)    | 10 KiB (10*1024 Bytes)|

| Labels        | labels for API requests                       | job="fluent-bit" (describe below)   |

| LogLevel      | Specify log level                             | info                                |

| RemoveKeys    | Comma separated list of needless record keys to remove. | none                      |

| LabelKeys     | Comma separated list of keys to use as stream labels.   | none                      |

Example:

add this section to fluent-bit.conf

```properties

[Output]

    Name loki

    Match *

    Url http://localhost:3100/loki/api/v1/push

    BatchWait 10 # (10msec)

    BatchSize 30 # (30KiB)

    Labels {test="fluent-bit-go",lang="Golang"}

    RemoveKeys key1,key2

```

## Useful links

* [fluent-bit-go](https://github.com/fluent/fluent-bit-go)