https://github.com/lmangani/vpipe
experimental log parser in v
https://github.com/lmangani/vpipe
chain cloki experimental json logfmt logs parse pipe regex v vlang
Last synced: about 1 year ago
JSON representation
experimental log parser in v
- Host: GitHub
- URL: https://github.com/lmangani/vpipe
- Owner: lmangani
- License: mit
- Created: 2022-03-27T23:49:59.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2022-08-25T22:24:24.000Z (almost 4 years ago)
- Last Synced: 2024-10-04T13:22:00.401Z (over 1 year ago)
- Topics: chain, cloki, experimental, json, logfmt, logs, parse, pipe, regex, v, vlang
- Language: V
- Homepage:
- Size: 33.2 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://github.com/lmangani/vpipe/actions/workflows/v.yml)
# vpipe
experimental log pipeline chain parser in [vlang](https://vlang.io/)
#### Status
* Experimental, Hackish, Amateurish. Do _NOT_ use this. 💣
### Parsers
- [x] logfmt
- [x] json
- [x] regex
### Dummy Functions
- [x] count()
- [x] avg()
### Usage
##### logfmt
```bash
echo "some=logs are=boring" | vpipe 'logfmt'
{ "some": "logs", "are": "boring" }
```
##### logfmt + json
```bash
echo "some=logs are=boring counter=100" | vpipe 'logfmt | json counter'
100
```
##### regex
```bash
echo 'http://www.ciao.mondo/pera.html' \
| vpipe 'regex (?Phttps?)|(?Pftps?)://(?P[\w_]+.)+'
{"format":"http","token":"html"}
```
#### 🕐 Benchmark
##### vpipe
```
# hyperfine --warmup 3 'cat /tmp/test.log | vpipe "logfmt"'
Benchmark 1: cat /tmp/test.log | vpipe "logfmt"
Time (mean ± σ): 1.3 ms ± 0.1 ms [User: 1.8 ms, System: 0.5 ms]
Range (min … max): 1.1 ms … 1.7 ms 1428 runs
```
##### angle-grinder
```
# hyperfine --warmup 3 "cat /tmp/test.log | ag '* | logfmt'"
Benchmark 1: cat /tmp/test.log | agrind '* | logfmt'
Time (mean ± σ): 4.5 ms ± 0.2 ms [User: 2.4 ms, System: 3.2 ms]
Range (min … max): 1.8 ms … 4.9 ms 544 runs
```