https://github.com/logpai/hybridlogparser
A toolkit for hybrid log parsing
https://github.com/logpai/hybridlogparser
Last synced: about 1 year ago
JSON representation
A toolkit for hybrid log parsing
- Host: GitHub
- URL: https://github.com/logpai/hybridlogparser
- Owner: logpai
- License: mit
- Created: 2023-08-14T06:38:43.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-08-23T15:51:58.000Z (almost 3 years ago)
- Last Synced: 2025-03-27T08:58:12.394Z (about 1 year ago)
- Language: Python
- Homepage:
- Size: 260 KB
- Stars: 18
- Watchers: 3
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# hybridlogparser
### !!!UNDER CONSTRUCTION
## Preliminary
Hybrid log parsing is a **superset** of existing log parsing research that targets single-line logs. It focuses on single-line logs (e.g., typical execution logs), multi-line logs (e.g, exception logs or tabular system status logs), and their mix.
Hybrid log parsers are designed to handle hybrid log parsing task, which is challenging for traditional [log parsers](https://github.com/logpai/logparser) due to the structural variability of hybrid logs.
## Contents
### Datasets
| Dataset | Description | #Event Template | #Table Template | # Text Template | Raw size |
| :-------: | :-----------: | :---: | :---: | :---: | :---: |
| HiBench | The logs of a common benchmark for HPC | 93 | 7 | 43 | 1.6MB |
| CTS | The system logs from a cloud testing service | 92 | 7 | 18 | 61KB |
### Parsers
| Parsers | Paper Title |
| :-------: | ----------- |
| Hue| Junjielong Xu, Qiuai Fu, Zhouruixing Zhu, Yutong Cheng, Zhijing Li, Yuchi Ma, Pinjia He. [Hue: A User-Adaptive Parser for Hybrid Logs](https://arxiv.org/abs/2308.07085). Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2023 |