https://github.com/mebjas/mrfrenzy

PoC around system to generate patterns and perform analysis on log streams
https://github.com/mebjas/mrfrenzy

annotations data-mining logs-analysis pattern-recognition stream

Last synced: about 1 month ago
JSON representation

PoC around system to generate patterns and perform analysis on log streams

• Host: GitHub
• URL: https://github.com/mebjas/mrfrenzy
• Owner: mebjas
• License: mit
• Created: 2018-06-02T16:37:25.000Z (almost 7 years ago)
• Default Branch: master
• Last Pushed: 2018-06-14T11:10:59.000Z (almost 7 years ago)
• Last Synced: 2024-05-23T08:03:18.965Z (11 months ago)
• Topics: annotations, data-mining, logs-analysis, pattern-recognition, stream
• Language: Jupyter Notebook
• Size: 98.6 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# MrFrenzy

### An experimental ***log pattern discovery*** and ***annotation framework***.

![temp logo](https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcTS4xufuVIzzgxcpXvISMryXfraeYRbfTIiL6I6K537s3pkLziX)

## Features wanted

 - [ ] Automatically detect patterns in stream of text logs

 - [ ] Automatically annotate these text logs and identify entities.

 - [ ] Detect hidden information in the logs, for example the datacenter location could be hidden in the resource name available in the log. Have a schema to define these kind of scenarios.

 - [ ] LOW_PRIORITY a dashboard to provide manual annotation, and system ability to learn from this;

## References

 - Using test datasets of logs from [logpai/loghub](https://github.com/logpai/loghub)