https://github.com/wuyifan18/DeepLog
Pytorch Implementation of DeepLog.
https://github.com/wuyifan18/DeepLog
anomaly-detection deeplearning pytorch sequence-prediction
Last synced: about 1 year ago
JSON representation
Pytorch Implementation of DeepLog.
- Host: GitHub
- URL: https://github.com/wuyifan18/DeepLog
- Owner: wuyifan18
- License: mit
- Created: 2018-12-27T11:53:58.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2024-07-25T10:58:40.000Z (almost 2 years ago)
- Last Synced: 2024-11-05T13:44:41.778Z (over 1 year ago)
- Topics: anomaly-detection, deeplearning, pytorch, sequence-prediction
- Language: Python
- Homepage:
- Size: 1.45 MB
- Stars: 374
- Watchers: 18
- Forks: 155
- Open Issues: 25
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# DeepLog
A Pytorch implementation of [DeepLog](https://www.cs.utah.edu/~lifeifei/papers/deeplog.pdf)'s log key anomaly detection model.
*If you are confusing about how to extract log key (i.e. log template), I recommend using **Drain** which is proposed in this [paper](https://pinjiahe.github.io/papers/ICWS17.pdf). As far as I know, it is the most effective log parsing method. By the way, there is a toolkit and benchmarks for automated log parsing in this [repository](https://github.com/logpai/logparser).*
## Requirement
* python>=3.6
* pytorch==1.4
* tensorboard==2.0.2
## Dataset
~~The dataset can be downloaded [HERE](https://www.cs.utah.edu/~mind/papers/deeplog_misc.html).~~ The website can't accessed now, but you can find the HDFS data in this repository.
The original HDFS logs can be found [HERE] (http://people.iiis.tsinghua.edu.cn/~weixu/sospdata.html).
## Visualization
Run the following code in terminal, then navigate to https://localhost:6006.
`tensorboard --logdir=log`
## Reference
Min Du, Feifei Li, Guineng Zheng, Vivek Srikumar. "Deeplog: Anomaly detection and diagnosis from system logs through deep learning." ACM SIGSAC Conference on Computer and Communications Security(CCS), 2017.
## Contributing
**If you have any questions, please open an** ***[issue](https://github.com/wuyifan18/DeepLog/issues).***
**Welcome to** ***[pull requests](https://github.com/wuyifan18/DeepLog/pulls)*** **to implement the rest of this paper!**