https://github.com/wuyifan18/DeepLog

Pytorch Implementation of DeepLog.
https://github.com/wuyifan18/DeepLog

anomaly-detection deeplearning pytorch sequence-prediction

Last synced: 8 days ago
JSON representation

Pytorch Implementation of DeepLog.

• Host: GitHub
• URL: https://github.com/wuyifan18/DeepLog
• Owner: wuyifan18
• License: mit
• Created: 2018-12-27T11:53:58.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2024-07-25T10:58:40.000Z (4 months ago)
• Last Synced: 2024-08-02T15:32:38.621Z (3 months ago)
• Topics: anomaly-detection, deeplearning, pytorch, sequence-prediction
• Language: Python
• Homepage:
• Size: 1.45 MB
• Stars: 366
• Watchers: 18
• Forks: 154
• Open Issues: 25
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# DeepLog

A Pytorch implementation of [DeepLog](https://www.cs.utah.edu/~lifeifei/papers/deeplog.pdf)'s log key anomaly detection model.

*If you are confusing about how to extract log key (i.e. log template), I recommend using **Drain** which is proposed in this [paper](https://pinjiahe.github.io/papers/ICWS17.pdf). As far as I know, it is the most effective log parsing method. By the way, there is a toolkit and benchmarks for automated log parsing in this [repository](https://github.com/logpai/logparser).*

## Requirement

* python>=3.6

* pytorch==1.4

* tensorboard==2.0.2

## Dataset

~~The dataset can be downloaded [HERE](https://www.cs.utah.edu/~mind/papers/deeplog_misc.html).~~ The website can't accessed now, but you can find the HDFS data in this repository.

The original HDFS logs can be found [HERE] (http://people.iiis.tsinghua.edu.cn/~weixu/sospdata.html).

## Visualization

Run the following code in terminal, then navigate to https://localhost:6006.

`tensorboard --logdir=log`

## Reference

Min Du, Feifei Li, Guineng Zheng, Vivek Srikumar. "Deeplog: Anomaly detection and diagnosis from system logs through deep learning." ACM SIGSAC Conference on Computer and Communications Security(CCS), 2017.

## Contributing

**If you have any questions, please open an** ***[issue](https://github.com/wuyifan18/DeepLog/issues).***

**Welcome to** ***[pull requests](https://github.com/wuyifan18/DeepLog/pulls)*** **to implement the rest of this paper!**