https://github.com/nokia/loggpt

https://github.com/nokia/loggpt

Last synced: 11 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/nokia/loggpt
• Owner: nokia
• License: other
• Created: 2023-12-07T15:44:39.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2023-12-12T04:38:58.000Z (over 2 years ago)
• Last Synced: 2024-04-14T13:07:14.721Z (about 2 years ago)
• Language: Python
• Size: 90.8 KB
• Stars: 10
• Watchers: 5
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# LogGPT: Log Anomaly Detection via GPT

This repository contains a Pytorch implementation of [LogGPT](https://arxiv.org/abs/2309.14482), a novel model that employs GPT for log anomaly detection. `LogGPT` is first trained to predict the next log entry based on the preceding sequence ((a) Pre-training). To further enhance the performance of `LogGPT`, a novel reinforcement learning (RL) strategy is proposed to finetune the model specifically for the log anomaly detection task ((b) Fine-tuning).

![alt text](img/LogGPT.PNG)

## Configuration

- Ubuntu 20.04

- NVIDIA driver 495.29.05 

- CUDA 11.3

- Python 3.9.7

- PyTorch 1.11.0

## Installation

This code requires the packages listed in requirements.txt.

A virtual environment is recommended to run this code

On macOS and Linux:  

```

python3 -m pip install --user virtualenv

python3 -m venv env

source env/bin/activate

pip install -r requirements.txt

deactivate

```

Reference: https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/

## Instructions

Run and test:

    python3 main.py HDFS

    or

    python3 main.py BGL

    or

    python3 main.py Thunderbird

## Reference

If you plan to use `LogGPT` in your project, please consider citing [our paper](https://arxiv.org/abs/2309.14482):

```bash

@misc{han2023loggpt,

      title={LogGPT: Log Anomaly Detection via GPT}, 

      author={Xiao Han and Shuhan Yuan and Mohamed Trabelsi},

      year={2023},

      eprint={2309.14482},

      archivePrefix={arXiv},

      primaryClass={cs.LG}

}

```

## Contact

If you have any questions, please contact Mohamed Trabelsi (mohamed.trabelsi@nokia-bell-labs.com) and Xiao Han (hanxiao2099@gmail.com).

## Acknowledgements

The code is mainly written by Xiao Han during his internship at Nokia Bell Labs.

## License

LogGPT is CC-BY-NC-4.0 licensed as of now.