Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/kiannaquines/log-parsing-algorithm

A side project of mine, blazing fast algorithm about parsing of logs.
https://github.com/kiannaquines/log-parsing-algorithm

batch-script fast multithreading python

Last synced: 6 days ago
JSON representation

A side project of mine, blazing fast algorithm about parsing of logs.

Awesome Lists containing this project

README

        

## Seconds it parses the 100+ logs

Any data needed in any database server can be effortlessly migrated with this fast algorithm. Just modify the code and run it. 🤩

For the multithreaded_main.py, it only takes 7.91 seconds to process all the logs, and that's very impressive to me.

In Windows, run the code with the:
```
python multithreaded_main.py
```

In Linux, run the code with the:
```
python3 multithreaded_main.py
```

![image](https://github.com/kiannaquines/Log-Parsing-Algorithm/assets/88887528/734e9e7b-48d0-476d-be02-501204ff2ca7)

93807 rows in just 7.91 seconds 🤩
![image](https://github.com/kiannaquines/Log-Parsing-Algorithm/assets/88887528/e3589a7a-a2c3-45aa-b796-fe0f70a22fcc)