Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kiannaquines/log-parsing-algorithm
A side project of mine, blazing fast algorithm about parsing of logs.
https://github.com/kiannaquines/log-parsing-algorithm
batch-script fast multithreading python
Last synced: 6 days ago
JSON representation
A side project of mine, blazing fast algorithm about parsing of logs.
- Host: GitHub
- URL: https://github.com/kiannaquines/log-parsing-algorithm
- Owner: kiannaquines
- Created: 2024-07-09T07:50:16.000Z (4 months ago)
- Default Branch: master
- Last Pushed: 2024-07-10T16:19:20.000Z (4 months ago)
- Last Synced: 2024-07-11T06:31:52.600Z (4 months ago)
- Topics: batch-script, fast, multithreading, python
- Language: Python
- Homepage:
- Size: 1.23 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Seconds it parses the 100+ logs
Any data needed in any database server can be effortlessly migrated with this fast algorithm. Just modify the code and run it. 🤩
For the multithreaded_main.py, it only takes 7.91 seconds to process all the logs, and that's very impressive to me.
In Windows, run the code with the:
```
python multithreaded_main.py
```In Linux, run the code with the:
```
python3 multithreaded_main.py
```![image](https://github.com/kiannaquines/Log-Parsing-Algorithm/assets/88887528/734e9e7b-48d0-476d-be02-501204ff2ca7)
93807 rows in just 7.91 seconds 🤩
![image](https://github.com/kiannaquines/Log-Parsing-Algorithm/assets/88887528/e3589a7a-a2c3-45aa-b796-fe0f70a22fcc)