{"id":13910745,"url":"https://github.com/lucianmarin/logparser","last_synced_at":"2026-01-19T02:03:36.253Z","repository":{"id":66604108,"uuid":"295495575","full_name":"lucianmarin/logparser","owner":"lucianmarin","description":"Command line parser for common log format.","archived":false,"fork":false,"pushed_at":"2024-07-06T14:07:30.000Z","size":39,"stargazers_count":141,"open_issues_count":1,"forks_count":1,"subscribers_count":6,"default_branch":"master","last_synced_at":"2024-08-08T00:44:03.401Z","etag":null,"topics":["commonlogging","nginx","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lucianmarin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"ko_fi":"lucianmarin"}},"created_at":"2020-09-14T17:53:58.000Z","updated_at":"2024-07-31T20:00:43.000Z","dependencies_parsed_at":"2024-07-06T15:27:40.325Z","dependency_job_id":"1bacfd11-e9e8-40aa-a8a8-958837191307","html_url":"https://github.com/lucianmarin/logparser","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucianmarin%2Flogparser","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucianmarin%2Flogparser/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucianmarin%2Flogparser/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lucianmarin%2Flogparser/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lucianmarin","download_url":"https://codeload.github.com/lucianmarin/logparser/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":226388717,"owners_count":17617321,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["commonlogging","nginx","python"],"created_at":"2024-08-07T00:01:44.352Z","updated_at":"2026-01-19T02:03:36.239Z","avatar_url":"https://github.com/lucianmarin.png","language":"Python","readme":"# Logparser\n\nCommand line parser for common log format (Nginx default).\n\n## Usage\n\nIt counts most important data: referrers, operating systems, browsers and daily unique visitors (IPs). It excludes bots by default.\n\n```shell\n# Console output\npython parse.py sitename.log.gz\n\n# Hide less than or equal values\npython parse.py sitename.log.gz --hide 1\n\n# HTML output\npython parse.py sitename.log.gz --page ~/sitename/logs.html\n\n# Ignore hostnames from referrers\npython parse.py sitename.log.gz --skip \"subreply.com\"\n```\n\nInstall and update PIP packages.\n\n```shell\npip install -U -r requirements.txt\n```\n\n## Speed\n\n- Logparser 24,249/s\n- GoAccess 1.3 6,234/s - virtual server, Intel (1 core)\n- GoAccess 1.5 47,299/s - laptop, Intel (4 cores)\n\n## Outputs\n\n- HTML output is based on Jinja2 templates. It can be improved as you see fit.\n- Console output for [Subreply](https://subreply.com/) for a fews days in Sep, 2021:\n\n```shell\n----- Days\n 1402 2021-09-14 Tuesday\n  893 2021-09-15 Wednesday\n  797 2021-09-16 Thursday\n  857 2021-09-17 Friday\n  951 2021-09-18 Saturday\n  945 2021-09-19 Sunday\n  869 2021-09-20 Monday\n\n----- Browsers\n    2 Chrome Mobile iOS\n    2 Bytespider\n    2 HeadlessChrome\n    3 Links\n    4 Firefox iOS\n    4 UC Browser\n    6 IE\n    7 Go-http-client\n    7 Opera\n    8 Other\n   20 Chrome Mobile WebView\n   20 Edge\n   28 Firefox Mobile\n   30 Safari\n   42 Chrome Mobile\n   56 Mobile Safari\n  111 Firefox\n 3468 Chrome\n\n----- Operating Systems\n   15 Other\n   22 Ubuntu\n   39 Linux\n   63 iOS\n   91 Android\n  101 Mac OS X\n 3474 Windows\n\n----- Referrers\n    2 twtxt.net\n    2 l.instagram.com\n    2 lobste.rs/s/bffayk/what_are_you_doing_this_weekend\n    3 ro.linkedin.com\n    3 199.247.2.88:80\n    3 t.co/sv4adihlka\n    3 lobste.rs/s/fe2eph/what_are_you_doing_this_weekend\n    4 news.ycombinator.com\n    4 1mb.club\n    4 old.reddit.com/r/internetisbeautiful\n    4 baidu.com\n    4 t.co\n    5 out.reddit.com/t3_pl9hiu\n    5 sjmulder.nl/en/textonly.html\n    8 nt\n   10 199.247.2.88\n   11 lobste.rs\n   13 sjmulder.nl\n   15 google.com\n   16 lucianmarin.com\n   49 reddit.com\n   85 lobste.rs/s/8fzzmz/what_are_you_doing_this_week\n```\n","funding_links":["https://ko-fi.com/lucianmarin"],"categories":["Python"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flucianmarin%2Flogparser","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flucianmarin%2Flogparser","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flucianmarin%2Flogparser/lists"}