{"id":41386505,"url":"https://github.com/pykit3/k3logcollector","last_synced_at":"2026-01-23T11:58:45.438Z","repository":{"id":39612741,"uuid":"397149924","full_name":"pykit3/k3logcollector","owner":"pykit3","description":"Scan log files on local machine, collector all interested logs, and send to somewhere for display.","archived":false,"fork":false,"pushed_at":"2025-08-28T12:37:18.000Z","size":37,"stargazers_count":0,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-10-25T14:34:50.468Z","etag":null,"topics":["log","python"],"latest_commit_sha":null,"homepage":"https://blog.openacid.com","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pykit3.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-08-17T07:20:45.000Z","updated_at":"2025-08-28T12:37:22.000Z","dependencies_parsed_at":"2023-02-01T07:00:58.102Z","dependency_job_id":null,"html_url":"https://github.com/pykit3/k3logcollector","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":"pykit3/tmpl","purl":"pkg:github/pykit3/k3logcollector","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pykit3%2Fk3logcollector","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pykit3%2Fk3logcollector/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pykit3%2Fk3logcollector/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pykit3%2Fk3logcollector/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pykit3","download_url":"https://codeload.github.com/pykit3/k3logcollector/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pykit3%2Fk3logcollector/sbom","scorecard":{"id":751504,"data":{"date":"2025-08-11","repo":{"name":"github.com/pykit3/k3logcollector","commit":"ad9d9ac2e489dd8c97e6ace3598c36494f5fabb8"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.6,"checks":[{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Code-Review","score":1,"reason":"Found 1/6 approved changesets -- score normalized to 1","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/python-package.yml:1","Warn: no topLevel permission defined: .github/workflows/python-publish.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:23: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:25: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:55: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:69: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:71: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:95: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-package.yml:98: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-package.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-publish.yml:17: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-publish.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/python-publish.yml:19: update your workflow using https://app.stepsecurity.io/secureworkflow/pykit3/k3logcollector/python-publish.yml/master?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:104","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:105","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:106","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:107","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:30","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:31","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:32","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:33","Warn: npmCommand not pinned by hash: .github/workflows/python-package.yml:36","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:77","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:78","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:79","Warn: pipCommand not pinned by hash: .github/workflows/python-package.yml:83","Warn: pipCommand not pinned by hash: .github/workflows/python-publish.yml:24","Warn: pipCommand not pinned by hash: .github/workflows/python-publish.yml:25","Warn: pipCommand not pinned by hash: .github/workflows/python-publish.yml:34","Info:   0 out of   9 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of  15 pipCommand dependencies pinned","Info:   0 out of   1 npmCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 7 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":0,"reason":"11 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: PYSEC-2019-217 / GHSA-462w-v97r-4m45","Warn: Project is vulnerable to: PYSEC-2014-8 / GHSA-8r7q-cvjq-x353","Warn: Project is vulnerable to: GHSA-cpwx-vrp4-4pq7","Warn: Project is vulnerable to: PYSEC-2014-82 / GHSA-fqh9-2qgg-h84h","Warn: Project is vulnerable to: PYSEC-2021-66 / GHSA-g3rq-g295-4j3m","Warn: Project is vulnerable to: GHSA-h5c8-rqwp-cp95","Warn: Project is vulnerable to: GHSA-h75v-3vvj-5mfj","Warn: Project is vulnerable to: PYSEC-2019-220 / GHSA-hj2j-77xm-mc5v","Warn: Project is vulnerable to: GHSA-q2x7-8rv6-6q7h","Warn: Project is vulnerable to: PYSEC-2021-142 / GHSA-8q59-q68h-6hv4","Warn: Project is vulnerable to: PYSEC-2018-49 / GHSA-rprw-h62v-c2w7"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-22T20:31:03.566Z","repository_id":39612741,"created_at":"2025-08-22T20:31:03.566Z","updated_at":"2025-08-22T20:31:03.566Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28690611,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-23T11:01:27.039Z","status":"ssl_error","status_checked_at":"2026-01-23T11:00:26.909Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["log","python"],"created_at":"2026-01-23T11:58:44.879Z","updated_at":"2026-01-23T11:58:45.426Z","avatar_url":"https://github.com/pykit3.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# k3logcollector\n\n[![Action-CI](https://github.com/pykit3/k3logcollector/actions/workflows/python-package.yml/badge.svg)](https://github.com/pykit3/k3logcollector/actions/workflows/python-package.yml)\n[![Documentation Status](https://readthedocs.org/projects/k3logcollector/badge/?version=stable)](https://k3logcollector.readthedocs.io/en/stable/?badge=stable)\n[![Package](https://img.shields.io/pypi/pyversions/k3logcollector)](https://pypi.org/project/k3logcollector)\n\nScan log files on local machine, collector all interested logs, and send to somewhere for display.\n\nk3logcollector is a component of [pykit3] project: a python3 toolkit set.\n\n\n#   Name\n\nlogcollector\n\nScan log files on local machine, collector all interested logs, and send\nto somewhere for display.\n\n#   Description\n\nWe may want to see all error logs on all machines, so we need to collector\nlogs, and save it in somewhere. This module is used to collector logs on one\nmachine.\n\nNormally, same error info will be loged repeatedly, we do not want\nto save duplicated log info, so logs produced by same source file at\nsame line number in one second will be combined.\n\n#   Conf\n\nconfiguration for log files. It is a dict, the key is the log name, the value\nis the configuration for the log.\n\n## file_path\n\nthe path of the log file.\n\n## is_first_line\n\nis a callback function.\nThe argument to this function is a line in log file, if the line is the\nfirst line of a log, then return `True`, otherwise return `False`.\n\n## get_level\n\nis a callback function.\nThe argument to this function is the complete log string, which may contains\nmultiple lines. It should return the level of the log, which is a string.\n\n## parse\n\nis a callback function.\nThe argument to this function is the complete log string, which may contains\nmultiple lines. It should return a dict contains following fields.\n\n-   log_ts:\n    the timestamp of this log, such as `1523936052`, is a integer.\n\n-   level:\n    the level of this log, such as 'info'.\n\n-   source_file:\n    the source file in which the log was produced.\n\n-   line_number:\n    the number of the line at which the log was produced.\n\n## level\n\nis a list, used to specify the interested log levels.\n\n\n\n\n# Install\n\n```\npip install k3logcollector\n```\n\n# Synopsis\n\n```python\n\nimport k3logcollector\n\n\ndef send_log(log_entry):\n    print(\"send the log entry to database or other place.\")\n\n\ndef is_first_line(line):\n    print(\"return True if the line is the first line of a log,\")\n    print(\"otherwise return False.\")\n\n\ndef get_level(log_str):\n    print(\"return the level of the log.\")\n\n\ndef parse(log_str):\n    print(\"parse the log.\")\n\n\nconf = {\n    'front_error_log': {\n        'file_path': 'path/to/log/file/xxx.error.log',\n        'level': ['warn', 'error'],\n        'is_first_line': is_first_line,\n        'get_level': get_level,\n        'parse': parse,\n    },\n}\n\nkwargs = {\n    'node_id': '123abc',\n    'node_ip': '1.2.3.4',\n    'send_log': send_log,\n    'conf': conf,\n}\n\nk3logcollector.run(**kwargs)\n\n```\n\n#   Author\n\nZhang Yanpo (张炎泼) \u003cdrdr.xp@gmail.com\u003e\n\n#   Copyright and License\n\nThe MIT License (MIT)\n\nCopyright (c) 2015 Zhang Yanpo (张炎泼) \u003cdrdr.xp@gmail.com\u003e\n\n\n[pykit3]: https://github.com/pykit3","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpykit3%2Fk3logcollector","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpykit3%2Fk3logcollector","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpykit3%2Fk3logcollector/lists"}