{"id":22621447,"url":"https://github.com/cca/egress-estimate","last_synced_at":"2025-03-29T02:24:31.102Z","repository":{"id":233237967,"uuid":"666562094","full_name":"cca/egress-estimate","owner":"cca","description":null,"archived":false,"fork":false,"pushed_at":"2023-07-14T21:05:47.000Z","size":9,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-02-03T12:35:18.724Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cca.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2023-07-14T21:05:12.000Z","updated_at":"2023-07-14T21:07:53.000Z","dependencies_parsed_at":"2024-04-15T04:11:04.958Z","dependency_job_id":null,"html_url":"https://github.com/cca/egress-estimate","commit_stats":null,"previous_names":["cca/egress-estimate"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cca%2Fegress-estimate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cca%2Fegress-estimate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cca%2Fegress-estimate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cca%2Fegress-estimate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cca","download_url":"https://codeload.github.com/cca/egress-estimate/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246127769,"owners_count":20727784,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-08T23:09:13.329Z","updated_at":"2025-03-29T02:24:31.083Z","avatar_url":"https://github.com/cca.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Apache Egress Estimate\n\nCompile the \"sent bytes\" data from Apache logs to estimate the amount of egress from a locally hosted application.\n\nNote that sent bytes does not include HTTP headers so these figures will undercount by at least that much. Headers are trivial relative to most file sizes but web apps involve _a lot_ of requests with little to no content (think: non-2XX responses, like 302 redirects) where the headers become a factor.\n\n## Usage\n\nRequires `pipenv` and a modern python. Download apache logs into the data dir. You will probably need to `tar czf` the logs and do some permissions changes. Look for the `LogFormat` directive in Apache configuration and make sure the `LogParser` call at the top of the script matches it so we know where to pull the date and bytes sent figures from. The script accepts any number of logs as positional arguments.\n\n```sh\n# setup project \u0026 run\npipenv install\npipenv run ./egress.py data/*\n```\n\n## Notes\n\nCLI progress bar\nhttps://pypi.org/project/progress/\n\nParallel processing\nhttps://docs.python.org/3/library/multiprocessing.html\n\nSee sections on Manager and Pool.\n\nApace `LogFormat` directive:\nhttps://httpd.apache.org/docs/2.4/logs.html\n\n## LICENSE\n\n[ECL Version 2.0](https://opensource.org/licenses/ECL-2.0)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcca%2Fegress-estimate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcca%2Fegress-estimate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcca%2Fegress-estimate/lists"}