{"id":15452208,"url":"https://github.com/digitalkaoz/aws-log-shipper","last_synced_at":"2026-02-02T17:04:08.422Z","repository":{"id":33628556,"uuid":"160157105","full_name":"digitalkaoz/aws-log-shipper","owner":"digitalkaoz","description":"Ship AWS Logs (CF, ALB, ELB, S3) stored in S3 to Cloudwatch (or others)","archived":false,"fork":false,"pushed_at":"2022-12-08T21:39:48.000Z","size":1038,"stargazers_count":3,"open_issues_count":18,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-02-01T18:46:10.318Z","etag":null,"topics":["alb","aws","aws-lambda","cloudfront-logs","cloudwatch","elb","logs"],"latest_commit_sha":null,"homepage":null,"language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/digitalkaoz.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-12-03T08:26:01.000Z","updated_at":"2021-12-01T22:26:14.000Z","dependencies_parsed_at":"2023-01-15T01:46:03.097Z","dependency_job_id":null,"html_url":"https://github.com/digitalkaoz/aws-log-shipper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitalkaoz%2Faws-log-shipper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitalkaoz%2Faws-log-shipper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitalkaoz%2Faws-log-shipper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitalkaoz%2Faws-log-shipper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/digitalkaoz","download_url":"https://codeload.github.com/digitalkaoz/aws-log-shipper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240002103,"owners_count":19732164,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["alb","aws","aws-lambda","cloudfront-logs","cloudwatch","elb","logs"],"created_at":"2024-10-01T21:41:35.042Z","updated_at":"2026-02-02T17:04:03.391Z","avatar_url":"https://github.com/digitalkaoz.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# aws-log-shipper\n\nThis module lets you ship AWS Logs from services that are only able to store them in an S3 Bucket (pretty useless) to other Services (e.g. Cloudwatch).\nIt ships the Data as JSON encoded String (so easy for every System afterwards)\n\n## Installation\n\n```\nyarn add aws-log-shipper\n```\n\n## Usage\n\n```js\nconst logShipper = require(\"aws-log-shipper\");\n\nmodule.exports.handler = logShipper.default;\n```\n\nThen configure your Lambda to use `index.handler` as handler endpoint.\nYou should invoke this Lambda with `s3:PutEvent` Bucket Notification of those Logfiles.\n\n## Implementations\n\ncurrently we can ship logs from the following services:\n\n* Cloudfront\n* ALB\n* ELB (not yet, its hard to differntiate from ALB logs just by looking at file itself)\n* S3\n\n## Configuration\n\nwe configure the Lambda with `ENV` vars completely\n\n* `SHIPPER` : where to ship the logs (atm the only option is `cloudwatch`)\n* `CF_LOG_GROUP` : which Cloudwatch Loggroup to use for Cloudfront logs\n* `ALB_LOG_GROUP` : which Cloudwatch Loggroup to use for ALB logs\n* `ELB_LOG_GROUP` : which Cloudwatch Loggroup to use for ELB logs\n* `S3_LOG_GROUP` : which Cloudwatch Loggroup to use for S3 logs\n\n## TODO\n\nthis was just a quick evening hack, so most things are a bit rough\n\n* Tests\n* Docs\n* decouple the ENV vars a bit (to tied to Cloudwatch Shipper)\n* differentiate between ELB and ALB logs","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdigitalkaoz%2Faws-log-shipper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdigitalkaoz%2Faws-log-shipper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdigitalkaoz%2Faws-log-shipper/lists"}