{"id":15141753,"url":"https://github.com/witchpixels/firehosehttp","last_synced_at":"2026-02-04T16:02:10.241Z","repository":{"id":257722555,"uuid":"859159674","full_name":"witchpixels/FirehoseHttp","owner":"witchpixels","description":"Simple containerized service that provides a mostly blind api into a firehose stream.","archived":false,"fork":false,"pushed_at":"2024-09-20T07:54:00.000Z","size":40,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-07-01T07:07:53.544Z","etag":null,"topics":["aws","developer-tools","docker","docker-image","firehose"],"latest_commit_sha":null,"homepage":"https://hub.docker.com/repository/docker/witchpixels/firehose-http","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/witchpixels.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-09-18T07:31:40.000Z","updated_at":"2024-09-20T07:54:04.000Z","dependencies_parsed_at":"2024-09-21T14:02:34.419Z","dependency_job_id":"0ebe3f87-8dfb-4f86-a7ea-e3df6d07531f","html_url":"https://github.com/witchpixels/FirehoseHttp","commit_stats":null,"previous_names":["witchpixels/firehosehttp"],"tags_count":2,"template":false,"template_full_name":null,"purl":"pkg:github/witchpixels/FirehoseHttp","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/witchpixels%2FFirehoseHttp","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/witchpixels%2FFirehoseHttp/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/witchpixels%2FFirehoseHttp/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/witchpixels%2FFirehoseHttp/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/witchpixels","download_url":"https://codeload.github.com/witchpixels/FirehoseHttp/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/witchpixels%2FFirehoseHttp/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262916657,"owners_count":23383888,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","developer-tools","docker","docker-image","firehose"],"created_at":"2024-09-26T09:01:42.798Z","updated_at":"2026-02-04T16:02:10.131Z","avatar_url":"https://github.com/witchpixels.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"FirehoseHTTP\n------------\nA Containerized Http Interface for AWS Firehose for testing, or very very basic event ingestion.\n\nCreated basically for the singular purpose of testing analytics collectors in various engines, namely Unreal.\n\n# Usage\n\n## Configuration\nThe primary intended use of this is as a docker container, but in either containerized mode, or running on a bare VM you\nwill need to set the following environment variables:\n\n| Environment Var | Example                                  | Description                                                                                              |\n|-----------------|------------------------------------------|----------------------------------------------------------------------------------------------------------|\n| `ACCESS_KEY`    | *a bunch of capital letters and numbers* | Get this from IAM Console, should be for a user with Put* access to the firehose stream you want to use. |\n| `ACCESS_SECRET` | *bunch more random chars*                | The Secret from the `ACCESS_KEY` variable.                                                               |\n| `STREAM_NAME`   | MyCoolFirehoseStream                     | Whatever you named the firehose stream on AWS, **not the full ARN**.                                     |\n| `STREAM_REGION` | ca-central-1                             | The region you created the stream in. Not the human friendly one, but the region code.                   |\n\nYou are going to want to make sure the `ACCESS_KEY` and `ACCESS_SECRET` belong to a user that has access to your \nFirehose Stream.\n\n## API\nThe following routes are provided\n\n### `POST /put`\nTakes any content type and directly streams whatever is in your post body into the Firehose client, unvalidated.\n\n#### Responses\nIt will either respond with `200 OK` with no response body, or will echo back the response from AWS as well as the error \ndetails.\n\n\n### `POST /putBatch`\nBatch uses, as you might expect, the `PutBatch` Firehose Client function and provides two ways of delimiting batches.\n\n#### Unprocessed (default behavior)\nYou can send it newline-delimited (any newline format) text bodies which it will split on those newlines, submitting \neach line as its own message batch. Use this if you are not sending JSON, or well formatted json.\n\n#### Json Array Deconstruction\nIf you set the content type to `application/json` it will try to parse the body as a JSON array.\n\nProvided the body is an array, each object in the array will be submitted as its own record in the batch without any \nfurther processing. \n\n#### Responses\nIt will either respond with `200 OK` with no response body, or will echo back the response from AWS as well as the error \ndetails.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwitchpixels%2Ffirehosehttp","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwitchpixels%2Ffirehosehttp","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwitchpixels%2Ffirehosehttp/lists"}