{"id":20359384,"url":"https://github.com/saidsef/aws-kinesis-local","last_synced_at":"2026-06-02T01:00:34.955Z","repository":{"id":39004896,"uuid":"95986526","full_name":"saidsef/aws-kinesis-local","owner":"saidsef","description":"AWS Kinesis local for building applications with streaming data","archived":false,"fork":false,"pushed_at":"2026-04-28T18:06:35.000Z","size":159,"stargazers_count":22,"open_issues_count":1,"forks_count":4,"subscribers_count":3,"default_branch":"main","last_synced_at":"2026-04-28T20:11:38.844Z","etag":null,"topics":["amazon-kinesis-streams","aws-kinesis","aws-kinesis-local","aws-kinesis-stream","docker-container","nodejs","stream-processing","streaming-data"],"latest_commit_sha":null,"homepage":"","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/saidsef.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null},"funding":{"custom":["https://revolut.me/saidsef"]}},"created_at":"2017-07-01T20:38:14.000Z","updated_at":"2026-04-28T18:06:37.000Z","dependencies_parsed_at":"2024-06-02T19:25:03.054Z","dependency_job_id":"dcb9cdff-e9aa-4c87-9683-8084e52eb35b","html_url":"https://github.com/saidsef/aws-kinesis-local","commit_stats":null,"previous_names":[],"tags_count":10,"template":false,"template_full_name":null,"purl":"pkg:github/saidsef/aws-kinesis-local","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saidsef%2Faws-kinesis-local","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saidsef%2Faws-kinesis-local/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saidsef%2Faws-kinesis-local/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saidsef%2Faws-kinesis-local/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/saidsef","download_url":"https://codeload.github.com/saidsef/aws-kinesis-local/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saidsef%2Faws-kinesis-local/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33800676,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-01T02:00:06.963Z","response_time":115,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["amazon-kinesis-streams","aws-kinesis","aws-kinesis-local","aws-kinesis-stream","docker-container","nodejs","stream-processing","streaming-data"],"created_at":"2024-11-14T23:33:40.928Z","updated_at":"2026-06-02T01:00:34.922Z","avatar_url":"https://github.com/saidsef.png","language":"Dockerfile","funding_links":["https://revolut.me/saidsef"],"categories":[],"sub_categories":[],"readme":"# Docker Kinesis Local [![CI](https://github.com/saidsef/aws-kinesis-local/actions/workflows/docker.yml/badge.svg)](#howto-and-documentation) [![Tagging](https://github.com/saidsef/aws-kinesis-local/actions/workflows/charts.yml/badge.svg)](#howto-and-documentation)\n\nBuild for local AWS Kinesis\n\n## Amazon Kinesis Streams\n\nAmazon Kinesis Streams lets you build your own apps to deal with streaming data, tailored to your specific requirements. It achieves this by:\n\n* **Continuous Data Capture:** Reliably storing huge volumes of data (terabytes per hour) from masses of sources. Think website activity, financial trades, social media, system logs, and location tracking.\n* **Custom App Development:** Using the Amazon Kinesis Client Library (KCL) to build applications that use this stream of data.\n* **Real-Time Use Cases:** Powering things like live dashboards, automated alerts, dynamic pricing models, and targeted advertising.\n* **Integration with AWS:** Feeding data from Kinesis Streams into other AWS services, such as Amazon S3, Amazon Redshift, Amazon EMR, and AWS Lambda.\n\n## Components\n\n* NodeJS\n* [Kinesislite](https://github.com/mhart/kinesalite)\n\n## HowTo and Documentation\n\n* [Kinesislite](https://github.com/mhart/kinesalite)\n\n ```bash\ndocker run --rm -ti docker.io/saidsef/aws-kinesis-local --help\n\n Usage: kinesalite [--port \u003cport\u003e] [--path \u003cpath\u003e] [--ssl] [options]\n\n A Kinesis http server, optionally backed by LevelDB\n\n Options:\n --help                 Display this help message and exit\n --port \u003cport\u003e          The port to listen on (default: 4567)\n --path \u003cpath\u003e          The path to use for the LevelDB store (in-memory by default)\n --ssl                  Enable SSL for the web server (default: false)\n --createStreamMs \u003cms\u003e  Amount of time streams stay in CREATING state (default: 500)\n --deleteStreamMs \u003cms\u003e  Amount of time streams stay in DELETING state (default: 500)\n --updateStreamMs \u003cms\u003e  Amount of time streams stay in UPDATING state (default: 500)\n --shardLimit \u003climit\u003e   Shard limit for error reporting (default: 10)\n ```\n\n## Local Deployment\n\n```bash\ndocker run -d -p 4567:4567 docker.io/saidsef/aws-kinesis-local:latest --help\n```\n\n```bash\naws --endpoint-url=http://{kinesis-host}:4567 kinesis list-streams --region eu-west-1\n\n{\n    \"StreamNames\": []\n}\n```\n\n## Kubernetes Deployment\n\n### HELM\n\n```shell\nhelm repo add kinesis https://saidsef.github.io/aws-kinesis-local/\nhelm repo update\nhelm upgrade --install kinesis kinesis/kinesis --namespace kinesis --create-namespace\n```\n\n### Kubectl\n\n```bash\nkubectl apply -k deployment/\n\n```\n\n### ArgoCD\n\n```bash\nkubectl apply -f argocd/application.yml\n```\n\n## Testing\n\n### AWS CLI/SDK\n\n```bash\naws --endpoint-url=http://[kinesis|IP_ADDRESS] kinesis list-streams --region eu-west-1\n\n{\n    \"StreamNames\": []\n}\n```\n\n```javascript\n// npm install aws-sdk\nconst AWS = require('aws-sdk');\n\nlet kinesis = new AWS.Kinesis({ endpoint: \"http://kinesis.[namespace].svc\", region: \"eu-west-1\"})\nkinesis.listStreams(console.log);\n```\n\n\u003e The `endpoint` value depends on your deployment type\n\n\u003e See [AWS Kinesis documentations](https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/Kinesis.html)\n\n## Source\n\nOur latest and greatest source of Jenkins can be found on [GitHub](#deployment). Fork us!\n\n## Contributing\n\nWe would :heart:  you to contribute by making a [pull request](https://github.com/saidsef/aws-kinesis-local/pulls).\n\nPlease read the official [Contribution Guide](./CONTRIBUTING.md) for more information on how you can contribute.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsaidsef%2Faws-kinesis-local","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsaidsef%2Faws-kinesis-local","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsaidsef%2Faws-kinesis-local/lists"}