{"id":13541463,"url":"https://github.com/superstreamlabs/memphis","last_synced_at":"2026-01-12T06:38:01.250Z","repository":{"id":37010949,"uuid":"454372510","full_name":"superstreamlabs/memphis","owner":"superstreamlabs","description":"Memphis.dev is a highly scalable and effortless data streaming platform","archived":false,"fork":false,"pushed_at":"2024-05-27T12:23:48.000Z","size":491208,"stargazers_count":3248,"open_issues_count":110,"forks_count":217,"subscribers_count":35,"default_branch":"master","last_synced_at":"2024-10-29T15:10:13.792Z","etag":null,"topics":["data","data-engineering","data-pipeline","data-stream-processing","data-streaming","enrichment","golang","kubernetes","message-broker","message-bus","message-queue","messaging-queue","microservices","schema-registry"],"latest_commit_sha":null,"homepage":"https://docs.memphis.dev","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/superstreamlabs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-02-01T12:07:05.000Z","updated_at":"2024-10-28T07:57:50.000Z","dependencies_parsed_at":"2023-11-12T12:21:11.232Z","dependency_job_id":"f01a7478-43e1-4ff5-9371-db90aa805df4","html_url":"https://github.com/superstreamlabs/memphis","commit_stats":null,"previous_names":["memphisdev/memphis-broker","superstreamlabs/memphis","memphisdev/memphis"],"tags_count":29,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/superstreamlabs%2Fmemphis","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/superstreamlabs%2Fmemphis/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/superstreamlabs%2Fmemphis/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/superstreamlabs%2Fmemphis/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/superstreamlabs","download_url":"https://codeload.github.com/superstreamlabs/memphis/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248688556,"owners_count":21145765,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","data-engineering","data-pipeline","data-stream-processing","data-streaming","enrichment","golang","kubernetes","message-broker","message-bus","message-queue","messaging-queue","microservices","schema-registry"],"created_at":"2024-08-01T10:00:48.279Z","updated_at":"2026-01-12T06:38:01.244Z","avatar_url":"https://github.com/superstreamlabs.png","language":"Go","readme":"\u003cp align=\"center\"\u003e\nPlease pay attention that Memphis.dev is no longer supported officially by the Superstream team (formerly Memphis.dev) and was released to the public.\n  \u003cp align=\"center\"\u003e\n    \n\u003ca href=\"![Github (4)](https://github.com/memphisdev/memphis-terraform/assets/107035359/a5fe5d0f-22e1-4445-957d-5ce4464e61b1)\"\u003e[![Github (4)](https://github.com/memphisdev/memphis-terraform/assets/107035359/a5fe5d0f-22e1-4445-957d-5ce4464e61b1)](https://memphis.dev)\u003c/a\u003e\n\u003cp align=\"center\"\u003e\n\u003ca href=\"https://memphis.dev/discord\"\u003e\u003cimg src=\"https://img.shields.io/discord/963333392844328961?color=6557ff\u0026label=discord\" alt=\"Discord\"\u003e\u003c/a\u003e\n\u003ca href=\"https://github.com/memphisdev/memphis/issues?q=is%3Aissue+is%3Aclosed\"\u003e\u003cimg src=\"https://img.shields.io/github/issues-closed/memphisdev/memphis?color=6557ff\"\u003e\u003c/a\u003e \n  \u003cimg src=\"https://img.shields.io/npm/dw/memphis-dev?color=ffc633\u0026label=installations\"\u003e\n\u003ca href=\"https://github.com/memphisdev/memphis/blob/master/CODE_OF_CONDUCT.md\"\u003e\u003cimg src=\"https://img.shields.io/badge/Code%20of%20Conduct-v1.0-ff69b4.svg?color=ffc633\" alt=\"Code Of Conduct\"\u003e\u003c/a\u003e \n\u003cimg alt=\"GitHub release (latest by date)\" src=\"https://img.shields.io/github/v/release/memphisdev/memphis?color=61dfc6\"\u003e\n\u003cimg src=\"https://img.shields.io/github/last-commit/memphisdev/memphis?color=61dfc6\u0026label=last%20commit\"\u003e\n\u003c/p\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n  \u003ch4\u003e\n\n**[Memphis.dev](https://memphis.dev)** Is The First Data Streaming Platform Designed For Backend Developers\u003cbr\u003e\nTo Build Event-driven And Real-time Features Faster Than Ever.\u003cbr\u003e\n\n  \u003c/h4\u003e\n  \n\u003c/div\u003e\n\n## ![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) About\n\nBefore Memphis came along, handling ingestion and processing of events on a large scale took months to adopt and was a capability reserved for the top 20% of mega-companies. Now, Memphis opens the door for the other 80% to unleash their event and data streaming superpowers quickly, easily, and with great cost-effectiveness.\n\n## 🚀 Getting Started\n[Tutorials](https://docs.memphis.dev/memphis/getting-started/tutorials) | [Videos](https://www.youtube.com/playlist?list=PL_7iYjqhtXpWpZT2U0zDYo2eGOoGmg2mm)\u003cbr\u003e\n#### ☸ Kubernetes\n```shell\nhelm repo add memphis https://k8s.memphis.dev/charts/ --force-update \u0026\u0026 \\\nhelm install my-memphis memphis/memphis --create-namespace --namespace memphis\n```\n#### 🐳 Docker Compose\n```shell\ncurl -s https://memphisdev.github.io/memphis-docker/docker-compose.yml -o docker-compose.yml \u0026\u0026 \\\ndocker compose -f docker-compose.yml -p memphis up\n```\n\n\u003cdiv align=\"center\"\u003e\n\n  \u003cimg style=\"width: 50%\" src=\"https://github.com/memphisdev/memphis/assets/70286779/38c7cee0-964e-40bd-ab3c-0ea5aeefc513\" /\u003e\n\n\u003c/div\u003e\n\n## ✨ Key Features [v1.4.4](https://docs.memphis.dev/memphis/release-notes/releases/v1.4.4-latest)\n\n\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Production-ready message broker in under 3 minutes\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Easy-to-use UI, CLI, and SDKs\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Data-level observability\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Dead-Letter Queue with automatic message retransmit\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Schemaverse - Embedded schema management for produced data (Protobuf/JSON/GraphQL/Avro)\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Functions for real-time processing\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Graph visualization\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Storage tiering\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) SDKs: Node.JS, Go, Python, Typescript, NestJS, REST, .NET, Kotlin\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Kubernetes-native\u003cbr\u003e\n![20](https://user-images.githubusercontent.com/70286779/220196529-abb958d2-5c58-4c33-b5e0-40f5446515ad.png) Community driven\u003cbr\u003e\n\n\u003ctable\u003e\n  \n  \u003ctr\u003e\n    \u003cth\u003e\n      \u003ca href=\"https://docs.memphis.dev\"\u003eEnd-to-end Observability\u003c/a\u003e\n    \u003c/th\u003e\n    \u003cth\u003e\n      \u003ca href=\"https://docs.memphis.dev\"\u003e\"Feel\" your producers, consumers, and records\u003c/a\u003e\n    \u003c/th\u003e\n\n  \u003c/tr\u003e\n\n   \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003ca href=\"https://docs.memphis.dev\"\u003e\n        \u003cimg src=\"https://github.com/memphisdev/memphis/assets/70286779/5763319d-1c06-4478-b0ee-582f37acf2b8\" /\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n        \u003ca href=\"https://docs.memphis.dev\"\u003e\n          \u003cimg width=\"1512\" alt=\"Screenshot 2023-09-29 at 10 17 01\" src=\"https://github.com/memphisdev/memphis/assets/70286779/1fd5358d-adb8-4aa5-9b19-9640bdfd2417\"\u003e\n        \u003c/a\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\n  \u003ctr\u003e\n    \u003cth\u003e\n      \u003ca href=\"https://docs.memphis.dev\"\u003eQuickly analyze system health using a graph overview\u003c/a\u003e\n    \u003c/th\u003e\n    \u003cth\u003e\n      \u003ca href=\"https://docs.memphis.dev\"\u003eNever lose a message with automatic dead-letter\u003c/a\u003e\n    \u003c/th\u003e\n\u003c/tr\u003e\n\n \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n        \u003ca href=\"https://docs.memphis.dev\"\u003e\n            \u003cimg src=\"https://github.com/memphisdev/memphis/assets/70286779/1be9768b-b658-4bb3-89bd-ee814a8813b9\" /\u003e\n        \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n      \u003ca href=\"https://docs.memphis.dev\"\u003e\n        \u003cimg width=\"1512\" alt=\"Screenshot 2023-09-29 at 10 17 12\" src=\"https://github.com/memphisdev/memphis/assets/70286779/2d6638d8-d1f1-4aba-8e36-7b7a57e76f16\"\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n \u003c/tr\u003e\n\n \u003ctr\u003e\n    \u003cth\u003e\n      \u003ca href=\"https://docs.memphis.dev/memphis/memphis-broker/concepts/storage-and-redundancy\"\u003eSave up 96% storage costs with Storage tiering\u003c/a\u003e\n    \u003c/th\u003e\n    \u003cth\u003e\n      \u003ca href=\"https://docs.memphis.dev/memphis/memphis-schemaverse/schemaverse-schema-management\"\u003eIncrease data quality with schemas\u003c/a\u003e\n    \u003c/th\u003e\n  \u003c/tr\u003e\n\n \u003ctr\u003e\n    \u003ctd width=\"50%\"\u003e\n        \u003ca href=\"https://docs.memphis.dev\"\u003e\n          \u003cimg width=\"1512\" alt=\"Screenshot 2023-09-29 at 10 17 58\" src=\"https://github.com/memphisdev/memphis/assets/70286779/beeaec9f-c8a5-4f6a-b520-a810eb68aa13\"\u003e\n        \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"50%\"\u003e\n        \u003ca href=\"https://docs.memphis.dev\"\u003e\n        \u003cimg width=\"1512\" alt=\"Screenshot 2023-09-29 at 10 16 40\" src=\"https://github.com/memphisdev/memphis/assets/70286779/7c62977a-2d83-4c54-b233-084958be1411\"\u003e\n        \u003c/a\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\n\u003c/table\u003e\n\n## Public case studies\n- [Dstny - Building the next-gen in-house communication using Memphis.dev](https://memphis.dev/blog/how-dstny-building-the-future-of-in-house-communication-using-memphis-dev/)\n- [Gastromatic - Synchronizing data using Memphis.dev](https://medium.com/gastromatic/synchronizing-data-using-memphis-dev-a-case-study-2e6e9a7b5512)\n- [KELA - Real-time cyber threats identification](https://memphis.dev/blog/how-kela-is-using-memphis-dev-for-real-time-cyber-threats-identification/)\n- [Handling millions of discord messages](https://memphis.dev/blog/how-cactusfire-handles-millions-of-daily-discord-messages-using-memphis-dev/)\n\n## Network diagram\n\n\u003ca href=\"https://docs.memphis.dev/memphis/memphis/architecture\"\u003e\n\u003cp align=\"center\"\u003e\n\u003cimg height=\"500\" alt=\"memphis.dev Architecture\" src=\"https://user-images.githubusercontent.com/70286779/229371674-35a5e4cc-d3f5-413e-982d-d1081b18d82a.jpeg\"\u003e\n\n\u003c/p\u003e\n\u003c/a\u003e\n\n## SDKs supported features\n                    \nFeature | Go | Python | JS | .NET | Java | Rust \n------------- | ------------- | ------------- | ------------- | ------------- | ------------- | -------------\nConnection | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nDisconnection | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nCreate a station | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nDestroy a station | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nRetention | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nRetention values | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nStorage types | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nCreate a new schema | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nEnforce a schema Protobuf | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nEnforce a schema Json | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :construction: (WIP)\nEnforce a schema GraphQL | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nEnforce a schema Avro | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nDetach a schema | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nProduce | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nAdd headers | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nAsync produce | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nMessage ID | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | ? | :white_check_mark:\nDestroy a producer | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | Partial | :white_check_mark:\nConsume | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nContext to message handler | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | Not Applicable\nAck a message | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nNack a Message | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nSend a message to dead-letter | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nGet message time sent | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\nFetch | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x:\nMessage delay | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nGet Headers | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nGet message sequence number | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nDestroying a Consumer | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:\nCheck if broker is connected | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark:\nConsumer prefetch | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark: | :x: | :white_check_mark:\nSchema deserialization | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x:\n\n## 👉 Use-cases\n- Async task management\n- Real-time streaming pipelines\n- Data ingestion\n- Cloud Messaging\n  - Services (microservices, service mesh)\n  - Event/Data Streaming (observability, analytics, ML/AI)\n- Queuing\n- N:N communication patterns\n- Ingest Grafana Loki logs at scale\n\n## Support 🙋‍♂️🤝\n\n### Have any questions ❓\n\nWe welcome you to our discord server with your questions, doubts and feedback.\n\n\u003ca href=\"https://memphis.dev/discord\"\u003e\u003cimg src=\"https://amplication.com/images/discord_banner_purple.svg\"/\u003e\u003c/a\u003e\n\n### Create a bug 🐞 report\n\nIf you see an error message or run into an issue, please [create bug report](https://github.com/memphisdev/memphis/issues/new?assignees=\u0026labels=type%3A%20bug\u0026template=bug_report.md\u0026title=). This effort is valued and it will help all Memphis{dev} users.\n\n\n### Submit a feature 💡 request \n\nIf you have an idea, or you think that we're missing a capability that would make development easier and more robust, please [Submit feature request](https://github.com/memphisdev/memphis/issues/new?assignees=\u0026labels=type%3A%20feature%20request).\n\nIf an issue❗with similar feature request already exists, don't forget to leave a \"+1\".\nIf you add some more information such as your thoughts and vision about the feature, your comments will be embraced warmly :)\n\n## Contributing\n\nMemphis.dev is an open-source project.\u003cbr\u003e\nWe are committed to a fully transparent development process and appreciate highly any contributions.\u003cbr\u003e\nWhether you are helping us fix bugs, proposing new features, improving our documentation or spreading the word - we would love to have you as part of the Memphis.dev community.\n\nPlease refer to our [Contribution Guidelines](./CONTRIBUTING.md) and [Code of Conduct](./CODE_OF_CONDUCT.md).\n\n## Contributors ✨\n\nThanks goes to these wonderful people ❤:\u003cbr\u003e\u003cbr\u003e\n \u003ca href = \"https://github.com/memphisdev/memphis/graphs/contributors\"\u003e\n   \u003cimg src = \"https://contrib.rocks/image?repo=memphisdev/memphis\"/\u003e\n \u003c/a\u003e\n\n## License 📃\nMemphis is open-sourced and operates under the \"Memphis Business Source License 1.0\" license\nBuilt out of Apache 2.0, the main difference between the licenses is:\n\"You may make use of the Licensed Work (i) only as part of your own product or service, provided it is not a message broker or a message queue product or service; and (ii) provided that you do not use, provide, distribute, or make available the Licensed Work as a Service. A “Service” is a commercial offering, product, hosted, or managed service, that allows third parties (other than your own employees and contractors acting on your behalf) to access and/or use the Licensed Work or a substantial set of the features or functionality of the Licensed Work to third parties as a software-as-a-service, platform-as-a-service, infrastructure-as-a-service or other similar services that compete with Licensor products or services.\"\nPlease check out [License](./LICENSE) to read the full text.\n","funding_links":[],"categories":["Go"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsuperstreamlabs%2Fmemphis","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsuperstreamlabs%2Fmemphis","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsuperstreamlabs%2Fmemphis/lists"}