{"id":13439247,"url":"https://github.com/apache/incubator-pegasus","last_synced_at":"2025-05-13T23:10:16.567Z","repository":{"id":36956518,"uuid":"41712332","full_name":"apache/incubator-pegasus","owner":"apache","description":"Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store","archived":false,"fork":false,"pushed_at":"2025-05-06T04:19:04.000Z","size":128789,"stargazers_count":2005,"open_issues_count":243,"forks_count":311,"subscribers_count":95,"default_branch":"master","last_synced_at":"2025-05-10T17:16:35.684Z","etag":null,"topics":["distributed-database","key-value-store","nosql","pegasus"],"latest_commit_sha":null,"homepage":"https://pegasus.apache.org/","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apache.png","metadata":{"files":{"readme":"README.md","changelog":"HISTORY.md","contributing":"docs/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2015-09-01T02:29:37.000Z","updated_at":"2025-05-07T03:07:43.000Z","dependencies_parsed_at":"2024-01-22T08:58:57.420Z","dependency_job_id":"3bd39a3d-acf1-49d9-acff-7d281c692021","html_url":"https://github.com/apache/incubator-pegasus","commit_stats":{"total_commits":4922,"total_committers":100,"mean_commits":49.22,"dds":0.8906948394961398,"last_synced_commit":"d91a6e7a492d9d53afae4d1f543d93581114ea64"},"previous_names":["xiaomi/pegasus"],"tags_count":57,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fincubator-pegasus","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fincubator-pegasus/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fincubator-pegasus/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fincubator-pegasus/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apache","download_url":"https://codeload.github.com/apache/incubator-pegasus/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254042312,"owners_count":22004899,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["distributed-database","key-value-store","nosql","pegasus"],"created_at":"2024-07-31T03:01:12.335Z","updated_at":"2025-05-13T23:10:11.518Z","avatar_url":"https://github.com/apache.png","language":"C++","funding_links":[],"categories":["HarmonyOS","C++"],"sub_categories":["Windows Manager"],"readme":"\u003c!--\nLicensed to the Apache Software Foundation (ASF) under one\nor more contributor license agreements.  See the NOTICE file\ndistributed with this work for additional information\nregarding copyright ownership.  The ASF licenses this file\nto you under the Apache License, Version 2.0 (the\n\"License\"); you may not use this file except in compliance\nwith the License.  You may obtain a copy of the License at\n\n  http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing,\nsoftware distributed under the License is distributed on an\n\"AS IS\" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY\nKIND, either express or implied.  See the License for the\nspecific language governing permissions and limitations\nunder the License.\n--\u003e\n\n[github-release]: https://github.com/apache/incubator-pegasus/releases\n\u003c!-- markdown-link-check-disable --\u003e\n[PacificA]: https://www.microsoft.com/en-us/research/publication/pacifica-replication-in-log-based-distributed-storage-systems/\n\u003c!-- markdown-link-check-enable--\u003e\n[rocksdb]: https://github.com/facebook/rocksdb\n[hbase]: https://hbase.apache.org\n[website]: https://pegasus.apache.org\n\n![pegasus-logo](https://github.com/apache/incubator-pegasus-website/blob/master/assets/images/pegasus-logo-inv.png)\n\n[![Lint and build regularly](https://github.com/apache/incubator-pegasus/actions/workflows/regular-build.yml/badge.svg)](https://github.com/apache/incubator-pegasus/actions/workflows/regular-build.yml)\n[![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html)\n[![Releases](https://img.shields.io/github/release/apache/incubator-pegasus.svg)][github-release]\n\n**Note**: The `master` branch may be in an *unstable or even in a broken state* during development.\nPlease use [GitHub Releases][github-release] instead of the `master` branch in order to get stable binaries.\n\nApache Pegasus is a distributed key-value storage system which is designed to be:\n\n- **horizontally scalable**: distributed using hash-based partitioning\n- **strongly consistent**: ensured by [PacificA][PacificA] consensus protocol\n- **high-performance**: using [RocksDB][rocksdb] as underlying storage engine\n- **simple**: well-defined, easy-to-use APIs\n\n## Background\n\nPegasus targets to fill the gap between Redis and [HBase][hbase]. As the former\nis in-memory, low latency, but does not provide a strong-consistency guarantee.\nAnd unlike the latter, Pegasus is entirely written in C++ and its write-path\nrelies merely on the local filesystem.\n\nApart from the performance requirements, we also need a storage system\nto ensure multiple-level data safety and support fast data migration\nbetween data centers, automatic load balancing, and online partition split.\n\n## Features\n\n- **Persistence of data**: Each write is replicated three-way to different ReplicaServers before responding to the client. Using PacificA protocol, Pegasus has the ability for strong consistent replication and membership changes.\n\n- **Automatic load balancing over ReplicaServers**: Load balancing is a builtin function of MetaServer, which manages the distribution of replicas. When the cluster is in an inbalance state, the administrator can invoke a simple rebalance command that automatically schedules the replica migration.\n\n- **Cold Backup**: Pegasus supports an extensible backup and restore mechanism to ensure data safety. The location of snapshot could be a distributed filesystem like HDFS or local filesystem. The snapshot storing in the filesystem can be further used for analysis based on [pegasus-spark](https://github.com/pegasus-kv/pegasus-spark).\n\n- **Eventually-consistent intra-datacenter replication**: This is a feature we called *duplication*. It allows a change made in the local cluster accesible after a short time period by the remote cluster. It help achieving higher availability of your service and gaining better performance by accessing only local cluster.\n\n## To start using Pegasus\n\nSee our documentation on the [Pegasus Website][website].\n\n## Client drivers\n\nPegasus has support for several languages:\n\n- [Java](https://github.com/apache/incubator-pegasus/blob/master/java-client)\n- [C++](https://github.com/apache/incubator-pegasus/blob/master/src/include/pegasus/client.h)\n- [Go](https://github.com/apache/incubator-pegasus/blob/master/go-client)\n- [Python](https://github.com/apache/incubator-pegasus/blob/master/python-client)\n- [Node.js](https://github.com/apache/incubator-pegasus/blob/master/nodejs-client)\n- [Scala](https://github.com/apache/incubator-pegasus/blob/master/scala-client)\n\n## Contact us\n\n- Send emails to the Apache Pegasus developer mailing list: `dev@pegasus.apache.org`. This is the place where topics around development, community, and problems are officially discussed. Please remember to subscribe to the mailing list via `dev-subscribe@pegasus.apache.org`.\n\n- GitHub Issues: submit an issue when you have any idea to improve Pegasus, and when you encountered some bugs or problems.\n\n## Related Projects\n\nTest tools:\n\n- [Java YCSB](https://github.com/xiaomi/pegasus-YCSB)\n\nData import/export tools:\n\n- [DataX](https://github.com/xiaomi/pegasus-datax)\n\n## License\n\nCopyright 2022 The Apache Software Foundation. Licensed under the Apache License, Version 2.0:\n[http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fincubator-pegasus","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapache%2Fincubator-pegasus","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fincubator-pegasus/lists"}