{"id":14988328,"url":"https://github.com/apache/ozone","last_synced_at":"2025-04-11T03:35:20.931Z","repository":{"id":36983505,"uuid":"212382406","full_name":"apache/ozone","owner":"apache","description":"Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.","archived":false,"fork":false,"pushed_at":"2025-04-10T06:51:07.000Z","size":102319,"stargazers_count":898,"open_issues_count":123,"forks_count":522,"subscribers_count":69,"default_branch":"master","last_synced_at":"2025-04-10T07:43:02.750Z","etag":null,"topics":["big-data","hadoop","kubernetes","object-store","s3","storage"],"latest_commit_sha":null,"homepage":"https://ozone.apache.org","language":"Java","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apache.png","metadata":{"files":{"readme":"README.md","changelog":"HISTORY.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-10-02T15:56:19.000Z","updated_at":"2025-04-10T06:51:12.000Z","dependencies_parsed_at":"2023-09-23T09:34:29.899Z","dependency_job_id":"2f1ddbce-c626-4f06-a118-bb0157074839","html_url":"https://github.com/apache/ozone","commit_stats":{"total_commits":7880,"total_committers":281,"mean_commits":28.04270462633452,"dds":0.8677664974619289,"last_synced_commit":"45f9138734083733bf1152f9eadcc9b5f1a20dde"},"previous_names":[],"tags_count":33,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fozone","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fozone/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fozone/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fozone/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apache","download_url":"https://codeload.github.com/apache/ozone/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248337363,"owners_count":21087022,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["big-data","hadoop","kubernetes","object-store","s3","storage"],"created_at":"2024-09-24T14:16:32.484Z","updated_at":"2025-04-11T03:35:20.889Z","avatar_url":"https://github.com/apache.png","language":"Java","funding_links":[],"categories":["大数据"],"sub_categories":[],"readme":"Apache Ozone\n===\n\nOzone is a scalable, redundant, and distributed object store for Hadoop and Cloud-native environments. Apart from scaling to billions of objects of varying sizes, Ozone can function effectively in containerized environments such as Kubernetes and YARN.\n\n\n * MULTI-PROTOCOL SUPPORT: Ozone supports different protocols like S3 and Hadoop File System APIs.\n * SCALABLE: Ozone is designed to scale to tens of billions of files and blocks and, in the future, even more.\n * CONSISTENT: Ozone is a strongly consistent object store. This consistency is achieved by using protocols like RAFT.\n * CLOUD-NATIVE: Ozone is designed to work well in containerized environments like YARN and Kubernetes.\n * SECURE: Ozone integrates with Kerberos infrastructure for authentication, supports native ACLs and integrates with Ranger for access control and supports TDE and on-wire encryption.\n * HIGHLY AVAILABLE: Ozone is a fully replicated system that is designed to survive multiple failures.\n\n## Documentation\n\nThe latest documentation is generated together with the releases and hosted on the apache site.\n\nPlease check [the documentation page](https://ozone.apache.org/docs/) for more information.\n\n## Contact\n\nOzone is a top level project under the [Apache Software Foundation](https://apache.org)\n\n * Ozone [web page](https://ozone.apache.org)\n * Mailing lists\n     * For any questions use: [dev@ozone.apache.org](https://lists.apache.org/list.html?dev@ozone.apache.org)\n * Chat: There are a few ways to interact with the community\n     * You can find the #ozone channel on the official ASF Slack. Invite link is [here](http://s.apache.org/slack-invite).\n     * You can use [GitHub Discussions](https://github.com/apache/ozone/discussions) to post questions or follow community syncs. \n * There are Open [Weekly calls](https://cwiki.apache.org/confluence/display/OZONE/Ozone+Community+Calls) where you can ask anything about Ozone.\n    * Past meeting notes are also available from the wiki.\n * Reporting security issues: Please consult with [SECURITY.md](./SECURITY.md) about reporting security vulnerabilities and issues.\n\n## Download\n\nLatest release artifacts (source release and binary packages) are [available](https://ozone.apache.org/downloads/) from the Ozone web page.\n\n## Quick start\n\n### Run Ozone from published Docker image\n\nThe easiest way to start a cluster with docker is:\n\n```\ndocker run -p 9878:9878 apache/ozone\n```\n\nAnd you can use AWS S3 cli:\n\n```\naws s3api --endpoint http://localhost:9878/ create-bucket --bucket=wordcount\naws s3 --endpoint http://localhost:9878 cp --storage-class REDUCED_REDUNDANCY  /tmp/testfile  s3://wordcount/testfile\n```\n\n### Run Ozone from released artifact\n\nIf you need a more realistic cluster, you can [download](https://ozone.apache.org/downloads/) the latest (binary) release package, and start a cluster with the help of docker-compose:\n\nAfter you untar the binary:\n\n```\ncd compose/ozone\ndocker-compose up -d --scale datanode=3\n```\n\nThe `compose` folder contains different sets of configured clusters (secure, HA, mapreduce example), you can check the various subfolders for more examples.\n\n### Run on Kubernetes\n\nOzone is a first class citizen of the Cloud-Native environments. The binary package contains multiple sets of K8s resource files to show how it can be deployed.\n\n## Build from source\n\nOzone can be built with [Apache Maven](https://maven.apache.org):\n\n```\nmvn clean install -DskipTests\n```\n\nAnd can be started with the help of Docker:\n\n```\ncd hadoop-ozone/dist/target/ozone-*/compose/ozone\ndocker-compose up -d --scale datanode=3\n```\nFor more information, you can check the [Contribution guideline](./CONTRIBUTING.md)\n\n## Contribute\n\nAll contributions are welcome.\n\n 1. Please open a [Jira](https://issues.apache.org/jira/projects/HDDS/issues) issue\n 2. And create a pull request\n\nFor more information, you can check the [Contribution guideline](./CONTRIBUTING.md)\n\n## License\n\nThe Apache Ozone project is licensed under the Apache 2.0 License. See the [LICENSE](./LICENSE.txt) file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fozone","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapache%2Fozone","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapache%2Fozone/lists"}