{"id":30743228,"url":"https://github.com/peterxcli/ozone-helper","last_synced_at":"2025-09-04T02:05:27.143Z","repository":{"id":298514462,"uuid":"966887261","full_name":"peterxcli/ozone-helper","owner":"peterxcli","description":null,"archived":false,"fork":false,"pushed_at":"2025-06-11T13:16:40.000Z","size":40378,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-11T14:43:47.757Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/peterxcli.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-04-15T15:48:30.000Z","updated_at":"2025-06-11T13:16:43.000Z","dependencies_parsed_at":"2025-06-11T14:53:56.145Z","dependency_job_id":null,"html_url":"https://github.com/peterxcli/ozone-helper","commit_stats":null,"previous_names":["peterxcli/ozone-helper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/peterxcli/ozone-helper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peterxcli%2Fozone-helper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peterxcli%2Fozone-helper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peterxcli%2Fozone-helper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peterxcli%2Fozone-helper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/peterxcli","download_url":"https://codeload.github.com/peterxcli/ozone-helper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peterxcli%2Fozone-helper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":273539317,"owners_count":25123499,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-04T02:00:08.968Z","response_time":61,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-09-04T02:05:26.118Z","updated_at":"2025-09-04T02:05:27.129Z","avatar_url":"https://github.com/peterxcli.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Ceph S3 Test\n\nPull submodules first\n\n```bash\ngit submodule update --init --recursive\n```\n\nInstall `tox`\n\n```bash\nuv tool install tox\n```\n\nCopy `s3tests.conf.SAMPLE` to `s3tests.conf` and edit it to point to your Ceph cluster.\n\n```bash\ncp s3tests.conf.SAMPLE s3tests.conf\n```\n\n## Build ozone cluster\n\n### Download from github artifact\n\nDownload the `gh` command and login to github\n\n```bash\nbrew install gh\ngh auth login\n```\n\nOzone build the binary for your each push\nTO download the ozone binary from the github artifact, specify the workflow run id and the repo\n\n```bash\n# TODO: if branch specific, get the latest run id from the branch\nREPO=github.com/apache/ozone\nRUN_ID=14467654746\nCOMMIT_SHA=$(gh run view $RUN_ID --repo $REPO --json headSha --jq .headSha)\nBRANCH_NAME=$(gh run view $RUN_ID --repo $REPO --json headBranch --jq .headBranch)\nSANITIZED_BRANCH_NAME=$(echo $BRANCH_NAME | tr '/' '_')\nBUILD_DIR=ozone-build/$SANITIZED_BRANCH_NAME-$COMMIT_SHA\nmkdir -p $BUILD_DIR\ngh run view $RUN_ID --repo $REPO --json headSha,headBranch,createdAt \u003e $BUILD_DIR/commit-meta.json\ngh run download $RUN_ID -n ozone-bin --repo $REPO --dir $BUILD_DIR\ntar -xzf $BUILD_DIR/ozone-*.tar.gz -C $BUILD_DIR\nrm $BUILD_DIR/ozone-*.tar.gz\n```\n\n### Start ozone cluster\n\n```bash\ncd $BUILD_DIR/ozone-*-SNAPSHOT/compose/ozone\ndocker compose up -d\ndocker compose exec scm bash -c \"ozone s3 -D=ozone.security.enabled=true revokesecret -y\" || true\ndocker compose exec scm bash -c \"ozone s3 -D=ozone.security.enabled=true getsecret -e\"\n# export AWS_ACCESS_KEY_ID='hadoop'\n# export AWS_SECRET_ACCESS_KEY='88359ea01ae53482e6cdb896c960dd8a57c32ee301fe071d07d0d465590e2074'\n```\n\n### Run tests\n\nSet the port in s3tests.conf to 9878\n\nSet the [s3 main].access_key and [s3 main].secret_key in s3tests.conf to the values above\n# TODO: use python to find the s3tests.conf.SAMPLE file then replace the access_key and secret_key with the parsed values from the above output\n\n```bash\n# You should be at the root of the repo\ncd s3-tests\nS3TEST_CONF=your.conf tox -- s3tests_boto3/functional\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpeterxcli%2Fozone-helper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpeterxcli%2Fozone-helper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpeterxcli%2Fozone-helper/lists"}