{"id":20068786,"url":"https://github.com/bigbitbus/objectbench","last_synced_at":"2025-09-25T17:26:06.304Z","repository":{"id":39847884,"uuid":"135720148","full_name":"bigbitbus/objectbench","owner":"bigbitbus","description":"Use public cloud SDKs to measure object store CRUD operations times (S3, google cloud storage, azure blobs etc.)","archived":false,"fork":false,"pushed_at":"2022-12-08T02:08:28.000Z","size":36,"stargazers_count":2,"open_issues_count":6,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-12T23:31:32.859Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bigbitbus.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-06-01T13:20:36.000Z","updated_at":"2021-02-11T07:56:34.000Z","dependencies_parsed_at":"2022-08-27T18:33:05.536Z","dependency_job_id":null,"html_url":"https://github.com/bigbitbus/objectbench","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bigbitbus%2Fobjectbench","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bigbitbus%2Fobjectbench/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bigbitbus%2Fobjectbench/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bigbitbus%2Fobjectbench/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bigbitbus","download_url":"https://codeload.github.com/bigbitbus/objectbench/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241495353,"owners_count":19972080,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-13T14:09:08.997Z","updated_at":"2025-09-25T17:26:01.254Z","avatar_url":"https://github.com/bigbitbus.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Object Bench\n\n## What is this?\n\nObject Bench is a benchmarking tool to create, upload, download and delete object store buckets (containers) and objects (blobs) into some public cloud stores (currently AWS, Azure, Google Cloud). At this time it supports uploading a directory (its constituent files being treated as multiple objects) to a single bucket.\n\n## Usage\n\nAll credentials are read-off set OS environment variables. Please obtain the required variables from the cloud provider. To see which environment variables are needed please see the \"__main__\" block of the corresponding \"*exercizer.py\" code file in this repository.\n\nInstall the requirements (preferably into a python virtual environment):\n```\npip install -r requirements.txt\n```\nAfter putting the credentials into environment variables (using e.g. the source statement below), run the benchmark. For example:\n\n```\n$ source {secure_folder}/credentials.sh\n$ python awsexercizer.py\nUpload objects\n{'/tmp/smalldir/MAINTAINERS': (1.1708409786224365, 446794),\n '/tmp/smalldir/cpuinfo': (0.6111950874328613, 1748),\n '/tmp/smalldir/downloads/MAINTAINERS': (0.5888941287994385, 446794),\n '/tmp/smalldir/downloads/cpuinfo': (0.4392850399017334, 1748),\n '/tmp/smalldir/downloads/iomem': (0.23023605346679688, 1043),\n '/tmp/smalldir/downloads/meminfo': (0.4946460723876953, 1307),\n '/tmp/smalldir/iomem': (0.3935070037841797, 1043),\n '/tmp/smalldir/level1/iomem': (0.5325939655303955, 1043),\n '/tmp/smalldir/meminfo': (0.1788921356201172, 1307),\n '/tmp/smalldir/uploads/MAINTAINERS': (0.7265870571136475, 446794),\n '/tmp/smalldir/uploads/cpuinfo': (0.2738769054412842, 1748),\n '/tmp/smalldir/uploads/iomem': (0.22115206718444824, 1043),\n '/tmp/smalldir/uploads/meminfo': (0.4289848804473877, 1307)}\nDownload objects\n{'/tmp/smalldir/MAINTAINERS': (17.39839506149292, 446794),\n '/tmp/smalldir/cpuinfo': (0.2229619026184082, 1748),\n '/tmp/smalldir/downloads/MAINTAINERS': (20.07686996459961, 446794),\n '/tmp/smalldir/downloads/cpuinfo': (0.5823531150817871, 1748),\n '/tmp/smalldir/downloads/iomem': (0.520056962966919, 1043),\n '/tmp/smalldir/downloads/meminfo': (0.22242498397827148, 1307),\n '/tmp/smalldir/iomem': (0.22393798828125, 1043),\n '/tmp/smalldir/level1/iomem': (0.21981501579284668, 1043),\n '/tmp/smalldir/meminfo': (0.6320850849151611, 1307),\n '/tmp/smalldir/uploads/MAINTAINERS': (48.98902893066406, 446794),\n '/tmp/smalldir/uploads/cpuinfo': (0.32395100593566895, 1748),\n '/tmp/smalldir/uploads/iomem': (0.7771360874176025, 1043),\n '/tmp/smalldir/uploads/meminfo': (1.2843818664550781, 1307),\n '_listObjectsInContainer': (0.17245697975158691,\n                             'Container objects listing time')}\nDelete buckets\n{'blobtester': 2.95768404006958, 'operation': 'Deleted'}\n(objbench) root@sachin-udtp:~/bbbcode/objbench#\n\n```\n\nIn the above run each uploaded file/downloaded object has a tuple (time in seconds, bytes).","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbigbitbus%2Fobjectbench","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbigbitbus%2Fobjectbench","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbigbitbus%2Fobjectbench/lists"}