{"id":29953707,"url":"https://github.com/rumbledb/hep-iris-benchmark-scripts","last_synced_at":"2025-08-03T15:10:53.042Z","repository":{"id":78436011,"uuid":"360820314","full_name":"RumbleDB/hep-iris-benchmark-scripts","owner":"RumbleDB","description":"HEP IRIS benchmark scripts","archived":false,"fork":false,"pushed_at":"2023-10-21T19:33:55.000Z","size":4472,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-04-13T20:56:57.130Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/RumbleDB.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-04-23T08:46:42.000Z","updated_at":"2022-12-14T23:39:53.000Z","dependencies_parsed_at":"2023-03-13T20:13:47.363Z","dependency_job_id":"680f7747-78bb-491f-bcb8-508c29e807b6","html_url":"https://github.com/RumbleDB/hep-iris-benchmark-scripts","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/RumbleDB/hep-iris-benchmark-scripts","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RumbleDB%2Fhep-iris-benchmark-scripts","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RumbleDB%2Fhep-iris-benchmark-scripts/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RumbleDB%2Fhep-iris-benchmark-scripts/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RumbleDB%2Fhep-iris-benchmark-scripts/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/RumbleDB","download_url":"https://codeload.github.com/RumbleDB/hep-iris-benchmark-scripts/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RumbleDB%2Fhep-iris-benchmark-scripts/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":268563772,"owners_count":24270648,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-03T02:00:12.545Z","response_time":2577,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-08-03T15:10:48.200Z","updated_at":"2025-08-03T15:10:53.033Z","avatar_url":"https://github.com/RumbleDB.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Benchmark Scripts for *Evaluating Query Languages and Systems for High-Energy Physics Data*\n\n[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5569049.svg)](https://doi.org/10.5281/zenodo.5569049)\n\nThis repository contains benchmarks scripts for running the implementations of High-energy Physics (HEP) analysis queries from the [IRIS HEP benchmark](https://github.com/iris-hep/adl-benchmarks-index) for various general-purpose query processing systems. The results have been published in the following paper:\n\nDan Graur, Ingo Müller, Mason Proffitt, Ghislain Fourny, Gordon T. Watts, Gustavo Alonso.\n*Evaluating Query Languages and Systems for High-Energy Physics Data.*\nIn: PVLDB 15(2), 2022.\nDOI: [10.14778/3489496.3489498](https://doi.org/10.14778/3489496.3489498).\n\nPlease cite both, the paper and the software, when citing in academic contexts.\n\n## Overview of the repository\n\nThis repository contains the scripts for producing the datasets, the scripts for\nrunning the experiments, and the scripts for plotting the results used in the\npaper mentioned above.\n\nWe recommend to get started with the scripts in the following order:\n\n1. Get individual queries to run with the systems you are interested in using\n   the small sample datasets provided for each system.\n\n   For that purpose, look at the general instructions in the\n   [`experiments`](experiments/) folder as well as the system-specific\n   instructions in the subfolders of the respective systems.\n1. Generate the full datasets as described in the [`datasets`](datasets/) folder\n   and upload them to cloud storage and/or load them as per the system-specific\n   instructions.\n1. Run the actual experiments using the system-specific scripts from the\n   subfolders of the respective systems.\n\n   Running all experiments takes several days and costs at least several hundred\n   dollars of cloud credits, so it's probably a good idea to start with a small\n   subset, then extend them as you gain experience and confidence.\n1. Re-generate the plots with the scripts in the [`plots`](plots/) folder.\n\n   We provide the data we used for the plots in the original paper, but you can\n   also copy over your own measurement data and plot that.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frumbledb%2Fhep-iris-benchmark-scripts","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frumbledb%2Fhep-iris-benchmark-scripts","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frumbledb%2Fhep-iris-benchmark-scripts/lists"}