{"id":21045040,"url":"https://github.com/quansight/ibis-benchmark","last_synced_at":"2026-04-28T10:32:28.496Z","repository":{"id":98605703,"uuid":"201276776","full_name":"Quansight/ibis-benchmark","owner":"Quansight","description":null,"archived":false,"fork":false,"pushed_at":"2019-12-02T14:02:40.000Z","size":2721,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"master","last_synced_at":"2026-01-19T22:57:20.629Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://quansight.github.io/ibis-benchmark","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Quansight.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-08-08T14:35:41.000Z","updated_at":"2024-11-01T15:30:18.000Z","dependencies_parsed_at":null,"dependency_job_id":"96888b2a-b0ad-4ac4-9c79-c91ab11d4359","html_url":"https://github.com/Quansight/ibis-benchmark","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Quansight/ibis-benchmark","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Quansight%2Fibis-benchmark","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Quansight%2Fibis-benchmark/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Quansight%2Fibis-benchmark/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Quansight%2Fibis-benchmark/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Quansight","download_url":"https://codeload.github.com/Quansight/ibis-benchmark/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Quansight%2Fibis-benchmark/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32377152,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-28T09:24:15.638Z","status":"ssl_error","status_checked_at":"2026-04-28T09:24:15.071Z","response_time":56,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-19T14:19:39.075Z","updated_at":"2026-04-28T10:32:28.467Z","avatar_url":"https://github.com/Quansight.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Ibis Benchmark\n\nThe goal of this project is the measuring of some expressions using \n`Ibis` with `OmniSciDB` `CPU` and `GPU` and pure `Pandas`.\n\nThe current benchmark was tested in a Ubuntu machine with kernel 4.15.0-62-generic.\n\n## Environment\n\nFirst, it is necessary to prepare the environments and install and start \nthe servers.\n\n### Install and run OmniSciDB-CPU and OmniSciDB-GPU using conda\n\nFor installing and running OmniSciDB-CPU, in a terminal, run:\n\n```sh\n# create a conda environment and install omniscidb-cpu\nconda create -n omniscidb-cpu -c conda-forge omniscidb-cpu\n# activate omniscidb-cpu conda environemtn\nsource activate omniscidb-cpu\n# rename initdb to pg_initdb\ncp $CONDA_PREFIX/bin/initdb pg_initdb\n# rename initdb to pg_initdb\ncp $CONDA_PREFIX/bin/omnisci_initdb initdb\n# deactivate the environment\nsource deactivate\n# export env variables\nexport OMNISCIDB_DATA_DIR=/work/$(whoami)/omniscidb-data\n# start omniscidb-cpu\ncd scripts \u0026\u0026 ./start_omniscidb_cpu.sh\n```\n\nFor installing and running OmniSciDB-CUDA, in another terminal, run:\n\n```sh\n# create a conda environment and install omniscidb-cuda\nconda create -n omniscidb-cuda -c quansight omniscidb-cuda\n# export env variables\nexport OMNISCIDB_DATA_DIR=/work/$(whoami)/omniscidb-data\n# start omniscidb-cuda\ncd scripts \u0026\u0026 ./start_omniscidb_cuda.sh\n```\n\nIt is not possible to use both OmniSciDB CPU and CUDA at the same time \nusing the same data directory. So for this reason, the benchmark should\nbe run separated for each server.\n\n### Ibis-benchmark\n\nTo prepare the conda environment, run:\n\n```sh\nconda env create -n ibis-benchmark --file environment.yml\nconda activate ibis-benchmark\n```\n\nInstall ibis-benchmark in development mode and some libraries that help the \ndevelpment:\n\n```\nmake develop\n```\n\n## NYC Taxi Benchmark\n\nTo load the data used by this benchark, run the follow commands:\n\n```sh\ncd scripts\n./download.sh\n./load_data_cpu.sh\n./load_data_gpu.sh\n```\n\nTo run the benchmark, follow the commands bellow:\n\n```sh\ncd ./ibis_benchmark/nyc_taxi\npython main.py\n```\n\nThe results is stored at `ibis_benchmark/results/`. \nIt stores a `JSON` file with the time used by each set of expressions and a\n`PNG` with the chart representation of this `JSON` file. \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquansight%2Fibis-benchmark","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquansight%2Fibis-benchmark","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquansight%2Fibis-benchmark/lists"}