{"id":19500093,"url":"https://github.com/prestodb/benchto","last_synced_at":"2026-01-11T17:39:54.708Z","repository":{"id":51085723,"uuid":"62405919","full_name":"prestodb/benchto","owner":"prestodb","description":"Framework for running macro benchmarks in a clustered environment","archived":false,"fork":false,"pushed_at":"2022-08-29T22:25:39.000Z","size":3798,"stargazers_count":24,"open_issues_count":24,"forks_count":18,"subscribers_count":97,"default_branch":"master","last_synced_at":"2025-04-04T04:51:08.882Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/prestodb.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-07-01T16:25:50.000Z","updated_at":"2024-03-27T05:55:24.000Z","dependencies_parsed_at":"2022-08-12T22:40:10.342Z","dependency_job_id":null,"html_url":"https://github.com/prestodb/benchto","commit_stats":null,"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/prestodb%2Fbenchto","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/prestodb%2Fbenchto/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/prestodb%2Fbenchto/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/prestodb%2Fbenchto/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/prestodb","download_url":"https://codeload.github.com/prestodb/benchto/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250912660,"owners_count":21506865,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-10T22:07:27.563Z","updated_at":"2025-10-26T12:15:40.276Z","avatar_url":"https://github.com/prestodb.png","language":"JavaScript","readme":"# Benchto [![Build Status](https://travis-ci.org/prestodb/benchto.svg?branch=master)](https://travis-ci.org/prestodb/benchto)\n\nThe purpose of _Benchto_ project is to provide easy and manageable way to define, run and analyze _macro benchmarks_\nin clustered environment. Understanding behaviour of distributed systems is hard and requires good visibility into\nstate of the cluster and internals of tested system. This project was developed for repeatable benchmarking of\nHadoop SQL engines, most importantly [Presto](https://prestodb.io/).\n\n_Benchto_ consists of two main components: `benchto-service` and `benchto-driver`. To utilize all features of _Benchto_,\nit is also recommended to configure _Graphite_ and _Grafana_. Image below depicts high level architecture:\n\n![Benchto high level architecture](high-level-architecture.png?raw=true \"Benchto high level architecture\")\n\n- _benchto-service_ - persistent data store for benchmark results. It exposes REST API and stores results in relational\nDB (_Postgres_). Driver component calls API to store benchmark execution details which are later displayed by webapp\nwhich is bundled with service. Single instance of _benchto-service_ can be shared by multiple benchmark drivers.\n\n- _benchto-driver_ - standalone java application which loads definitions of benchmarks (_benchmark descriptors_) and\nexecutes them against tested distributed system. If cluster monitoring is in place, driver collects various metrics\n(cpu, memory, network usage) regarding cluster resource utilization. Moreover it adds graphite events which can be\nlater displayed as [Grafana annotations](http://docs.grafana.org/reference/annotations/). All data is stored in service\nfor later analysis.\n\n- _monitoring_ - cluster monitoring is optional, but highly recommended to fully understand performance characteristics\nof tested system. It is assumed that _Graphite/Carbon_ is used as metrics store and _Grafana_ for clusters dashboards.\nThere is no limitation on metric agents deployed on cluster hosts.\n\n- _benchto-generator_ - map reduce job for generating benchmark data. You can configure number of rows, type of the\nrow (ex. _BIGINT_, _INT_, _DOUBLE_, _DECIMAL(38,8)_), output format (_ORC_, _TEXT_) and number of output files. More\ndetails can be found in _benchto-generator_ module README file.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fprestodb%2Fbenchto","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fprestodb%2Fbenchto","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fprestodb%2Fbenchto/lists"}