{"id":21711257,"url":"https://github.com/distributedsystemsgroup/cluster-scheduler-simulator","last_synced_at":"2025-04-12T17:33:57.365Z","repository":{"id":78311867,"uuid":"59500977","full_name":"DistributedSystemsGroup/cluster-scheduler-simulator","owner":"DistributedSystemsGroup","description":null,"archived":false,"fork":false,"pushed_at":"2017-06-22T11:45:05.000Z","size":4484,"stargazers_count":2,"open_issues_count":0,"forks_count":3,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-03-26T11:51:10.873Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DistributedSystemsGroup.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE_BERKELEY","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-05-23T16:49:13.000Z","updated_at":"2024-08-12T19:47:19.000Z","dependencies_parsed_at":"2023-03-07T13:00:34.942Z","dependency_job_id":null,"html_url":"https://github.com/DistributedSystemsGroup/cluster-scheduler-simulator","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DistributedSystemsGroup%2Fcluster-scheduler-simulator","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DistributedSystemsGroup%2Fcluster-scheduler-simulator/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DistributedSystemsGroup%2Fcluster-scheduler-simulator/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DistributedSystemsGroup%2Fcluster-scheduler-simulator/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DistributedSystemsGroup","download_url":"https://codeload.github.com/DistributedSystemsGroup/cluster-scheduler-simulator/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248605120,"owners_count":21132114,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-25T23:20:48.114Z","updated_at":"2025-04-12T17:33:57.360Z","avatar_url":"https://github.com/DistributedSystemsGroup.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Cluster scheduler simulator overview\n\nThis simulator is forked from Cluster-Scheduler-Simulator by [Google](https://github.com/google/cluster-scheduler-simulator) and contains the features introduces by [Liang-Chi Hsieh](https://github.com/viirya) in his [fork](https://github.com/viirya/cluster-scheduler-simulator).\n\nThis version of the simulator has gone trough a lot of fixes, refactoring and improvements. The original document can be located [here](README_GOOGLE.md). We recommend to read it before using this version.\n\n## Downloading, building, and running\n\nTo download this project you can clone this Git repository. Once cloned there are several ways to run it:\n\n1. follow instructions in the same section [here](README_GOOGLE.md)\n\n2. if you have a Swarm or Docker deployment at hand, it is possible to launch it with the following command:\n\n\n        $ bash bin/launch_on_container.sh\n\n\nIf you use option 2. make sure to update the variables inside the above script and to deploy the Docker Image [here](docker).\n\n## Simulators implemented\n\nCurrently the scheduler architectures supported are:\n\n1. Monolithic by [Google](https://github.com/google/cluster-scheduler-simulator/blob/master/src/main/scala/MonolithicSimulation.scala)\n2. Mesos by [Google](https://github.com/google/cluster-scheduler-simulator/blob/master/src/main/scala/MesosSimulation.scala)\n3. Omega by [Google](https://github.com/google/cluster-scheduler-simulator/blob/master/src/main/scala/OmegaSimulation.scala)\n4. Spark by [Liang-Chi Hsieh](https://github.com/viirya/cluster-scheduler-simulator/blob/spark_support/src/main/scala/SparkSimulation.scala)\n5. Zoe   by [Pace Francesco](https://github.com/Nosfe)\n\nBe aware that the scheduler simulators original code might be different after the refactoring and improvements, but the logic is the same.\n\n## Metrics\n\n### Plotted\n\nBelow there is a table that summarize the metric plotted for each scheduler simulator.\n\n|                                   | Monolithic  |  Mesos  | Omega     | Spark     | Zoe       |\n|:-:|:-:|:-:|:-:|:-:|:-:|\n| Avg Cell CPU Utilization          | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Avg Cell RAM Utilization          | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Avg Cell CPU Locked               | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Avg Cell RAM Locked               | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Busy Time Fraction                | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Conflict Fraction                 |           |           | \u0026#10004;  |           |           |\n| Daily Busy Fraction Median        | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Daily Conflict Fraction Median    |           |           | \u0026#10004;  |           |           |\n| Failed Task Allocation            | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Jobs Unscheduled                  | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Jobs Scheduled                    | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Jobs Fully Scheduled              | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Number Jobs Timed Out             | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Number Pending Jobs at the End    | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  | \n| Retried Transactions              |           |           | \u0026#10004;  |           |           |\n| Task Conflict Fraction            |           |           | \u0026#10004;  |           |           |\n| Wait Time Before First Task       | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Wait Time Before All Tasks        | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Avg Job Execution Time            | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n| Avg Job Completion Time           | \u0026#10004;  | \u0026#10004;  | \u0026#10004;  |           | \u0026#10004;  |\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdistributedsystemsgroup%2Fcluster-scheduler-simulator","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdistributedsystemsgroup%2Fcluster-scheduler-simulator","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdistributedsystemsgroup%2Fcluster-scheduler-simulator/lists"}