{"id":16123706,"url":"https://github.com/austenstone/is-larger-worth","last_synced_at":"2025-07-05T17:06:45.341Z","repository":{"id":187281282,"uuid":"676275385","full_name":"austenstone/is-larger-worth","owner":"austenstone","description":"Are larger runners worth it? Test for yourself.","archived":false,"fork":false,"pushed_at":"2023-09-27T17:57:47.000Z","size":62,"stargazers_count":1,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-06T12:17:06.523Z","etag":null,"topics":["benchmark","github","larger-runner"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/austenstone.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":["austenstone"]}},"created_at":"2023-08-08T20:43:38.000Z","updated_at":"2024-04-23T13:21:30.000Z","dependencies_parsed_at":null,"dependency_job_id":"aa326aa0-9c06-4c18-8a7f-02a7a5b4ab0c","html_url":"https://github.com/austenstone/is-larger-worth","commit_stats":null,"previous_names":["austenstone/is-larger-worth"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/austenstone/is-larger-worth","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austenstone%2Fis-larger-worth","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austenstone%2Fis-larger-worth/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austenstone%2Fis-larger-worth/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austenstone%2Fis-larger-worth/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/austenstone","download_url":"https://codeload.github.com/austenstone/is-larger-worth/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austenstone%2Fis-larger-worth/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259565536,"owners_count":22877345,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["benchmark","github","larger-runner"],"created_at":"2024-10-09T21:18:29.700Z","updated_at":"2025-06-13T02:03:27.137Z","avatar_url":"https://github.com/austenstone.png","language":null,"funding_links":["https://github.com/sponsors/austenstone"],"categories":[],"sub_categories":[],"readme":"# Are larger runners worth the cost increase?\n\nGitHub's [Larger runners](https://docs.github.com/en/actions/using-github-hosted-runners/about-larger-runners) have more CPU, RAM, and disk space. They also cost more. Are they worth it?\n\nThis repository contains a simple benchmark that runs on the default and larger runners.\n\n## How to run the benchmark\n\n### Generating the runners\n\nYou could create the runners manually but I made a workflow that does this for you!\n\nThere is a workflow called [`runners-create.yml`](.github/workflows/runners-create.yml) that will create a runner group for you called `larger-runners` and then add all the different runner sizes to that group: `4-core`, `8-core`, `16-core`, `32-core`, `64-core`.\n\nYou MUST add a new secret called `PAT` that is a GitHub Personal Access token with the permissions to create these runners/group.\n\n### Running the test\n\nThe basic test is called `benchmark-matrix.yml` and it calls `benchmark.yml` for each of the different runner sizes. Once you've generated the runners from the previous step you can execute this workflow manually using workflow dispatch.\n\n\u003cimg width=\"725\" alt=\"259485096-9fdbbb16-081f-49ab-8a19-264c8c719d57\" src=\"https://github.com/austenstone/is-larger-worth/assets/22425467/d993e64b-5eb2-404f-9883-a5099ade27bf\"\u003e\n\n### CodeQL\n\nThere is also a prewritten workflow for testing larger runners with CodeQL [`codeql-analysis-larger.yml`](.github/workflows/codeql-analysis-larger.yml). You will need to modify your `codeql.yml` workflow file slightly.\n\nReplace your workflow event with the `workflow_call` event so that it can be called as a reusable workflow. Define the `runs-on` input variable so we can pass it in.\n```yml\non:\n  workflow_call:\n    inputs:\n      runs-on:\n        default: 'ubuntu-latest'\n        required: false\n        type: string\n```\n\nThen replace the `runs-on` label in the workflow file with the new variable we are passing in.\n```yml\n    runs-on: ${{ inputs.runs-on }}\n```\n\nThat's it! Now you can trigger codeql scans from the workflow `codeql-matrix.yml` and it will simultaneously run the codeql workflow with all different larger runner types.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faustenstone%2Fis-larger-worth","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faustenstone%2Fis-larger-worth","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faustenstone%2Fis-larger-worth/lists"}