{"id":24166084,"url":"https://github.com/jonathanvdc/flame-benchmark","last_synced_at":"2026-06-08T12:32:16.779Z","repository":{"id":88519343,"uuid":"53528154","full_name":"jonathanvdc/flame-benchmark","owner":"jonathanvdc","description":null,"archived":false,"fork":false,"pushed_at":"2016-05-09T13:27:55.000Z","size":2967,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-03-02T07:51:54.892Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jonathanvdc.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-03-09T20:09:38.000Z","updated_at":"2022-12-27T17:19:44.000Z","dependencies_parsed_at":"2023-07-22T22:00:44.920Z","dependency_job_id":null,"html_url":"https://github.com/jonathanvdc/flame-benchmark","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/jonathanvdc/flame-benchmark","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanvdc%2Fflame-benchmark","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanvdc%2Fflame-benchmark/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanvdc%2Fflame-benchmark/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanvdc%2Fflame-benchmark/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jonathanvdc","download_url":"https://codeload.github.com/jonathanvdc/flame-benchmark/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonathanvdc%2Fflame-benchmark/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34063149,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-08T02:00:07.615Z","response_time":111,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-12T20:14:29.076Z","updated_at":"2026-06-08T12:32:16.774Z","avatar_url":"https://github.com/jonathanvdc.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# flame-benchmark\n\n## Overview\n\nThis repository contains major components. Each component has its own folder:\n\n* `src/Flame.Benchmark/`: the `flame-benchmark` tool, which rewrites regular programs to be executed as benchmarks.\n* `src/Harnesses/`: various test harnesses, which `flame-benchmark` uses to rewrite programs.\n* `benchmarks/`: a collection of benchmark programs that compare Flame's `-Og` performance to `-O3` performance.\n\n## Running the benchmarks\n\nIf you want to run the benchmarks and examine the results for yourself, then you'll first need a couple of\n\n### Prerequisites\n\nYou'll need the following external programs:\n\n* A CLR implementation: he .NET Framework ships with all recent versions of Windows, and Linux/Mac OS X users can install Mono.\n* A recent C# compiler: `csc` (for Windows users) or `mcs` (for Mono users).\n* An MSBuild-compatible build system: `msbuild` (for Windows users) or `xbuild` (for Mono users).\n* The NuGet package manager.\n\nIf you're a Linux/Mac OS X user, and you don't have Mono installed yet,\nthen I recommend you follow the Mono project's [useful guide](http://www.mono-project.com/docs/getting-started/install/) to installing Mono.\n\nRegardless of whether you're using Mono or the Windows .NET Framework, you'll also need `dsc` and `compare-test`. These can be acquired by running the following bash script:\n\n```bash\n./get-dependencies.sh\n```\n\nNext, compile `flame-benchmark`. Again, a script can take care of this:\n\n```bash\n./build.sh\n```\n\n__Note:__ the script above is Mono-specific. If you want to compile `flame-benchmark` on a Windows computer,\nthen I suggest you open `src/Flame.Benchmark/Flame.Benchmark.sln` in Visual Studio and compile it in 'Release' mode.\n\n### Actually running the benchmarks\n\nRunning the benchmarks is pretty easy, actually: the process is fully automated.\nIt can be time-consuming, though.\nSo make sure that you can spare quite a bit of processing power for a while, before running the benchmarks.\n\nIf you have used the `get-dependencies.sh` script to install `dsc` and `compare-test`, then the following script will run the benchmarks:\n\n```bash\n./run-benchmarks.sh\n```\n\nOtherwise, if you already have a version of `dsc` and `compare-test` installed and in your `PATH` environment variable, then the following works, too:\n\n```\ncd benchmarks/\ncompare-test benchmark-all.test\n```\n\nAfter running the benchmarks, the sub-folders of `benchmarks/` will contain `results/` subdirectories. The benchmark results can be found in those `results/` directories.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjonathanvdc%2Fflame-benchmark","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjonathanvdc%2Fflame-benchmark","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjonathanvdc%2Fflame-benchmark/lists"}