Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/coq-community/coq-performance-tests

A library of Coq source files testing for performance regressions on Coq [maintainer=@JasonGross]
https://github.com/coq-community/coq-performance-tests

coq performance testing

Last synced: 2 months ago
JSON representation

A library of Coq source files testing for performance regressions on Coq [maintainer=@JasonGross]

Host: GitHub
URL: https://github.com/coq-community/coq-performance-tests
Owner: coq-community
License: mit
Created: 2019-11-25T04:45:51.000Z (about 5 years ago)
Default Branch: master
Last Pushed: 2024-11-01T04:09:19.000Z (3 months ago)
Last Synced: 2024-11-01T05:18:02.618Z (3 months ago)
Topics: coq, performance, testing
Language: Coq
Homepage:
Size: 197 MB
Stars: 7
Watchers: 5
Forks: 7
Open Issues: 3
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # coq-performance-tests

[![CI (Coq)](https://github.com/coq-community/coq-performance-tests/actions/workflows/coq.yml/badge.svg?branch=master)](https://github.com/coq-community/coq-performance-tests/actions/workflows/coq.yml)

A library of Coq source files testing for performance regressions on Coq

## Contributing

Please add tests to this repository.

Each test should go in its own .v file in [`src/`](./src/), and each .v file should be

targeted to take around 1 minute, so that all tests get roughly equal

weight.

## PerformanceExperiments

The [`PerformanceExperiments`](./PerformanceExperiments/) folder contains a number of tests based on a [test harness file](./PerformanceExperiments/Harness.v) which allow automatic generation of plots, as displayed below.

The plots are updated on each run of GitHub Actions.

To contribute to this folder, please add your test to [`Makefile.variables.kinds`](./PerformanceExperiments/Makefile.variables.kinds) and follow the format of the existing tests.

You can use `make update-README` to regenerate the tables for this README.

### PerformanceExperiments plots

- [`Reify/BaselineStats`](./PerformanceExperiments/Reify/BaselineStats.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/CanonicalStructures`](./PerformanceExperiments/Reify/CanonicalStructures.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/Ltac2`](./PerformanceExperiments/Reify/Ltac2.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/LtacVariants`](./PerformanceExperiments/Reify/LtacVariants.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/OCaml`](./PerformanceExperiments/Reify/OCaml.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/Parametricity`](./PerformanceExperiments/Reify/Parametricity.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/QuoteFlat`](./PerformanceExperiments/Reify/QuoteFlat.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`Reify/TypeClasses`](./PerformanceExperiments/Reify/TypeClasses.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`destruct_large_context`](./PerformanceExperiments/destruct_large_context.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`n_polymorphic_universes`](./PerformanceExperiments/n_polymorphic_universes.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`pattern`](./PerformanceExperiments/pattern.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`repeat_setoid_rewrite_under_binders`](./PerformanceExperiments/repeat_setoid_rewrite_under_binders.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`repeat_setoid_rewrite_under_binders_noop`](./PerformanceExperiments/repeat_setoid_rewrite_under_binders_noop.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_lift_lets_map`](./PerformanceExperiments/rewrite_lift_lets_map.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_plus_0_tree`](./PerformanceExperiments/rewrite_plus_0_tree.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_autorewrite`](./PerformanceExperiments/rewrite_repeated_app_autorewrite.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_autorewrite_noop`](./PerformanceExperiments/rewrite_repeated_app_autorewrite_noop.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_fast_rewrite`](./PerformanceExperiments/rewrite_repeated_app_fast_rewrite.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_fast_rewrite_ltac2`](./PerformanceExperiments/rewrite_repeated_app_fast_rewrite_ltac2.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_fast_rewrite_no_abstract`](./PerformanceExperiments/rewrite_repeated_app_fast_rewrite_no_abstract.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_rewrite_strat`](./PerformanceExperiments/rewrite_repeated_app_rewrite_strat.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_ssrrewrite`](./PerformanceExperiments/rewrite_repeated_app_ssrrewrite.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_repeated_app_ssrrewrite_noop`](./PerformanceExperiments/rewrite_repeated_app_ssrrewrite_noop.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_strat_under_binders`](./PerformanceExperiments/rewrite_strat_under_binders.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`rewrite_under_lets_plus_0`](./PerformanceExperiments/rewrite_under_lets_plus_0.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`sieve_of_eratosthenes`](./PerformanceExperiments/sieve_of_eratosthenes.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`typeclass_reification_let_in_HOAS`](./PerformanceExperiments/typeclass_reification_let_in_HOAS.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`typeclass_reification_let_in_PHOAS`](./PerformanceExperiments/typeclass_reification_let_in_PHOAS.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  | 

- [`zify_large_context`](./PerformanceExperiments/zify_large_context.v)

  dev | 8.19 | 8.18 | 8.17 | 8.16 | 8.15 | 8.14 | 8.13 | 8.12 | 8.11 | 8.10 | 8.9 | 8.8

  --|--|--|--|--|--|--|--|--|--|--|--|--

   |  |  |  |  |  |  |  |  |  |  |  |