https://github.com/sinclairzx81/runtime-type-benchmarks

High Performance Validation Benchmarks for JavaScript
https://github.com/sinclairzx81/runtime-type-benchmarks

Last synced: about 1 year ago
JSON representation

High Performance Validation Benchmarks for JavaScript

• Host: GitHub
• URL: https://github.com/sinclairzx81/runtime-type-benchmarks
• Owner: sinclairzx81
• License: other
• Created: 2022-12-20T12:07:54.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2023-06-24T05:08:19.000Z (about 3 years ago)
• Last Synced: 2024-10-03T08:07:01.997Z (almost 2 years ago)
• Language: TypeScript
• Size: 12 MB
• Stars: 6
• Watchers: 3
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md
  • License: license

Awesome Lists containing this project

README

          
# Runtime Type Benchmarks

High Performance Benchmarks for JavaScript Validation Libraries

### Overview

This project benchmarks a variety of JavaScript runtime type checking libraries to adequately assess their validation performance across a wide range of data structures. This project also seeks to compare JIT to AOT by measuring static JavaScript validation routines against those dynamically evaluated at runtime.

[Latest Benchmark Results](https://sinclairzx81.github.io/runtime-type-benchmarks/)

### Benchmarks

These benchmarks measure validation throughput for a number of common JavaScript data structures. The project provides two datasets, one `correct` the other `incorrect` (where-in the `incorrect` dataset is used to trip error handling paths within each validator and test early return performance). Data for each test is hardcoded as not to introduce unnecessary variance in the results as well as to provide high visibility to the actual data being benchmarked. Additionally, each benchmark is run in within an isolated Node process to avoid previous benchmarks breaking optimizations for subsequent benchmarks. All benchmarks can be inspected under the benchmark/validators directory.

### Packages

The following JavaScript validation packages are benchmarked.

| Package                                                              | Identifier | Compilation    | Assertion        | Description                                                                                |

|---                                                                   |---         |---             |---               |---                                                                                         |

| [ts-runtime-checks](https://github.com/GoogleFeud/ts-runtime-checks) | tsrc       | AOT            | Structural       | A typescript transformer which automatically generates validation code from your types.    |

| [typescript-is](https://github.com/woutervh-/typescript-is)          | tsis       | AOT            | Structural       | TypeScript transformer that generates run-time type-checks.                                |

| [typia](https://github.com/samchon/typia)                            | typia      | AOT            | Structural       | Super-fast Runtime validator (type checker) with only one line.                            |

| [typebox](https://github.com/sinclairzx81/typebox)                   | typebox    | JIT + AOT      | Json Schema      | JSON Schema Type Builder with Static Type Resolution for TypeScript.                       |

| [ajv](https://github.com/ajv-validator/ajv)                          | ajv        | JIT + AOT      | Json Schema      | The fastest JSON Schema Validator.                                                         |

| [zod](https://github.com/colinhacks/zod)                             | zod        | Dynamic        | Structural       | TypeScript-first schema validation with static type inference                              |

### Commands

The following commands are available following an `npm install`

```bash

$ hammer task    # runs a specific benchmark with the given iteration

                                                  # count. Can be used for testing benchmarks without

                                                  # running the complete suite.

$ npm run benchmark              # Runs all benchmarks with an optional iteration 

                                                  # count. If not specified the default is 10 million

                                                  # iterations. Running the benchmark will write

                                                  # results to reporting/results//.json.

$ npm run reporting                               # Builds and minifies the reporting website and serves

                                                  # it on port 5000. This task will also capture the 

                                                  # current websites benchmark results which is written 

                                                  # to the project root (screenshot.png)

$ npm run format                                  # Runs a prettier pass over the project.

$ npm run clean                                   # Remove the target build directory.

```

### Results

The following shows the comparative performance results for the `correct` dataset. Results show as estimated operations per second. The image below was generated on the following hardware profile.

| Component        | Description                                  |

|---               |---                                           |

| Processor        | AMD Ryzen 7 3700X 8-Core Processor, 3600 Mhz | 

| Memory           | 16GB                                         |

| Operating System | Window 10                                    |

| Node             | v16.17.1                                     |

Full results can be located [here](https://sinclairzx81.github.io/runtime-type-benchmarks/)

![](screenshot.png)

### Contribute

This project is open to community contribution.