Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/zxch3n/crdt-bench
https://github.com/zxch3n/crdt-bench
Last synced: 21 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/zxch3n/crdt-bench
- Owner: zxch3n
- License: other
- Created: 2022-06-20T12:06:48.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-24T03:01:25.000Z (10 months ago)
- Last Synced: 2024-04-14T03:08:04.645Z (7 months ago)
- Language: JavaScript
- Size: 1.05 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# CRDT benchmarks
> A collection of reproducible benchmarks. *PRs are welcome.*
```sh
# Install Node.js https://nodejs.org
npm i && npm start
```
You can find the benchmark results of Automerge's current [`performance`](https://github.com/automerge/automerge/pull/253) branch [here](https://github.com/dmonad/crdt-benchmarks/pull/4).
## Benchmarks
#### B1: No conflicts
Simulate two clients. One client modifies a text object and sends update messages to the other client. We measure the time to perform the task (`time`), the amount of data exchanged (`avgUpdateSize`), the size of the encoded document after the task is performed (`docSize`), the time to parse the encoded document (`parseTime`), and the memory used to hold the decoded document (`memUsed`).
#### B2: Two users producing conflicts
Simulate two clients. Both start with a synced text object containing 100 characters. Both clients modify the text object in a single transaction and then send their changes to the other client. We measure the time to sync concurrent changes into a single client (`time`), the size of the update messages (`updateSize`), the size of the encoded document after the task is performed (`docSize`), the time to parse the encoded document (`parseTime`), and the memory used to hold the decoded document (`memUsed`).
#### B3: Many conflicts
Simulate `√N` concurrent actions. We measure the time to perform the task
and sync all clients (`time`), the size of the update messages (`updateSize`),
the size of the encoded document after the task is performed (`docSize`),
the time to parse the encoded document (`parseTime`), and the memory used to hold the decoded document (`memUsed`).
The logarithm of `N` was
chosen because `√N` concurrent actions may result in up to `√N^2 - 1`
conflicts (apply action 1: 0 conlict; apply action2: 1 conflict, apply action 2: 2 conflicts, ..).
#### B4: Real-world editing dataset
Replay a real-world editing dataset. This dataset contains the character-by-character editing trace of a large-ish text document, the LaTeX source of this paper: https://arxiv.org/abs/1608.03960
Source: https://github.com/automerge/automerge-perf/tree/master/edit-by-index
* 182,315 single-character insertion operations
* 77,463 single-character deletion operations
* 259,778 operations totally
* 104,852 characters in the final document
We simulate one client replaying all changes and storing each update. We measure the time to replay
the changes and the size of all update messages (`updateSize`),
the size of the encoded document after the task is performed (`docSize`), the time to encode the document (`encodeTime`),
the time to parse the encoded document (`parseTime`), and the memory used to hold the decoded document in memory (`memUsed`).
** For now we replay all actions in a single transaction, otherwise Automerge is running out of memory.
##### [B4 x 100] Real-world editing dataset 100 times
Replay the [B4] dataset one hundred times. The final document has a size of over 10 million characters. As comparison, the book "Game of Thrones: A Song of Ice and Fire" is only 1.6 million characters long (including whitespace).
* 18,231,500 single-character insertion operations
* 7,746,300 single-character deletion operations
* 25,977,800 operations totally
* 10,485,200 characters in the final document
### Results
**Notes**
* The benchmarks were performed on a desktop computer "Intel® Core™ i5-8400 CPU @ 2.80GHz × 6" / Ubuntu 20.04 and Node 12.18.1
* There is a more exchaustive benchmark at the bottom that only runs benchmarks on Yjs.
* `memUsed` only approximates the amount of memory used. We run the JavaScript garbage collector and use the heap-size difference before and after the benchmark is performed. If the heap is highly fragmented, the heap size might be larger than the actual amount of data stored in the heap. In some cases this even leads to a `memUsed` of less than zero.
* Preliminary benchmark results for native implementation of the [Ron/Chronofold CRDT](https://github.com/gritzko/ron) (written in C++) are posted [in this thread](https://github.com/dmonad/crdt-benchmarks/issues/3).
| N = 6000 | [Yjs](https://github.com/yjs/yjs) | [Automerge](https://github.com/automerge/automerge) | [delta-crdts](https://github.com/peer-base/js-delta-crdts) |
| :- | -: | -: | -: |
|Version | 13.3.0 | 0.14.1 | 0.10.3 |
|Bundle size | 65923 bytes | 259763 bytes | 227573 bytes |
|Bundle size (gzipped) | 19377 bytes | 61478 bytes | 64388 bytes |
|[B1.1] Append N characters (time) | 303 ms | 2460 ms | 9595 ms |
|[B1.1] Append N characters (avgUpdateSize) | 27 bytes | 326 bytes | 46 bytes |
|[B1.1] Append N characters (docSize) | 6031 bytes | 2161851 bytes | 186031 bytes |
|[B1.1] Append N characters (memUsed) | 372.1 kB | 74.7 MB | 2.4 MB |
|[B1.1] Append N characters (parseTime) | 18 ms | 737 ms | 48 ms |
|[B1.2] Insert string of length N (time) | 7 ms | 2981 ms | 9592 ms |
|[B1.2] Insert string of length N (avgUpdateSize) | 6031 bytes | 1484719 bytes | 275992 bytes |
|[B1.2] Insert string of length N (docSize) | 6031 bytes | 1569051 bytes | 186031 bytes |
|[B1.2] Insert string of length N (memUsed) | 0 B | 53.3 MB | 2 MB |
|[B1.2] Insert string of length N (parseTime) | 19 ms | 516 ms | 44 ms |
|[B1.3] Prepend N characters (time) | 280 ms | 83488 ms | 8932 ms |
|[B1.3] Prepend N characters (avgUpdateSize) | 27 bytes | 290 bytes | 38 bytes |
|[B1.3] Prepend N characters (docSize) | 6041 bytes | 1946994 bytes | 186031 bytes |
|[B1.3] Prepend N characters (memUsed) | 3.7 MB | 67.6 MB | 1.8 MB |
|[B1.3] Prepend N characters (parseTime) | 55 ms | 83509 ms | 884 ms |
|[B1.4] Insert N characters at random positions (time) | 311 ms | 3255 ms | 9487 ms |
|[B1.4] Insert N characters at random positions (avgUpdateSize) | 29 bytes | 326 bytes | 46 bytes |
|[B1.4] Insert N characters at random positions (docSize) | 29614 bytes | 2159192 bytes | 186031 bytes |
|[B1.4] Insert N characters at random positions (memUsed) | 3.4 MB | 71 MB | 1.6 MB |
|[B1.4] Insert N characters at random positions (parseTime) | 57 ms | 1215 ms | 728 ms |
|[B1.5] Insert N words at random positions (time) | 376 ms | 12090 ms | 471437 ms |
|[B1.5] Insert N words at random positions (avgUpdateSize) | 36 bytes | 1587 bytes | 277 bytes |
|[B1.5] Insert N words at random positions (docSize) | 87826 bytes | 10148335 bytes | 1122045 bytes |
|[B1.5] Insert N words at random positions (memUsed) | 7.6 MB | 330.9 MB | 16.2 MB |
|[B1.5] Insert N words at random positions (parseTime) | 65 ms | 4106 ms | 8509 ms |
|[B1.6] Insert string, then delete it (time) | 6 ms | 2715 ms | 31058 ms |
|[B1.6] Insert string, then delete it (avgUpdateSize) | 6053 bytes | 1412719 bytes | 413992 bytes |
|[B1.6] Insert string, then delete it (docSize) | 38 bytes | 1497051 bytes | 240035 bytes |
|[B1.6] Insert string, then delete it (memUsed) | 0 B | 37.7 MB | 0 B |
|[B1.6] Insert string, then delete it (parseTime) | 27 ms | 335 ms | 57 ms |
|[B1.7] Insert/Delete strings at random positions (time) | 378 ms | 6347 ms | 218372 ms |
|[B1.7] Insert/Delete strings at random positions (avgUpdateSize) | 31 bytes | 1102 bytes | 195 bytes |
|[B1.7] Insert/Delete strings at random positions (docSize) | 28691 bytes | 7085598 bytes | 687945 bytes |
|[B1.7] Insert/Delete strings at random positions (memUsed) | 4.4 MB | 163.8 MB | 9.4 MB |
|[B1.7] Insert/Delete strings at random positions (parseTime) | 51 ms | 2351 ms | 1648 ms |
|[B1.8] Append N numbers (time) | 330 ms | 2913 ms | 10309 ms |
|[B1.8] Append N numbers (avgUpdateSize) | 32 bytes | 333 bytes | 48 bytes |
|[B1.8] Append N numbers (docSize) | 35634 bytes | 2200659 bytes | 204029 bytes |
|[B1.8] Append N numbers (memUsed) | 0 B | 73.6 MB | 1.9 MB |
|[B1.8] Append N numbers (parseTime) | 19 ms | 671 ms | 42 ms |
|[B1.9] Insert Array of N numbers (time) | 14 ms | 3223 ms | 10157 ms |
|[B1.9] Insert Array of N numbers (avgUpdateSize) | 35661 bytes | 1523693 bytes | 48 bytes |
|[B1.9] Insert Array of N numbers (docSize) | 35661 bytes | 1608026 bytes | 204031 bytes |
|[B1.9] Insert Array of N numbers (memUsed) | 0 B | 53.3 MB | 2.1 MB |
|[B1.9] Insert Array of N numbers (parseTime) | 20 ms | 613 ms | 39 ms |
|[B1.10] Prepend N numbers (time) | 271 ms | 62982 ms | 9121 ms |
|[B1.10] Prepend N numbers (avgUpdateSize) | 32 bytes | 297 bytes | 40 bytes |
|[B1.10] Prepend N numbers (docSize) | 35669 bytes | 1985894 bytes | 204031 bytes |
|[B1.10] Prepend N numbers (memUsed) | 7.1 MB | 67.3 MB | 1.9 MB |
|[B1.10] Prepend N numbers (parseTime) | 49 ms | 60077 ms | 933 ms |
|[B1.11] Insert N numbers at random positions (time) | 296 ms | 3844 ms | 9892 ms |
|[B1.11] Insert N numbers at random positions (avgUpdateSize) | 34 bytes | 332 bytes | 48 bytes |
|[B1.11] Insert N numbers at random positions (docSize) | 59161 bytes | 2198120 bytes | 204029 bytes |
|[B1.11] Insert N numbers at random positions (memUsed) | 7.5 MB | 70.1 MB | 1.9 MB |
|[B1.11] Insert N numbers at random positions (parseTime) | 51 ms | 1116 ms | 682 ms |
|[B2.1] Concurrently insert string of length N at index 0 (time) | 3 ms | 5729 ms | 39820 ms |
|[B2.1] Concurrently insert string of length N at index 0 (updateSize) | 12058 bytes | 2970726 bytes | 551984 bytes |
|[B2.1] Concurrently insert string of length N at index 0 (docSize) | 12149 bytes | 3164619 bytes | 375131 bytes |
|[B2.1] Concurrently insert string of length N at index 0 (memUsed) | 0 B | 107.8 MB | 5.1 MB |
|[B2.1] Concurrently insert string of length N at index 0 (parseTime) | 20 ms | 912 ms | 70 ms |
|[B2.2] Concurrently insert N characters at random positions (time) | 143 ms | 53873 ms | 38517 ms |
|[B2.2] Concurrently insert N characters at random positions (updateSize) | 66360 bytes | 2753229 bytes | 551912 bytes |
|[B2.2] Concurrently insert N characters at random positions (docSize) | 66454 bytes | 2947122 bytes | 375131 bytes |
|[B2.2] Concurrently insert N characters at random positions (memUsed) | 7.3 MB | 98.2 MB | 5.2 MB |
|[B2.2] Concurrently insert N characters at random positions (parseTime) | 59 ms | 60674 ms | 2740 ms |
|[B2.3] Concurrently insert N words at random positions (time) | 228 ms | 309114 ms | 2280822 ms |
|[B2.3] Concurrently insert N words at random positions (updateSize) | 177753 bytes | 17696052 bytes | 3295776 bytes |
|[B2.3] Concurrently insert N words at random positions (docSize) | 177918 bytes | 18725017 bytes | 2224223 bytes |
|[B2.3] Concurrently insert N words at random positions (memUsed) | 15.3 MB | 619.6 MB | 39.8 MB |
|[B2.3] Concurrently insert N words at random positions (parseTime) | 81 ms | 139273 ms | 41511 ms |
|[B2.4] Concurrently insert & delete (time) | 408 ms | 518020 ms | 3058659 ms |
|[B2.4] Concurrently insert & delete (updateSize) | 278025 bytes | 26580311 bytes | 5560784 bytes |
|[B2.4] Concurrently insert & delete (docSize) | 278153 bytes | 28112800 bytes | 3607213 bytes |
|[B2.4] Concurrently insert & delete (memUsed) | 19.4 MB | 850 MB | 38.1 MB |
|[B2.4] Concurrently insert & delete (parseTime) | 120 ms | 19810 ms | 64675 ms |
|[B3.1] 20√N clients concurrently set number in Map (time) | 551 ms | 7643 ms | |
|[B3.1] 20√N clients concurrently set number in Map (updateSize) | 49168 bytes | 246830 bytes | |
|[B3.1] 20√N clients concurrently set number in Map (docSize) | 32213 bytes | 288422 bytes | |
|[B3.1] 20√N clients concurrently set number in Map (memUsed) | 3.6 MB | 30.9 MB | |
|[B3.1] 20√N clients concurrently set number in Map (parseTime) | 54 ms | 6067 ms | |
|[B3.2] 20√N clients concurrently set Object in Map (time) | 711 ms | 39655 ms | |
|[B3.2] 20√N clients concurrently set Object in Map (updateSize) | 95864 bytes | 684190 bytes | |
|[B3.2] 20√N clients concurrently set Object in Map (docSize) | 41477 bytes | 758122 bytes | |
|[B3.2] 20√N clients concurrently set Object in Map (memUsed) | 7 MB | 64.9 MB | |
|[B3.2] 20√N clients concurrently set Object in Map (parseTime) | 54 ms | 14129 ms | |
|[B3.3] 20√N clients concurrently set String in Map (time) | 790 ms | 9342 ms | |
|[B3.3] 20√N clients concurrently set String in Map (updateSize) | 7826229 bytes | 8021860 bytes | |
|[B3.3] 20√N clients concurrently set String in Map (docSize) | 38360 bytes | 8063452 bytes | |
|[B3.3] 20√N clients concurrently set String in Map (memUsed) | 13.1 MB | 77.9 MB | |
|[B3.3] 20√N clients concurrently set String in Map (parseTime) | 49 ms | 7670 ms | |
|[B3.4] 20√N clients concurrently insert text in Array (time) | 596 ms | 21964 ms | 2063 ms |
|[B3.4] 20√N clients concurrently insert text in Array (updateSize) | 52746 bytes | 499350 bytes | 65810 bytes |
|[B3.4] 20√N clients concurrently insert text in Array (docSize) | 26591 bytes | 552023 bytes | 57757 bytes |
|[B3.4] 20√N clients concurrently insert text in Array (memUsed) | 6.8 MB | 59.5 MB | 4.4 MB |
|[B3.4] 20√N clients concurrently insert text in Array (parseTime) | 32 ms | 44967 ms | 2078 ms |
|[B4] Apply real-world editing dataset (time) | 6342 ms | 489104 ms | 20134540 ms |
|[B4] Apply real-world editing dataset (avgUpdateSize) | 29 bytes | 291 bytes | 45 bytes |
|[B4] Apply real-world editing dataset (encodeTime) | 27 ms | 2611 ms | 814 ms |
|[B4] Apply real-world editing dataset (docSize) | 159929 bytes | 83966886 bytes | 7888799 bytes |
|[B4] Apply real-world editing dataset (memUsed) | 3.2 MB | 1.1 GB | 34.4 MB |
|[B4] Apply real-world editing dataset (parseTime) | 86 ms | 37844 ms | 51991 ms |
|[B4 x 100] Apply real-world editing dataset 100 times (time) | 170254 ms | | |
|[B4 x 100] Apply real-world editing dataset 100 times (encodeTime) | 645 ms | | |
|[B4 x 100] Apply real-world editing dataset 100 times (docSize) | 15989245 bytes | | |
|[B4 x 100] Apply real-world editing dataset 100 times (parseTime) | 1792 ms | | |
|[B4 x 100] Apply real-world editing dataset 100 times (memUsed) | 266.4 MB | | |
| N = 60000 | Yjs | automerge |
| :- | -: | -: |
|Bundle size | 65939 bytes | 259763 bytes |
|Bundle size (gzipped) | 19383 bytes | 61478 bytes |
|[B1.1] Append N characters (time) | 1582 ms | |
|[B1.1] Append N characters (avgUpdateSize) | 29 bytes | |
|[B1.1] Append N characters (docSize) | 60034 bytes | |
|[B1.1] Append N characters (parseTime) | 1 ms | |
|[B1.1] Append N characters (memUsed) | 16.3 MB | |
|[B1.1] Append N characters | | skipping |
|[B1.2] Insert string of length N (time) | 8 ms | |
|[B1.2] Insert string of length N (avgUpdateSize) | 60034 bytes | |
|[B1.2] Insert string of length N (docSize) | 60034 bytes | |
|[B1.2] Insert string of length N (parseTime) | 1 ms | |
|[B1.2] Insert string of length N (memUsed) | 1.8 MB | |
|[B1.2] Insert string of length N | | skipping |
|[B1.3] Prepend N characters (time) | 1229 ms | |
|[B1.3] Prepend N characters (avgUpdateSize) | 29 bytes | |
|[B1.3] Prepend N characters (docSize) | 60047 bytes | |
|[B1.3] Prepend N characters (parseTime) | 45 ms | |
|[B1.3] Prepend N characters (memUsed) | 35.2 MB | |
|[B1.3] Prepend N characters | | skipping |
|[B1.4] Insert N characters at random positions (time) | 1801 ms | |
|[B1.4] Insert N characters at random positions (avgUpdateSize) | 31 bytes | |
|[B1.4] Insert N characters at random positions (docSize) | 374543 bytes | |
|[B1.4] Insert N characters at random positions (parseTime) | 53 ms | |
|[B1.4] Insert N characters at random positions (memUsed) | 48.9 MB | |
|[B1.4] Insert N characters at random positions | | skipping |
|[B1.5] Insert N words at random positions (time) | 5711 ms | |
|[B1.5] Insert N words at random positions (avgUpdateSize) | 36 bytes | |
|[B1.5] Insert N words at random positions (docSize) | 932585 bytes | |
|[B1.5] Insert N words at random positions (parseTime) | 205 ms | |
|[B1.5] Insert N words at random positions (memUsed) | 51.2 MB | |
|[B1.5] Insert N words at random positions | | skipping |
|[B1.6] Insert string, then delete it (time) | 7 ms | |
|[B1.6] Insert string, then delete it (avgUpdateSize) | 60057 bytes | |
|[B1.6] Insert string, then delete it (docSize) | 40 bytes | |
|[B1.6] Insert string, then delete it (parseTime) | 0 ms | |
|[B1.6] Insert string, then delete it (memUsed) | 924.7 kB | |
|[B1.6] Insert string, then delete it | | skipping |
|[B1.7] Insert/Delete strings at random positions (time) | 4771 ms | |
|[B1.7] Insert/Delete strings at random positions (avgUpdateSize) | 32 bytes | |
|[B1.7] Insert/Delete strings at random positions (docSize) | 362959 bytes | |
|[B1.7] Insert/Delete strings at random positions (parseTime) | 86 ms | |
|[B1.7] Insert/Delete strings at random positions (memUsed) | 67.7 MB | |
|[B1.7] Insert/Delete strings at random positions | | skipping |
|[B1.8] Append N numbers (time) | 15069 ms | |
|[B1.8] Append N numbers (avgUpdateSize) | 34 bytes | |
|[B1.8] Append N numbers (docSize) | 356220 bytes | |
|[B1.8] Append N numbers (parseTime) | 2 ms | |
|[B1.8] Append N numbers (memUsed) | 19.5 MB | |
|[B1.8] Append N numbers | | skipping |
|[B1.9] Insert Array of N numbers (time) | 6 ms | |
|[B1.9] Insert Array of N numbers (avgUpdateSize) | 356278 bytes | |
|[B1.9] Insert Array of N numbers (docSize) | 356278 bytes | |
|[B1.9] Insert Array of N numbers (parseTime) | 2 ms | |
|[B1.9] Insert Array of N numbers (memUsed) | 0 B | |
|[B1.9] Insert Array of N numbers | | skipping |
|[B1.10] Prepend N numbers (time) | 1185 ms | |
|[B1.10] Prepend N numbers (avgUpdateSize) | 34 bytes | |
|[B1.10] Prepend N numbers (docSize) | 356347 bytes | |
|[B1.10] Prepend N numbers (parseTime) | 29 ms | |
|[B1.10] Prepend N numbers (memUsed) | 0 B | |
|[B1.10] Prepend N numbers | | skipping |
|[B1.11] Insert N numbers at random positions (time) | 1901 ms | |
|[B1.11] Insert N numbers at random positions (avgUpdateSize) | 36 bytes | |
|[B1.11] Insert N numbers at random positions (docSize) | 670910 bytes | |
|[B1.11] Insert N numbers at random positions (parseTime) | 52 ms | |
|[B1.11] Insert N numbers at random positions (memUsed) | 84.5 MB | |
|[B1.11] Insert N numbers at random positions | | skipping |
|[B2.1] Concurrently insert string of length N at index 0 (time) | 5 ms | |
|[B2.1] Concurrently insert string of length N at index 0 (updateSize) | 120064 bytes | |
|[B2.1] Concurrently insert string of length N at index 0 (docSize) | 120154 bytes | |
|[B2.1] Concurrently insert string of length N at index 0 (parseTime) | 2 ms | |
|[B2.1] Concurrently insert string of length N at index 0 (memUsed) | 4.2 MB | |
|[B2.1] Concurrently insert string of length N at index 0 | | skipping |
|[B2.2] Concurrently insert N characters at random positions (time) | 1017 ms | |
|[B2.2] Concurrently insert N characters at random positions (updateSize) | 760850 bytes | |
|[B2.2] Concurrently insert N characters at random positions (docSize) | 760942 bytes | |
|[B2.2] Concurrently insert N characters at random positions (parseTime) | 91 ms | |
|[B2.2] Concurrently insert N characters at random positions (memUsed) | 0 B | |
|[B2.2] Concurrently insert N characters at random positions | | skipping |
|[B2.3] Concurrently insert N words at random positions (time) | 9163 ms | |
|[B2.3] Concurrently insert N words at random positions (updateSize) | 1877355 bytes | |
|[B2.3] Concurrently insert N words at random positions (docSize) | 1877486 bytes | |
|[B2.3] Concurrently insert N words at random positions (parseTime) | 344 ms | |
|[B2.3] Concurrently insert N words at random positions (memUsed) | 0 B | |
|[B2.3] Concurrently insert N words at random positions | | skipping |
|[B2.4] Concurrently insert & delete (time) | 18214 ms | |
|[B2.4] Concurrently insert & delete (updateSize) | 2883749 bytes | |
|[B2.4] Concurrently insert & delete (docSize) | 2883876 bytes | |
|[B2.4] Concurrently insert & delete (parseTime) | 661 ms | |
|[B2.4] Concurrently insert & delete (memUsed) | 258.2 MB | |
|[B2.4] Concurrently insert & delete | | skipping |
|[B3.1] √N clients concurrently set number in Map (time) | 20 ms | |
|[B3.1] √N clients concurrently set number in Map (updateSize) | 7736 bytes | |
|[B3.1] √N clients concurrently set number in Map (docSize) | 5121 bytes | |
|[B3.1] √N clients concurrently set number in Map (parseTime) | 3 ms | |
|[B3.1] √N clients concurrently set number in Map (memUsed) | 0 B | |
|[B3.1] √N clients concurrently set number in Map | | skipping |
|[B3.2] √N clients concurrently set Object in Map (time) | 29 ms | |
|[B3.2] √N clients concurrently set Object in Map (updateSize) | 15011 bytes | |
|[B3.2] √N clients concurrently set Object in Map (docSize) | 6612 bytes | |
|[B3.2] √N clients concurrently set Object in Map (parseTime) | 2 ms | |
|[B3.2] √N clients concurrently set Object in Map (memUsed) | 6.6 MB | |
|[B3.2] √N clients concurrently set Object in Map | | skipping |
|[B3.3] √N clients concurrently set String in Map (time) | 24 ms | |
|[B3.3] √N clients concurrently set String in Map (updateSize) | 159565 bytes | |
|[B3.3] √N clients concurrently set String in Map (docSize) | 5601 bytes | |
|[B3.3] √N clients concurrently set String in Map (parseTime) | 3 ms | |
|[B3.3] √N clients concurrently set String in Map (memUsed) | 6.4 MB | |
|[B3.3] √N clients concurrently set String in Map | | skipping |
|[B3.4] √N clients concurrently insert text in Array (time) | 20 ms | |
|[B3.4] √N clients concurrently insert text in Array (updateSize) | 8185 bytes | |
|[B3.4] √N clients concurrently insert text in Array (docSize) | 4062 bytes | |
|[B3.4] √N clients concurrently insert text in Array (parseTime) | 0 ms | |
|[B3.4] √N clients concurrently insert text in Array (memUsed) | 0 B | |
|[B3.4] √N clients concurrently insert text in Array | | skipping |
|[B4] Apply real-world editing dataset (time) | 5238 ms | |
|[B4] Apply real-world editing dataset (updateSize) | 7306126 bytes | |
|[B4] Apply real-world editing dataset (encodeTime) | 13 ms | |
|[B4] Apply real-world editing dataset (docSize) | 159927 bytes | |
|[B4] Apply real-world editing dataset (parseTime) | 16 ms | |
|[B4] Apply real-world editing dataset (memUsed) | 6.9 MB | |
|[B4] Apply real-world editing dataset | | skipping |
|[B4 x 100] Apply real-world editing dataset 100 times (time) | 198383 ms | |
|[B4 x 100] Apply real-world editing dataset 100 times (encodeTime) | 617 ms | |
|[B4 x 100] Apply real-world editing dataset 100 times (docSize) | 15989245 bytes | |
|[B4 x 100] Apply real-world editing dataset 100 times (parseTime) | 2127 ms | |
|[B4 x 100] Apply real-world editing dataset 100 times (memUsed) | 165.5 MB | |
## Development
Modify the `N` variable in `benchmarks/utils.js` to increase the difficulty.
```sh
npm run watch
node dist/benchmark.js
```
Now you can also open `benchmark.html` to run the benchmarks in the browser.
## License
[The MIT License](./LICENSE) © Kevin Jahns
Except for /b4-editing-trace.js © Martin Kleppmann