https://github.com/open-quantum-safe/profiling
Network-level performance testing of post-quantum cryptography using the OQS suite
https://github.com/open-quantum-safe/profiling
cryptography performance post-quantum tls
Last synced: 3 months ago
JSON representation
Network-level performance testing of post-quantum cryptography using the OQS suite
- Host: GitHub
- URL: https://github.com/open-quantum-safe/profiling
- Owner: open-quantum-safe
- License: mit
- Created: 2020-08-19T14:58:51.000Z (about 5 years ago)
- Default Branch: main
- Last Pushed: 2024-03-11T15:24:23.000Z (over 1 year ago)
- Last Synced: 2025-06-07T04:08:46.320Z (4 months ago)
- Topics: cryptography, performance, post-quantum, tls
- Language: JavaScript
- Homepage: https://openquantumsafe.org/benchmarking
- Size: 174 KB
- Stars: 11
- Watchers: 7
- Forks: 8
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# profiling
Testing various functional and non-functional properties like performance and memory consumption
## DEPRECATION NOTICE
The Open Quantum Safe project has discontinued development of our profiling project. This repository is being archived as read-only. Use of this code is not recommended, as it is not maintained and may produce unreliable data. If you are interested in contributing to OQS benchmarking efforts, please reach out via the [OQS discussion board on Github](https://github.com/orgs/open-quantum-safe/discussions).
## Purpose
This repository is to contain software geared to collect profiling information across the algorithms supported by liboqs at different levels of the software and network stack.
Particularly, measurements will be collected using
1) ´liboqs´ library-level performance testing using ´speed_sig´ and ´speed_kem´ for execution performance numbers and ´test_sig_mem´ and ´test_kem_mem´ for memory consumption numbers (heap and stack)
2) ´openssl´ application-level performance testing using ´openssl speed´
3) ´openssl´ "basic network"-level raw handshake performance testing using ´openssl s_time´
4) "Simulated"/controlled network-level performance testing [not yet implemented]
5) "Full stack" performance testing using standard client software like ´curl´ and standard server software like ´nginx´ [not yet implemented].
This repository will not contain tests replicating raw algorithm-level testing as done by [Supercop](https://bench.cr.yp.to/supercop.html).
## Methodology
All tests
- are packaged into standalone Docker images facilitating execution across different (cloud) platforms and hardware architectures & CPU optimizations
- are designed to return JSON output representing current profiling numbers that can be stored arbitrarily; initial storage facilities are provided to deposit data into AWS S3.
- allow to also collect/document profiling numbers of classic crypto to permit comparison with PQC algorithms
- can be visualized by suitable Chart.js code: see [visualization folder](https://github.com/open-quantum-safe/profiling/tree/master/visualization).
Wrapper scripts are created to facilitate automatically running these tests on different cloud infrastructures and storing the resulting JSON output as well as the wrapping HTML and JavaScript code.