https://github.com/c410-f3r/wtx

A collection of different transport implementations and related tools focused primarily on web technologies.
https://github.com/c410-f3r/wtx

api async cli client database database-administration database-client embedded framework grpc http http2 network pool postgres rust server sql web websocket

Last synced: 6 days ago
JSON representation

A collection of different transport implementations and related tools focused primarily on web technologies.

• Host: GitHub
• URL: https://github.com/c410-f3r/wtx
• Owner: c410-f3r
• License: apache-2.0
• Created: 2023-08-28T10:33:48.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-12-06T13:39:33.000Z (7 days ago)
• Last Synced: 2024-12-06T14:42:50.465Z (7 days ago)
• Topics: api, async, cli, client, database, database-administration, database-client, embedded, framework, grpc, http, http2, network, pool, postgres, rust, server, sql, web, websocket
• Language: Rust
• Homepage: https://c410-f3r.github.io/wtx
• Size: 1.98 MB
• Stars: 212
• Watchers: 7
• Forks: 6
• Open Issues: 16
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

• rust-embedded - wtx
• awesome-embedded-rust - wtx
• awesome-rust - c410-f3r/wtx - Fast implementation with a low set of external dependencies. (Libraries / Database)
• fucking-awesome-rust - c410-f3r/wtx - Fast implementation with a low set of external dependencies. (Libraries / Database)

README

        
# WTX 

[![CI](https://github.com/c410-f3r/wtx/workflows/CI/badge.svg)](https://github.com/c410-f3r/wtx/actions?query=workflow%3ACI)

[![crates.io](https://img.shields.io/crates/v/wtx.svg)](https://crates.io/crates/wtx)

[![Documentation](https://docs.rs/wtx/badge.svg)](https://docs.rs/wtx)

[![License](https://img.shields.io/badge/license-APACHE2-blue.svg)](https://github.com/c410-f3r/wtx/blob/main/LICENSE)

[![Rustc](https://img.shields.io/badge/rustc-1.83-lightgray")](https://blog.rust-lang.org/2024/11/28/Rust-1.83.0.html)

A collection of different transport implementations and related tools focused primarily on web technologies. Features the in-house development of 6 IETF RFCs ([6265](https://datatracker.ietf.org/doc/html/rfc6265), [6455](https://datatracker.ietf.org/doc/html/rfc6455), [7541](https://datatracker.ietf.org/doc/html/rfc7541), [7692](https://datatracker.ietf.org/doc/html/rfc7692), [8441](https://datatracker.ietf.org/doc/html/rfc8441), [9113](https://datatracker.ietf.org/doc/html/rfc9113)), 2 formal specifications ([gRPC](https://github.com/grpc/grpc/blob/master/doc/PROTOCOL-HTTP2.md), [PostgreSQL](https://www.postgresql.org/docs/current/protocol.html)) and several other invented ideas.

1. [Client API Framework](https://c410-f3r.github.io/wtx/client-api-framework/index.html)

2. [Database Client](https://c410-f3r.github.io/wtx/database-client/index.html)

3. [Database Schema Manager](https://c410-f3r.github.io/wtx/database-schema-manager/index.html)

4. [gRPC Client/Server](https://c410-f3r.github.io/wtx/grpc/index.html)

5. [HTTP Client Framework](https://c410-f3r.github.io/wtx/http-client-framework/index.html)

6. [HTTP Server Framework](https://c410-f3r.github.io/wtx/http-server-framework/index.html)

7. [HTTP/2 Client/Server](https://c410-f3r.github.io/wtx/http2/index.html)

8. [Pool Manager](https://c410-f3r.github.io/wtx/pool/index.html)

9. [UI tools](https://c410-f3r.github.io/wtx/ui-tools/index.html)

10. [WebSocket Client/Server](https://c410-f3r.github.io/wtx/web-socket/index.html)

11. [WebSocket over HTTP/2](https://c410-f3r.github.io/wtx/web-socket-over-http2/index.html)

Every feature is optional and must be set at compile time. Please see the intended documentation for further information.

Embedded devices with a working heap allocator can use this `no_std` crate.

## Performance

Many things that generally improve performance are used in the project, to name a few:

1. **Manual vectorization**: When an algorithm is known for processing large amounts of data, several experiments are performed to analyze the best way to split loops in order to allow the compiler to take advantage of SIMD instructions in x86 processors.

2. **Memory allocation**: Whenever possible, all heap allocations are called only once at the start of an instance creation and additionally, stack memory usage is preferably prioritized over heap memory.

3. **Fewer dependencies**: No third-party is injected by default. In other words, additional dependencies are up to the user through the selection of Cargo features, which decreases compilation times. For example, you can see the mere 16 dependencies required by the PostgreSQL client using `cargo tree -e normal --features postgres`.

Since memory are usually held at the instance level instead of being created and dropped on the fly, it is worth noting that its usage can growth significantly depending on the use-case. If appropriated, try using a shared pool of resources or try limiting how much data can be exchanged between parties.

## High-level benchmarks

Checkout [wtx-bench](https://c410-f3r.github.io/wtx-bench/) to see a variety of benchmarks or feel free to point any misunderstandings or misconfigurations.

![WebSocket Benchmark](https://i.imgur.com/Iv2WzJV.jpg)

There are mainly 2 things that impact performance, the chosen runtime and the number of pre-allocated bytes. Specially for servers that have to create a new instance for each handshake, pre-allocating a high number of bytes for short-lived or low-transfer connections can have a negative impact.

![PostgreSQL Benchmark](https://i.imgur.com/vf2tYxY.jpg)

## Low-level benchmarks

Anything marked with `#[bench]` in the repository is considered a low-level benchmark in the sense that they measure very specific operations that generally serve as the basis for other parts.

Take a look at  to see all low-level benchmarks over different periods of time.

## Transport Layer Security (TLS)

When using a feature that requires network connection, it is often necessary to perform encrypted communication and since `wtx` is not hard-coded with a specific stream implementation, it is up to you to choose the best TLS provider.

Some utilities like `TokioRustlsConnector` or `TokioRustlsAcceptor` are available to make things more convenient but keep in mind that it is still necessary to activate a crate that provides certificates for client usage.

## Examples

Demonstrations of different use-cases can be found in the `wtx-instances` directory as well as in the documentation.

## Limitations

* Does not support systems with a pointer length of 16 bits.

* Expects the infallible sum of the lengths of an arbitrary number of slices, otherwise the program will likely trigger an overflow that can possibly result in unexpected operations. For example, in a 32bit system such a scenario should be viable without swap memory or through specific limiters like `ulimit`.