Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/electricessence/asyncfilewriter
Manages multi-threaded writing to a single file.
https://github.com/electricessence/asyncfilewriter
Last synced: 8 days ago
JSON representation
Manages multi-threaded writing to a single file.
- Host: GitHub
- URL: https://github.com/electricessence/asyncfilewriter
- Owner: electricessence
- License: mit
- Created: 2018-04-05T22:53:32.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2018-12-03T02:25:13.000Z (almost 6 years ago)
- Last Synced: 2024-06-21T19:02:52.885Z (5 months ago)
- Language: C#
- Size: 62.5 KB
- Stars: 30
- Watchers: 4
- Forks: 7
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# AsyncFileWriter
Manages multi-threaded writing to a single file.
## Async Options
```.AsyncFileStream``` and ```.AsyncFileWrite``` are provided for configurability but the default of ```false``` for both is recommended.
## Default Behavior
Testing has revealed that using a standard ```fs.Write(bytes)``` on the underlying file stream yields optimal results.
```await fs.WriteAsync(bytes)``` creates enough overhead that the overall time taken to write to the destination can be much worse.
This may be fixed in future versions of .NET Core/Standard.
---
## Current Testing Results
Total bytes written per test: 116,888,890
### STANDARD BENCHMARKS:
#### File stream standard benchmark.
```
Total Elapsed Time: 0.1750803 seconds
```
#### File stream async benchmark.
```
Total Elapsed Time: 3.1865426 seconds
```
#### Synchronized file stream benchmark.
This test and the following tests use the same test harness and contain +1 second delay time for tesing a full open close and reopen of the underlying file stream. This is the minimum performance required to meet expecations. If a test result does not exceed this one's performance (less total time) then it's probably not worth pursuing.
```
Total Time: 3.3883187 seconds
Aggregate Waiting: 00:00:30.8530035
```
### TESTS WITH PARTIAL BLOCKING:
#### 100,000 bounded capacity.
```
Total Time: 2.5057271 seconds
Aggregate Waiting: 00:00:25.4319344
```
#### 10,000 bounded capacity.
```
Total Time: 2.6683573 seconds
Aggregate Waiting: 00:00:29.6922757
```
#### 1,000 bounded capacity.
```
Total Time: 2.5546364 seconds
Aggregate Waiting: 00:00:54.2961971
```
#### 500 bounded capacity.
```
Total Time: 2.9537176 seconds
Aggregate Waiting: 00:00:39.4386377
```
#### 100 bounded capacity.
```
Total Time: 85.4482081 seconds
Aggregate Waiting: 02:18:51.5013343
```
### TESTS WITH PARTIAL BLOCKING AND ASYNC FILESTREAM:
#### 100,000 bounded capacity.
```
Total Time: 6.5296874 seconds
Aggregate Waiting: 00:00:27.9669792
```
#### 10,000 bounded capacity.
```
Total Time: 6.7625757 seconds
Aggregate Waiting: 00:00:31.8351860
```
#### 1,000 bounded capacity.
```
Total Time: 10.807509 seconds
Aggregate Waiting: 00:01:01.5740778
```
#### 500 bounded capacity.
```
Total Time: 8.198802 seconds
Aggregate Waiting: 00:00:41.9564596
```
#### 100 bounded capacity.
```
Total Time: 24.0677165 seconds
Aggregate Waiting: 00:02:27.8041755
```
### FULLY ASYNCHRONOUS:
#### 100,000 bounded capacity.
```
Total Time: 44.2459905 seconds
Aggregate Waiting: 00:04:40.2752856
```
#### 10,000 bounded capacity.
```
Total Time: 55.6650965 seconds
Aggregate Waiting: 00:06:13.0226689
```
#### 1,000 bounded capacity.
```
Total Time: 53.0426809 seconds
Aggregate Waiting: 00:05:50.5497056
```
#### 500 bounded capacity.
```
Total Time: 57.8209485 seconds
Aggregate Waiting: 00:06:24.1047755
```
#### 100 bounded capacity.
```
Total Time: 61.7946165 seconds
Aggregate Waiting: 00:06:49.5865838
```
## Performance Profile
