https://github.com/a-poor/file-rw-speed-test

https://github.com/a-poor/file-rw-speed-test

Last synced: about 1 year ago
JSON representation

• Host: GitHub
• URL: https://github.com/a-poor/file-rw-speed-test
• Owner: a-poor
• Created: 2021-01-23T03:33:44.000Z (over 5 years ago)
• Default Branch: main
• Last Pushed: 2021-01-23T03:42:25.000Z (over 5 years ago)
• Last Synced: 2025-03-26T06:35:57.860Z (about 1 year ago)
• Language: Jupyter Notebook
• Size: 119 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Testing File Read/Write Speed

_created by Austin Poor_

I wanted to experiment with how long it takes to read & write files of different sizes in Python. What is the ideal size for a single file for optimized read/write times?

For example, when storing rows of data, how big should each file be to a) counteract the penalty of reading files and b) minimize the cost of rewriting files.

![](./bytes-per-ns.png)

The above plot shows the number of bytes written per nanosecond compared to the size of file, in bytes.