https://github.com/adampaternostro/azure-blob-concurrency
Docker container that runs on Azure blob using Alpine Linux with Azure Python SDK to put a load on Azure Storage to see the download times.
https://github.com/adampaternostro/azure-blob-concurrency
alpine-linux azure azure-batch azure-shipyard docker dockerfile python
Last synced: 3 months ago
JSON representation
Docker container that runs on Azure blob using Alpine Linux with Azure Python SDK to put a load on Azure Storage to see the download times.
- Host: GitHub
- URL: https://github.com/adampaternostro/azure-blob-concurrency
- Owner: AdamPaternostro
- Created: 2017-08-31T18:58:59.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2017-08-31T19:06:55.000Z (over 8 years ago)
- Last Synced: 2025-03-26T03:43:00.667Z (10 months ago)
- Topics: alpine-linux, azure, azure-batch, azure-shipyard, docker, dockerfile, python
- Language: Python
- Size: 4.88 KB
- Stars: 1
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Azure-Blob-Concurrency
Docker container that runs on Azure blob using Alpine Linux with Azure Python SDK to put a load on Azure Storage to see the download times. The timings are saved to an Azure Storage Table. It is up to you to download and analyze.
### To Run this code
1. Create an Azure Storage Account
2. Create an Azure Batch Account
3. Create some different sized blobs and place in your storage account (or use https://www.thinkbroadband.com/download)
4. Test the Python code locally
5. Build the Docker image
6. Upload image to a repository
7. Edit the Shipward config files
8. Issue the below commands to run the process. You will need to change /home/shipyarduser/pythonblob to where the shipyard config files reside on your disk.
### Get Shipyard Docker image, Create the Batch Pool, Run the Job, Delete the Pool
```
sudo docker pull alfpark/batch-shipyard:cli-latest
sudo docker run --rm -it -v /home/shipyarduser/pythonblob:/configs -e SHIPYARD_CONFIGDIR=/configs alfpark/batch-shipyard:cli-latest pool add
sudo docker run --rm -it -v /home/shipyarduser/pythonblob:/configs -e SHIPYARD_CONFIGDIR=/configs alfpark/batch-shipyard:cli-latest jobs add --tail stdout.txt
sudo docker run --rm -it -v /home/shipyarduser/pythonblob:/configs -e SHIPYARD_CONFIGDIR=/configs alfpark/batch-shipyard:cli-latest pool del
```