https://github.com/epomatti/azure-batch
Azure Batch architecture
https://github.com/epomatti/azure-batch
appi application-insights azure azure-batch batch hpc python terraform
Last synced: 3 months ago
JSON representation
Azure Batch architecture
- Host: GitHub
- URL: https://github.com/epomatti/azure-batch
- Owner: epomatti
- License: mit
- Created: 2023-03-07T13:18:48.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-23T20:53:19.000Z (over 1 year ago)
- Last Synced: 2025-01-17T18:34:48.274Z (5 months ago)
- Topics: appi, application-insights, azure, azure-batch, batch, hpc, python, terraform
- Language: HCL
- Homepage:
- Size: 199 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Azure Batch
> You might have to submit a support to increase Batch quotas
## Setup
Copy the `.auto.tfvars` file template:
```sh
cp config/template.tfvars .auto.tfvars
```
Create the account infrastructure:
```sh
terraform init
terraform apply -auto-approve
```
ℹ️ The pool will be provisioned with 0 nodes. Adjust your preferences accordingly.
Optionally, Configure your Batch account logs to be sent to the Log Analytics Workspace by setting up the Diagnostic Settings using the portal.
Use the script to create the application package:
```sh
cd scripts
bash scripts/create-batch-application.sh
```
Set the application to the pool:
```sh
az batch pool set \
--account-name bafastbrains \
--pool-id dev \
--application-package-references "molecular-analysis#1.0"
```
One option to easily interact with the CLI is to login to the Batch account:
```sh
az batch account login \
--name bafastbrains \
--resource-group rg-fastbrains \
--shared-key-auth
```
Alternatively, if you need to use the keys, add `--shared-key-auth`.
Run a task:
```sh
az batch task create --task-id sciTask001 --command-line "echo task001" --job-id dev-job
```
View task status:
```sh
az batch task show \
--job-id dev-job \
--task-id sciTask001
```
View task output:
```sh
az batch task file list \
--job-id dev-job \
--task-id sciTask001 \
--output table
```
It is possible to create a task with the [`--json-file`][1] option:
> The file containing the task(s) to create in JSON(formatted to match REST API request body). When submitting multiple tasks, accepts either an array of tasks or a TaskAddCollectionParameter. If this parameter is specified, all other parameters are ignored.
Additional functionality for the CLI is available through extensions:
```sh
az extension add --name azure-batch-cli-extensions
```
The jump box already has System-Assigned Identity. To use it:
```sh
# Using the System-Assigned identity within the VM
az login --identity
```
This is not required if you use `az batch account login`, but another option to interact with a private endpoint Batch/pools using the jump box:
```sh
export AZURE_BATCH_ACCOUNT=""
export AZURE_BATCH_ENDPOINT=""
export AZURE_BATCH_ACCESS_KEY=""
```
Now it is possible to use the private endpoints:
```sh
az batch pool list
```
## Connect to nodes
Use the node IP and frontend port:
```sh
ssh batch@ -p 50000
```
Batch files are located in the [temporary storage][2].
For the mounted storage, on [Ubuntu batch][3] the path is `/mnt/batch/tasks/fsmounts/blobs`.
## Metrics
Detailed usage of the `applicationinsights` package can be found in the [full documentation][5]. For details on Azure Monitor custom metrics, [link][6] for the guidelines.
Configuration of the instruction can be done via `opentelemetry` available [variables][7]:
```sh
OTEL_RESOURCE_ATTRIBUTES="service.namespace=,service.instance.id="
OTEL_SERVICE_NAME=""
```
From the renewed [official docs][4]:
```sh
python3 -m venv .venv
source .venv/bin/activate
python3 -m pip install --upgrade pip
python3 -m pip install -r requirements.txt
```
For troubleshooting:
```sh
which python
.venv/bin/python
```
## User access
A user named `BatchUser` will be created.
This user has `Reader` permissions in the resource group, and `Contributor` access in the Batch account.
It should be possible to created Pools with this user.
## Reference
- [Azure Batch permissions](https://techcommunity.microsoft.com/t5/azure-paas-blog/the-usage-of-managed-identity-in-the-azure-batch-account-and/ba-p/3607014)
- [Private Endpoints + VM](https://learn.microsoft.com/en-us/troubleshoot/azure/general/azure-batch-pool-creation-failure#cause-1-public-network-access-is-disabled-but-batch-account-doesnt-have-private-endpoint)
[1]: https://learn.microsoft.com/en-us/cli/azure/batch/task?view=azure-cli-latest#az-batch-task-create
[2]: https://learn.microsoft.com/en-us/azure/batch/files-and-directories
[3]: https://learn.microsoft.com/en-us/azure/batch/virtual-file-mount?tabs=linux
[4]: https://packaging.python.org/en/latest/guides/installing-using-pip-and-virtual-environments/
[5]: https://shipit.dev/python-appinsights/
[6]: https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/metrics-custom-overview
[7]: https://learn.microsoft.com/en-us/azure/azure-monitor/app/opentelemetry-configuration?tabs=python