https://github.com/p4irin/azp-agent-python-build-tools

Install Python build tools on an Azure Pipelines self-hosted agent
https://github.com/p4irin/azp-agent-python-build-tools

azure-pipelines ci-cd devops python raspberry-pi

Last synced: 1 day ago
JSON representation

Install Python build tools on an Azure Pipelines self-hosted agent

• Host: GitHub
• URL: https://github.com/p4irin/azp-agent-python-build-tools
• Owner: p4irin
• Created: 2024-04-08T13:50:15.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-04-10T20:14:21.000Z (7 months ago)
• Last Synced: 2024-10-11T10:52:39.881Z (25 days ago)
• Topics: azure-pipelines, ci-cd, devops, python, raspberry-pi
• Language: Shell
• Homepage:
• Size: 14.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
[![azp agent python build tools](https://github.com/p4irin/azp-agent-python-build-tools/actions/workflows/main.yml/badge.svg)](https://github.com/p4irin/azp-agent-python-build-tools/actions/workflows/main.yml)

![Static Badge](https://img.shields.io/badge/Raspberry_Pi-4B_8GB-red?logo=raspberrypi&logoColor=red)

![Static Badge](https://img.shields.io/badge/Ubuntu-22.04_LTS-orange?logo=ubuntu)

# Install Python build tools on an Azure Pipelines self-hosted agent

To build and test an application on different versions of Python you need to install them when using a self-hosted agent with Azure Pipelines. Most of everything else you need can be installed with pip.

When installed on a self-hosted agent you can use the UsePythonVersion@0 task in your Azure pipeline as you would with a Microsoft hosted agent. Installation is required as UsePythonVersion@0 doesn't support automatic downloading of missing Python versions on self-hosted agents.

## Stack

This is what I used. So, you might need to adapt.

* Raspberry Pi 4, 8Gb

* Ubuntu server 22.04.3 LTS jammy (arm64).

  Comes with Python 3.10.12 pre-installed

* Also tested script on ubuntu:jammy Docker image (amd64)

## build-tools.sh

This script will install Python versions in the agent's tool cache according to the requirements explained [here](https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/use-python-version-v0?view=azure-pipelines&viewFallbackFrom=azure-devops#how-can-i-configure-a-self-hosted-agent-to-use-this-task:~:text=How%20can%20I%20configure%20a%20self%2Dhosted%20agent%20to%20use%20this%20task%3F). By default this cache is located at _work/_tool in the directory where the agent is installed. The Python versions installed are from the deadsnakes apt repository. After installing from the deadsnakes repository the script installs each Python version using the venv package in the tool cache. The versions installed are 3.8, 3.9, 3.10 and 3.11

### Usage

1. SSH into your agent's host

1. cd into it's tool cache. 

1. Execute the following commands

   ```bash

   $ sudo apt-get update

   $ curl https://raw.githubusercontent.com/p4irin/azp-agent-python-build-tools/main/build-tools.sh > build-tools.sh

   $ chmod u+x build-tools.sh

   $ ./build-tools.sh

   ```

1. Restart your agent. You should be able to run jobs in a matrix using different Python versions.

## Testing

Tests executed on the Python versions installed by _build-tools.sh_ can be found [here](https://dev.azure.com/p4irin/playground/_git/test_raspberry_pi_hosted_agent). Those tests were run on Raspberry Pis 4 with 8Gb memory.

The script itself, setting op the Python tool cache's directory structure with Python versions, can be tested locally in a Docker container using the image build by the Dockerfile in this repo.

And, the script is tested by the repo's workflow.