https://github.com/Avature/lxd-image-server
Creates, manages and mirrors a simplestreams lxd image server on top of nginx.
https://github.com/Avature/lxd-image-server
lxd lxd-image server
Last synced: 24 days ago
JSON representation
Creates, manages and mirrors a simplestreams lxd image server on top of nginx.
- Host: GitHub
- URL: https://github.com/Avature/lxd-image-server
- Owner: Avature
- License: apache-2.0
- Created: 2019-04-10T14:07:06.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2021-12-01T09:36:20.000Z (over 3 years ago)
- Last Synced: 2024-11-01T11:35:42.433Z (6 months ago)
- Topics: lxd, lxd-image, server
- Language: Python
- Homepage:
- Size: 67.4 KB
- Stars: 60
- Watchers: 13
- Forks: 13
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
Lxd-image-server
================
[](https://travis-ci.org/Avature/lxd-image-server)
Creates and manages a simplestreams lxd image server on top of nginx.
If installed as a debian package, a new service is created and it monitors
if there are any changes in the image directory and updates json files.
Requirements
------------
* Python: Version 3.5.2 or higher.
* Nginx
* OpenSSL
Building the debian package
---------------------------
### Building the package ###
To build lxd-image-server, first, install the build dependecies:
```bash
# debhelper >= 9
# dh-virtualenv >= 9
apt-get install debhelper dh-exec python3 python-dev dh-virtualenv
```
Then build the package:
```bash
dpkg-buildpackage -us -uc -b
```
### Building the package in a Docker container ###
To build lxd-image-server itself in a Docker container, call docker build:
```bash
docker build --tag lxd-image-server-builder .
```
This will build the DEB package for Ubuntu Bionic by default. Add e.g.
--build-arg distro=ubuntu:xenial to build for Ubuntu Xenial.
The resulting files must be copied out of the build container, using these
commands:
```bash
mkdir -p dist && docker run --rm lxd-image-server-builder tar -C /dpkg -c . | tar -C dist -xv
```
Installation
------------
### From debian package (recommended) ###
The debian package will automatically copy the source files, create the user lxdadm
to upload the files and setup the nginx server with its configuration (included a
self signed ssl certificate).
* **Install from repository**:
```sh
apt-get install lxd-image-server
```
* **Install using dpkg**:
```sh
dpkg -i lxd-image-server_0.0.1~xenial_all.deb
```
After the installation of the package, a rsa key has to be generated at
/home/lxdadm/.ssh to control the upload of images:
```sh
ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa): # use /home/lxdadm/.ssh/id_rsa
...
```
The generated id_rsa key will be used to upload files to the server.
### From source code ###
Clone the repository and run:
```sh
python setup.py install
```
The subcommand init generates all the default directories, ssl keys and links nginx
configuration (when using default configuration it is recommended to use debian installation)
Usage
-----
Lxd-image-server is not just a new remote for your lxd, it also allows you to
distribute your images to different mirrors. Clients will update new images to
the master server and the master will mirror the image on the mirrors defined
on the configuration file.
The following picture describes, the master server which replicates images to
other two servers. Clients can get images from any of them but they can only
upload new images to the master.
The configuration file would be:
```yaml
[mirrors]
[mirror1]
user = "lxdadm"
remote = "mirror1.xxxxxxx.com"
key_path = "/etc/lxd-image-server/lxdhub.key"
[mirror2]
user = "lxdadm"
remote = "mirror2.xxxxxxx.com"
key_path = "/etc/lxd-image-server/lxdhub.key"
```
The installed service on the master will automatically monitor the image
directory and update all the required metadata. No further commands are needed.
This is the structure the simplestreams server needs to have.
```
- /var/www # document root
`- simplestreams
|- images # images folder
| `- iats # environment
| `- xenial # release
| `- amd64 # architecture
| `- default # box type
| `- 20180716_12:00 # version 1
| |- lxd.tar.xz # index and templates
| `- rootfs.squashfs # rootfs of container
`- streams
`- v1
|- index.json # index of products
`- images.json # info with versions of products
```
The command `lxd-image-server` can be used to manage the server manually:
```sh
Usage: lxd-image-server [OPTIONS] COMMAND [ARGS]...
Options:
--verbose Sets log level to debug
--help Show this message and exit.
Commands:
init
update
watch
Default paths:
- Index files: /var/www/simplestreams/streams/v1
- Image dirs: /var/www/simplestreams/images
```
### Logging configuration
The logging via configuration. The default configuration is defined
[here](lxd_image_server/default_config.toml).
### Subcommands ###
#### init ####
Init creates default configuration needed for the server. See Installation
section for more info.
#### Update ####
Update recreates all the metadata from scratch, and recalculate the
sha256 info for all the images. This option is only intended as a safeguard or in case
the service is not running.
#### Watch ####
Watch will start the monitoring of the directory. It is intended to be
used only if the service is not running.
How to use my new server?
-------------------------
### How to add server as lxd remote ###
Once your own image server is running, you can add it as new remote on lxc:
```bash
lxc remote add --protocol=simplestreams
```
Remember add the certificate:
```bash
openssl s_client -showcerts -connect :443 /dev/null | openssl x509 -outform PEM > my-lxd-image-server.cert
cp my-lxc-image-server.cert /user/local/share/ca-certificates
update-ca-certificates
systemctl restart lxd
```
Also, you can use https://letsencrypt.org/ and makes easier use your server.
### Publish a new image ###
Now, any client can create a image container and publish it on the master server. [Here]9https://ubuntu.com/blog/publishing-lxd-images):
```bash
lxc launch lxc:ubuntu/bionic/amd64 n1
lxc exec n1 -- apt-get -y install vim
lxc stop n1
lxc publish --public n1 --alias=bionic-vim
lxc image copy bionic-vim
```
Now, you can use your image in a new container
```bash
lxc launch bionic-vim ntest
lxc exec ntest -- vim -c "smile"
```
For more information [Here](https://ubuntu.com/blog/publishing-lxd-images).