An open API service indexing awesome lists of open source software.

https://github.com/ustclug/Yuki

Mirror management tool, developed and used in-house in USTC
https://github.com/ustclug/Yuki

docker-container mirror restful-api

Last synced: 10 months ago
JSON representation

Mirror management tool, developed and used in-house in USTC

Awesome Lists containing this project

README

          

README
=======

[![Presubmit Checks](https://github.com/ustclug/Yuki/actions/workflows/pr-presubmit-checks.yml/badge.svg)](https://github.com/ustclug/Yuki/actions/workflows/pr-presubmit-checks.yml)
[![Go Report](https://goreportcard.com/badge/github.com/ustclug/Yuki)](https://goreportcard.com/report/github.com/ustclug/Yuki)

- [Requirements](#requirements)
- [Quickstart](#quickstart)
- [Handbook](#handbook)
- [Development](#development)

Sync local repositories with remote.

## Requirements

* Docker
* SQLite

## Quickstart

### Setup

#### Debian and Ubuntu

Download `yuki_*_amd64.deb` from the [latest release][latest-release] and install it:

[latest-release]: https://github.com/ustclug/Yuki/releases/latest

```shell
# Using v0.6.1 for example
wget https://github.com/ustclug/Yuki/releases/download/v0.6.1/yuki_0.6.1_amd64.deb
sudo dpkg -i yuki_0.6.1_amd64.deb
```

Copy `/etc/yuki/daemon.example.toml` to `/etc/yuki/daemon.toml` and edit accordingly.

Create the `mirror` user and start the system service:

```shell
sudo useradd -m mirror
sudo systemctl enable --now yukid.service
```

#### Other distros

Download the binaries from the [latest release][latest-release]. For example:

```bash
wget https://github.com/ustclug/Yuki/releases/latest/download/yukictl_linux_amd64
wget https://github.com/ustclug/Yuki/releases/latest/download/yukid_linux_amd64

sudo cp yukictl_linux_amd64 /usr/local/bin/yukictl
sudo cp yukid_linux_amd64 /usr/local/bin/yukid
sudo chmod +x /usr/local/bin/{yukid,yukictl}
```

Configure yukid:

```bash
sudo mkdir /etc/yuki/
sudo useradd -m mirror
mkdir /tmp/repo-logs/ /tmp/repo-configs/

cat < /tmp/repo-configs/docker-ce.yaml
name: docker-ce
# every 1 hour
cron: "0 * * * *"
storageDir: /tmp/repo-data/docker-ce
image: ustcmirror/rsync:latest
logRotCycle: 2
envs:
RSYNC_HOST: rsync.mirrors.ustc.edu.cn
RSYNC_PATH: docker-ce/
RSYNC_EXCLUDE: --exclude=.~tmp~/
RSYNC_EXTRA: --size-only
RSYNC_MAXDELETE: "50000"
EOF

yukictl reload
# Verify
yukictl repo ls

# Trigger synchronization immediately
yukictl sync docker-ce
```

For more details of the configuration file, please refer to the [yukid handbook](./cmd/yukid/README.md).

## Handbook

* [yukid](./cmd/yukid/README.md): Yuki daemon
* [yukictl](./cmd/yukictl/README.md): Yuki cli

## Migration Guide

### v0.3.x -> v0.4.x

For configuration:

```bash
sed -i.bak 's/log_dir/repo_logs_dir/' /etc/yuki/daemon.toml
# Also remember to update the `images_upgrade_interval` field in /etc/yuki/daemon.toml if it is set.

sed -i.bak 's/interval/cron/' /path/to/repo/configs/*.yaml
```

For post sync hook, the environment variables that are passed to the hook script are changed:

* `Dir` -> `DIR`: the directory of the repository
* `Name` -> `NAME`: the name of the repository

## Development

* Build `yukid`:

```shell
make yukid
```

* Build `yukictl`:

```shell
make yukictl
```

* Build Debian package:

```shell
make deb
```

* Lint the whole project:

```shell
make lint
```