{"id":20382203,"url":"https://github.com/nolte/personal-storage-infrastructure","last_synced_at":"2025-04-12T08:53:40.563Z","repository":{"id":46606086,"uuid":"197196482","full_name":"nolte/personal-storage-infrastructure","owner":"nolte","description":"Self Hosted MinIO Server at Hetzner Cloud","archived":false,"fork":false,"pushed_at":"2019-07-23T22:42:14.000Z","size":21,"stargazers_count":31,"open_issues_count":0,"forks_count":3,"subscribers_count":0,"default_branch":"develop","last_synced_at":"2025-04-12T08:53:35.650Z","etag":null,"topics":["ansible-playbook","hetzner-cloud","minio","minio-server","s3-storage","terraform"],"latest_commit_sha":null,"homepage":"https://personal-storage-infrastructure.readthedocs.io/en/master/#","language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nolte.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-07-16T13:10:22.000Z","updated_at":"2024-10-12T16:02:14.000Z","dependencies_parsed_at":"2022-08-27T06:51:53.693Z","dependency_job_id":null,"html_url":"https://github.com/nolte/personal-storage-infrastructure","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nolte%2Fpersonal-storage-infrastructure","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nolte%2Fpersonal-storage-infrastructure/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nolte%2Fpersonal-storage-infrastructure/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nolte%2Fpersonal-storage-infrastructure/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nolte","download_url":"https://codeload.github.com/nolte/personal-storage-infrastructure/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248543882,"owners_count":21121838,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ansible-playbook","hetzner-cloud","minio","minio-server","s3-storage","terraform"],"created_at":"2024-11-15T02:16:50.979Z","updated_at":"2025-04-12T08:53:40.544Z","avatar_url":"https://github.com/nolte.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Private S3 Storage\n\n[![Github Project Stars](https://img.shields.io/github/stars/nolte/personal-storage-infrastructure.svg?label=Stars\u0026style=social)](https://github.com/nolte/personal-storage-infrastructure) [![Travis CI build status](https://travis-ci.org/nolte/personal-storage-infrastructure.svg?branch=master)](https://travis-ci.org/nolte/personal-storage-infrastructure) [![Documentation Status](https://readthedocs.org/projects/personal-storage-infrastructure/badge/?version=latest)](https://personal-storage-infrastructure.readthedocs.io/en/stable/?badge=stable) [![Github Issue Tracking](https://img.shields.io/github/issues-raw/nolte/personal-storage-infrastructure.svg)](https://github.com/nolte/personal-storage-infrastructure) [![Github LatestRelease](https://img.shields.io/github/release/nolte/personal-storage-infrastructure.svg)](https://github.com/nolte/personal-storage-infrastructure)\n\nFor hosting a private S3 Object storage we use [min.io](https://min.io/) at [hetzner.cloud](https://docs.hetzner.cloud), created with [Terraform](https://www.terraform.io/docs/providers/hcloud/index.html) and configured with Ansible.\n\n**Precondition**\n\n* For full Configuration you need the Base Scripts from [nolte/ansible_playbook-baseline-online-server](https://github.com/nolte/ansible_playbook-baseline-online-server).\n* The Terraform Infrastructuon part used Modules from [nolte/terraform-infrastructure-modules](https://github.com/nolte/terraform-infrastructure-modules).\n\n## Usage\n\nFor Interaction with the [Hetzner API](https://docs.hetzner.cloud/), you must be define a environment variable with the name ``HCLOUD_TOKEN``. This Variable will be used from the [Terraform Hetzner Cloud Provider](https://www.terraform.io/docs/providers/hcloud/), and the [hcloud Dynamic Ansible Inventory plugin](https://docs.ansible.com/ansible/latest/plugins/inventory/hcloud.html).\n\n```bash\nexport HCLOUD_TOKEN=$(pass internet/hetzner.com/projects/personal_storage/token)\n```\n\nFor the Dependency Management it is recommedet to use a seperated virtual env like:\n\n```bash\nvirtualenv -p python3 ~/venvs/ansible-vagrant\nsource ~/venvs/ansible-vagrant/bin/activate\npip install -r requirements.txt\npre-commit install\n```\n\n### Infrastructure\n\nThe Terraform Source at the `./infrastructure` folder, is splitted into two different Steps.  \nFirstly `./infrastructure/longterm_elements` for manage the Hetzner Project and the Storage Volume, so be carefull when you call `terraform destroy`, **you lost all your Stored Data!**  \nThe second part are located at `./infrastructure/minio_env`, here we attach the Storage volume and create the computing instance. `terraform destory` only delete the Computing Instance! The Storage Volume are not removed, so all your data are safe!  \nBoth parts used self written Terraform Modules from [nolte/terraform-infrastructure-modules](https://github.com/nolte/terraform-infrastructure-modules) as wrapper for the [Terraform hcloud](https://www.terraform.io/docs/providers/hcloud/index.html) provider.\n\n### Maintenance\n\nFor Installation and Maintenance, we use [Ansible](https://www.ansible.com/) with a Dynamic Inventory. We splitted the production used inventory from the playbook Repository. For define the Inventory Location you can use a environment variable ``export ANSIBLE_INVENTORY=$(pwd)/inventory/prod/``, or the ``-i`` parameter. At this Git Repository, you will only find MinIO Specific Configuration steps. For the base configutation we use the [nolte/ansible_playbook-baseline-online-server](https://github.com/nolte/ansible_playbook-baseline-online-server) scripts, like base firewall configruations or install Docker.\n\nFor quick usage you can use the [gilt - A GIT layering tool](https://gilt.readthedocs.io/en/latest/) by:\n\n```bash\ngilt overlay\n```\n\nnow you have all required dependencies at the ``./ext_debs`` working directory, and configure the basement with:\n\n```bash\nansible-playbook ./ext_debs/ansible_playbook-baseline-online-server/master-configure-system.yml\n```\n\n#### Storage Box Installation\n\n```bash\nansible-playbook maintenance/master-configure-system.yml\n```\n\n### Development\n\n\n\n\n\n*Future Read:*\n\n* [how-to-secure-access-to-minio-server-with-tls](https://docs.min.io/docs/how-to-secure-access-to-minio-server-with-tls.html#using-open-ssl)\n* [minio-multi-user-quickstart-guide](https://docs.min.io/docs/minio-multi-user-quickstart-guide.html)\n* [minio-client-quickstart-guide](https://docs.min.io/docs/minio-client-quickstart-guide.html)\n\n\n* [resizing-hetzner-cloud-block-storage-volumes-on-the-fly](https://blog.ruanbekker.com/blog/2018/12/19/resizing-hetzner-cloud-block-storage-volumes-on-the-fly/)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnolte%2Fpersonal-storage-infrastructure","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnolte%2Fpersonal-storage-infrastructure","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnolte%2Fpersonal-storage-infrastructure/lists"}