{"id":16060784,"url":"https://github.com/geerlingguy/arm-nas","last_synced_at":"2025-04-05T06:03:51.803Z","repository":{"id":224636529,"uuid":"763808281","full_name":"geerlingguy/arm-nas","owner":"geerlingguy","description":"Arm NAS configuration with ZFS.","archived":false,"fork":false,"pushed_at":"2024-10-15T16:16:43.000Z","size":478,"stargazers_count":169,"open_issues_count":10,"forks_count":9,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-03-29T05:03:07.834Z","etag":null,"topics":["arm","arm64","hl15","linux","raspberry-pi","zfs"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/geerlingguy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-27T00:30:11.000Z","updated_at":"2025-03-28T12:08:00.000Z","dependencies_parsed_at":"2024-02-29T16:33:04.007Z","dependency_job_id":"a8a646f6-ebe9-4ef1-8bed-040f81db3d63","html_url":"https://github.com/geerlingguy/arm-nas","commit_stats":null,"previous_names":["geerlingguy/hl15-arm64-nas"],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Farm-nas","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Farm-nas/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Farm-nas/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/geerlingguy%2Farm-nas/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/geerlingguy","download_url":"https://codeload.github.com/geerlingguy/arm-nas/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247294516,"owners_count":20915340,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["arm","arm64","hl15","linux","raspberry-pi","zfs"],"created_at":"2024-10-09T04:06:22.818Z","updated_at":"2025-04-05T06:03:51.787Z","avatar_url":"https://github.com/geerlingguy.png","language":"Shell","funding_links":[],"categories":["How to Use OpenZFS on Raspberry Pi (ZFS on Raspberry Pi)"],"sub_categories":["ZFS other tools"],"readme":"# Arm NAS\n\nAnsible playbook to configure my Arm NASes:\n\n  - [HL15 with Ampere Altra](#primary-nas)\n  - [Raspberry Pi 5 SATA NAS](#secondary-nas)\n\n## Hardware\n\n### \u003ca name=\"primary-nas\"\u003e\u003c/a\u003ePrimary NAS - 45Drives HL15\n\n\u003cp align=\"center\"\u003e\u003cimg alt=\"45Homelab HL15 with Jeff Geerling hardware\" src=\"/resources/hl15-hardware.jpeg\" height=\"auto\" width=\"600\"\u003e\u003c/p\u003e\n\nThe current iteration of the HL15 I'm running contains the following hardware:\n\n  - (Motherboard) [ASRock Rack ALTRAD8UD-1L2T](https://reurl.cc/qrnXNp) ([specs](https://reurl.cc/67jk0V))\n  - (Case) [45Homelab HL15 + backplane + PSU](https://store.45homelab.com/configure/hl15)\n  - (PSU) [Corsair RM750e](https://amzn.to/3OyDQ79)\n  - (RAM) [8x Samsung 16GB 1Rx4 ECC RDIMM M393A2K40DB3-CWE PC25600](https://amzn.to/49lCtkb)\n  - (NVMe) [Kioxia XG8 2TB NVMe SSD](https://amzn.to/3Uzag5d)\n  - (CPU) [Ampere Altra Q32-17](https://amperecomputing.com/briefs/ampere-altra-family-product-brief)\n  - (SSDs) [4x Samsung 8TB 870 QVO 2.5\" SATA](https://amzn.to/3OylbZk)\n  - (HDDs) [6x Seagate EXOS 20TB SATA HDD](https://amzn.to/3OA2CDM)\n  - (HBA) [Broadcom MegaRAID 9405W-16i](https://amzn.to/3srcZOh)\n  - (Cooler) [Noctua NH-D9 AMP-4926 4U](https://noctua.at/en/nh-d9-amp-4926-4u)\n  - (Case Fans) [6x Noctua NF-A12x25 PWM](https://amzn.to/3SUReE7)\n  - (Fan Hub) [Noctua NA-FH1 8 channel Fan Hub](https://amzn.to/3SVPL01)\n\nSome of the above links are affiliate links. I have a series of videos showing how I put this system together:\n\n  - Part 1: [How efficient can I build the 100% Arm NAS?](https://www.youtube.com/watch?v=Hz5k5WgTkcc)\n  - Part 2: [Silencing the 100% Arm NAS—while making it FASTER?](https://www.youtube.com/watch?v=iD9awxmOGG4)\n\n### \u003ca name=\"secondary-nas\"\u003e\u003c/a\u003eSecondary NAS - Raspberry Pi 5 with SATA HAT\n\n\u003cp align=\"center\"\u003e\u003cimg alt=\"Raspberry Pi 5 with Jeff Geerling hardware\" src=\"/resources/raspberrypi-5-hardware.jpeg\" height=\"auto\" width=\"600\"\u003e\u003c/p\u003e\n\nThe current iteration of the Raspberry Pi 5 SATA NAS I'm running contains the following hardware:\n\n  - (SBC) [Raspberry Pi 5](https://www.raspberrypi.com/products/raspberry-pi-5/)\n  - (HAT) [Radxa Penta SATA HAT for Pi 5](https://amzn.to/3UyWXBr)\n  - (SSDs) [Samsung 870 QVO 8TB SATA SSD](https://amzn.to/3y2nrSR)\n  - (microSD) [Kingston Industrial 16GB A1](https://amzn.to/3y2noGF)\n  - (Network) [Plugable 2.5GB USB Ethernet Adapter](https://amzn.to/4b9QMt1)\n  - (Power) [TMEZON 12V 5A AC adapter](https://amzn.to/3QhYKIw)\n\nSome of the above links are affiliate links. I have a series of videos showing how I put this system together:\n\n  - Part 1: [The ULTIMATE Raspberry Pi 5 NAS](https://www.youtube.com/watch?v=l30sADfDiM8)\n  - Part 2: [Big NAS, Lil NAS](https://www.youtube.com/watch?v=D8EIs8s303k)\n\n## Preparing the hardware\n\nThe HL15 should not require any special prep, besides having Ubuntu installed. The Raspberry Pi 5 is running Debian (Pi OS) and needs its PCIe connection enabled. To do that:\n\n  1. Edit the boot config: `sudo nano /boot/firmware/config.txt`\n  2. Add in the following config at the bottom and save the file:\n\n     ```\n     dtparam=pciex1\n     dtparam=pciex1_gen=3\n     ```\n  \n  3. Reboot\n\nConfirm the SATA drives are recognized with `lsblk`.\n\n## Running the playbook\n\nEnsure you have Ansible installed, and can SSH into the NAS using `ssh user@nas-ip-or-address` without entering a password, then run:\n\n```\nansible-playbook main.yml\n```\n\n## Accessing Samba Shares\n\nAfter the playbook runs, you should be able to access Samba shares, for example the `hddpool/jupiter` share, by connecting to the server at the path:\n\n```\nsmb://nas01.mmoffice.net/hddpool_jupiter\n```\n\nUntil [issue #2](https://github.com/geerlingguy/hl15-arm64-nas/issues/2) is resolved, there is one manual step required to add a password for the `jgeerling` user (one time). Log into the server via SSH, run the following command, and enter a password when prompted:\n\n```\nsudo smbpasswd -a jgeerling\n```\n\nThe same thing goes for the Pi, if you want to access it's ZFS volume.\n\n## Replication / Backups\n\nBackups of the primary NAS (nas01) to the secondary NAS (nas02) are handled using [Sanoid](https://github.com/jimsalterjrs/sanoid) (and it's included `syncoid` replication tool).\n\nSanoid is configured on nas01 to store a set of monthly, daily, and hourly snapshots. Syncoid is run on cron on nas02 to pull snapshots nightly.\n\nSanoid should prune snapshots on nas01, and Syncoid on nas02.\n\nYou can check on snapshot health with:\n\n  - nas01: `sudo sanoid --monitor-snapshots \u0026\u0026 zfs list -t snapshot`\n  - nas02: `zfs list -t snapshot`\n\nFor example:\n\n```\njgeerling@nas01:~$ sudo sanoid --monitor-snapshots\nOK: all monitored datasets (hddpool/jupiter) have fresh snapshots\n```\n\n### Offsite Backups to Amazon Glacier\n\nFollowing the [1-2-3 Backup Principle](https://www.jeffgeerling.com/blog/2021/my-backup-plan), I have an offsite replica of all my data stored on an Amazon S3 Glacier Deep Archive-backed bucket.\n\nThis keeps offsite storage costs minimal (about $1/TB/month), and using `rclone`, it is easy enough to keep things in sync between my onsite backups and S3.\n\nThe S3 bucket is owned by IAM user `rclone`, and is named `mm-archive`.\n\nLocally, `rclone config` is set up with an Access Key and Secret Access Key for that `rclone` IAM user, and allows NAS02 to synchronize directories straight into the Amazon S3 bucket.\n\nFull documentation of the setup is in [this GitHub issue](https://github.com/geerlingguy/arm-nas/issues/14).\n\n#### Office Backup Retrieval\n\nTODO: We'll cross this bridge if we come to it. The only time I've ever had to retrieve a folder, I used rclone to sync down the directory but it was a bit of a hassle, since Deep Archive means you have to request files to be put back online for retrieval, and this can take 6-24 hours!\n\n## Benchmarks\n\nI like to verify the performance of my NAS storage pools on the device itself, using my [`disk-benchmark.sh` script](https://github.com/geerlingguy/pi-cluster/blob/master/benchmarks/disk-benchmark.sh).\n\nYou can run it by copying it to the server, making it executable, and running it with `sudo`:\n\n```\nwget https://raw.githubusercontent.com/geerlingguy/pi-cluster/master/benchmarks/disk-benchmark.sh\nchmod +x disk-benchmark.sh\nsudo MOUNT_PATH=/nvmepool/mercury TEST_SIZE=20g ./disk-benchmark.sh\n```\n\n## Troubleshooting\n\n### Samba Monitoring\n\nIf you're having trouble mounting a share or authenticating with Samba, run `sudo watch smbstatus` to monitor connections to the server. Logs inside `/var/log/samba` aren't useful by default.\n\n### ZFS Command Line Cheat Sheet\n\n```\n# Check pool health (should return 'all pools are healthy')\nzpool status -x\n\n# List all zfs pools and datasets\nzfs list\n\n# List all zfs pool info\nzpool list\n\n# List single zfs pool info (verbose)\nzpool status -v [pool_name]\n\n# List all properties for a pool\nzfs get all [pool_name]\n\n# Scrub a pool manually (check progress with `zpool status -v`)\nzpool scrub [pool_name]\n\n# Monitor zfs I/O statistics (update every 2s)\nzpool iostat 2\n```\n\n## License\n\nGPLv3 or later\n\n## Author\n\nJeff Geerling\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgeerlingguy%2Farm-nas","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgeerlingguy%2Farm-nas","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgeerlingguy%2Farm-nas/lists"}