{"id":13983975,"url":"https://github.com/solus-project/ferryd","last_synced_at":"2025-10-30T11:31:40.773Z","repository":{"id":145851596,"uuid":"75593421","full_name":"solus-project/ferryd","owner":"solus-project","description":"Fast, safe and reliable transit for the delivery of software updates to users.","archived":false,"fork":false,"pushed_at":"2018-10-18T18:08:10.000Z","size":2294,"stargazers_count":40,"open_issues_count":3,"forks_count":7,"subscribers_count":10,"default_branch":"master","last_synced_at":"2025-02-02T08:11:40.407Z","etag":null,"topics":["binary","daemon","database","delivery","delta","delta-packages","eopkg","linux","linux-distribution","manifest","monitor","needs-more-tags","package","pool","repository","repository-management","software-update","solus","transit"],"latest_commit_sha":null,"homepage":"https://solus-project.com/","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/solus-project.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":"AUTHORS"}},"created_at":"2016-12-05T05:56:15.000Z","updated_at":"2023-09-18T18:11:14.000Z","dependencies_parsed_at":"2023-05-18T11:31:19.727Z","dependency_job_id":null,"html_url":"https://github.com/solus-project/ferryd","commit_stats":null,"previous_names":["solus-project/binman"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solus-project%2Fferryd","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solus-project%2Fferryd/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solus-project%2Fferryd/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solus-project%2Fferryd/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/solus-project","download_url":"https://codeload.github.com/solus-project/ferryd/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":238960405,"owners_count":19559259,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["binary","daemon","database","delivery","delta","delta-packages","eopkg","linux","linux-distribution","manifest","monitor","needs-more-tags","package","pool","repository","repository-management","software-update","solus","transit"],"created_at":"2024-08-09T05:02:06.415Z","updated_at":"2025-10-30T11:31:34.715Z","avatar_url":"https://github.com/solus-project.png","language":"Go","readme":"ferryd\n--------\n\n\u003e Fast, safe and reliable transit for the delivery of software updates to users.\n\n\n[![Report](https://goreportcard.com/badge/github.com/solus-project/binman)](https://goreportcard.com/report/github.com/solus-project/ferryd) [![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\n\nferryd is a [Solus project](https://solus-project.com/).\n\n![logo](https://build.solus-project.com/logo.png)\n\n`ferryd` is the binary repository manager for Solus. In addition to providing basic management for repositories, it is also an asynchronous job-based daemon, processing incoming package\nuploads from authorised builder machines. `ferryd` attempts to optimise all operations ahead of time, by caching all metadata required for repository indexes.\n\nThe primary goal for `ferryd` is to provide a daemon that constantly monitors new uploads, and processes them as fast as possible. This ensures new packages are available almost immediately.\nComplex, long running operations, are run in the background within a dedicated worker pool. This allows new packages to turn up in batch, and the delta packages to be produced lazily. Once\nthose delta packages are available, they're inserted into the main repository (and will appear in the index.)\n\nThe design of `ferryd` allows us to blit a repository index from the database to disk very fast (around 2-3s for a large repository). Special care is taken to only perform atomic updates to the\nindex - meaning no connectivity issues for clients with corrupt or partial indexes. The repository index should always be available, and all published packages should *permanently* be present.\n\n`ferryd` takes special care to cache wherever possible, and uses a reference-counted package pool. All package files within each repository are hard-linked from the pool tree, allowing to\nsave disk space through enforced deduplication. As such, a package's ID (the basename of the file) must be unique to a ferryd instance. Putting it all together, this allows us to simply \"ref\"\na package into a repository from the pool, which is used for very rapid clone and pull operations.\n\n`ferryd` is the replacement for the aging `binman.py` script previously used by Solus, and is designed to combat the design mistakes of that implementation. Emphasis is placed on speed, scaling,\nand having packages immediately and permanently available. Less delays for developers, and rapid updates and sync deployment to users.\n\nLastly, `ferryd` aims to provide very simple sync abilities to help control deployment of packages to other repositories. An explicit design goal is to enable \"Pulling\" a repository into an\nexisting repository, which in turn publishes one channel to another. This is used in Solus to control sync-windows from unstable to stable, and is done as a single atomic operation.\n\n_Disclaimer regarding the name: Solus has this weird obsession with all things nautical. Oh and birds._\n\n\nUsage (basic)\n-------------\n\nStart ferryd to monitor `ferryd.sock`:\n\n    ./bin/ferryd -d myRepoBase -s ./ferryd.sock\n\nCreate a repo:\n\n    ./bin/ferryctl -s ./ferryd.sock create-repo testing\n\nAdd packages:\n\n    ./bin/ferryctl -s ./ferryd.sock import testing path/to/eopkgs\n\nLicense\n-------\n\nCopyright © 2016-2017 Solus Project, ferryd Developers (See AUTHORS file)\n\n`ferryd` is available under the terms of the Apache-2.0 license\n","funding_links":[],"categories":["Go"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsolus-project%2Fferryd","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsolus-project%2Fferryd","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsolus-project%2Fferryd/lists"}