{"id":51385897,"url":"https://github.com/engineering87/sibillaos","last_synced_at":"2026-07-03T20:33:23.901Z","repository":{"id":369047642,"uuid":"1288064550","full_name":"engineering87/sibillaos","owner":"engineering87","description":"Linux distro with a built-in LLM. Detects your hardware, picks vLLM or Ollama, downloads a model that fits, and serves an OpenAI-compatible API from first boot.","archived":false,"fork":false,"pushed_at":"2026-07-03T10:24:35.000Z","size":839,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-07-03T11:25:50.197Z","etag":null,"topics":["debian-packages","distro","inference","iso-builder","linux","linux-distribution","llm","local-ai","ollama","self-hosted","ubuntu","vllm"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/engineering87.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-07-03T08:40:23.000Z","updated_at":"2026-07-03T10:24:40.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/engineering87/sibillaos","commit_stats":null,"previous_names":["engineering87/sibillaos"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/engineering87/sibillaos","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/engineering87%2Fsibillaos","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/engineering87%2Fsibillaos/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/engineering87%2Fsibillaos/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/engineering87%2Fsibillaos/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/engineering87","download_url":"https://codeload.github.com/engineering87/sibillaos/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/engineering87%2Fsibillaos/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":35101093,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-07-03T02:00:05.635Z","response_time":110,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["debian-packages","distro","inference","iso-builder","linux","linux-distribution","llm","local-ai","ollama","self-hosted","ubuntu","vllm"],"created_at":"2026-07-03T20:33:23.124Z","updated_at":"2026-07-03T20:33:23.896Z","avatar_url":"https://github.com/engineering87.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003cimg src=\"branding/banner.png\" alt=\"SibillaOS\" width=\"820\"/\u003e\n\n\u003cbr/\u003e\n\n**Install Linux, get a working LLM API. Nothing else to set up.**\n\n[![License](https://img.shields.io/badge/license-Apache--2.0-blue.svg)](LICENSE)\n[![Base](https://img.shields.io/badge/base-Ubuntu%2024.04%20LTS-e95420.svg)](https://ubuntu.com)\n[![Build](https://github.com/engineering87/sibillaos/actions/workflows/build-iso.yml/badge.svg)](https://github.com/engineering87/sibillaos/actions/workflows/build-iso.yml)\n[![Status](https://img.shields.io/badge/status-proof%20of%20concept-f5c542.svg)](docs/architecture.md)\n\n\u003c/div\u003e\n\n\u003cbr/\u003e\n\nRunning a local LLM still means picking an engine, matching a model to your VRAM, choosing a quantization and wiring up a service. SibillaOS does all of that in the installer. Boot the ISO, answer the usual questions, and the first thing your machine does is serve an OpenAI-compatible API.\n\n```console\n$ curl https://myserver:8080/v1/chat/completions \\\n    -H \"Authorization: Bearer $(cat /etc/llmd/apikey)\" \\\n    -d '{\"model\": \"default\", \"messages\": [{\"role\": \"user\", \"content\": \"hello\"}]}'\n```\n\n\u003cbr/\u003e\n\n## How it works\n\nThe installer detects your hardware and makes the decisions a human would otherwise have to research.\n\n| | |\n|---|---|\n| **Engine selection** | vLLM in an OCI container on datacenter GPUs (24 GB VRAM and up), Ollama everywhere else, CPU-only machines included. |\n| **Model sizing** | [llmfit](https://github.com/AlexsJones/llmfit) recommends only models that actually fit your VRAM and RAM, with the best quantization and a speed estimate. |\n| **Curated catalog** | Permissively licensed (Apache-2.0/MIT), non-gated Hugging Face repos only. Verified ids, signed list. |\n| **Resilient download** | The model is pulled from Hugging Face during install and resumed at first boot if the connection drops. |\n| **Single endpoint** | One OpenAI-compatible API on port 8080, TLS, bearer token. Engines stay on loopback. |\n\nTwo variants: headless server and desktop (GNOME, optional Open WebUI).\n\n## Getting started\n\nThe easiest path is a prebuilt ISO from [Releases](https://github.com/engineering87/sibillaos/releases), verified against its `SHA256SUMS`.\n\nTo build from source you only need `xorriso` and `curl` (no root). The build downloads the official Ubuntu 24.04 live-server ISO, verifies its checksum and repacks it with the SibillaOS autoinstall, packages and branding:\n\n```bash\nsudo apt-get install xorriso\n./packages/build-debs.sh       # build the llmd-* debs\n./iso/build.sh                 # out/sibillaos-\u003cversion\u003e-amd64.iso\n```\n\nEvery push to `main` also builds the ISO in CI, boots it in QEMU and runs the automated install end to end; the image is attached to each run as an artifact.\n\n## Repository layout\n\n```\niso/          ISO repack (official Ubuntu live-server + payload) and autoinstall\npackages/     Debian packages: hardware detection, engines, gateway, first boot\ncatalog/      curated model list (signed JSON)\nbranding/     logo, banner and wallpaper\ndocs/         architecture document\n```\n\n## Status\n\nProof of concept, moving toward MVP. Before any real deployment be aware that the autoinstall user password is a placeholder and must be replaced, and that engine versions are not yet pinned in the ISO build. The full design, decision log and roadmap live in [docs/architecture.md](docs/architecture.md).\n\n## License\n\nApache-2.0, see [LICENSE](LICENSE). Bundled components keep their own licenses: vLLM (Apache-2.0), Ollama (MIT), llmfit (MIT). NVIDIA drivers are not redistributed by this repository; the ISO installs them from the Ubuntu `restricted` component.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fengineering87%2Fsibillaos","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fengineering87%2Fsibillaos","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fengineering87%2Fsibillaos/lists"}