Self-Hosting-Guide

Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
https://github.com/mikeroyal/Self-Hosting-Guide

Last synced: 5 days ago
JSON representation

Tools for Self-Hosting
- Configuration Management
  - Salt - is an event-driven automation tool and framework to deploy, configure, and manage complex IT systems. It automates common infrastructure administration tasks and ensure that all the components of your infrastructure are operating in a consistent desired state.
  - Fleek - in-one management system for everything you need to be productive on your computer.
  - mgmt - is a next generation config management written in Go.
  - Chef - is a powerful automation platform that transforms infrastructure into code automating how infrastructure is configured, deployed and managed across any environment.
  - Pallet - is a Infrastructure definition, configuration and management via a Clojure DSL.
  - Puppet - is an automated administrative engine for your Linux, Unix, and Windows systems, performs administrative tasks (such as adding users, installing packages, and updating server configurations) based on a centralized specification.
  - Ansible.Ai
- Containers
  - Application Container Security Guide | NIST (PDF)
  - DockerHub Container Images
  - LinuxServer.io Container Images
  - Quay Container Images
  - Docker Include
  - Kompose
  - Containerd - level storage to network attachments and beyond. It is available for Linux and Windows.
  - ContainersSSH
  - Podman
  - Kitematic
  - Open Container Initiative
  - OpenNebula - rich and flexible solution to build and manage enterprise clouds for virtualized services, containerized applications and serverless computing.
  - Buildah
  - Red Hat Universal Base Images (UBI) - compliant, container-based, operating system images with complementary runtime languages and packages that are freely redistributable. Easily find UBI images in the Red Hat container catalog, and they are buildable and deployable anywhere.
  - Red Hat Quay
  - ctop - time metrics for multiple containers as well as a [single container view](https://github.com/bcicen/ctop/blob/master/_docs/single.md) for inspecting a specific container. It comes with built-in support for Docker and runC; connectors for other container and cluster systems are planned for future releases.
  - Alnoda Workspaces - source portable containerized browser-based development environments in Docker containers. You can create your own custom workspace or customize any of the workspaces with your preferred stack of applications without knowing much of the Docker.
  - Autoheal
  - Dozzle
  - Diun
  - WatchTower
  - Docker Compose - container applications. With Compose, we can create a YAML file to define the services and with a single command, can spin everything up or tear it all down.
  - SwarmKit - based consensus, task scheduling and more.
  - Lima - source alternative for [Docker Desktop](https://www.docker.com/products/docker-desktop).
  - Colima
  - Portainer Community Edition
  - Yacht - click deployments.
  - runc
  - container-images
  - Clair - spec/blob/master/spec.md) and [Docker](https://github.com/docker/docker/blob/master/image/spec/v1.2.md)).
  - Shipwright - Compose, and Unraid.
  - Nginx Proxy - gen](https://github.com/nginx-proxy/docker-gen). Docker-gen generates reverse proxy configs for nginx and reloads nginx when containers are started and stopped.
  - Visual Studio Code Dev Containers - featured development environment. It allows you to open any folder inside (or mounted into) a container and take advantage of Visual Studio Code's full feature set. A [devcontainer.json file](https://code.visualstudio.com/docs/devcontainers/containers#_create-a-devcontainerjson-file) in your project tells VS Code how to access (or create) a development container with a well-defined tool and runtime stack.
  - DockerHub Container Images
  - HashiCorp Nomad - containerized applications across on-premises and clouds at scale.
  - Docker Include
  - Kasm Workspaces
- Development
  - IT-Tools
  - Visual Studio Live Share
  - GistPad
  - Live Server
  - Gitea - hosted Git service.
  - GitLab - to-end software development platform with built-in version control, issue tracking, code review, CI/CD, and more. Self-host GitLab on your own servers, in a container, or on a cloud provider.
  - Bonobo Git Server - Set up your own self hosted git server on IIS for Windows. Manage users and have full control over your repositories with a nice user friendly graphical interface.
  - Gerrit - A code review and project management tool for Git based projects.
  - Gitblit - Pure Java stack for managing, viewing, and serving Git repositories.
  - Gitlist - Web-based git repository browser - GitList allows you to browse repositories using your favorite browser, viewing files under different revisions, commit history and diffs.
  - Gitolite - Gitolite allows you to setup git hosting on a central server, with fine-grained access control and many more powerful features.
  - Gogs - Painless self-hosted Git Service written in Go.
  - Kallithea - Source code management system that supports two leading version control systems, Mercurial and Git, with a web interface.
  - Taiga - source project management software for cross-functional teams that work agile across both scrum and kanban frameworks.
  - Planka
  - OneDev - All-In-One DevOps Platform. With Git Management, Issue Tracking, and CI/CD. Simple yet Powerful.
  - Pagure - A lightweight, powerful, and flexible git-centric forge with features laying the foundation for federated and decentralized development.
  - Phorge - Phorge is an open source, community driven platform for collaborating, managing, organizing and reviewing software development projects.
  - Redmine - Redmine is a flexible project management web application. ([Demo](http://demo.redmine.org/),
  - RhodeCode - RhodeCode is an open source platform for software development teams. It unifies and simplifies repository management for Git, Subversion, and Mercurial.
  - Titra - Time-tracking solution for freelancers and small teams.
  - Traq - Project management and issue tracking system written in PHP.
  - Tuleap - Tuleap is a libre suite to plan, track, code and collaborate on software projects.
  - ZenTao - An agile(scrum) project management system/tool.
  - Node-Red - code programming for event-driven applications.
  - Zeal
  - Self-Hosted Sentry nightly - complete and packaged up for low-volume deployments and proofs-of-concept.
  - Terraform provider plugin for Proxmox - docs/) and exposes Terraform resources to provision QEMU VMs and LXC Containers.
  - OTF
  - Chisel Kubernetes Operator - operator](https://github.com/inlets/inlets-operator).
  - Docker-pgautoupgrade
  - Lazygit
  - LazyDocker - compose, written in Go with the [gocui](https://github.com/jroimartin/gocui) library.
  - Code-Server
  - Turbopilot - language-model based code completion engine that runs locally on your CPU.
  - Act
  - Act runner
  - gitbucket - Easily installable GitHub clone powered by Scala.
  - GitPrep - Portable Github clone.
  - Klaus - Simple, easy-to-set-up Git web viewer that Just Works.
  - Microgit - Git hosting service made in Crystal and Lucky. `MIT` `Crystal`
  - k3s-ansible - hosted High Availability Kubernetes cluster. A fully automated HA k3s etcd install with [kube-vip](https://kube-vip.chipzoller.dev/), [MetalLB](https://metallb.universe.tf/installation/), and more.
  - Soft Serve - hostable Git server for the command line.
  - Corosync Cluster Engine
  - Glow
  - Deep Lake - source dataset format is optimized for rapid streaming and querying of data while training models at scale, and it includes a simple API for creating, storing, and collaborating on AI datasets of any size. It can be deployed locally or in the cloud, and it enables you to store all of your data in one place, ranging from simple annotations to large videos.
  - krunvm - based utility for creating microVMs from OCI images, using [libkrun](https://github.com/containers/libkrun) and [buildah](https://github.com/containers/buildah).
  - Semaphore UI
  - Chisel Kubernetes Operator - operator](https://github.com/inlets/inlets-operator).
  - APITable - oriented low-code platform for building collaborative apps and better than all other Airtable open-source alternatives.
  - Fossil - Distributed version control system featuring wiki and bug tracker.
  - Leantime - Leantime is a lean project management system for small teams and startups helping to manage projects from ideation through delivery.
  - UVDesk - UVDesk community is a service oriented, event driven extensible opensource helpdesk system that can be used by your organization to provide efficient support to your clients effortlessly whichever way you imagine.
- LLMs
  - A comprehensive guide to running Llama 2 locally
  - Leaderboard by lmsys.org
  - Open LLM Leaderboard by Hugging Face
  - Holistic Evaluation of Language Models (HELM)
  - Ava PLS - in-one desktop app to run LLMs locally.
  - LLM-Leaderboard
  - OpenLLM - tune, serve, deploy, and monitor any LLMs with ease.
  - Llama-gpt - hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device.
  - Llama2 webui - wrapper` as your local llama2 backend for Generative Agents/Apps.
  - Llama2.c - line C file ([run.c](https://github.com/karpathy/llama2.c/blob/master/run.c)).
  - LoLLMS WebUI - friendly interface to access and utilize various LLM models for a wide range of tasks. Whether you need help with writing, coding, organizing data, generating images, or seeking answers to your questions.
  - Gradio Web UI
  - KoboldCpp - to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author's note, characters, and scenarios.
  - Minima - premises using containers.
  - llama.cpp
  - Open LLM Leaderboard by Hugging Face
  - ollama
- MinIO Object Storage
  - MinIO - 171GB/s** if you use standard hardware. It can function as the main storage tier for many workloads like **Spark, TensorFlow, Presto, Hadoop HDFS, and H2O.**
  - MinIO - 171GB/s** if you use standard hardware. It can function as the main storage tier for many workloads like **Spark, TensorFlow, Presto, Hadoop HDFS, and H2O.**
- Running Locally on Windows, MacOS, and Linux:
  - LocalAI - hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware with no GPU required. It's an API to run ggml compatible models: llama, gpt4all, rwkv, whisper, vicuna, koala, gpt4all-j, cerebras, falcon, dolly, starcoder, and many others.
  - MiniGPT-4 - language Understanding with Advanced Large Language Models
  - OpenAI API Key
  - demo.py
  - minigpt4_eval.yaml
  - HttpGPT - E) through asynchronous REST requests, making it easy for developers to communicate with these services. It also includes Editor Tools to integrate Chat GPT and DALL-E image generation directly in the Engine.
  - Serge - hosted & dockerized, with an easy to use API.
  - Alpaca.cpp - like model locally on your device. It combines the [LLaMA foundation model](https://github.com/facebookresearch/llama) with an [open reproduction](https://github.com/tloen/alpaca-lora) of [Stanford Alpaca](https://github.com/tatsu-lab/stanford_alpaca) a fine-tuning of the base model to obey instructions (akin to the [RLHF](https://huggingface.co/blog/rlhf) used to train ChatGPT) and a set of modifications to [llama.cpp](https://github.com/ggerganov/llama.cpp) to add a chat interface.
  - GPT4All - source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue based on [LLaMa](https://github.com/facebookresearch/llama).
  - OpenPlayground - like models locally on your device.
  - Yeagar ai - powered agents with ease.
  - DoctorGPT - contained binary that monitors your application logs for problems and diagnoses them.
  - Vicuna
  - GPT4All UI
- Web servers
  - Apache - Most popular web server.
  - Caddy - The HTTP/2 Web Server with Fully Managed TLS.
  - Cherokee - Lightweight, high-performance web server/reverse proxy.
  - Lighttpd - Web server more optimized for speed-critical environments.
  - Nginx - Reverse proxy, load balancer, HTTP cache, and web server.
  - HAProxy - Software based load Balancing, SSL offloading and performance optimization, compression, and general web routing.
  - Squid - Caching proxy for the web supporting HTTP, HTTPS, FTP, and more.
  - Traefik - Taefik is a modern HTTP reverse proxy and load balancer made to deploy microservices with ease.
  - Beakon - A self-host location sharing webserver. Beakon aims to leak as little data as possible and uses mostly self-contained libraries and local database files. Where possible, it will reference local files and not reach out over any network.
  - OpenResty Manager - The easiest using, powerful and beautiful OpenResty Manager(Nginx Enhanced Version), open source alternative to OpenResty Edge.
  - Varnish - HTTP based web application accelerator focusing on optimizing caching and compression.
  - Varnish - HTTP based web application accelerator focusing on optimizing caching and compression.
XML Learning Resources
- In-memory data grids
  - XML(Extensible Markup Language)
  - XMLmind XML Editor Tutorial
  - XMLReader for Android Developers
  - XML Processing Modules for Python 3
  - PHP: XML Parser Manual
  - Introduction to XML on W3Schools
  - XML Fundamentals Training Program from Oracle University
  - XML Online Training Courses on Udemy
  - XML Schema (XSD) Crash Course for Beginners on Udemy
  - XML Online Training Courses on LinkedIn Learning
  - Introduction to Microsoft Office Open XML on Pluralsight
  - XML Fundamentals in C# on Pluralsight
  - Working with XML in Java Using JAXB
  - Querying JSON, XML, and Temporal Data with T-SQL
  - XML Training Courses on NobleProg
  - Using XML editor in Visual Studio
  - XAML - based markup language that is applied to the .NET Core programming model, which XAML simplifies creating a UI for a [.NET Core app](https://docs.microsoft.com/en-us/windows/uwp/xaml-platform/xaml-overview).
  - Using XML editor in Visual Studio
  - Adding app configuration policies for managed iOS/iPadOS devices
  - Introduction to XML by IBM
  - XML Online Training Courses on Coursera
XML Tools and Frameworks
- In-memory data grids
  - Visual Studio - rich application that can be used for many aspects of software development. Visual Studio makes it easy to edit, debug, build, and publish your app. By using Microsoft software development platforms such as Windows API, Windows Forms, Windows Presentation Foundation, and Windows Store.
  - WebStorm - the-fly error detection, powerful navigation and refactoring for JavaScript, TypeScript, stylesheet languages, and all the most popular frameworks([Angular](https://angular.io/), [React](https://reactjs.org/), [Vue.js](https://vuejs.org/), [Ionic](https://ionicframework.com/), [Apache Cordova](https://cordova.apache.org/), [React Native](https://reactnative.dev/), [Node.js](https://nodejs.org/), [Meteor](https://www.meteor.com/#!), and [Electron](https://www.electronjs.org/)).
  - Uno Platform - based code (C# and XAML) to run on iOS, Android, macOS, WebAssembly, Linux and Windows. It provides the full definitions of the UWP [Windows 10 2004 (19041)](https://docs.microsoft.com/en-us/windows/uwp/whats-new/windows-10-build-19041), and the implementation of a growing number of parts of the UWP API, such as Windows.UI.Xaml, to enable UWP and WinUI applications to run on these platforms.
  - Oxygen XML Editor
  - XMLmind XML Editor
  - MSBuild
  - Refit - safe REST library for .NET Core,.NET and Xamarin.
  - Pugixml - like interface with rich traversal/modification capabilities, an extremely fast XML parser which constructs the DOM tree from an XML file/buffer, and an XPath 1.0 implementation for complex data-driven tree queries.
  - Erlsom
  - REST-assured
  - Serializer

Programming Languages

Python 102 Go 74 TypeScript 66 JavaScript 62 Rust 54 C++ 43 Shell 27 C 26 Jinja 17 Java 16

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

Self-Hosting-Guide

Tools for Self-Hosting

Configuration Management

Containers

Development

LLMs

MinIO Object Storage

Running Locally on Windows, MacOS, and Linux:

Web servers

XML Learning Resources

In-memory data grids

XML Tools and Frameworks

In-memory data grids