{"id":13461660,"url":"https://github.com/fauxpilot/fauxpilot","last_synced_at":"2025-05-13T23:09:18.439Z","repository":{"id":51993555,"uuid":"520708737","full_name":"fauxpilot/fauxpilot","owner":"fauxpilot","description":"FauxPilot - an open-source alternative to GitHub Copilot server","archived":false,"fork":false,"pushed_at":"2024-04-09T08:42:23.000Z","size":3044,"stargazers_count":14692,"open_issues_count":63,"forks_count":630,"subscribers_count":118,"default_branch":"main","last_synced_at":"2025-04-10T00:15:17.388Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/fauxpilot.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-08-03T02:14:22.000Z","updated_at":"2025-04-09T04:33:49.000Z","dependencies_parsed_at":"2024-01-06T15:13:03.707Z","dependency_job_id":"ba539b62-2808-4568-9cfd-899d9c127bc1","html_url":"https://github.com/fauxpilot/fauxpilot","commit_stats":null,"previous_names":["moyix/fauxpilot"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fauxpilot%2Ffauxpilot","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fauxpilot%2Ffauxpilot/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fauxpilot%2Ffauxpilot/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/fauxpilot%2Ffauxpilot/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/fauxpilot","download_url":"https://codeload.github.com/fauxpilot/fauxpilot/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254042045,"owners_count":22004835,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T11:00:51.190Z","updated_at":"2025-05-13T23:09:13.408Z","avatar_url":"https://github.com/fauxpilot.png","language":"Python","funding_links":[],"categories":["🚀 AI Tools for Vim, Neovim, and Terminal","Python","AI Сервисы для разработки ПО","Uncategorized","Tools/Products","Vector search","Artificial Intelligence","AI code completion tools","A01_文本生成_文本对话","HarmonyOS","[:robot: machine-learning]([robot-machine-learning)](\u003chttps://github.com/stars/ketsapiwiq/lists/robot-machine-learning\u003e))","Code AI","Features","Repos","The Alternatives","IDE Integration \u0026 Copilots","Projects","📚 Tools","Videos","1. Local Agents","AI Coding Assistants","others","⚡ Code Completion Tools"],"sub_categories":["Автозавершение кода (autocomplition)","Uncategorized","AI code completion tools","Android Launcher","大语言对话模型及数据","Windows Manager","Vector search","Software productivity","10. Open Source \u0026 Local Models (Various Tools/Setups)","🌟 What You'll Find Here:","Alternatives","Coding Agents \u0026 IDE Extensions","Full IDE Integrations","By Deployment Model"],"readme":"\n# FauxPilot\n\nThis is an attempt to build a locally hosted alternative to [GitHub Copilot](https://copilot.github.com/). It uses the [SalesForce CodeGen](https://github.com/salesforce/CodeGen) models inside of NVIDIA's [Triton Inference Server](https://developer.nvidia.com/nvidia-triton-inference-server) with the [FasterTransformer backend](https://github.com/triton-inference-server/fastertransformer_backend/).\n\n\u003cp align=\"right\"\u003e\n  \u003cimg width=\"50%\" align=\"right\" src=\"./img/fauxpilot.png\"\u003e\n\u003c/p\u003e\n\n## Prerequisites\n\nYou'll need:\n\n* Docker\n* `docker compose` \u003e= 1.28\n* An NVIDIA GPU with Compute Capability \u003e= 6.0 and enough VRAM to run the model you want.\n* [`nvidia-docker`](https://github.com/NVIDIA/nvidia-docker)\n* `curl` and `zstd` for downloading and unpacking the models.\n\nNote that the VRAM requirements listed by `setup.sh` are *total* -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you *should* be able to run the 6B model by putting half on each GPU.\n\n\n## Support and Warranty\n\nlmao\n\nOkay, fine, we now have some minimal information on [the wiki](https://github.com/moyix/fauxpilot/wiki) and a [discussion forum](https://github.com/moyix/fauxpilot/discussions) where you can ask questions. Still no formal support or warranty though!\n\n\n\n## Setup\n\nThis section describes how to install a Fauxpilot server and clients.\n\n### Setting up a FauxPilot Server\n\nRun the setup script to choose a model to use. This will download the model from [Huggingface/Moyix](https://huggingface.co/Moyix) in GPT-J format and then convert it for use with FasterTransformer.\n\nPlease refer to [How to set-up a FauxPilot server](documentation/server.md).\n\n\n### Client configuration for FauxPilot\n\nWe offer some ways to connect to FauxPilot Server. For example, you can create a client by how to open the Openai API, Copilot Plugin, REST API.\n\nPlease refer to [How to set-up a client](documentation/client.md).\n\n\n## Terminology\n * API: Application Programming Interface\n * CC: Compute Capability\n * CUDA: Compute Unified Device Architecture\n * FT: Faster Transformer\n * JSON: JavaScript Object Notation \n * gRPC: Remote Procedure call by Google\n * GPT-J: A transformer model trained using Ben Wang's Mesh Transformer JAX \n * REST: REpresentational State Transfer\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffauxpilot%2Ffauxpilot","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffauxpilot%2Ffauxpilot","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffauxpilot%2Ffauxpilot/lists"}