Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ErikBjare/are-copilots-local-yet

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!
https://github.com/ErikBjare/are-copilots-local-yet

copilot github-copilot llama llm openai starcoder wizardcoder

Last synced: 6 days ago
JSON representation

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

Host: GitHub
URL: https://github.com/ErikBjare/are-copilots-local-yet
Owner: ErikBjare
License: mit
Created: 2023-07-19T09:48:55.000Z (over 1 year ago)
Default Branch: master
Last Pushed: 2024-07-30T13:46:55.000Z (3 months ago)
Last Synced: 2024-10-18T22:04:28.798Z (24 days ago)
Topics: copilot, github-copilot, llama, llm, openai, starcoder, wizardcoder
Language: Python
Homepage:
Size: 141 KB
Stars: 485
Watchers: 30
Forks: 22
Open Issues: 4
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

awesome-ai-coding - Are copilots local yet?

README

        

# 🛠️ Are Copilots Local Yet?

Current trends and state of the art for using open & local LLM models as copilots to complete code, generate projects, act as shell assistants, automatically fix bugs, and more.

📝 *Help keep this list relevant and up-to-date by [making edits][edit]!*

[edit]: https://github.com/ErikBjare/are-copilots-local-yet/edit/master/data/data.yaml

## Table of Contents

- [Summary](#-summary)

- [Background](#-background)

- [Editor Extensions](#-editor-extensions)

- [Tools](#-tools)

- [Chat Interfaces](#-chat-interfaces)

- [Models](#-models)

- [Datasets](#-datasets)

- [Misc Tools](#-misc-tools)

- [History](#-history)

- [Stats](#-stats)

## 📋 Summary

Local Copilots are in an early experimental stage, with most being of MVP-quality.

The reasons for this are:

- 📉 Local models still being inferior to Copilot

- 🔧 Difficult to set up

- 💻 High hardware requirements

However, as models improve, and editor extensions get developed to use them, we're expected to get a renaissance of code-completion tools.

This document is a curated list of local Copilots, shell assistants, and related projects. It is intended to be a resource for those interested in a survey of the existing tools, and to help developers discover the state of the art for projects like these.

## 📚 Background

In 2021, GitHub released Copilot which quickly became popular among devs. Since then, with the flurry of AI developments around LLMs, local models that can run on consumer machines have become available, and it has seemed only a matter of time before Copilot will go local.

Many perceived limitations of GitHub's Copilot are related to its closed and cloud-hosted nature.

As an alternative, local Copilots enable:

- 🌐 Offline & private use

- ⚡ Improved responsiveness

- 📚 Better project/context awareness

- 🎯 The ability to run models specialized for a particular language/task

- 🔒 [Constraining the LLM output](https://twitter.com/ErikBjare/status/1656731582001020928) to fit a particular format/syntax.

## 🧩 Editor Extensions

Editor extensions used to complete code using LLMs:

| Name          | Editor   | :star:  | Released | Notes     |

| ------------- | -------- | ------- | -------- | --------- |

| [GitHub Copilot](https://github.com/github/copilot.vim) | VSCode, vim | 8076 | 2021-6-29 | The GitHub Original, not local or open-source. |

| [Cursor](https://github.com/getcursor/cursor) | VSCode | 20730 | 2023-3-14 | Fork of VSCode, not open-source |

| [Fauxpilot](https://github.com/fauxpilot/fauxpilot) | VSCode | 14464 | 2022-9-3 | Early local PoC. Stale? |

| [Tabby](https://github.com/TabbyML/tabby) | VSCode, vim, IntelliJ | 20170 | 2023-9-30 | Completes the cursor selection |

| [turbopilot](https://github.com/ravenscroftj/turbopilot) | VSCode | 3835 | 2023-4-10 | Completions with FIM support, inspired by fauxpilot |

| [HuggingFace-vscode](https://github.com/huggingface/huggingface-vscode) | VSCode | 1184 | 2023-6-19 | Fork of Tabnine, supports Starcoder |

| [localpilot](https://github.com/danielgross/localpilot) | VSCode | 3328 | 2023-10-2 | Utility for easily hosting models locally, for use with official Copilot extension using custom API endpoint. |

| [StarcoderEx](https://github.com/Lisoveliy/StarCoderEx) | VSCode | 100 | 2023-5-5 | Completes the cursor selection |

| [WizardCoder-VSC](https://github.com/mzbac/wizardCoder-vsc) | VSCode | 142 | 2023-6-19 | PoC, article available |

| [KoboldAIConnect](https://github.com/Phiality-dot/KoboldAIConnect-VSCODE/) | VSCode |  | 2023-10-7 | Copilot clone using local KoboldAI backend |

| [gen.nvim](https://github.com/David-Kunz/gen.nvim) | vim | 1017 | 2023-10-1 | Edit selection using custom prompts |

| [uniteai](https://github.com/freckletonj/uniteai) | VSCode, emacs, lsp | 240 | 2023-8-27 |  |

| [Privy](https://github.com/srikanth235/privy) | VSCode | 825 | 2024-1-8 | A privacy-first coding assistant. |

| [twinny](https://github.com/rjmacarthy/twinny) | VSCode | 2386 | 2024-1-24 | The most no-nonsense locally hosted AI code completion plugin for VS Code |

## 🛠️ Tools

Tools that try to generate projects/features from specification:

| Name           | :star:  | Released  | Notes |

| -------------- | ------- | --------- | ----- |

| [gpt-engineer](https://github.com/AntonOsika/gpt-engineer) | 51527 | 2023-6-6 | Specify what you want it to build, the AI asks for clarification, and then builds it. |

| [gpt-pilot](https://github.com/Pythagora-io/gpt-pilot) | 29228 | 2023-7-18 | Very similar to gpt-engineer |

| [continue](https://github.com/continuedev/continue) | 13883 | 2023-5-24 | VSCode extension. Task-based autocomplete |

| [aider](https://github.com/paul-gauthier/aider) | 14883 | 2023-6-8 | AI pair programming in your terminal, works well with pre-existing, larger codebases |

| [rift](https://github.com/morph-labs/rift) | 3051 | 2023-6-20 | VSCode extension. Lets you write code by chatting, makes your IDE agentic, AI engineer that works alongside you. |

| [mentat](https://github.com/biobootloader/mentat) | 2441 | 2023-7-25 | Mentat coordinates edits across multiple locations and files. |

| [clippinator](https://github.com/ennucore/clippinator) | 309 | 2023-4-15 | Uses a team of agents to plan, write, debug, and test |

| [Refact.AI](https://github.com/smallcloudai/refact) | 1513 | 2023-10-06 | Full self-hostable code completion, chat and training service, complete with VSCode extension. |

| [LocalCompletion](https://github.com/lufixSch/LocalCompletion) | 25 | 2023-11-15 | Inline completion with support for any OpenAI compatible backend |

## 🗨️ Chat Interfaces

Chat interfaces with shell/REPL/notebook access.

Similar to/inspired by ChatGPT's "Advanced Data Analysis" feature (previously "Code Interpreter").

| Name           | :star:  | Notes     |

| -------------- | ------- | --------- |

| [open-interpreter](https://github.com/KillianLucas/open-interpreter) | 51204 | open-source, locally running implementation of OpenAI's Code Interpreter |

| [gptme](https://github.com/ErikBjare/gptme) | 247 | Supporting open models. Developed by me, @ErikBjare |

| [octogen](https://github.com/dbpunk-labs/octogen) | 249 | Local Code Interpreter executing in Docker environment. |

| [terminal-x](https://github.com/davidfant/terminal-x) | 32 | Very early prototype that converts natural language into shell commands, unmaintained since Sept. 2021 |

| [DODA](https://github.com/agentcasa/doda) | >50 | Electron based GUI for a local OpenAI Dev Assistant |

## 🤖 Models

Models relevant for local Copilot-use. Ordered by most recent first.

| Name                            | Size       | Languages   | :star:  | Released   | Notes   |

| ------------------------------- | ---------- | ----------- | ------- | ---------- | ------- |

| [Phind CodeLlama v2](https://huggingface.co/Phind/Phind-CodeLlama-34B-v2) | 34B | Many | 810 | 2023-8-27 |  |

| [WizardCoder-Python](https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0) | 7/13/34B | Python | 753 | 2023-8 |  |

| [CodeLlama](https://github.com/facebookresearch/codellama) | 7/13/34B | Many | 15705 | 2023-8 |  |

| [WizardCoder](https://huggingface.co/WizardLM/WizardCoder-15B-V1.0) | 15B | 80+ | 741 | 2023-6 | Fine-tuning of Starcoder |

| [replit-glaive](https://huggingface.co/sahil2801/replit-code-instruct-glaive) | 3B | 1? | 88 | 2023-7 | Small model fine-tuned on high-quality data with impressive performance. |

| [Starcoder](https://github.com/bigcode-project/starcoder) | 15B | 80+ | 7219 | 2023-5 |  |

| [replit-v1-3b](https://huggingface.co/replit/replit-code-v1-3b) | 3B | 20+ | 717 | 2023-5 |  |

| [SantaCoder](https://huggingface.co/bigcode/santacoder) | 1.1B | Python, Java, JavaScript | 325 | 2023-4 | Tiny model selectively trained on 3 languages from 'The Stack' |

**Note:** due to the pace of new model releases, this section is doomed to be out of date.

## 📚 Datasets

Datasets relevant for training models.

| Name                            | Size       | Languages   | :star:  | Released   | Notes   |

| ------------------------------- | ---------- | ----------- | ------- | ---------- | ------- |

| [The Stack](https://huggingface.co/datasets/bigcode/the-stack) | 3TB/6TB | 358 | >500 | 2022-10 | Excludes weak-copyleft licenses (MPL, LGPL, EGL) since v1.1 |

## Tools

Misc relevant useful tools.

| Name                            | :star:  | Released   | Notes   |

| ------------------------------- | ------- | ---------- | ------- |

| [ollama](https://github.com/jmorganca/ollama) | 82233 | 2023-8-27 | Easily get up and running with large language models locally. |

## 📰 History

- 🐦 [Tweet announcing this repo][announce]

[announce]: https://twitter.com/ErikBjare/status/1681616666600394753

## 📈 Stats

Stargazers over time:

[![Stargazers over time](https://starchart.cc/ErikBjare/are-copilots-local-yet.svg)](https://starchart.cc/ErikBjare/are-copilots-local-yet)