are-copilots-local-yet

are-copilots-local-yet

Are Copilots Local Yet? The frontier of local LLM Copilots for code completion, project generation, shell assistance, and more. Find tools shaping tomorrow's developer experience, today!

Stars: 448

Visit
 screenshot

Current trends and state of the art for using open & local LLM models as copilots to complete code, generate projects, act as shell assistants, automatically fix bugs, and more. This document is a curated list of local Copilots, shell assistants, and related projects, intended to be a resource for those interested in a survey of the existing tools and to help developers discover the state of the art for projects like these.

README:

🛠️ Are Copilots Local Yet?

Current trends and state of the art for using open & local LLM models as copilots to complete code, generate projects, act as shell assistants, automatically fix bugs, and more.

📝 Help keep this list relevant and up-to-date by making edits!

Table of Contents

📋 Summary

Local Copilots are in an early experimental stage, with most being of MVP-quality.

The reasons for this are:

  • 📉 Local models still being inferior to Copilot
  • 🔧 Difficult to set up
  • 💻 High hardware requirements

However, as models improve, and editor extensions get developed to use them, we're expected to get a renaissance of code-completion tools.

This document is a curated list of local Copilots, shell assistants, and related projects. It is intended to be a resource for those interested in a survey of the existing tools, and to help developers discover the state of the art for projects like these.

📚 Background

In 2021, GitHub released Copilot which quickly became popular among devs. Since then, with the flurry of AI developments around LLMs, local models that can run on consumer machines have become available, and it has seemed only a matter of time before Copilot will go local.

Many perceived limitations of GitHub's Copilot are related to its closed and cloud-hosted nature.

As an alternative, local Copilots enable:

  • 🌐 Offline & private use
  • ⚡ Improved responsiveness
  • 📚 Better project/context awareness
  • 🎯 The ability to run models specialized for a particular language/task
  • 🔒 Constraining the LLM output to fit a particular format/syntax.

🧩 Editor Extensions

Editor extensions used to complete code using LLMs:

Name Editor Released Notes
GitHub Copilot VSCode, vim 8076 2021-6-29 The GitHub Original, not local or open-source.
Cursor VSCode 20730 2023-3-14 Fork of VSCode, not open-source
Fauxpilot VSCode 14464 2022-9-3 Early local PoC. Stale?
Tabby VSCode, vim, IntelliJ 20170 2023-9-30 Completes the cursor selection
turbopilot VSCode 3835 2023-4-10 Completions with FIM support, inspired by fauxpilot
HuggingFace-vscode VSCode 1184 2023-6-19 Fork of Tabnine, supports Starcoder
localpilot VSCode 3328 2023-10-2 Utility for easily hosting models locally, for use with official Copilot extension using custom API endpoint.
StarcoderEx VSCode 100 2023-5-5 Completes the cursor selection
WizardCoder-VSC VSCode 142 2023-6-19 PoC, article available
KoboldAIConnect VSCode 2023-10-7 Copilot clone using local KoboldAI backend
gen.nvim vim 1017 2023-10-1 Edit selection using custom prompts
uniteai VSCode, emacs, lsp 240 2023-8-27
Privy VSCode 825 2024-1-8 A privacy-first coding assistant.
twinny VSCode 2386 2024-1-24 The most no-nonsense locally hosted AI code completion plugin for VS Code

🛠️ Tools

Tools that try to generate projects/features from specification:

Name Released Notes
gpt-engineer 51527 2023-6-6 Specify what you want it to build, the AI asks for clarification, and then builds it.
gpt-pilot 29228 2023-7-18 Very similar to gpt-engineer
continue 13883 2023-5-24 VSCode extension. Task-based autocomplete
aider 14883 2023-6-8 AI pair programming in your terminal, works well with pre-existing, larger codebases
rift 3051 2023-6-20 VSCode extension. Lets you write code by chatting, makes your IDE agentic, AI engineer that works alongside you.
mentat 2441 2023-7-25 Mentat coordinates edits across multiple locations and files.
clippinator 309 2023-4-15 Uses a team of agents to plan, write, debug, and test
Refact.AI 1513 2023-10-06 Full self-hostable code completion, chat and training service, complete with VSCode extension.
LocalCompletion 25 2023-11-15 Inline completion with support for any OpenAI compatible backend

🗨️ Chat Interfaces

Chat interfaces with shell/REPL/notebook access. Similar to/inspired by ChatGPT's "Advanced Data Analysis" feature (previously "Code Interpreter").

Name Notes
open-interpreter 51204 open-source, locally running implementation of OpenAI's Code Interpreter
gptme 247 Supporting open models. Developed by me, @ErikBjare
octogen 249 Local Code Interpreter executing in Docker environment.
terminal-x 32 Very early prototype that converts natural language into shell commands, unmaintained since Sept. 2021
DODA >50 Electron based GUI for a local OpenAI Dev Assistant

🤖 Models

Models relevant for local Copilot-use. Ordered by most recent first.

Name Size Languages Released Notes
Phind CodeLlama v2 34B Many 810 2023-8-27
WizardCoder-Python 7/13/34B Python 753 2023-8
CodeLlama 7/13/34B Many 15705 2023-8
WizardCoder 15B 80+ 741 2023-6 Fine-tuning of Starcoder
replit-glaive 3B 1? 88 2023-7 Small model fine-tuned on high-quality data with impressive performance.
Starcoder 15B 80+ 7219 2023-5
replit-v1-3b 3B 20+ 717 2023-5
SantaCoder 1.1B Python, Java, JavaScript 325 2023-4 Tiny model selectively trained on 3 languages from 'The Stack'

Note: due to the pace of new model releases, this section is doomed to be out of date.

📚 Datasets

Datasets relevant for training models.

Name Size Languages Released Notes
The Stack 3TB/6TB 358 >500 2022-10 Excludes weak-copyleft licenses (MPL, LGPL, EGL) since v1.1

Tools

Misc relevant useful tools.

Name Released Notes
ollama 82233 2023-8-27 Easily get up and running with large language models locally.

📰 History

📈 Stats

Stargazers over time:

Stargazers over time

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for are-copilots-local-yet

Similar Open Source Tools

For similar tasks

For similar jobs