Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/devoxx/devoxxgenieideaplugin
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code.
https://github.com/devoxx/devoxxgenieideaplugin
anthropic assistant chatgpt claude-3 claude-ai copilot gemini genai gpt4all groq intellij-plugin java llm lmstudio mistral ollama openai
Last synced: 7 days ago
JSON representation
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code.
- Host: GitHub
- URL: https://github.com/devoxx/devoxxgenieideaplugin
- Owner: devoxx
- License: mit
- Created: 2024-04-14T21:08:14.000Z (7 months ago)
- Default Branch: master
- Last Pushed: 2024-10-23T14:11:16.000Z (16 days ago)
- Last Synced: 2024-10-24T08:17:45.942Z (15 days ago)
- Topics: anthropic, assistant, chatgpt, claude-3, claude-ai, copilot, gemini, genai, gpt4all, groq, intellij-plugin, java, llm, lmstudio, mistral, ollama, openai
- Language: Java
- Homepage: https://devoxx.com
- Size: 7.96 MB
- Stars: 198
- Watchers: 7
- Forks: 27
- Open Issues: 27
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-ChatGPT-repositories - DevoxxGenieIDEAPlugin - DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code. (Browser-extensions)
README
## Devoxx Genie
[](https://x.com/devoxxgenie)
Devoxx Genie is a fully Java-based LLM Code Assistant plugin for IntelliJ IDEA, designed to integrate with local LLM providers such as [Ollama](https://ollama.com/), [LMStudio](https://lmstudio.ai/), [GPT4All](https://gpt4all.io/index.html), [Llama.cpp](https://github.com/ggerganov/llama.cpp) and [Exo](https://github.com/exo-explore/exo) but also cloud based LLM's such as [OpenAI](https://openai.com), [Anthropic](https://www.anthropic.com/), [Mistral](https://mistral.ai/), [Groq](https://groq.com/), [Gemini](https://aistudio.google.com/app/apikey), [DeepInfra](https://deepinfra.com/dash/deployments), [DeepSeek](https://www.deepseek.com/), [OpenRouter](https://www.openrouter.ai/) and [Azure OpenAI](https://azure.microsoft.com/en-us/products/ai-services/openai-service)
We now also support LLM-driven web search with [Google](https://developers.google.com/custom-search) and [Tavily](https://tavily.com/).
With Claude 3.5 Sonnet, DevoxxGenie isn't just another developer tool... it's a glimpse into the future of software engineering. As we eagerly await Claude 3.5 Opus, one thing is clear: we're witnessing a paradigm shift in Ai Augmented Programming (AAP) 🐒
[
](https://plugins.jetbrains.com/plugin/24169-devoxxgenie)
### Hands-on with DevoxxGenie
[](https://www.youtube.com/live/kgtctcbA6WE?feature=shared&t=124)
### More Video Tutorials:
- [DevoxxGenie in action (Devoxx Belgium 2024)](https://www.youtube.com/watch?v=c5EyVLAXaGQ)
- [How ChatMemory works](https://www.youtube.com/watch?v=NRAe4d7n6_4)
- [Hands-on with DevoxxGenie](https://youtu.be/Rs8S4rMTR9s?feature=shared)
### Blog Posts:
- [DevoxxGenie: Your AI Assistant for IDEA](https://mydeveloperplanet.com/2024/10/08/devoxxgenie-your-ai-assistant-for-idea/)
### Key Features:
- **👀 Chat History**: Your chats are stored locally, allowing you to easily restore them in the future.
- **🧠 Project Scanner**: Add source code (full project or by package) to prompt context when using Anthropic, OpenAI or Gemini.
- **💰 Token Cost Calculator**: Calculate the cost when using Cloud LLM providers.
- **🔍 Web Search** : Search the web for a given query using Google or Tavily.
- **🏎️ Streaming responses**: See each token as it's received from the LLM in real-time.
- **🧐 Abstract Syntax Tree (AST) context**: Automatically include parent class and class/field references in the prompt for better code analysis.
- **💬 Chat Memory Size**: Set the size of your chat memory, by default its set to a total of 10 messages (system + user & AI msgs).
- **☕️ 100% Java**: An IDEA plugin using local and cloud based LLM models. Fully developed in Java using [Langchain4J](https://github.com/langchain4j/langchain4j)
- **👀 Code Highlighting**: Supports highlighting of code blocks.
- **💬 Chat conversations**: Supports chat conversations with configurable memory size.
- **📁 Add files & code snippets to context**: You can add open files to the chat window context for producing better answers or code snippets if you want to have a super focused window
We now support also streaming responses which you can enable in the Settings page 🤩 🚀
https://github.com/devoxx/DevoxxGenieIDEAPlugin/assets/179457/8081d4f2-c5c4-4283-af1d-19061b7ae7bf
### Start in 5 Minutes with local LLM
- Download and start [Ollama](https://ollama.com/download)
- Open terminal and download a model using command "ollama run llama3.2"
- Start your IDEA and go to plugins > Marketplace and enter "Devoxx"
- Select "DevoxxGenie" and install plugin
- In the DevoxxGenie window select Ollama and available model
- Start prompting
### Start in 2 Minutes using Cloud LLM
- Start your IDEA and go to plugins > Marketplace and enter "Devoxx"
- Select "DevoxxGenie" and install plugin
- Click on DevoxxGenie cog (settings) icon and click on Cloud Provider link icon to create API KEY
- Paste API Key in Settings panel
- In the DevoxxGenie window select your cloud provider and model
- Start prompting
### LLM Settings
In the IDEA settings you can modify the REST endpoints and the LLM parameters. Make sure to press enter and apply to save your changes.
We now also support Cloud based LLMs, you can paste the API keys on the Settings page.
### Smart Model Selection and Cost Estimation
The language model dropdown is not just a list anymore, it's your compass for smart model selection.
See available context window sizes for each cloud model
View associated costs upfront
Make data-driven decisions on which model to use for your project
### Add Project to prompt & clipboard
You can now add the full project to your prompt IF your selected cloud LLM has a big enough window context.
### Calc Cost
Leverage the prompt cost calculator for precise budget management. Get real-time updates on how much of the context window you're using.
See the input/output costs and window context per Cloud LLM. Eventually we'll also allow you to edit these values.
### Handling Massive Projects?
"But wait," you might say, "my project is HUGE!" 😅
Fear not! We've got options:
1. Leverage Gemini's Massive Context:
Gemini's colossal 1 million token window isn't just big, it's massive. We're talking about the capacity to digest approximately 30,000 lines of code in a single go. That's enough to digest most codebases whole, from the tiniest scripts to some decent projects.
But if that's not enough you have more options...
2. Smart Filtering:
The new "Copy Project" panel lets you:
Exclude specific directories
Filter by file extensions
Remove JavaDocs to slim down your context
3. Selective Inclusion
Right-click to add only the most relevant parts of your project to the context.
## The Power of Full Context: A Real-World Example
The DevoxxGenie project itself, at about 70K tokens, fits comfortably within most high-end LLM context windows.
This allows for incredibly nuanced interactions – we're talking advanced queries and feature requests that leave tools like GitHub Copilot scratching their virtual heads!
## Local LLM Cluster with Exo
V0.2.7 also supports Exo, a local LLM cluster for Apple Silicon which allows you to run Llama 3.1 8b, 70b and 405b on your own Apple computers 🤩
### Installation:
- **From IntelliJ IDEA**: Go to `Settings` -> `Plugins` -> `Marketplace` -> Enter 'Devoxx' to find [plugin](https://plugins.jetbrains.com/plugin/24169-devoxxgenie) OR Install plugin from Disk
- **From Source Code**: Clone the repository, build the plugin using `./gradlew buildPlugin`, and install the plugin from the `build/distributions` directory and select file 'DevoxxGenie-X.Y.Z.zip'
### Requirements:
- **IntelliJ** minimum version is 2023.3.4
- **Java** minimum version is JDK 17
### Build
Gradle IntelliJ Plugin prepares a ZIP archive when running the buildPlugin task.
You'll find it in the build/distributions/ directory
```shell
./gradlew buildPlugin
```
### Publish plugin
It is recommended to use the publishPlugin task for releasing the plugin
```shell
./gradlew publishPlugin
```
### Usage:
1) Select an LLM provider from the DevoxxGenie panel (right corner)
2) Select some code
4) Enter shortcode command review, explain, generate unit tests of the selected code or enter a custom prompt.
Enjoy!