Projects in Awesome Lists tagged with mistral

https://github.com/ollama/ollama

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

gemma gemma2 go golang llama llama2 llama3 llava llm llms mistral ollama phi3

Last synced: 16 Dec 2024

https://github.com/hiyouga/llama-factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers

Last synced: 16 Dec 2024

https://github.com/hiyouga/LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers

Last synced: 25 Oct 2024

https://github.com/hiyouga/LLaMA-Efficient-Tuning

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

agent ai chatglm fine-tuning gpt instruction-tuning language-model large-language-models llama llama3 llm lora mistral moe peft qlora quantization qwen rlhf transformers

Last synced: 05 Sep 2024

https://github.com/go-skynet/LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

ai api audio-generation distributed gemma gpt4all image-generation kubernetes llama llama3 llm mamba mistral musicgen p2p rerank rwkv stable-diffusion text-generation tts

Last synced: 09 Nov 2024

https://github.com/mudler/localai

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

ai api audio-generation distributed gemma gpt4all image-generation kubernetes llama llama3 llm mamba mistral musicgen p2p rerank rwkv stable-diffusion text-generation tts

Last synced: 16 Dec 2024

https://github.com/mudler/LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

ai api audio-generation distributed gemma gpt4all image-generation kubernetes llama llama3 llm mamba mistral musicgen p2p rerank rwkv stable-diffusion text-generation tts

Last synced: 25 Oct 2024

https://github.com/unslothai/unsloth

Finetune Llama 3.3, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory

ai fine-tuning finetuning gemma gemma2 llama llama3 llm llms lora mistral phi3 qlora unsloth

Last synced: 16 Dec 2024

https://github.com/ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

computer-vision data-centric data-science deep deep-learning deeplearning fine-tuning learning llama llama2 llm llm-training machine-learning machinelearning mistral ml natural-language natural-language-processing neural-network pytorch

Last synced: 16 Dec 2024

https://github.com/bentoml/openllm

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

Last synced: 16 Dec 2024

https://github.com/bentoml/OpenLLM

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint, locally and in the cloud.

ai bentoml falcon fine-tuning llama llama2 llm llm-inference llm-ops llm-serving llmops mistral ml mlops model-inference mpt open-source-llm openllm stablelm vicuna

Last synced: 26 Oct 2024

https://github.com/yangjianxin1/firefly

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

alpaca aquila baichuan chatglm gemma gpt internlm llama llama2 llama3 llm lora minicpm mistral mixtral peft qlora qwen qwen2 zephyr

Last synced: 17 Dec 2024

https://github.com/yangjianxin1/Firefly

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

alpaca aquila baichuan chatglm gemma gpt internlm llama llama2 llama3 llm lora minicpm mistral mixtral peft qlora qwen qwen2 zephyr

Last synced: 27 Oct 2024

https://github.com/enricoros/big-agi

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

agi anthropic beam chatgpt chatgpt-ui generative-ai gpt gpt-4 gpt-5 groq large-language-models mistral multimodal openai openai-api stable-diffusion ui

Last synced: 17 Dec 2024

https://github.com/enricoros/nextjs-chatgpt-app

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

agi anthropic beam chatgpt chatgpt-ui generative-ai gpt gpt-4 gpt-5 groq large-language-models mistral multimodal openai openai-api stable-diffusion ui

Last synced: 13 Dec 2024

https://github.com/xorbitsai/inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

artificial-intelligence chatglm deployment flan-t5 gemma ggml glm4 inference llama llama3 llamacpp llm machine-learning mistral openai-api pytorch qwen vllm whisper wizardlm

Last synced: 16 Dec 2024

https://github.com/enricoros/big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

agi anthropic beam chatgpt chatgpt-ui generative-ai gpt gpt-4 gpt-5 groq large-language-models mistral multimodal openai openai-api stable-diffusion ui

Last synced: 25 Oct 2024

https://github.com/augustdev/enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

ios large-language-model llama llama2 llm mistral ollama ollama-app swift

Last synced: 17 Dec 2024

https://github.com/linkedin/Liger-Kernel

Efficient Triton Kernels for LLM Training

finetuning gemma2 llama llama3 llm-training llms mistral phi3 triton triton-kernels

Last synced: 20 Dec 2024

https://github.com/linkedin/liger-kernel

Efficient Triton Kernels for LLM Training

finetuning gemma2 llama llama3 llm-training llms mistral phi3 triton triton-kernels

Last synced: 16 Dec 2024

https://github.com/AugustDev/enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

ios large-language-model llama llama2 llm mistral ollama ollama-app swift

Last synced: 05 Nov 2024

https://github.com/stochasticai/xturing

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

adapter alpaca deep-learning fine-tuning finetuning gen-ai generative-ai gpt-2 gpt-j language-model llama llm lora mistral mixed-precision peft quantization

Last synced: 18 Dec 2024

https://github.com/stochasticai/xTuring

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

adapter alpaca deep-learning fine-tuning finetuning gen-ai generative-ai gpt-2 gpt-j language-model llama llm lora mistral mixed-precision peft quantization

Last synced: 24 Oct 2024

https://github.com/agentops-ai/agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

agent agentops ai anthropic autogen cost-estimation crewai evals evaluation-metrics groq langchain llm mistral ollama openai

Last synced: 17 Dec 2024

https://github.com/silasmarvin/lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

ai auto-completion developer-tools ide language-client llama llamacpp llm lsp mistral openai self-hosted

Last synced: 17 Dec 2024

https://github.com/SilasMarvin/lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

ai auto-completion developer-tools ide language-client llama llamacpp llm lsp mistral openai self-hosted

Last synced: 29 Oct 2024

https://github.com/darrenburns/elia

A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

ai chatgpt claude gemma gpt large-language-models llama llama3 llm mistral mistral-ai mixtral ollama ollama-client ollama-interface phi-3 python terminal tui

Last synced: 17 Dec 2024

https://github.com/vitoplantamura/onnxstream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.

llama machine-learning mistral onnx raspberry-pi stable-diffusion tinyml wasm webassembly yolov8

Last synced: 19 Dec 2024

https://github.com/AgentOps-AI/agentops

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

agent agentops ai anthropic autogen cost-estimation crewai evals evaluation-metrics groq langchain llm mistral ollama openai

Last synced: 30 Oct 2024

https://github.com/zjunlp/easyedit

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

artificial-intelligence baichuan chatgpt easyedit efficient gpt knowledge-editing knowlm large-language-models llama llama2 mistral mmedit model-editing natural-language-processing open-source-project safeedit tool trustworthy-ai unlearning

Last synced: 17 Dec 2024

https://github.com/vitoplantamura/OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.

llama machine-learning mistral onnx raspberry-pi stable-diffusion tinyml wasm webassembly yolov8

Last synced: 08 Nov 2024

https://github.com/n4ze3m/dialoqbase

Create chatbots with ease

anthropic chatbot chatgpt claude code-llama codellama cohere docx google-palm gpt-3 gpt-4 huggingface langchain llama localai mistral pdf private-gpt privategpt

Last synced: 19 Dec 2024

https://github.com/zjunlp/EasyEdit

[知识编辑] [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

artificial-intelligence baichuan chatgpt easyedit efficient gpt knowledge-editing knowlm large-language-models llama llama2 mistral mmedit model-editing natural-language-processing open-source-project safeedit tool trustworthy-ai unlearning

Last synced: 31 Oct 2024

https://github.com/mobile-artificial-intelligence/maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

android android-ai chatbot chatgpt facebook flutter free-chatgpt gguf large-language-models llama llama-cpp llama2 llamacpp local-ai mistral mobile-ai mobile-artificial-intelligence ollama openai openorca

Last synced: 19 Dec 2024

https://github.com/floneum/floneum

Instant, controllable, local pre-trained AI models in Rust

ai candle constrained-generation dioxus floneum-v3 kalosm llama llamacpp llm mistral rust transcription whisper

Last synced: 17 Dec 2024

https://github.com/kevinhermawan/Ollamac

Mac app for Ollama

ai llama3 llm llma llma2 llms macos mistral mixtral ollama

Last synced: 30 Oct 2024

https://github.com/kevinhermawan/ollamac

Mac app for Ollama

ai llama3 llm llma llma2 llms macos mistral mixtral ollama

Last synced: 19 Dec 2024

https://github.com/mangiucugna/json_repair

A python module to repair invalid JSON, commonly used to parse the output of LLMs

deep-learning gpt-4 json llama3 llm machine-learning mistral openai-api parser repair

Last synced: 17 Dec 2024

https://github.com/vercel/modelfusion

The TypeScript library for building AI applications.

ai artificial-intelligence chatbot claude dall-e embedding gpt-3 huggingface javascript js llamacpp llm mistral multi-modal ollama openai stable-diffusion ts typescript whisper

Last synced: 19 Dec 2024

https://github.com/lgrammel/ai-utils.js

The TypeScript library for building AI applications.

ai artificial-intelligence chatbot claude dall-e embedding gpt-3 huggingface javascript js llamacpp llm mistral multi-modal ollama openai stable-diffusion ts typescript whisper

Last synced: 09 Nov 2024

https://github.com/snowby666/poe-api-wrapper

👾 A Python API wrapper for Poe.com. With this, you will have free access to GPT-4, Claude, Llama, Gemini, Mistral and more! 🚀

api chatbot chatgpt claude code-llama dall-e gemini gpt-4 groq llama mistral openai palm2 poe poe-api python quora qwen reverse-engineering stable-diffusion

Last synced: 18 Dec 2024

https://github.com/brucemacd/chatd

Chat with your documents using local AI

chat desktop electron llama2 llm mistral mistral-7b ollama rag

Last synced: 20 Dec 2024

https://github.com/BruceMacD/chatd

Chat with your documents using local AI

chat desktop electron llama2 llm mistral mistral-7b ollama rag

Last synced: 05 Nov 2024

https://github.com/robitx/gp.nvim

Gp.nvim (GPT prompt) Neovim AI plugin: ChatGPT sessions & Instructable text/code operations & Speech to text [OpenAI, Ollama, Anthropic, ..]

claude codeium copilot gemini gpt-4o gpt4o llm lua mistral neovim nvim ollama parrot perplexity sonnet speech-to-text stt vim voice whisper

Last synced: 17 Dec 2024

https://github.com/jakobhoeg/nextjs-ollama-llm-ui

Fully-featured, beautiful web interface for Ollama LLMs - built with NextJS. Deploy with a single click.

ai chatbot gemma llm local localstorage mistral mistral-7b nextjs nextjs14 offline ollama openai react shadcn tailwindcss typescript

Last synced: 20 Dec 2024

https://github.com/open-compass/mixtralkit

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

llm mistral moe

Last synced: 20 Dec 2024

https://github.com/open-compass/MixtralKit

A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI

llm mistral moe

Last synced: 07 Nov 2024

https://github.com/aws-samples/generative-ai-use-cases-jp

すぐに業務活用できるビジネスユースケース集付きの安全な生成AIアプリ実装

aws bedrock chatbot claude claude3 command-r generative-ai image-generation lambda llama2 llama3 llm mistral rag react sagemaker typescript

Last synced: 20 Dec 2024

https://github.com/alexpinel/Dot

Standalone app for fully local RAG with Mistral 7B

ai app desktop-app document-chat embeddings faiss gpt langchain llm local localai mistral mistral-7b privategpt rag standalone standalone-app

Last synced: 28 Oct 2024

https://github.com/Mobile-Artificial-Intelligence/maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

android android-ai chatbot chatgpt facebook ffigen flutter gguf large-language-models llama llama-cpp llama2 llamacpp local-ai mistral mobile-ai mobile-artificial-intelligence ollama openai openorca

Last synced: 28 Oct 2024

https://github.com/if-ai/ComfyUI-IF_AI_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.

anthropic comfyui flux gemini graphrag groq koboldcpp llamacpp lmstudio mistral ocr ollama omost rag stable-diffusion supervision textgeneration transformers xai

Last synced: 19 Dec 2024

https://github.com/if-ai/comfyui-if_ai_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.

anthropic comfyui flux gemini graphrag groq koboldcpp llamacpp lmstudio mistral ocr ollama omost rag stable-diffusion supervision textgeneration transformers xai

Last synced: 14 Dec 2024

https://github.com/hexastack/hexabot

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

agent agents ai artificial-intelligence bot-framework chatbot chatbot-framework chatbots chatgpt claude-ai conversational-ai gemini grok hacktoberfest llama llm mistral nlu ollama openassistant

Last synced: 21 Dec 2024

https://github.com/OwlAIProject/Owl

A personal wearable AI that runs locally

ai ble bluetooth esp32 llama2 mistral nrf52840 ollama wearable whisper

Last synced: 22 Nov 2024

https://github.com/owlaiproject/owl

A personal wearable AI that runs locally

ai ble bluetooth esp32 llama2 mistral nrf52840 ollama wearable whisper

Last synced: 21 Dec 2024

https://github.com/evilpsycho/play-with-llms

Tutorial on training, evaluating LLM, as well as utilizing RAG, Agent, Chain to build entertaining applications with LLMs.分享如何训练、评估LLMs，如何基于RAG、Agent、Chain构建有趣的LLMs应用。

agent baichuan2 chatgpt gpt large-language-models llama2 llms mistral rag retrieval-augmented-generation

Last synced: 21 Dec 2024

https://github.com/vgel/repeng

A library for making RepE control vectors

language-model machine-learning mistral mistral-7b representation-engineering transformers

Last synced: 20 Dec 2024

https://github.com/pgalko/bambooai

A lightweight library that leverages Language Models (LLMs) to enable natural language interactions, allowing you to source and converse with data.

ai ai-agents data-analysis data-science gemini groq llm mistral ollama openai-api pandas pinecone python vector-database

Last synced: 21 Dec 2024

https://github.com/pgalko/BambooAI

A lightweight library that leverages Language Models (LLMs) to enable natural language interactions, allowing you to source and converse with data.

ai ai-agents data-analysis data-science gemini groq llm mistral ollama openai-api pandas pinecone python vector-database

Last synced: 28 Oct 2024

https://github.com/apeatling/ollama-voice-mac

Mac compatible Ollama Voice

ai assistant chatbot llm macos mistral ollama speech-recognition voice whisper

Last synced: 14 Dec 2024

https://github.com/jakobdylanc/llmcord

A Discord LLM chat bot that supports any OpenAI compatible API (Ollama, LM Studio, vLLM, OpenRouter, xAI, Mistral, Groq and more)

bot chatbot chatgpt discord gpt gpt-4 gpt-4o grok groq llama llama3 llava llm lmstudio mistral ollama oobabooga openai vllm xai

Last synced: 15 Dec 2024

https://github.com/voxos-ai/bolna

End-to-end platform for building voice first multimodal agents

anyscale chatgpt-api claude-3-sonnet deepgram elevenlabs fastapi gpt-4o llama3 llm mistral openai perplexity-api polly telephony twilio voice-assistant websocket-chat websockets whisper xtts

Last synced: 21 Dec 2024

https://github.com/bolna-ai/bolna

End-to-end platform for building voice first multimodal agents

anyscale chatgpt-api claude-3-sonnet deepgram elevenlabs fastapi gpt-4o llama3 llm mistral openai perplexity-api polly telephony twilio voice-assistant websocket-chat websockets whisper xtts

Last synced: 20 Dec 2024

https://github.com/bobazooba/xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

alpaca bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral openai pytorch torch vicuna zephyr

Last synced: 20 Dec 2024

https://github.com/sozercan/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

ai buildkit chatgpt docker fine-tuning finetuning gemma gpt inference kubernetes large-language-models llama llm localllama mistral mixtral nvidia open-llm open-source-llm openai

Last synced: 15 Dec 2024

https://github.com/princeton-nlp/less

[ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning

data data-selection influence instruction-tuning llama llm mistral

Last synced: 15 Dec 2024

https://github.com/frankroeder/parrot.nvim

parrot.nvim 🦜 - the plugin that brings stochastic parrots to Neovim. This is a gp.nvim-fork focused on simplicity.

anthropic chatgpt claude-3-5-sonnet gemini gpt gpt-4o groq-api large-language-models llm mistral neovim nvidia-api nvim o1 ollama openai openai-api perplexity plugin prompting

Last synced: 15 Dec 2024

https://github.com/llm-tools/embedjs

A NodeJS RAG framework to easily work with LLMs and embeddings

ai chatgpt claude cohere embedding embeddings gpt gpt-4 gpt-4o huggingface large-language-models llm mistral ollama openai pinecone rag vector-database vertex-ai

Last synced: 20 Dec 2024

https://github.com/helixml/helix

Multi-node production GenAI stack. Run the best of open source AI easily on your own servers. Easily add knowledge from documents and scrape websites. Create your own AI by fine-tuning open source models. Integrate LLMs with APIs. Run gptscript securely on the server

api finetuning function-calling golang gptscript helm k8s llama llm llm-agent llm-serving mistral mixtral openai openapi rag sdxl self-hosted stable-diffusion swagger

Last synced: 15 Dec 2024

https://github.com/riccardomusmeci/mlx-llm

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

llama llm mistral mlx phi transformers

Last synced: 07 Nov 2024

https://github.com/llm-tools/embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings

ai chatgpt claude cohere embedding embeddings gpt gpt-4 gpt-4o huggingface large-language-models llm mistral ollama openai pinecone rag vector-database vertex-ai

Last synced: 07 Nov 2024

https://github.com/squeezeailab/kvquant

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

compression efficient-inference efficient-model large-language-models llama llm localllama localllm mistral model-compression natural-language-processing quantization small-models text-generation transformer

Last synced: 20 Dec 2024

https://github.com/ai-commandos/llama2lang

Convenience scripts to finetune (chat-)LLaMa3 and other models for any language

ai genai huggingface llama2 llama3 llm mistral

Last synced: 15 Dec 2024

https://github.com/jakobdylanc/llmcord.py

A Discord LLM chat bot that supports any OpenAI compatible API. Run a local model with ollama, oobabooga, Jan and more

ai bot chatbot chatgpt discord gpt gpt-4 gpt-4o groq litellm llama llama3 llava llm llmcord lmstudio mistral ollama oobabooga openai

Last synced: 10 Oct 2024

https://github.com/hmunachi/nanodl

A Jax-based library for designing and training transformer models from scratch.

attention attention-mechanism deep-learning distributed-training flax gpt jax llama machine-learning mistral nlp transformer

Last synced: 14 Dec 2024

https://github.com/jorge-menjivar/unsaged

Open source chat kit engineered for seamless interaction with AI models.

anthropic anthropic-claude bard chatbot chatgpt claude claude-ai claude2 codellama gpt-3 gpt-3-5-turbo gpt-4 gpt-4-turbo llama2 mistral ollama openai palm palm2

Last synced: 15 Dec 2024

https://github.com/papersgpt/papersgpt-for-zotero

Zotero AI plugin chatting papers with ChatGPT, Gemini, Claude, Llama 3.2, QwQ-32B-Preview, Marco-o1, Gemma, Mistral and Phi-3.5

ai chatgpt claude gemini gemma llama marco-o1 mistral paper phi-3 qwq-32b-preview summary zotero zotero-plugin

Last synced: 03 Dec 2024

https://github.com/kevinhermawan/ollamakit

Ollama client for Swift

llama3 llm mistral ollama ollama-api ollama-client

Last synced: 18 Dec 2024

https://github.com/inferflow/inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

baichuan2 bloom deepseek falcon gemma internlm llama2 llamacpp llm-inference m2m100 minicpm mistral mixtral mixture-of-experts model-quantization moe multi-gpu-inference phi-2 qwen

Last synced: 17 Dec 2024

https://github.com/microsoft/ai-dev-gallery

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

ai csharp developer-tools directml dotnet genai mistral npu onnx onnxruntime onnxruntime-genai phi3 qnn stable-diffusion visual-studio whisper winappsdk windows winui3 wpf

Last synced: 21 Dec 2024

https://github.com/nathanborror/heat

An LLM agnostic desktop and mobile client.

anthropic llm mistral ollama openai perplexity swift swiftui

Last synced: 20 Dec 2024

https://github.com/nathanborror/Heat

An LLM agnostic desktop and mobile client.

anthropic llm mistral ollama openai perplexity swift swiftui

Last synced: 06 Nov 2024

https://github.com/kolinko/effort

An implementation of bucketMul LLM inference

inference llm mistral

Last synced: 21 Dec 2024

https://github.com/devoxx/devoxxgenieideaplugin

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Llama.cpp and Exo) and Cloud based LLMs to help review, test, explain your project code.

anthropic assistant chatgpt claude-3 claude-ai copilot gemini genai gpt4all groq intellij-plugin java llm lmstudio mistral ollama openai

Last synced: 18 Dec 2024

https://github.com/picovoice/picollm

On-device LLM Inference Powered by X-Bit Quantization

compression efficient-inference gemma generative-ai language-model language-models large-language-model llama llama2 llama3 llm llm-inference llms mistral mixtral model-compression natural-language-processing quantization self-hosted

Last synced: 15 Dec 2024

https://github.com/gbaptista/ollama-ai

A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.

ai alpaca bakllava dolphin llama llama2 llava llm mistral mistral-ai mixtral nano-bots ollama ollama-api openorca vicuna

Last synced: 14 Dec 2024

https://github.com/amscotti/local-LLM-with-RAG

Running local Language Language Models (LLM) to perform Retrieval-Augmented Generation (RAG)

chatbot embeddings langchain llm mistral ollama python rag retrieval-augmented-generation streamlit

Last synced: 06 Nov 2024

https://github.com/tak-bro/aicommit2

A Reactive CLI that generates git commit messages with Ollama, ChatGPT, Gemini, Claude, Mistral and other AI

ai-commit ai-commits aicommit aicommits anthropic chatgpt claude cli codestral cohere deepseek git-commit groq huggingface llama mistral ollama perplexity

Last synced: 15 Dec 2024

https://github.com/gair-nlp/prox

Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"

continual continual-pre-training data-centric-ai data-quality llama llm mistral neural-symbolic pre-training

Last synced: 14 Dec 2024

https://github.com/babycommando/machinascript-for-robots

Build LLM-powered robots in your garage with MachinaScript For Robots!

ai arduino artificial-intelligence gpt gpt-3 gpt-4 llama llama2 llm llms mistral mistral-7b mixtral mixtral-8x7b raspberry-pi raspberry-pi-4 robot robotics robots

Last synced: 14 Dec 2024

https://github.com/amscotti/local-llm-with-rag

Running local Language Language Models (LLM) to perform Retrieval-Augmented Generation (RAG)

chatbot embeddings langchain llm mistral ollama python rag retrieval-augmented-generation streamlit

Last synced: 10 Oct 2024

https://github.com/grofers/go-codon

Workflow based REST framework code generator

aggregation concurrency golang mistral rest rest-api swagger web web-framework workflow workflows

Last synced: 05 Nov 2024

https://github.com/ictnlp/truthx

Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"

baichuan chatglm chatgpt explainable-ai gpt-4 hallucination hallucinations language-model llama llama2 llama3 llm llm-inference llms mistral representation safety truthfulness

Last synced: 03 Dec 2024

https://github.com/eliranwong/toolmate

ToolMate AI, developed by Eliran Wong, is a cutting-edge AI companion that seamlessly integrates agents, tools, and plugins to excel in conversations, generative work, and task execution. Supports custom workflow and plugins to automate multi-step actions.

agent ai autogen chatgpt dalle-3 fabric gemini google grok groq imagen-3 llama3 llamacpp mistral ollama openai stable-diffusion tool vision xai