https://github.com/ggerganov/llama.cpp

LLM inference in C/C++
https://github.com/ggerganov/llama.cpp

ggml llama

Last synced: about 1 month ago
JSON representation

LLM inference in C/C++

• Host: GitHub
• URL: https://github.com/ggerganov/llama.cpp
• Owner: ggerganov
• License: mit
• Created: 2023-03-10T18:58:00.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2024-04-13T22:21:55.000Z (5 months ago)
• Last Synced: 2024-04-13T22:54:20.022Z (5 months ago)
• Topics: ggml, llama
• Language: C++
• Homepage:
• Size: 25.2 MB
• Stars: 55,160
• Watchers: 504
• Forks: 7,800
• Open Issues: 578
• Metadata Files:
  • Readme: README-sycl.md
  • License: LICENSE
  • Security: SECURITY.md
  • Authors: AUTHORS

Awesome Lists containing this project

• awesome_open_llms - LLaMA-cpp
• awesome-local-llms - llama.cpp
• awesome-open-chatgpt - ggerganov/llama.cpp
• awesome - ggerganov/llama.cpp - LLM inference in C/C++ (C++)
• awesome - ggerganov/llama.cpp - LLM inference in C/C++ (C++)
• awesome-local-ai - llama.cpp - Inference of LLaMA model in pure C/C++ | GGML/GGUF | Both | ❌ | C/C++ | Text-Gen | (Inference Engine)
• awesomeLibrary - llama.cpp - LLM inference in C/C++ (语言资源库 / c++)
• awesome-colab-project - LlamaCpp
• awesome-totally-open-chatgpt - ggerganov/llama.cpp
• Self-Hosting-Guide - llama.cpp
• awesome-github-repos - ggerganov/llama.cpp - LLM inference in C/C++ (C++)
• awesome - ggerganov/llama.cpp - LLM inference in C/C++ (C++)
• awesome-llmops - llama.cpp - square) | (Serving / Large Model Serving)
• awesome-transformer-nlp - llama.cpp - Port of Facebook's LLaMA model in C/C++. (Transformer Implementations By Communities / Other)
• awesome-llm-and-aigc - llama.cpp
• ai-catalog - llama
• awesome-repositories - ggerganov/llama.cpp - LLM inference in C/C++ (C++)
• awesome-ChatGPT-repositories - llama.cpp - Port of Facebook's LLaMA model in C/C++ (Langchain)
• AiTreasureBox - ggerganov/llama.cpp - 09-08_64615_3](https://img.shields.io/github/stars/ggerganov/llama.cpp.svg) | Port of Facebook's LLaMA model in C/C++ | (Repos)
• awesome - ggerganov/llama.cpp - LLM inference in C/C++ (C++)
• awesome - llama.cpp
• awesome-zig - llama.cpp
• awesome-generative-ai - ggerganov/llama.cpp
• awesome-privacy - llama.cpp - Inference of Facebook's LLaMA model in pure C/C++ so it can run locally on a CPU. (Artificial Intelligence / Android Launcher)
• fucking-awesome-privacy - llama.cpp - Inference of Facebook's LLaMA model in pure C/C++ so it can run locally on a CPU. (Artificial Intelligence / Android Launcher)
• StarryDivineSky - ggerganov/llama.cpp - 13B在大部分基准测评上超过了GPT3-175B，LLaMA可能是目前公开模型权重中效果最好的语言模型。 (文本生成、文本对话 / 大语言对话模型及数据)
• Awesome-LLM - llama.cpp - LLM inference in C/C++. (LLM Deployment)
• Awesome-LLM-Compression - [Code
• Awesome-LLM-Inference - **llama.cpp**
• awesome-cuda-and-hpc - llama.cpp
• my-awesome - ggerganov/llama.cpp - 09 star:64.5k fork:9.2k LLM inference in C/C++ (C++)