{"id":15165937,"url":"https://github.com/saddam213/llamastack","last_synced_at":"2025-09-30T21:30:49.064Z","repository":{"id":190548527,"uuid":"682419433","full_name":"saddam213/LLamaStack","owner":"saddam213","description":"ASP.NET Core Web, WebApi \u0026 WPF implementations for LLama.cpp \u0026 LLamaSharp","archived":true,"fork":false,"pushed_at":"2023-11-14T09:59:35.000Z","size":9265,"stargazers_count":59,"open_issues_count":2,"forks_count":19,"subscribers_count":8,"default_branch":"master","last_synced_at":"2025-01-18T16:08:21.043Z","etag":null,"topics":["alpaca","chatgpt","cuda","huggingface","llama","llama2","llamacpp","llamasharp","llm"],"latest_commit_sha":null,"homepage":"https://www.llama-stack.com","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/saddam213.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-08-24T06:13:56.000Z","updated_at":"2024-12-29T12:22:16.000Z","dependencies_parsed_at":"2023-11-21T07:03:46.686Z","dependency_job_id":"3cc3b20c-200f-421f-8631-cb40d38dc41e","html_url":"https://github.com/saddam213/LLamaStack","commit_stats":{"total_commits":86,"total_committers":1,"mean_commits":86.0,"dds":0.0,"last_synced_commit":"1bfef6cbf1b851066a58e2f8cb8144ee647fe05c"},"previous_names":["saddam213/llamastack"],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saddam213%2FLLamaStack","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saddam213%2FLLamaStack/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saddam213%2FLLamaStack/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/saddam213%2FLLamaStack/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/saddam213","download_url":"https://codeload.github.com/saddam213/LLamaStack/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":234782893,"owners_count":18885808,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["alpaca","chatgpt","cuda","huggingface","llama","llama2","llamacpp","llamasharp","llm"],"created_at":"2024-09-27T04:20:43.688Z","updated_at":"2025-09-30T21:30:41.724Z","avatar_url":"https://github.com/saddam213.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\" width=\"100%\"\u003e\n    \u003cimg width=\"80%\" src=\"Assets/LLamaStack-640%C3%97320.png\"\u003e\n\u003c/p\u003e\n\n\n![GitHub last commit (by committer)](https://img.shields.io/github/last-commit/saddam213/LLamaStack)\n[![LLamaStack Badge](https://img.shields.io/nuget/v/LLamaStack?color=4bc51e\u0026label=LLamaStack)](https://www.nuget.org/packages/LLamaStack)\n[![Web Demo](https://img.shields.io/website/https/www.llama-stack.com?label=Web%20Demo\u0026up_message=online)](https://www.llama-stack.com)\n[![Web API Demo](https://img.shields.io/website/https/llama-stack.com?label=Web%20API%20Demo\u0026up_message=online)](https://api.llama-stack.com/swagger/index.html)\n[![Discord](https://img.shields.io/discord/1147446100442226699?label=Discord)](https://discord.gg/cDpupfb2JB)\n\n### Welcome to LLamaStack!\n\nLLamaStack is a library that provides higher-level services and integrations for .NET applications, enhancing the functionality and versatility of the LLamaSharp and llama.cpp projects.\n\nThis repository also contains a collection of barebone/bootstrap UI \u0026 API projects. Here, you'll find various user interface applications, including Web, API, WPF, and Websocket, all built to showcase the capabilities of the LLamaStack.\n\n\n\n## Overview\nLLamaStack is built on top of the popular **[LLamaSharp](https://github.com/SciSharp/LLamaSharp)** and **[llama.cpp](https://github.com/ggerganov/llama.cpp)** projects, extending their functionalities with a range of user-friendly UI applications. LLamaSharp is a powerful library that provides C# interfaces and abstractions for the popular llama.cpp, the C++ counterpart that offers high-performance inference capabilities on low end hardware. LLamaStack complements these projects by creating intuitive UI \u0026 API interfaces, making the power of LLamaSharp and llama.cpp more accessible to users.\n\n\n## Projects\nLLamaStack is a comprehensive library with several projects tailored for different purposes:\n\n1. **[LLamaStack.Core](LLamaStack.Core/README.md)**: This project offers high-level services and integrations for .NET applications.\n\n2. **[LLamaStack.Web](LLamaStack.Web/README.md)**: The ASP.NET Core Web interface provides all the core functions of llama.cpp \u0026 LLamaSharp.\n\n3. **[LLamaStack.WPF](LLamaStack.WPF/README.md)**: The WPF UI interface provides all the core functions of llama.cpp \u0026 LLamaSharp.\n\n4. **[LLamaStack.WebAPI](LLamaStack.WebApi/README.md)**: This is an implementation of an ASP.NET Core WebAPI with all the essential features of llama.cpp \u0026 LLamaSharp.\n\n\n### In Development\n5. **LLamaStack.Signalr**: `SignalR` websocket server and client implementations designed for use in web and .NET environments.\n\n6. **LLamaStack.SemanticKernel**: Support for `Microsoft.SemanticKernel` using local models and the `LLamaStack.WebAPI` and `LLamaStack.Signalr` implementations\n\n\n## Installation\n\n`LLamaStack` can be found via the nuget package manager, download and install it.\n\n```\nPM\u003e Install-Package LLamaStack\n```\n\n**LLamaStack** relies on the `llama.cpp` and `LLamaSharp` libraries.\n\n- `LLamaSharp` is conveniently included in the NuGet package.\n- However, you will need to obtain `llama.cpp` separately. You can either **[download](https://github.com/ggerganov/llama.cpp/releases)** or compile it yourself.\n\nAlternatively, you can opt for one of the `LLamaSharp` backend Nuget packages tailored for your specific system.\n```\nLLamaSharp.Backend.Cpu  # CPU for Windows, Linux and Mac\nLLamaSharp.Backend.Cuda11  # GPU CUDA11 for Windows and Linux\nLLamaSharp.Backend.Cuda12  # GPU CUDA12 for Windows and Linux\nLLamaSharp.Backend.MacMetal  # GPU Metal for Mac\n```\n\n\n## Getting Started\nTo start using a specific UI project, please refer to the README file located in its respective directory.\n\nYou can store model configurations in the `appsettings.json` file. For examples and documentation on the `appsettings.json` structure, please see the [appsettings.json Documentation](Docs/appsettings.md).\n\nLLamaStack also provides functionality for adding custom sections and loading/saving at runtime.\n\n\n\n\n\n\n\n\n## Contribution\n\nWe welcome contributions to LLamaStack! If you have any ideas, bug reports, or improvements, feel free to open an issue or submit a pull request.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsaddam213%2Fllamastack","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsaddam213%2Fllamastack","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsaddam213%2Fllamastack/lists"}