https://github.com/artefact2/horde-bridge-lcpp-server

A simple bridge between AI Horde and llama.cpp
https://github.com/artefact2/horde-bridge-lcpp-server

aihorde llamacpp

Last synced: 13 days ago
JSON representation

A simple bridge between AI Horde and llama.cpp

• Host: GitHub
• URL: https://github.com/artefact2/horde-bridge-lcpp-server
• Owner: Artefact2
• License: apache-2.0
• Created: 2024-02-17T14:33:03.000Z (11 months ago)
• Default Branch: master
• Last Pushed: 2024-03-09T17:17:24.000Z (10 months ago)
• Last Synced: 2024-12-22T06:40:10.809Z (13 days ago)
• Topics: aihorde, llamacpp
• Language: PHP
• Homepage:
• Size: 59.6 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: COPYING

Awesome Lists containing this project

README

        
# horde-bridge-lcpp-server

A really simple proof of concept that bridges requests from the [AI

Horde](https://aihorde.net/) to

[llama.cpp](https://github.com/ggerganov/llama.cpp)'s

[server](https://github.com/ggerganov/llama.cpp/tree/master/examples/server).

Released under the Apache License, version 2.0.

# Quickstart guide

```

git clone https://github.com/Artefact2/horde-bridge-lcpp-server

cd horde-bridge-lcpp-server

git clone -b for-horde https://github.com/Artefact2/llama.cpp.git

make -C llama.cpp LLAMA_HIPBLAS=1 AMDGPU_TARGETS=gfx1030 server # tweak build type to your hardware

cp config.json.example config.json

$EDITOR config.json

./bridge

```