https://github.com/green-sky/solanaceae_llama-cpp-web

https://github.com/green-sky/solanaceae_llama-cpp-web

solanaceae

Last synced: 10 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/green-sky/solanaceae_llama-cpp-web
• Owner: Green-Sky
• Created: 2024-01-22T21:10:40.000Z (12 months ago)
• Default Branch: master
• Last Pushed: 2024-05-28T08:11:33.000Z (8 months ago)
• Last Synced: 2024-05-28T20:04:06.917Z (8 months ago)
• Topics: solanaceae
• Language: C++
• Homepage:
• Size: 68.4 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# llama.cpp webserver based api + RPBot

used llama embedded webserver api for easier portability

## LlamaCppWeb config options

- `LlamaCppWeb`, `server`

  - type: `string`

  - host + port

  - default: `localhost:8080`

## RPBot config options

TODO: move rpbot to own repo

- `RPBot`, `system_prompt`(, opt contact ID)

  - type: `string`

  - System prompt that is prefixed

  - can contain specific formatters:

    - `{self_name}` username for specified chat

    - `{online_users}` coma seperated list of online users

  - default: `Transcript of a group chat, where {self_name} talks to online strangers.\n{self_name} is creative and curious. {self_name} is writing with precision, but also with occasional typos.\n`

- `RPBot`, `min_messages`(, opt contact ID)

  - type: `int`

  - TODO: implement per ID

  - default: `4`

- `RPBot`, `max_cont_messages`(, opt contact ID)

  - type: `int`

  - TODO: implement per ID

  - default: '4'

- `RPBot`, `max_interactive_delay`(, opt contact ID)

  - type: `float`

  - TODO: implement per ID

  - default: `4.0`

## example config

```json

{

	"LlamaCppWeb": {

		"server": "localhost:8080"

	},

	"RPBot": {

		"min_messages": 1,

		"system_prompt":  "A group chat with an artificial intelligence assistant called {self_name}. The assistant gives helpful and detailed answers to the chat participants's questions. The assistant has it's own opinions. {self_name} only ever answers when explicitly asked.\n"

		}

	}

}

```