https://github.com/jellyterra/llamash

REST API Bridge for Ollama.
https://github.com/jellyterra/llamash

ai chatbot llama2 ollama

Last synced: 10 days ago
JSON representation

REST API Bridge for Ollama.

• Host: GitHub
• URL: https://github.com/jellyterra/llamash
• Owner: jellyterra
• License: mpl-2.0
• Created: 2024-02-16T15:24:18.000Z (9 months ago)
• Default Branch: master
• Last Pushed: 2024-03-30T18:56:52.000Z (8 months ago)
• Last Synced: 2024-03-30T20:26:15.219Z (8 months ago)
• Topics: ai, chatbot, llama2, ollama
• Language: Go
• Homepage:
• Size: 14.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# llamash

RESTful API Bridge for [Ollama](https://ollama.com).

### Build and Run

```shell

$ go build .

$ ./llamash

```

### Setup

Before starting the bridge server, you need a running Ollama server which the address is ```http://127.0.0.1:11434``` in default.

```shell

$ podman run --network host ollama serve

$ ./llamash -p 11444 -i 'http://127.0.0.1:11434'

```

### Enjoy it!

```shell

$ curl 'http://127.0.0.1:11444/generate?model=codellama&prompt=sayhi'

```

GET Form:

- ```generate``` Generate content.

    - ```model``` The LLaMA model you gonna use.

    - ```prompt``` The content will send to the model.

    

Responds in pure text.