https://github.com/edeandrea/tools-streaming

https://github.com/edeandrea/tools-streaming

Last synced: 1 day ago
JSON representation

• Host: GitHub
• URL: https://github.com/edeandrea/tools-streaming
• Owner: edeandrea
• Created: 2024-11-18T15:38:47.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2024-11-18T15:40:39.000Z (2 months ago)
• Last Synced: 2024-11-18T17:09:43.773Z (2 months ago)
• Language: TypeScript
• Size: 3.71 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
By default the app will assume there is a chat model on https://localhost:8000/v1 that exposes an OpenAI endpoint.

If you would like to use Ollama instead, first install/run Ollama on your machine. Then do one of the following:

## Building the app

When building the app, run `./mvnw clean package -DskipTests -Dquarkus.profile=ollama,prod` (or `quarkus build --no-tests -Dquarkus.profile=ollama`)

## Running dev mode

When running dev mode, run `./mvnw quarkus:dev -Dquarkus.profile=ollama` (or `quarkus dev -Dquarkus.profile=ollama`).

## Running tests

When running tests, run `./mvnw verify -Dquarkus.test.profile=ollama,test -Dquarkus.profile=ollama` (or `quarkus build --tests -Dquarkus.test.profile=ollama,test -Dquarkus.profile=ollama`)

## Running the app outside dev mode

If you want to run the app outside dev mode, first build the app as described above, then run `java -Dquarkus.profile=ollama,prod -jar target/quarkus-app/quarkus-run.jar`