https://github.com/bruceunx/gpt-server

gpt-server with gemini and groq as sever for Copilot like client
https://github.com/bruceunx/gpt-server

Last synced: 6 days ago
JSON representation

gpt-server with gemini and groq as sever for Copilot like client

• Host: GitHub
• URL: https://github.com/bruceunx/gpt-server
• Owner: bruceunx
• Created: 2024-04-18T07:48:18.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-08-06T00:20:09.000Z (4 months ago)
• Last Synced: 2024-08-06T02:34:56.605Z (4 months ago)
• Language: Python
• Size: 87.9 KB
• Stars: 3
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Use Gemini and Groq(Llama3, Mixtral) and OpenAI for Unary Interface

## Easy Self Host setup for any usage, like CopilotChat.nvim

> Make sure `make` is installed in your system, or your should run command in `Makefile` manually.

## Add Support for Auto Switch between Gemini Pro 1.5 and Gemini Pro 1.0

## Pre-Requirements

> Make sure you have `docker`.

### Change password in your Makefile for redis server

```makefile

# change password

    docker run --name redis -p 6379:6379 -e REDIS_PASSWORD=123456 -d redis /bin/sh -c 'redis-server --appendonly yes --requirepass ${REDIS_PASSWORD}'

```

### personal information file .person in root

```sh

groq=

gemini=

proxy=

redis=

redis_port=

redis_password=

```

## Install Dependencies and Run Server

```sh

make run

```

## Run in docker

```sh

make new

```

## Rebuild docker

```sh

make rebuild

```

## If you want to add new Llm servers.

- copy and past file in routers

- adjust some logic and add

- add routers to `__main__.py`