Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/metriccoders/chatgpt_llama2_backend
https://github.com/metriccoders/chatgpt_llama2_backend
Last synced: 7 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/metriccoders/chatgpt_llama2_backend
- Owner: metriccoders
- License: mit
- Created: 2024-02-10T23:08:02.000Z (11 months ago)
- Default Branch: master
- Last Pushed: 2024-02-12T09:47:34.000Z (11 months ago)
- Last Synced: 2024-12-06T16:14:49.411Z (22 days ago)
- Language: Python
- Size: 2.93 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# Llama2 Model API
## Overview
This is a FastAPI application that serves as an API endpoint for the Llama2 model. The API allows users to get answers from the Llama2 model.
## Installation
1. Clone the repository:
```bash
git clone https://github.com/metriccoders/chatgpt_llama2_backend.git
```
2. Navigate to the project directory:
```bash
cd chatgpt_llama2_backend
```
## Usage
1. Install all the required dependencies: llama_cpp, fastapi, uvicorn and pydantic.
2. Download the Llama2.gguf model from https://huggingface.co/TheBloke/Llama-2-7B-GGUF/tree/main
3. Update the path to model in the code.
4. Start the server:
```bash
uvicorn main:app --reload
```
## License
MIT