https://github.com/nishant-sethi/python-ai-extension-server

Python Server to use local LLMs
https://github.com/nishant-sethi/python-ai-extension-server

ai langchain langchain-python llama3 llms meta ollama

Last synced: 9 days ago
JSON representation

Python Server to use local LLMs

• Host: GitHub
• URL: https://github.com/nishant-sethi/python-ai-extension-server
• Owner: nishant-sethi
• License: gpl-3.0
• Created: 2024-09-18T00:21:52.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-10-29T20:04:20.000Z (2 months ago)
• Last Synced: 2024-11-07T19:21:14.785Z (2 months ago)
• Topics: ai, langchain, langchain-python, llama3, llms, meta, ollama
• Language: Python
• Homepage:
• Size: 60.5 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md

Awesome Lists containing this project

README

        
# python-ai-extension-server

Python Server to use local LLMs

## Table of Contents

- [Installation](#installation)

- [Usage](#usage)

- [Features](#features)

- [Contributing](#contributing)

- [License](#license)

## Installation

To install the necessary dependencies, run:

```bash

pip install -r requirements.txt

```

## Usage

To start the server, use the following command:

```bash

python main.py

```

## Features

- Supports multiple local LLMs

- Easy to integrate with other applications

- High performance and low latency

## Contributing

Contributions are welcome! Please fork the repository and submit a pull request.

## License

This project is licensed under the GNU License.