https://github.com/parisneo/gptq_backend

A Backend for GPT4All that uses GPTQ.
https://github.com/parisneo/gptq_backend

Last synced: 4 days ago
JSON representation

A Backend for GPT4All that uses GPTQ.

• Host: GitHub
• URL: https://github.com/parisneo/gptq_backend
• Owner: ParisNeo
• License: apache-2.0
• Created: 2023-05-02T07:01:24.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-05-02T12:43:27.000Z (over 1 year ago)
• Last Synced: 2024-10-31T11:29:07.676Z (about 2 months ago)
• Language: Python
• Size: 437 KB
• Stars: 4
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

        
# GPTQ_backend

GPTQ_backend is a backend for the GPT4All-ui project. It provides additional functionality for GPTQ, a variant of GPT that generates questions instead of text.

## Installation

To install GPTQ_backend, simply run the `install.bat` or `install.sh` script and provide the path to the root of your GPT4All-ui folder. The installer will copy the `gptq` subfolder to the `backends` folder and install the required libraries inside the virtual environment of GPT4ALL-ui.

On linux/macos :

```bash

./install.sh /path/to/GPT4All-ui

```

On windows :

```bash

./install.bat /path/to/GPT4All-ui

```

Note: Replace `/path/to/GPT4All-ui` with the actual path to the root of your GPT4All-ui folder.

## Usage

After installation, you can start using GPTQ_backend by running GPT4ALL-ui and selecting "gptq" as the backend.

## License

GPTQ_backend is licensed under the Apache License, Version 2.0. See LICENSE for more information.