Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jasperan/oci-gpt4
Use a GPT4 model on OCI
https://github.com/jasperan/oci-gpt4
Last synced: about 2 months ago
JSON representation
Use a GPT4 model on OCI
- Host: GitHub
- URL: https://github.com/jasperan/oci-gpt4
- Owner: jasperan
- License: gpl-3.0
- Created: 2023-05-08T23:10:20.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-08-30T23:41:22.000Z (over 1 year ago)
- Last Synced: 2024-10-12T18:29:24.780Z (3 months ago)
- Size: 3.81 MB
- Stars: 3
- Watchers: 1
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# oci-gpt4
Learn to use a GPT4 model on OCI
## Create compute instance
First, we will need a compute instance (with an OCI Marketplace image). This image will make our lives better when using generative deco Refer to [this documentation](files/create_compute_instance.md) for detailed instructions on how to create an OCI Compute Instance.
## Install dependencies
To install
```bash
conda create -n "gen_ai" python=3.10
conda activate -n "gen_ai"
pip install nomic
pip install pygpt4all
```
## Available GPT4ALl models for download
- https://gpt4all.io/models/ggml-gpt4all-j-v1.3-groovy.bin (default) (md5sum 81a09a0ddf89690372fc296ff7f625af) Current best commercially licensable model based on GPT-J and trained by Nomic AI on the latest curated GPT4All dataset.
- https://gpt4all.io/models/ggml-gpt4all-l13b-snoozy.bin (md5sum 91f886b68fbce697e9a3cd501951e455) Current best non-commercially licensable model based on Llama 13b and trained by Nomic AI on the latest curated GPT4All dataset.
- https://gpt4all.io/models/ggml-gpt4all-j-v1.2-jazzy.bin (md5sum 879344aaa9d62fdccbda0be7a09e7976) An commercially licensable model based on GPT-J and trained by Nomic AI on the v2 GPT4All dataset.
- https://gpt4all.io/models/ggml-gpt4all-j-v1.1-breezy.bin (md5sum 61d48a82cb188cceb14ebb8082bfec37) An commercially licensable model based on GPT-J and trained by Nomic AI on the v1 GPT4All dataset.
- https://gpt4all.io/models/ggml-gpt4all-j.bin (md5sum 5b5a3f9b858d33b29b52b89692415595) An commercially licensable model based on GPT-J and trained by Nomic AI on the v0 GPT4All dataset.
- https://gpt4all.io/models/ggml-vicuna-7b-1.1-q4_2.bin (md5sum 29119f8fa11712704c6b22ac5ab792ea) An non-commercially licensable model based on Llama 7b and trained by teams from UC Berkeley, CMU, Stanford, MBZUAI, and UC San Diego.
- https://gpt4all.io/models/ggml-vicuna-13b-1.1-q4_2.bin (md5sum 95999b7b0699e2070af63bf5d34101a8) An non-commercially licensable model based on Llama 13b and trained by teams from UC Berkeley, CMU, Stanford, MBZUAI, and UC San Diego.
- https://gpt4all.io/models/ggml-wizardLM-7B.q4_2.bin (md5sum 99e6d129745a3f1fb1121abed747b05a) An non-commercially licensable model based on Llama 7b and trained by Microsoft and Peking University.
- https://gpt4all.io/models/ggml-stable-vicuna-13B.q4_2.bin (md5sum 6cb4ee297537c9133bddab9692879de0) An non-commercially licensable model based on Llama 13b and RLHF trained by Stable AI.
Choose your preferred model and wget / curl it in the next section:
## Using `pygpt4all`
Using `pygpt4all` is a bit more advanced because it requires you to manually download whichever model checkpoint you want to use, but still achievable.
For more information on how to download or get these `.bin` files, refer to the [full lab guide](files/guide.md) for specific instructions for `pygpt4all`.
### Run:
```bash
curl -O https://gpt4all.io/models/ggml-gpt4all-l13b-snoozy.bin
```
### Download this repository
Once we have the repo in the local machine, we'll be able to access the examples folder with some Python scripts for you.
```bash
git clone https://github.com/jasperan/oci-gpt4
```
## Using `nomic-ai`
You can also run GPTs with the `nomic` library (easier). Refer to the [full lab guide](files/guide.md) for specific instructions for `nomic`.