https://github.com/mcaimi/rhoai-demo
WIP repository that will hold AI demos on RedHat Openshift AI
https://github.com/mcaimi/rhoai-demo
Last synced: about 1 year ago
JSON representation
WIP repository that will hold AI demos on RedHat Openshift AI
- Host: GitHub
- URL: https://github.com/mcaimi/rhoai-demo
- Owner: mcaimi
- License: gpl-3.0
- Created: 2024-06-21T08:01:09.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-12-20T11:47:52.000Z (over 1 year ago)
- Last Synced: 2025-03-06T10:22:03.053Z (over 1 year ago)
- Language: Jupyter Notebook
- Size: 73.2 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# RedHat Openshift AI Demo Collection
WIP demos running on Openshift AI. Currently *very* work in progress and *very* imcomplete.
Notebooks folder contents:
- (1) Prepare S3 buckets and interact with HuggingFace to download and upload model checkpoints
- (2) Use langchain to tokenize and embed a database of additional information and interact with ChromaDB to store embeddings
- (3) Download the full Mistral-7B model from HuggingFace, test inference, quantize the model, save the quantized model and upload the resulting checkpoint to S3
- (4) Test the full model via vLLM
## TODO
- Finish demo code
- Upload more demos