https://github.com/nicholasjackson/demo-securing-llms-with-vault

Demo repo showing how to secure the training and storage of Large Language Models using HashiCorp Vault
https://github.com/nicholasjackson/demo-securing-llms-with-vault

Last synced: 23 days ago
JSON representation

Demo repo showing how to secure the training and storage of Large Language Models using HashiCorp Vault

• Host: GitHub
• URL: https://github.com/nicholasjackson/demo-securing-llms-with-vault
• Owner: nicholasjackson
• Created: 2024-05-07T19:05:27.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-05-13T20:40:06.000Z (6 months ago)
• Last Synced: 2024-05-14T15:32:37.511Z (6 months ago)
• Language: Jupyter Notebook
• Size: 99.6 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Creating a custom model from Mistral

First pull the mistral model

```bash

ollama pull mistral:v0.2

```

Check the model has been downloaded

```bash

ollama list

```

You should see the mistral model in the list of models

```bash

NAME            ID              SIZE    MODIFIED       

mistral:v0.2    61e88e884507    4.1 GB  31 seconds ago

```