https://github.com/yuhexiong/ollama-hugging-face-mistrallite-python

https://github.com/yuhexiong/ollama-hugging-face-mistrallite-python

huggingface mistral-7b natural-language-processing nlp ollama

Last synced: about 1 month ago
JSON representation

• Host: GitHub
• URL: https://github.com/yuhexiong/ollama-hugging-face-mistrallite-python
• Owner: yuhexiong
• Created: 2024-07-14T12:04:29.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-07-20T04:51:39.000Z (6 months ago)
• Last Synced: 2024-07-20T05:50:11.269Z (6 months ago)
• Topics: huggingface, mistral-7b, natural-language-processing, nlp, ollama
• Language: Python
• Homepage:
• Size: 65.4 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Ollama Hugging Face MistralLite

Using ollama with custom Model From HuggingFace MistralLite for **traditional chinese chatting**. I run the command in a Colab .ipynb file, but you can choose the environment that suits you.  

HuggingFace MistralLite Model From [Website](https://huggingface.co/TheBloke/MistralLite-7B-GGUF).  

## Overview

- Application: Ollama v0.2.5

- Model: MistralLite-7B-GGUF mistrallite.Q8_0.gguf

## Architecture

```

ollama-hugging-face-mistralLite-python/

├── ollama_mistrallite_q8.py

├── Modelfile

└── downloads/

    └── mistrallite.Q8_0.gguf

```

## Run

### Run Cmd

```

python ollama_mistrallite_q8_cmd.py

```

### Run Python

```

python ollama_mistrallite_q8_subprocess.py

```

## Results

### Adding Model Into Ollama

![image](./images/ollama_list.png)

### Api Example  

```

>> 請用繁體中文介紹MistralLite-7B-GGUF 

>> MistralLite-7B-GGUF是一種高效率的翻譯模型，可以將英文文本轉換為繁體中文。它使用了由Hugging Face開發的Transformer架構，並且培訓在大量的英文和繁體中文資料上，使其能夠產生高品質的翻譯結果。

```

![image](./images/ollama_api.png)