https://github.com/kitswas/deepseek-ai
Run Deepseek Models locally on your machine
https://github.com/kitswas/deepseek-ai
ai chatbot deepseek llm ml offline
Last synced: 9 months ago
JSON representation
Run Deepseek Models locally on your machine
- Host: GitHub
- URL: https://github.com/kitswas/deepseek-ai
- Owner: kitswas
- License: mit
- Created: 2025-01-28T16:38:45.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-01-28T17:23:26.000Z (over 1 year ago)
- Last Synced: 2025-01-28T17:36:18.426Z (over 1 year ago)
- Topics: ai, chatbot, deepseek, llm, ml, offline
- Language: Python
- Homepage:
- Size: 0 Bytes
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# [Deepseek AI](https://huggingface.co/deepseek-ai)
> [!IMPORTANT]
> This is not an official Deepseek project.
> I do not own any of the models or datasets used in this project.
## How to use
You need the UV package/project manager to install the dependencies.
You can get it from [here](https://docs.astral.sh/uv/getting-started/installation/).
Set up the environment. (Only once)
```bash
uv venv
.venv/Scripts/activate
uv pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 --link-mode=symlink
uv sync
```
Run the script.
```bash
.venv/Scripts/activate
uv run python ./deepseek/deepseek_ai.py
```
Models will be downloaded on the first run.
## Models available
Models are fetched from HuggingFace.
1. deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
2. deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
3. deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
4. deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
5. deepseek-ai/DeepSeek-R1-Distill-Llama-70B
6. deepseek-ai/DeepSeek-R1-Distill-Llama-8B
7. deepseek-ai/DeepSeek-R1
8. deepseek-ai/DeepSeek-R1-Zero