https://github.com/tsjdev-apps/llm-locally-using-ollama

Simple repository to demonstrate how to use Large Language Models locally using Ollama.
https://github.com/tsjdev-apps/llm-locally-using-ollama

Last synced: 5 months ago
JSON representation

Simple repository to demonstrate how to use Large Language Models locally using Ollama.

• Host: GitHub
• URL: https://github.com/tsjdev-apps/llm-locally-using-ollama
• Owner: tsjdev-apps
• License: mit
• Created: 2024-03-21T10:31:20.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-08-06T19:59:38.000Z (almost 2 years ago)
• Last Synced: 2024-08-06T23:19:27.209Z (almost 2 years ago)
• Language: Python
• Size: 1.09 MB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Run Large Language Models locally using Ollama

![Header](./docs/header.png)

## Usage in Terminal

First you need to download the Ollama client from the official website [ollama.com](https://ollama.com/download).

Open a Terminal and use `ollama pull ` to download a Large Language Model. A complete list of all available models can be found on the [Ollama website](https://ollama.com/library).

In the Terminal use `ollama run ` to use the model in the console. You can also add `--verbose` to the command to get more statistic about the usage of the model.

![Ollama1](./docs/sample-ollama-1.png)

![Ollama2](./docs/sample-ollama-1.png)

## Usage in Python

I've created two Python scripts to demonstrate the usage of the *Ollama Server*.

The script `main-langchaincommunity.py` uses the `langchain_community` package.

![Ollama3](./docs/sample-ollama-3.png)

The script `main-api.py` uses the REST api approach by calling the `api/generate` endpoint on the *Ollama Server*.

![Ollama4](./docs/sample-ollama-4.png)

Before running the Python scripts, make sure to install [Python](https://www.python.org/downloads/) on your PC and also install the required packages by calling `pip install -r requirements.txt`. You can also create a Python environment if you want.

## Blog Post / YouTube Video

If you are more interested into details, please see the following [medium.com](https://www.medium.com) post:

- [Using Ollama to run local LLMs on your computer](https://medium.com/medialesson/using-ollama-to-run-local-llms-on-your-computer-2e2ee6572a13)

You can also watch the following video on my [YouTube channel](https://www.youtube.com/@tsjdevapps):

- [Lokale LLMs mit Ollama auf dem eigenen PC](https://www.youtube.com/watch?v=bux3jTkmRoI)