https://github.com/haalven/llm_terminal
ask LLMs in the terminal
https://github.com/haalven/llm_terminal
chatgpt command-line gemma2 gpt4o llama3 ollama-api openai-api python terminal
Last synced: 30 days ago
JSON representation
ask LLMs in the terminal
- Host: GitHub
- URL: https://github.com/haalven/llm_terminal
- Owner: haalven
- Created: 2024-07-12T15:51:35.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2025-03-18T09:25:49.000Z (about 1 month ago)
- Last Synced: 2025-03-18T10:28:10.376Z (about 1 month ago)
- Topics: chatgpt, command-line, gemma2, gpt4o, llama3, ollama-api, openai-api, python, terminal
- Language: Python
- Homepage:
- Size: 662 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ask LLMs in the Terminal
`ask_openai.py` – call the [OpenAI API](https://openai.com/api), fill in your `API_KEY`
`ask_ollama.py` – call the [local Ollama API](https://ollama.com/) (localhost:11434)
required:
* [prompt_toolkit](https://github.com/prompt-toolkit/python-prompt-toolkit) (input)
* [openai](https://github.com/openai/openai-python) (ask_openai.py)
* [requests](https://requests.readthedocs.io/) (ask_ollama.py)
* [rich](https://github.com/Textualize/rich) (output)
## OpenAI API
[ask_openai.py](https://github.com/haalven/LLM_terminal/blob/main/ask_openai.py) uses the [openai Python library](https://github.com/openai/openai-python) to call the [OpenAI API](https://openai.com/api). An internet connection is required. You have to insert your `API_KEY` by editing the `my_api_key = 'sk-***'` line before running the script.
Choose a specific OpenAI model by editing the `openai_model = models['o1pre']` line. See also: [platform.openai.com/docs/models](https://platform.openai.com/docs/models).
## Ollama API
[ask_ollama.py](https://github.com/haalven/LLM_terminal/blob/main/ask_ollama.py) uses the [requests Python library](https://requests.readthedocs.io/) to call the [local Ollama API](https://ollama.com/) (based on [llama.cpp](https://en.wikipedia.org/wiki/Llama.cpp)). An internet connection is not required. Install Ollama first and start the local server (localhost:11434). To download LLMs use the `ollama run ` command.
The best general LLMs for computers with 8…16 GB of RAM in March 2025 are `gemma3` by Google (4B, 3.3GB) and `llama3.2` by Meta (3B, 2.0GB). See also: [ollama.com/models](https://ollama.com/models).
Example:
