https://github.com/promptengineer48/llm_selector
This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query
https://github.com/promptengineer48/llm_selector
langchain-python ollama streamlit
Last synced: 26 days ago
JSON representation
This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query
- Host: GitHub
- URL: https://github.com/promptengineer48/llm_selector
- Owner: PromptEngineer48
- Created: 2023-11-26T05:55:24.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-11-26T09:56:22.000Z (over 1 year ago)
- Last Synced: 2025-04-03T17:22:54.622Z (about 2 months ago)
- Topics: langchain-python, ollama, streamlit
- Language: Python
- Homepage: https://youtu.be/zCKwnfHB99k
- Size: 12.7 KB
- Stars: 102
- Watchers: 6
- Forks: 22
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# LLM_Selector
# Auto Select the Best LLM for Your Use Case or Queries
Check out the youtube video
https://youtu.be/zCKwnfHB99k
Clone this Repo on your local drive and then get started.
This code selects the best model for your specific question.
# FLOW +>
Step 1: User Asks a Question
Step 2: A Local LLM runs checks to find the best model to run for the particular user input
Step 3: The user query is sent to the chosen one
Step 4: The chosen LLM runs giving the output
# CODE EXPLANATION
main.py +> Basic Implementation of Langchain for Ollama
main_working.py +> Gives your Terminal Experience (This is the full code your can run on your terminal using "python main_working.py")
main_stream.py +> Give a Web UI experience using Streamlit (To run this code, type "streamlit run main_stream.py" on your terminal)
requirements.txt +> Run these requirements before running any codes above ("pip install -r requirements.txt" on your terminal)
# REQUIREMENTS:
1. You need to have Ollama Running on your System
Check out these videos on Ollama:
Ollama Videos:
https://youtu.be/lhQ8ixnYO2Y
https://youtu.be/ridRXgAmqoQ
https://youtu.be/oguOlJz7RIY