https://github.com/wittyicon29/astogemma
A completely local chat UI for any LLMs available on ollama using LangSmith and ChainLit
https://github.com/wittyicon29/astogemma
chainlit langchain langsmith llms ollama python
Last synced: 3 months ago
JSON representation
A completely local chat UI for any LLMs available on ollama using LangSmith and ChainLit
- Host: GitHub
- URL: https://github.com/wittyicon29/astogemma
- Owner: wittyicon29
- License: mit
- Created: 2024-02-27T05:27:46.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-02-27T06:33:23.000Z (over 1 year ago)
- Last Synced: 2025-03-15T15:17:12.309Z (7 months ago)
- Topics: chainlit, langchain, langsmith, llms, ollama, python
- Language: Python
- Homepage:
- Size: 267 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# AstoGemma
A simple local UI for LLMs available on Ollama using Langchain, LangSmith API and ChainLit
This local user interface (UI) allows you to ask questions about astronomy using the powerful Gemma 7b language model built with Chainlit and Ollama.
## What you can do with AstroGemma:
- Ask questions about celestial objects, astronomical phenomena, space exploration, and more.
- Get informative and comprehensive answers directly from the Gemma 7b model.
- Explore various aspects of astronomy in an interactive and engaging way.
## Requirements
- You must have Python 3.10 or later installed. Earlier versions of python may not compile.
- Ollama should be installed from the [Ollama](https://ollama.com/)
- Pull the Gemma 7B model from the [Ollama Library](https://ollama.com/library)
Uisng the following command
```bash
ollama run gemma:7b
```
## Steps to replicate
1. Fork this repository and create a codespace in GitHub as I showed you in the youtube video OR Clone it locally.
```
git clone https://github.com/wittyicon29/AstroGemma.git
cd AstroGemma
```
2. Create a virtualenv and activate it
```
python3 -m venv .venv
.venv/Scripts/activate
```
3. Rename example.env to .env with `cp example.env .env`and input the environment variables from [LangSmith](https://smith.langchain.com/). You need to create an account in LangSmith website if you haven't already.
```
LANGCHAIN_TRACING_V2=true
LANGCHAIN_ENDPOINT="https://api.smith.langchain.com"
LANGCHAIN_API_KEY="your-api-key"
LANGCHAIN_PROJECT="your-project"
```
4. Run the following command in the terminal to install necessary python packages:
```
pip install -r requirements.txt
```
5. Run the following command in your terminal to start the chat UI:
```
chainlit run gemma.py
```
## Monitoring with LangSmith
## Additional Notes
- AstroGemma is still under development, and the accuracy of its responses may vary depending on the complexity of the question.
- It is recommended to frame your questions clearly and concisely for optimal results.
- For advanced users, the underlying code can be modified to customize the UI and integrate additional functionalities.
## Docs
- [Gemma](https://ai.google.dev/gemma/docs/model_card) as Large Language model via [Ollama](https://ollama.com/)
- [LangChain](https://www.langchain.com/) as a Framework for LLM
- [LangSmith](https://smith.langchain.com/) for developing, collaborating, testing, deploying, and monitoring LLM applications.
- [Chainlit](https://docs.chainlit.io/langchain) for deploying.