https://github.com/smaranjitghose/litellm
Multi LLM Integration with LiteLLM and Ollama
https://github.com/smaranjitghose/litellm
claude-ai gpt-4 llama3 llm ollama python
Last synced: 5 months ago
JSON representation
Multi LLM Integration with LiteLLM and Ollama
- Host: GitHub
- URL: https://github.com/smaranjitghose/litellm
- Owner: smaranjitghose
- License: mit
- Created: 2024-11-12T11:25:05.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-11-12T11:46:28.000Z (7 months ago)
- Last Synced: 2024-12-22T15:33:25.490Z (6 months ago)
- Topics: claude-ai, gpt-4, llama3, llm, ollama, python
- Language: Jupyter Notebook
- Homepage:
- Size: 48.8 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
# MultiLLM Integration with LiteLLM 🚀
This repository contains a Jupyter notebook demonstrating how to integrate multiple LLMs using LiteLLM and Ollama.
## Overview 📖
The notebook provides a step-by-step guide to:
- Set up LiteLLM with Ollama
- Configure multiple LLM providers
- Run both local and cloud-based models
- Build a unified interface for all your LLM needs
## Requirements 🛠️
- Python 3.8+
- CUDA-compatible GPU
- Ubuntu/Linux environment
- Jupyter Notebook
## Quick Start 🏃♂️
1. Clone this repository
```bash
git clone [your-repo-url]
cd [repo-name]
```
2. Install dependencies
```bash
pip install -r requirements.txt
```
3. Launch Jupyter Notebook
```bash
jupyter notebook
```
4. Open `litellm_Demo.ipynb` and follow along!
## What's Inside? 📦
The notebook covers:
- Basic LiteLLM setup
- Ollama configuration
- Model management
- API integration (OpenAI, Anthropic)
- Code examples for both local and cloud models
## Additional Resources 📚
1. [LiteLLM Documentation](https://docs.litellm.ai/docs/)
2. [LiteLLM GitHub Repository](https://github.com/BerriAI/litellm)
3. [Blog Post Tutorial](your-blog-url)
## Contributing 🤝
Feel free to:
- Open issues
- Submit PRs
- Suggest improvements
## License 📄
MIT License - feel free to use this code in your projects!
---
Created with ❤️ by [Smaranjit Ghose](https://github.com/smaranjitghose)