https://github.com/abhrankan-chakrabarti/llamainteract
An interactive AI platform with both terminal and web-based interfaces for real-time model interactions, featuring dynamic model integration and immediate feedback streaming. Developed by *The Vanguards*.
https://github.com/abhrankan-chakrabarti/llamainteract
ai chatbot flask interactive-cli llama llama-cpp llm nlp ollama python real-time-streaming text-generation web-app
Last synced: 10 days ago
JSON representation
An interactive AI platform with both terminal and web-based interfaces for real-time model interactions, featuring dynamic model integration and immediate feedback streaming. Developed by *The Vanguards*.
- Host: GitHub
- URL: https://github.com/abhrankan-chakrabarti/llamainteract
- Owner: Abhrankan-Chakrabarti
- License: mit
- Created: 2024-05-17T02:20:12.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-08-15T16:22:00.000Z (11 months ago)
- Last Synced: 2025-05-21T16:15:11.380Z (about 1 month ago)
- Topics: ai, chatbot, flask, interactive-cli, llama, llama-cpp, llm, nlp, ollama, python, real-time-streaming, text-generation, web-app
- Language: Python
- Homepage: https://helping-physically-pelican.ngrok-free.app/
- Size: 2.67 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LlamaInteract
**LlamaInteract** is a versatile, AI-powered platform developed by *The Vanguards*, offering both terminal and web-based interfaces for dynamic, real-time AI interactions. This project is designed for flexibility, enabling users to easily switch between different language models and experience immediate response streaming.
## Features
- **Dual Interface Flexibility**: Interact via Terminal Interface or through a user-friendly Web Application.
- **Real-Time Streaming**: Immediate feedback and interaction using Server-Sent Events (SSE).
- **Dynamic Model Integration**: Easily switch between models without extensive reconfiguration.
- **Modular Design**: Structured for easy maintenance and future enhancements.
## Technology Stack
- **Python**: Core programming language.
- **Flask**: Framework for the web application.
- **Ollama**: Library for model interactions and streaming.
- **HTML/CSS/JavaScript**: For building and styling the web interface.
- **Server-Sent Events (SSE)**: For real-time communication between server and client.
## Installation
1. **Clone the repository**:
```bash
git clone https://github.com/Abhrankan-Chakrabarti/LlamaInteract.git
cd LlamaInteract
```
2. **Install dependencies**:
```bash
pip install -r requirements.txt
```
3. **Run the Web Application**:
```bash
python app.py
```
Visit `http://127.0.0.1:5000` in your browser.
4. **Run the Terminal Interface**:
```bash
python terminal.py
```
## Usage
- **Terminal Mode**:
- Run `terminal.py` and follow the prompts to interact with the AI model directly through the terminal.
- Type `exit` to quit the terminal mode.
- **Web App Mode**:
- Start the web server using `app.py` and interact through the browser interface.
- Input your queries and receive real-time responses directly on the webpage.
## Contributing
We welcome contributions! Please fork the repository, create a feature branch, and submit a pull request with your improvements or new features.
## License
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
## Authors
- **Abhrankan Chakrabarti**
- **The Vanguards** Team