https://github.com/alejandro-ao/yt-stream-langchain-streamlit
How to stream the generation of a LLM in your Streamlit application
https://github.com/alejandro-ao/yt-stream-langchain-streamlit
Last synced: 8 days ago
JSON representation
How to stream the generation of a LLM in your Streamlit application
- Host: GitHub
- URL: https://github.com/alejandro-ao/yt-stream-langchain-streamlit
- Owner: alejandro-ao
- License: mit
- Created: 2024-02-28T17:26:58.000Z (about 1 year ago)
- Default Branch: master
- Last Pushed: 2024-05-11T20:40:02.000Z (11 months ago)
- Last Synced: 2025-03-22T18:42:25.354Z (23 days ago)
- Language: Python
- Size: 99.6 KB
- Stars: 23
- Watchers: 2
- Forks: 16
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
- jimsghstars - alejandro-ao/yt-stream-langchain-streamlit - How to stream the generation of a LLM in your Streamlit application (Python)
README
# ChatGPT clone with Streaming Feature using Streamlit
>This repository accompanies the YouTube tutorial on how to stream the output of a chatbot as it is being generated.
>- You may find the video tutorial [on YouTube](https://youtu.be/zKGeRWjJlTU).
>- Written article on [my Blog](https://alejandro-ao.com/how-to-use-streaming-in-langchain-and-streamlit/)
Welcome to the GitHub repository for the Streaming tutorial form LangChain and Streamlit. This repository contains the code for the Streamlit app that we will be building in the tutorial. The app is a chatbot that will remember the previous messages and respond to the user's input. The response from the chatbot will be streamed as it is being generated.
## Usage
To run the app, you will need to have Python installed on your machine. You can install the required packages by running the following command in your terminal:
```bash
pip install -r requirements.txt
```
Once you have installed the required packages, you can run the app by running the following command in your terminal:
```bash
streamlit run src/app.py
```
This will start the Streamlit app, and you will be able to interact with the chatbot in your web browser.
## Contributing
This repository is intended only for educational purposes. The only contributions that will be accepted are those that fix typos or inconsistencies with the tutorial.
## License
This repository is licensed under the MIT License. See the [LICENSE](./LICENCE.md) file for more information.