https://github.com/ricoledan/langsmith-demo
🔨 Companion repository to The Art of LangSmithing by Ricardo Ledan, A guide to testing, evaluating, and monitoring LLM calls for production using LangSmith.
https://github.com/ricoledan/langsmith-demo
Last synced: 6 days ago
JSON representation
🔨 Companion repository to The Art of LangSmithing by Ricardo Ledan, A guide to testing, evaluating, and monitoring LLM calls for production using LangSmith.
- Host: GitHub
- URL: https://github.com/ricoledan/langsmith-demo
- Owner: Ricoledan
- Created: 2023-08-02T01:57:50.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-08-07T02:09:59.000Z (almost 3 years ago)
- Last Synced: 2025-02-27T19:57:55.489Z (over 1 year ago)
- Language: Python
- Homepage:
- Size: 7.81 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# LangSmith-Demo
🔨 Companion repository to [The Art of LangSmithing](https://medium.com/@ricoledan/the-art-of-langsmithing-42dcd191a220)
by Ricardo Ledan, A guide to testing, evaluating, and monitoring LLM
calls for production using LangSmith.
## Tools
* [Pyenv](https://github.com/pyenv/pyenv)
* [Serverless Framework](https://www.serverless.com/)
## Commands
Activate your local Python virtual environment (pyenv)
```bash
pyenv activate ENV_NAME
```
Install Python dependencies
```bash
pip install -r requirements.txt
```
Run the serverless function locally with a sample user input
```bash
sls invoke local --function chat --path user_input_event.json
```
Run when testing the model against a dataset we set in langSmith
```bash
sls invoke local --function eval
```