https://github.com/digitalocean/langchain-gradient
Langchain Gradient Integration
https://github.com/digitalocean/langchain-gradient
digitalocean gradientai langchain
Last synced: 8 months ago
JSON representation
Langchain Gradient Integration
- Host: GitHub
- URL: https://github.com/digitalocean/langchain-gradient
- Owner: digitalocean
- License: mit
- Created: 2025-07-22T12:39:03.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2025-09-29T11:23:39.000Z (9 months ago)
- Last Synced: 2025-09-29T13:23:12.178Z (9 months ago)
- Topics: digitalocean, gradientai, langchain
- Language: Python
- Homepage: https://pypi.org/project/langchain-gradient/
- Size: 124 KB
- Stars: 2
- Watchers: 0
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# langchain-gradient
[](https://pepy.tech/projects/langchain-gradient)
This package contains the LangChain integration with DigitalOcean
## Installation
```bash
pip install -U langchain-gradient
```
And you should configure credentials by setting the `DIGITALOCEAN_INFERENCE_KEY` environment variable:
1. Log in to the DigitalOcean Cloud console
2. Go to the **Gradient Platform** and navigate to **Serverless Inference**.
2. Click on **Create model access key**, enter a name, and create the key.
3. Use the generated key as your `DIGITALOCEAN_INFERENCE_KEY`:
Create .env file with your access key:
```DIGITALOCEAN_INFERENCE_KEY=your_access_key_here```
## Chat Models
`ChatGradient` class exposes chat models from langchain-gradient.
### Invoke
```python
import os
from dotenv import load_dotenv
from langchain_gradient import ChatGradient
load_dotenv()
llm = ChatGradient(
model="llama3.3-70b-instruct",
api_key=os.getenv("DIGITALOCEAN_INFERENCE_KEY")
)
result = llm.invoke("What is the capital of France?.")
print(result)
```
### Stream
```python
import os
from dotenv import load_dotenv
from langchain_gradient import ChatGradient
load_dotenv()
llm = ChatGradient(
model="llama3.3-70b-instruct",
api_key=os.getenv("DIGITALOCEAN_INFERENCE_KEY")
)
for chunk in llm.stream("Tell me what happened to the Dinosaurs?"):
print(chunk.content, end="", flush=True)
```
More features coming soon.