https://github.com/superglue-ai/superglue
Self-healing integration agent. Use it as a layer between you and any complex / legacy APIs and always get the data that you want in the format you expect.
https://github.com/superglue-ai/superglue
api api-gateway etl-automation graphql transformations
Last synced: about 1 month ago
JSON representation
Self-healing integration agent. Use it as a layer between you and any complex / legacy APIs and always get the data that you want in the format you expect.
- Host: GitHub
- URL: https://github.com/superglue-ai/superglue
- Owner: superglue-ai
- License: gpl-3.0
- Created: 2025-01-10T18:38:47.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2025-05-07T14:22:19.000Z (about 2 months ago)
- Last Synced: 2025-05-07T15:32:10.148Z (about 2 months ago)
- Topics: api, api-gateway, etl-automation, graphql, transformations
- Language: TypeScript
- Homepage: https://superglue.ai
- Size: 1.45 MB
- Stars: 1,736
- Watchers: 7
- Forks: 78
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
one SDK to manage all your data pipelines.
🍯
superglue bundles your pipelines into one stable, self-healing endpoint. Comes with automated schema-drift detection, retries and remappings so your data keeps moving no matter what - no connector maintenance, no rewrites. You can deploy it as a proxy between you and any SaaS app, API and data source and always get the data that you want in the format you expect.
- Drop‑in proxy: point it at any REST / GraphQL / SQL / file endpoint.
- LLM‑assisted mapping at setup; cached JSONata transforms at runtime (no LLM latency).
- Self‑healing drift detector: when the upstream schema changes, superglue regenerates the transform, bumps a version, and keeps the pipeline running.
- Security‑first: zero data stored; run fully on‑prem or use our hosted version.
- Agent‑ready: every pipeline is exposed as a single, deterministic endpoint that LangChain, Retool or internal no‑code tools can call without knowing the ugly stuff underneath.
[](https://github.com/superglue-ai/superglue/blob/main/LICENSE)
[](https://www.ycombinator.com/companies/superglue)
[](https://www.npmjs.com/package/@superglue/client)
[](https://hub.docker.com/r/superglueai/superglue)
[](https://twitter.com/adinagoerres)
[](https://twitter.com/sfaistenauer)
[](https://app.workweave.ai/reports/repository/org_0S2o9PLamHvNsTjHbszc38vC/914997268)
## quick start
### hosted version
1. Run on our [cloud-hosted version](https://superglue.ai)
2. Install the superglue js/ts client:
```bash
npm install @superglue/client
```
3. Configure your first api call:
```javascript
import { SuperglueClient } from "@superglue/client";
const superglue = new SuperglueClient({
apiKey: "************"
});
const workflowResult = await superglue.executeWorkflow({
// input can be an ID of a pre-saved workflow or a WorkflowInput object
workflow: {
id: "myTodoUserWorkflow",
steps: [
{
id: "fetchTodos", // Unique ID for this step
apiConfig: {
id: "jsonplaceholderTodos",
urlHost: "https://jsonplaceholder.typicode.com",
urlPath: "/todos",
method: HttpMethod.GET,
instruction: "Fetch a list of todos. We only need the first one for this example.",
},
},
{
id: "fetchUser",
apiConfig: {
id: "jsonplaceholderUsers",
urlHost: "https://jsonplaceholder.typicode.com",
urlPath: "/users/<<$.fetchTodos[0].userId>>", // JSONata path parameter for first userId
method: HttpMethod.GET,
instruction: "Fetch user details by user ID for the first todo."
},
},
],
// Transform the results of the steps into the final desired output. If not given, this will be generated from the reponse schema
finalTransform: "$",
responseSchema: { // define the expected final output structure
type: "object",
description: "first todo",
properties: {
todoTitle: { type: "string" },
userName: { type: "string" }
}
}
},
// `payload` could be used to pass initial data to the first step if needed. E.g. IDs to fetch, filters, etc. In short, things that can change across calls.
// payload: { userId: 1 },
// `credentials` can be used to authenticate requests. They need to be referenced in the api config (e.g. "headers": {"Authorization": "Bearer <>"})
// credentials: { hubspot_api_key: "pa_xxx" },
});
console.log(JSON.stringify(workflowResult, null, 2));
```
## what people build with superglue
- Ship connectors 10x faster, without the maintenance overhead
- Simple interface for legacy API pipelines
- CMS or cloud migration
- Transforming SQL queries into Rest API calls
- Data lake consolidation
- Track data lineage
- And many more...
## key features
- **API Proxy**: Configure APIs and intercept responses in real-time with minimal added latency
- **LLM-Powered Data Mapping**: Automatically generate data transformations using large language models
- **Schema Validation**: Ensure data compliance with your specified schemas
- **File Processing**: Handle various file formats (CSV, JSON, XML) with automatic decompression
- **Flexible Authentication**: Support for various auth methods including header auth, api keys, oauth, and more
- **Smart Pagination**: Handle different pagination styles automatically
- **Caching & Retry Logic**: Built-in caching and configurable retry strategies
## 📖 Documentation
For detailed documentation, visit [docs.superglue.cloud](https://docs.superglue.cloud).
## 🤝 contributing
We love contributions! Feel free to open issues for bugs or feature requests.
[//]: # (To contribute to the docs, check out the /docs folder.)
## license
superglue is GPL licensed. The superglue client SDKs are MIT licensed. See [LICENSE](LICENSE) for details.
## 🙋♂️ support
- 💬 Discord: [Join our community](https://discord.gg/vUKnuhHtfW)
- 🐛 Issues: [GitHub Issues](https://github.com/superglue-ai/superglue/issues)
[](https://twitter.com/superglue_d)