An open API service indexing awesome lists of open source software.

https://github.com/log10-io/log10js

JavaScript client library for managing your LLM data in one place
https://github.com/log10-io/log10js

ai artificial-intelligence autonomous-agents debugging javascript langchain langchain-js llmops logging monitoring openai openai-api rlhf

Last synced: 10 months ago
JSON representation

JavaScript client library for managing your LLM data in one place

Awesome Lists containing this project

README

          

# log10

⚡ Unified LLM data management ⚡

[![](https://dcbadge.vercel.app/api/server/CZQvnuRV94?compact=true&style=flat)](https://discord.gg/CZQvnuRV94)

## Quick Install

``` bash
npm install log10js
yarn add log10js
```

## 🤔 What is this?

A JavaScript integration to manage your LLM data.

```javascript
const { Configuration, OpenAIApi } = require("openai");
const log10 = require("log10js");

const configuration = new Configuration({
apiKey: process.env.OPENAI_API_KEY,
});

const log10_OpenAIApi = log10(OpenAIApi);
const openai = new log10_OpenAIApi(configuration);
```

Access your LLM data at [log10.io](https://log10.io)

[See full example](./examples/completions.js)

## 🚀 What can this help with?

**🔍🐞 Prompt chain debugging**

Prompt chains such as those in [Langchain](https://github.com/hwchase17/langchain) can be difficult to debug. Log10 provides prompt provenance, session tracking and call stack functionality to help debug chains.

```javascript
const { OpenAI } = require("langchain/llms/openai");
const { Configuration, OpenAIApi } = require("openai");
const log10 = require("log10js");

const log10_OpenAIApi = log10(OpenAIApi);
const openai = new log10_OpenAIApi(
new Configuration({
apiKey: process.env.OPENAI_API_KEY,
})
);
let model = new OpenAI();
model.client = openai;

// Run any chain here...
```

[See full example](./examples/langchain_summarize.js)

**📝📊 Logging**

Log all your OpenAI calls to compare and find the best prompts, store feedback, collect latency and usage metrics, and perform analytics and compliance monitoring of LLM powered features.

**🧠🔁 Readiness for RLHF & self hosting**

Use your data and feedback from users to fine-tune custom models with RLHF with the option of building and deploying more reliable, accurate and efficient self-hosted models.

**👥🤝 Collaboration**

Create flexible groups to share and collaborate over all of the above features

## ⚙️ Setup

Create a free account at [log10.io](https://log10.io) to get a `LOG10_TOKEN` and a `LOG10_ORG_ID`. Please add these to your environment along with `LOG10_URL=https://log10.io`.

## 💬 Community

We welcome community participation and feedback. Please leave an issue, submit a PR or join our [Discord](https://discord.gg/CZQvnuRV94).