Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/uniai-lab/uniai
AI models all in one!
https://github.com/uniai-lab/uniai
ai chatglm chatgpt gemini gpt midjourney moonshot openai stable-diffusion wenxinworkshop
Last synced: 5 days ago
JSON representation
AI models all in one!
- Host: GitHub
- URL: https://github.com/uniai-lab/uniai
- Owner: uniai-lab
- License: mit
- Created: 2024-01-29T01:33:12.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-07-11T09:20:06.000Z (3 months ago)
- Last Synced: 2024-07-20T15:33:11.214Z (3 months ago)
- Topics: ai, chatglm, chatgpt, gemini, gpt, midjourney, moonshot, openai, stable-diffusion, wenxinworkshop
- Language: TypeScript
- Homepage: https://www.uniai.us
- Size: 3.87 MB
- Stars: 16
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
UniAI
To Unify AI Models!
UniAI, built on Node.js, serves as an integrated AI model library. It provides a unified interface for various models, streamlining the development process by ensuring a consistent model input and output.
Chat
Imagine
Prompt: Pink dress, Candy, Sandy, Mandy, short hair, blonde hair, bangs, forehead, red lipstick, elbow gloves, hair accessories, high heels, sitting, cross legged, high chair, cocktail, holding cocktail glass, looking through the glass.
Negative Prompt: EasyNegative, badhandv4, badv5, aid210, aid291.
MidJourney
Stability v1.6
OpenAI DALL-E-3
Easy to Use
```typescript
import UniAI from 'uniai'
// fill the config for the provider/model you want to use!
const ai = new UniAI({ OpenAI: { key: 'Your key', proxy: 'Your proxy API' } })
// chat model
const chat = await ai.chat('hello world')
// embedding model
const embedding = await ai.embedding('hello world')
// imagine model
const task = await ai.imagine('a panda is eating bamboo')
// show imagining tasks, get generated images
const image = await ai.task(task.taskId)
// change image, Midjourney only, return a new task
const task2 = await ai.change('midjourney', task.taskId, 'UPSCALE', 4)
```
English Β· [π¨π³ δΈζθ―΄ζ](./README_CN.md)
## Supported Models
- [IFLYTEK/Spark](https://xinghuo.xfyun.cn)
- [THUDM/ChatGLM-6B](https://github.com/THUDM/ChatGLM4)
- [ZHIPU/GLM3-4](https://open.bigmodel.cn)
- [OpenAI/GPT](https://platform.openai.com)
- [Baidu/WenXin Workshop](https://cloud.baidu.com/product/wenxinworkshop)
- [Google/Gemini](https://makersuite.google.com/app/)
- [MoonShot/moonshot](https://platform.moonshot.cn/docs)
- [OpenAI/DALL-E](https://platform.openai.com)
- [MidJourney](https://github.com/novicezk/midjourney-proxy)
- [Stability AI](https://platform.stability.ai/docs/getting-started)
- [Stable Diffusion](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
- [GanymedeNil/text2vec-large-chinese](https://huggingface.co/GanymedeNil/text2vec-large-chinese)
## Applications Developed on UniAI
We have developed several sample applications using **uniai**:
## Install
**Using yarn:**
```bash
yarn add uniai
```
**Using npm:**
```bash
npm install uniai
```
## Example
> We have written a simple call demo for you, which is placed in the `/examples` folder. You can read the `/examples` file directly to learn how to use UniAI.
> You can also read on to learn how to use UniAI based on the documentation.
### List Models
You can use `.models` to list all the available models in UniAI.
**TypeScript & JavaScript ES6+**
```typescript
import UniAI from 'uniai'
const ai = new UniAI()
console.log(ai.models)
```
**JavaScript ES5**
```javascript
const UniAI = require('uniai').default
const ai = new UniAI()
console.log(ai.models)
```
**Output**
```json
[
{
"provider": "OpenAI",
"value": "openai",
"models": [
"gpt-3.5-turbo-1106",
"gpt-3.5-turbo",
"gpt-3.5-turbo-16k",
"gpt-4",
"gpt-4-32k",
"gpt-4-1106-preview",
"gpt-4-vision-preview"
]
},
// ...providers and models
{
"provider": "StabilityAI",
"value": "stability.ai",
"models": ["stable-diffusion-v1-6", "stable-diffusion-xl-1024-v1-0"]
}
]
```
### Chat
To interact with a model, use `.chat()` and remember to provide the required API key or secret parameters when initializing `new UniAI()`.
Default model is OpenAI/gpt-3.5-turbo, put the OpenAI key and your proxy API.
```typescript
const key: string | string[] = 'Your OpenAI Key (required), support multi keys'
const proxy = 'Your OpenAI API proxy (optional)'
const uni = new UniAI({ OpenAI: { key, proxy } })
const res = await uni.chat()
console.log(res)
```
**Output**
```json
{
"content": "I am OpenAI's language model trained to assist with information.",
"model": "gpt-3.5-turbo-0613",
"object": "chat.completion",
"promptTokens": 20,
"completionTokens": 13,
"totalTokens": 33
}
```
**Chat with image**
```js
const input = [
{
role: 'user',
content: 'Describe this picture, is it a man or a woman, and what is she doing?',
img: 'https://pics7.baidu.com/feed/1f178a82b9014a903fcc22f1e98d931fb11bee90.jpeg@f_auto?token=d5a33ea74668787d60d6f61c7b8f9ca2'
}
]
// Warn: If you choose a non-image model, img attributes will be dropped!
const res = await ai.chat(input, { model: 'gpt-4-vision-preview' })
console.log(res)
```
**Output**
```json
{
"content": "The image shows a person taking a mirror selfie using a smartphone...",
"model": "gpt-4-1106-vision-preview",
"object": "chat.completion",
"promptTokens": 450,
"completionTokens": 141,
"totalTokens": 591
}
```
### Streaming Chat
For streaming chat, the response is a JSON buffer.
The following is an example to chat with Google gemini-pro in stream mode.
```typescript
const key: string | string[] = 'Your Google Key (required), support multi keys'
const proxy = 'Your google api proxy (optional)'
const uni = new UniAI({ Google: { key, proxy } })
const res = await uni.chat(input, { stream: true, provider: ModelProvider.Google, model: GoogleChatModel.GEM_PRO })
const stream = res as Readable
let data = ''
stream.on('data', chunk => (data += JSON.parse(chunk.toString()).content))
stream.on('end', () => console.log(data))
```
**Output (Stream)**
```
Language model trained by Google, at your service.
```
## Running Tests
UniAI uses `jest` to run unit tests on all supported models.
```bash
yarn test
```
If you want to run unit tests for a specific model provider:
```bash
# OpenAI, Google, Baidu, IFlyTek, MoonShot, GLM, Other, Imagine...
yarn test OpenAI
```
## Thanks
[Institute of Intelligent Computing Technology, Suzhou, CAS](http://iict.ac.cn/)
## Contributors
[Youwei Huang](https://github.com/devilyouwei)
[Weilong Yu](https://github.com/mrkk1)
## Who is using it
| Project | Brief introduction |
| :----------------------------------------------------: | :---------------------------------------------------------------------------------------------------: |
| [UniAI MaaS](https://github.com/uni-openai/uniai-maas) | UniAI is a unified API platform designed to simplify interaction with a variety of complex AI models. |
| [LeChat](https://github.com/CAS-IICT/lechat-uniapp) | Document analysis based on large language model, dialogue with WeChat Mini Programs. |
| [LeChat Pro](https://lechat.cas-ll.cn) | Full-platform client based on UniAI, multi-model streaming dialogue platform. |
## Star History
[](https://star-history.com/#devilyouwei/UniAI&Timeline)
## License
[MIT](./LICENSE)
Copyright (c) 2022-present, Youwei Huang