https://github.com/eliranwong/toolmate-sdk
ToolMate-SDK: a kit for developing agentic AI applications that support 13 LLM backends and integrate tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, custom, deepseek, genai, github, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai
https://github.com/eliranwong/toolmate-sdk
agentic agents anthropic azure chatgpt deepseek genai googleai groq llamacpp mistral ollama openai toolmate vertexai xai
Last synced: 3 months ago
JSON representation
ToolMate-SDK: a kit for developing agentic AI applications that support 13 LLM backends and integrate tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, custom, deepseek, genai, github, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai
- Host: GitHub
- URL: https://github.com/eliranwong/toolmate-sdk
- Owner: eliranwong
- License: gpl-3.0
- Created: 2025-01-25T19:06:37.000Z (5 months ago)
- Default Branch: main
- Last Pushed: 2025-01-28T19:18:13.000Z (5 months ago)
- Last Synced: 2025-01-28T19:39:53.496Z (5 months ago)
- Topics: agentic, agents, anthropic, azure, chatgpt, deepseek, genai, googleai, groq, llamacpp, mistral, ollama, openai, toolmate, vertexai, xai
- Language: Python
- Homepage: https://toolmate.ai
- Size: 42 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# ToolMate AI - SDK
ToolMate-SDK: a software developement kit for developing agentic AI applications that support 13 LLM backends and integrate tools and agents. (Developer: Eliran Wong)
Supported backends: anthropic, azure, custom, deepseek, genai, github, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai
# A Sibling Project
This SDK incorporates the best aspects of our favorite project, [Toolmate AI](https://github.com/eliranwong/toolmate), to create a library aimed at further advancing the development of AI applications.
# Supported backends
`anthropic` - [Anthropic API](https://console.anthropic.com/)
`azure` - [Azure OpenAI API](https://learn.microsoft.com/en-us/azure/ai-services/openai/reference)
`custom` - any openai-compatible backends
`deepseek` - [DeepSeek API](https://platform.deepseek.com/)
`genai` - [Vertex AI](https://cloud.google.com/vertex-ai) or [Google AI](https://ai.google.dev/)
`github` - [Github API](https://github.com/marketplace/models/azure-openai/gpt-4o)
`googleai` - [Google AI](https://ai.google.dev/)
`groq` - [Groq Cloud API](https://console.groq.com)
`llamacpp` - [Llama.cpp Server](https://github.com/ggerganov/llama.cpp)
`mistral` - [Mistral API](https://console.mistral.ai/api-keys/)
`ollama` - [Ollama](https://ollama.com/)
`openai` - [OpenAI API](https://platform.openai.com/)
`vertexai` - [Vertex AI](https://cloud.google.com/vertex-ai)
`xai` - [XAI API](https://x.ai/api)
# Installation
Basic:
> pip install --upgrade toolmate-sdk
Basic installation supports all AI backends mentioned above, except for `vertexai`.
Extras:
We support Vertex AI via [Google GenAI SDK](https://pypi.org/project/google-genai/). As this package supports most platforms, except for Android Termux, we separate this package `google-genai` as an extra. To support Vertex AI with `toolmate-sdk`, install with running:
> pip install --upgrade toolmate-sdk[genai]
# Usage
The main APIs are provided with the function `getChatResponse` in this [file](https://github.com/eliranwong/toolmate-sdk/blob/main/llmsdk/__init__.py#L28). We will add documentation soon.
# Examples
... upcoming ...
# TODO
* add documentation
* add examples
* add `follow_up_prompts` parameter
* add `tool` parameter to function `getChatResponse`
* support built-in tool library
* convert availble ToolMate AI tools into tools that runable with this SDK
* support custom tools
* added built-in system messages
* added built-in predefined contexts
* add cli options for running simple inference, tools or testing
* check backends that use getParameterSchema
* add agent to handle code generation