Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/abeldiress/cohere-cpp
A C++ library providing access to Cohere's API.
https://github.com/abeldiress/cohere-cpp
ai cohere-ai cohere-api cpp17 sdk-cpp
Last synced: about 1 month ago
JSON representation
A C++ library providing access to Cohere's API.
- Host: GitHub
- URL: https://github.com/abeldiress/cohere-cpp
- Owner: abeldiress
- License: mit
- Created: 2024-08-02T01:08:35.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2024-09-28T20:24:38.000Z (about 2 months ago)
- Last Synced: 2024-09-29T23:42:00.319Z (about 2 months ago)
- Topics: ai, cohere-ai, cohere-api, cpp17, sdk-cpp
- Language: C++
- Homepage: https://docs.cohere.com/reference/about
- Size: 208 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Cohere C++ SDK
## Introduction
`cohere-cpp` is an unofficial C++17 library to utilize Cohere's API through [libcurl](https://curl.se/libcurl/) and [nlohmann/json](https://github.com/nlohmann/json). Although still a work in progress, it allows thread-safe access to most API endpoints through only a single header file, `cohere.h`.
## Example
Python, from [Cohere's SDK](https://github.com/cohere-ai/cohere-python?tab=readme-ov-file#usage)
```py
import cohere
co = cohere.Client(
api_key="YOUR_API_KEY",
)
chat = co.chat(
message="hello world!",
model="command"
)
print(chat)
```
C++
```cpp
#include
#include "cohere.h" // only header file necessary
using namespace std;
using namespace cohere;
int main() {
Cohere co{"YOUR_API_KEY"}; // can rewrite to make it more "Pythonic"
Json chat = co.Chat->chat(
"hello world!",
"command"
);
cout << chat.dump() << endl;
}
```
Similar to the Python SDK, you can either provide the key or place it as an enviroment variable name `CO_API_KEY`.
For chat streams, you can perform the following:
```cpp
int main() {
Cohere co("YOUR_API_KEY");
Json chat_stream = co.Chat->chat(
"Tell me about Terry Fox",
"command",
true
);
for (auto &event: chat_stream["stream"]) {
if (event["event_type"] == "text-generation") {
cout << event["text"] << endl;
}
}
}
```
## Endpoint Status
- [x] chat_stream
- [x] chat
- [ ] dataset†
- [x] generate_stream
- [x] generate
- [x] embed
- [x] rerank
- [x] classify
- [x] summarize
- [x] tokenize
- [x] detokenize
- [x] check_api_key
† missing 1 endpoint
Tentative date for preview release binaries: **09/21**
## Future Plans (unordered)
- Encapsulate parameters with easy-to-use enumerations and classes, finish other endpoints.
- Provide support for Cohere's other [supported enviroments](https://docs.cohere.com/docs/cohere-works-everywhere#supported-environments) (Bedrock, Azure, etc.)
- Improve build routine.
- Add the library to vcpkg for easier access.
- The library only covers non-2XX errors. Expand to cover API specifc errors through exception based handling.
- Provide basic documentation for every available endpoint.
## Acknowledgements
- [Everything cURL](https://everything.curl.dev/)
- [Cohere's Python SDK](https://github.com/cohere-ai/cohere-python)
- [OpenAI's Community Maintained Libraries](https://platform.openai.com/docs/libraries/community-libraries)
- [nlohmann::json](https://github.com/nlohmann/json), spectacular library