https://github.com/ibmstreams/streamsx.objectstorage
The com.ibm.streamsx.objectstorage toolkit supports Object Storage services with S3 API like IBM Cloud Object Storage service.
https://github.com/ibmstreams/streamsx.objectstorage
ibm-streams object-storage stream-processing toolkit
Last synced: about 1 year ago
JSON representation
The com.ibm.streamsx.objectstorage toolkit supports Object Storage services with S3 API like IBM Cloud Object Storage service.
- Host: GitHub
- URL: https://github.com/ibmstreams/streamsx.objectstorage
- Owner: IBMStreams
- License: other
- Created: 2017-04-04T14:51:01.000Z (about 9 years ago)
- Default Branch: develop
- Last Pushed: 2024-03-11T09:44:37.000Z (over 2 years ago)
- Last Synced: 2024-11-17T17:54:10.394Z (over 1 year ago)
- Topics: ibm-streams, object-storage, stream-processing, toolkit
- Language: Java
- Homepage: https://ibmstreams.github.io/streamsx.objectstorage
- Size: 115 MB
- Stars: 4
- Watchers: 15
- Forks: 7
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# streamsx.objectstorage
The **com.ibm.streamsx.objectstorage** toolkit provides primitive operators and native functions for reading and writing data from and to Object Storage.
This toolkit supports S3 compatible Object Storages and allows developers to write IBM Streams application that interacts with [IBM
Cloud Object Storage](https://cloud.ibm.com/docs/cloud-object-storage).
## Documentation
Find the full documentation [here](https://ibmstreams.github.io/streamsx.objectstorage/).
## Changes
[CHANGELOG.md](com.ibm.streamsx.objectstorage/CHANGELOG.md)
## Quick start with IBM Cloud Object Storage
You'll need:
* An instance of [IBM COS](https://cloud.ibm.com/docs/cloud-object-storage?topic=cloud-object-storage-getting-started-cloud-object-storage).
* An API key from [IBM Cloud Identity and Access Management](https://cloud.ibm.com/docs/cloud-object-storage/iam?topic=cloud-object-storage-iam-overview) with at least `Writer` permissions.
* The ID of the instance of COS that you are working with.
* Token acquisition endpoint
* Service endpoint
These values can be found in the IBM Cloud UI by [generating a 'service credential'](https://cloud.ibm.com/docs/cloud-object-storage?topic=cloud-object-storage-service-credentials) and these credentials shall be stored in an IBM Streams instance application configuration property.
## Streaming Analytics service on IBM Cloud
This toolkit is compatible with the Streaming Analytics service on IBM Cloud.
### Python package
There is a python package available, that exposes SPL operators in the `com.ibm.streamsx.objectstorage` toolkit as Python methods.
* [streamsx.objectstorage python package](https://pypi.org/project/streamsx.objectstorage/)
* [Python package documentation](http://streamsxobjectstorage.readthedocs.io)
### Demo application with integration of other IBM Cloud services
*Event Streams* --> *COS* [Demo](demo/data.historian.event.streams.cos.exactly.once.semantics.demo/README.md)