https://github.com/sd2e/uploads-manager
(Mirror) Automatically copies files uploaded to designated TACC S3 buckets to their respective Agave-managed storage resource.
https://github.com/sd2e/uploads-manager
agaveapi metadata reactor s3-bucket
Last synced: about 1 year ago
JSON representation
(Mirror) Automatically copies files uploaded to designated TACC S3 buckets to their respective Agave-managed storage resource.
- Host: GitHub
- URL: https://github.com/sd2e/uploads-manager
- Owner: SD2E
- Created: 2018-12-10T12:42:18.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2019-12-05T20:38:30.000Z (over 6 years ago)
- Last Synced: 2025-01-28T22:51:16.145Z (over 1 year ago)
- Topics: agaveapi, metadata, reactor, s3-bucket
- Language: Python
- Size: 892 KB
- Stars: 0
- Watchers: 7
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Ingest File on Upload
This Reactor responds to upload events by copying the uploaded file from S3 to
the destination configured in the settings document. No path remapping is done.
The Reactor also makes a couple of attempts to grant `READ` to `world` on the
file and any directories created as a consequence of the copy. Finally, it
messages one or more downstream Reactors with the agave-canonical form of the
file path for additional processing.
# Example inbound message
```json
{"uri": "s3://uploads/emerald/201809/protein.png"}
```
## Example outbound message
```json
{"uri": "agave://data-sd2e-community/uploads/emerald/201809/protein.png"}
```