https://github.com/viveknaskar/triggering-dataflow-pipeline-function
Google Cloud function to trigger cloud-dataflow pipeline when a file is uploaded into a cloud storage bucket
https://github.com/viveknaskar/triggering-dataflow-pipeline-function
google-cloud-dataflow google-cloud-function google-cloud-platform javascript nodejs
Last synced: 9 months ago
JSON representation
Google Cloud function to trigger cloud-dataflow pipeline when a file is uploaded into a cloud storage bucket
- Host: GitHub
- URL: https://github.com/viveknaskar/triggering-dataflow-pipeline-function
- Owner: viveknaskar
- License: cc0-1.0
- Created: 2020-08-22T23:17:54.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2021-06-14T20:29:07.000Z (almost 5 years ago)
- Last Synced: 2025-02-22T07:20:57.529Z (about 1 year ago)
- Topics: google-cloud-dataflow, google-cloud-function, google-cloud-platform, javascript, nodejs
- Language: JavaScript
- Homepage:
- Size: 4.88 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# triggering-dataflow-pipeline-function
## About Google Cloud Function
Google Cloud Functions is a serverless execution environment for building and connecting cloud services. With Cloud Functions, you write simple, single-purpose functions that are attached to events emitted from your cloud infrastructure and services. Your function is triggered when an event being watched is fired. Your code executes in a fully managed environment. There is no need to provision any infrastructure or worry about managing any servers.
## What does it do here?
This cloud function is created to trigger cloud-dataflow pipeline when a file is uploaded into a cloud storage bucket. The function has been written in Node.js while the dataflow is worked on Java.
## Cloud Dataflow pipeline code
https://github.com/viveknaskar/google-dataflow-redis-example
## How does a google cloud function trigger work?
Though in this code I have used nodejs as my main runtime language but just to get the gist of it, below link can clear a lot.
https://thedeveloperstory.com/2020/07/23/triggering-cloud-storage-with-cloud-functions-in-java/