https://github.com/starnowski/apache-beam-fun
Apache Beam fun
https://github.com/starnowski/apache-beam-fun
Last synced: over 1 year ago
JSON representation
Apache Beam fun
- Host: GitHub
- URL: https://github.com/starnowski/apache-beam-fun
- Owner: starnowski
- Created: 2024-09-19T21:35:10.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-12-20T01:13:48.000Z (over 1 year ago)
- Last Synced: 2025-02-12T14:24:04.983Z (over 1 year ago)
- Language: Java
- Size: 52.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
[](https://github.com/starnowski/apache-beam-fun/actions/workflows/maven.yml)
# apache-beam-fun
Apache Beam fun
### Links
https://beam.apache.org/documentation/basics/
https://beam.apache.org/documentation/programming-guide/#overview
https://beam.apache.org/documentation/pipelines/test-your-pipeline/
### Dataflow links
https://cloud.google.com/composer/docs/how-to/using/writing-dags#airflow-1_1
https://medium.com/@darshan0mehta/how-to-read-file-with-apache-beam-1946d599e480
https://medium.com/@tommanzur/good-practices-in-apache-beam-86e123193a27
https://stackoverflow.com/questions/51439189/how-to-read-large-csv-with-beam
https://beam.apache.org/blog/splittable-do-fn/
https://stackoverflow.com/questions/65842305/scalable-way-to-read-large-numbers-of-files-with-apache-beam
https://beam.apache.org/documentation/patterns/file-processing/