Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/sanderploegsma/beam-di

Dependency Injection in Apache Beam
https://github.com/sanderploegsma/beam-di

apache-beam dependency-injection

Last synced: 8 days ago
JSON representation

Dependency Injection in Apache Beam

Awesome Lists containing this project

README

        

# Dependency Injection in Apache Beam
This is an example implementation of the Dependency Injection approach as described in https://www.tikalk.com/posts/2017/05/24/apache-beam-testing/

### Caveats
It seems to be impossible to combine this approach with Apache Beam's `TestPipeline`, so you cannot use `PAssert` anywhere. This is because any `PipelineOptions` you pass to the `TestPipeline` are not used directly, but serialized and deserialized instead (I guess).

If you happen to know how to solve this, feel free to let me know in the issues.