https://github.com/marklogic/flux
Data movement application for MarkLogic.
https://github.com/marklogic/flux
Last synced: 9 months ago
JSON representation
Data movement application for MarkLogic.
- Host: GitHub
- URL: https://github.com/marklogic/flux
- Owner: marklogic
- License: other
- Created: 2023-12-06T18:06:15.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-17T20:04:32.000Z (about 1 year ago)
- Last Synced: 2024-10-19T12:09:18.138Z (about 1 year ago)
- Language: Java
- Homepage: https://marklogic.github.io/flux/
- Size: 3.69 MB
- Stars: 0
- Watchers: 7
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Codeowners: CODEOWNERS
Awesome Lists containing this project
README
MarkLogic Flux is a single extensible application for all of your data movement use cases with MarkLogic.
Flux supports importing, exporting, copying, and reprocessing data via a simple command-line interface.
Flux can also be easily embedded in your own application to support any flow of data to and from MarkLogic.
With Flux, you can automate common data movement use cases including:
- Importing rows from an RDBMS.
- Importing JSON, XML, CSV, Parquet and other file types from a local filesystem or S3.
- Implementing a data pipeline for a [RAG solution with MarkLogic](https://www.progress.com/marklogic/solutions/generative-ai).
- Copying data from one MarkLogic database to another database.
- Reprocessing data in MarkLogic via custom code.
- Exporting data to an RDBMS, a local filesystem, or S3.
Flux leverages the [MarkLogic Spark connector](https://github.com/marklogic/marklogic-spark-connector) and
[Apache Spark](https://spark.apache.org/) to support a wide variety of data sources and data formats. Current users of
[MarkLogic Content Pump](https://developer.marklogic.com/products/mlcp/) and
[CoRB 2](https://developer.marklogic.com/code/corb/) can easily switch to Flux to support their current data movement needs and also start leveraging
the new data sources and formats that may have required custom development in the past to integrate with
MarkLogic.
You can download the latest release of Flux from [the releases page](https://github.com/marklogic/flux/releases).
For more information, please see [the user guide](https://marklogic.github.io/flux/).
## Support
Flux is maintained by Progress MarkLogic and distributed under the
[Apache 2.0 license](https://github.com/marklogic/flux/blob/LICENSE).
Progress MarkLogic provides technical support for [all releases of Flux](https://github.com/marklogic/flux/releases).
Please visit [our support guide](https://community.progress.com/s/products/marklogic/support-guide) for more
information on technical support.