{"id":22279007,"url":"https://github.com/marklogic/flux","last_synced_at":"2025-03-25T18:25:18.184Z","repository":{"id":249709227,"uuid":"728334300","full_name":"marklogic/flux","owner":"marklogic","description":"Data movement application for MarkLogic. ","archived":false,"fork":false,"pushed_at":"2024-10-17T20:04:32.000Z","size":3870,"stargazers_count":0,"open_issues_count":0,"forks_count":1,"subscribers_count":7,"default_branch":"main","last_synced_at":"2024-10-19T12:09:18.138Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://marklogic.github.io/flux/","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/marklogic.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-06T18:06:15.000Z","updated_at":"2024-10-17T20:04:06.000Z","dependencies_parsed_at":"2024-08-13T07:35:21.756Z","dependency_job_id":"c85e1d51-9534-403b-aaeb-0548cde8cdf2","html_url":"https://github.com/marklogic/flux","commit_stats":null,"previous_names":["marklogic/flux"],"tags_count":13,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marklogic%2Fflux","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marklogic%2Fflux/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marklogic%2Fflux/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/marklogic%2Fflux/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/marklogic","download_url":"https://codeload.github.com/marklogic/flux/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245518293,"owners_count":20628501,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-03T15:17:45.568Z","updated_at":"2025-03-25T18:25:18.155Z","avatar_url":"https://github.com/marklogic.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"MarkLogic Flux is a single extensible application for all of your data movement use cases with MarkLogic.\nFlux supports importing, exporting, copying, and reprocessing data via a simple command-line interface.\nFlux can also be easily embedded in your own application to support any flow of data to and from MarkLogic.\n\nWith Flux, you can automate common data movement use cases including:\n\n- Importing rows from an RDBMS.\n- Importing JSON, XML, CSV, Parquet and other file types from a local filesystem or S3.\n- Implementing a data pipeline for a [RAG solution with MarkLogic](https://www.progress.com/marklogic/solutions/generative-ai).\n- Copying data from one MarkLogic database to another database.\n- Reprocessing data in MarkLogic via custom code.\n- Exporting data to an RDBMS, a local filesystem, or S3.\n\nFlux leverages the [MarkLogic Spark connector](https://github.com/marklogic/marklogic-spark-connector) and\n[Apache Spark](https://spark.apache.org/) to support a wide variety of data sources and data formats. Current users of \n[MarkLogic Content Pump](https://developer.marklogic.com/products/mlcp/) and\n[CoRB 2](https://developer.marklogic.com/code/corb/) can easily switch to Flux to support their current data movement needs and also start leveraging\nthe new data sources and formats that may have required custom development in the past to integrate with \nMarkLogic.\n\nYou can download the latest release of Flux from [the releases page](https://github.com/marklogic/flux/releases).\n\nFor more information, please see [the user guide](https://marklogic.github.io/flux/).\n\n## Support\n\nFlux is maintained by Progress MarkLogic and distributed under the \n[Apache 2.0 license](https://github.com/marklogic/flux/blob/LICENSE). \nProgress MarkLogic provides technical support for [all releases of Flux](https://github.com/marklogic/flux/releases). \nPlease visit [our support guide](https://community.progress.com/s/products/marklogic/support-guide) for more \ninformation on technical support. \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmarklogic%2Fflux","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmarklogic%2Fflux","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmarklogic%2Fflux/lists"}