https://github.com/analysiscenter/batchflow

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
https://github.com/analysiscenter/batchflow

data-science machine-learning pipeline pipeline-framework python python3 workflow workflow-engine

Last synced: about 1 month ago
JSON representation

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

• Host: GitHub
• URL: https://github.com/analysiscenter/batchflow
• Owner: analysiscenter
• License: apache-2.0
• Created: 2017-03-13T14:22:53.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2024-05-18T11:51:55.000Z (4 months ago)
• Last Synced: 2024-05-18T12:46:52.687Z (4 months ago)
• Topics: data-science, machine-learning, pipeline, pipeline-framework, python, python3, workflow, workflow-engine
• Language: Python
• Homepage: https://analysiscenter.github.io/batchflow/
• Size: 151 MB
• Stars: 196
• Watchers: 14
• Forks: 46
• Open Issues: 37
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• best-of-python - GitHub - 29% open · ⏱️ 18.05.2024): (Data Pipelines & Streaming)
• awesome-production-machine-learning - BatchFlow - BatchFlow helps data scientists conveniently work with random or sequential batches of your data and define data processing and machine learning workflows for large datasets. (Data Pipeline)
• awesome-python-machine-learning-resources - GitHub - 28% open · ⏱️ 03.08.2022): (数据管道和流处理)