Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/aqueducthq/aqueduct
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
https://github.com/aqueducthq/aqueduct
ai data data-science kubernetes llm llms machine-learning ml ml-infrastructure ml-monitoring mlops orchestration python python3
Last synced: 3 months ago
JSON representation
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
- Host: GitHub
- URL: https://github.com/aqueducthq/aqueduct
- Owner: RunLLM
- License: apache-2.0
- Created: 2022-05-27T03:07:09.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-06-07T19:24:59.000Z (over 1 year ago)
- Last Synced: 2024-05-23T02:38:56.789Z (6 months ago)
- Topics: ai, data, data-science, kubernetes, llm, llms, machine-learning, ml, ml-infrastructure, ml-monitoring, mlops, orchestration, python, python3
- Language: Go
- Homepage: https://aqueducthq.com
- Size: 22 MB
- Stars: 522
- Watchers: 9
- Forks: 17
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
- awesome-llmops - aqueduct - Source Platform for Production Data Science |  | (Large Scale Deployment / Workflow)
README
Run LLMs and ML on any cloud infrastructure
### 📢 [Slack](https://slack.aqueducthq.com) | 🗺️ [Roadmap](https://roadmap.aqueducthq.com) | 🐞 [Report a bug](https://github.com/aqueducthq/aqueduct/issues/new?assignees=&labels=bug&template=bug_report.md&title=%5BBUG%5D) | ✍️ [Blog](https://blog.aqueducthq.com)
[](https://github.com/codespaces/new?hide_repo_select=true&ref=main&repo=496844646)
[](https://pypi.org/project/aqueduct-ml/)
[](https://join.slack.com/t/aqueductusers/shared_invite/zt-11hby91cx-cpmgfK0qfXqEYXv25hqD6A)
[](https://github.com/aqueducthq/aqueduct/blob/master/LICENSE)
[](https://pypi.org/project/aqueduct-ml/)
[](https://github.com/aqueducthq/aqueduct/actions/workflows/integration-tests.yml)
**Aqueduct is an MLOps framework that allows you to define and deploy machine learning and LLM workloads on any cloud infrastructure. [Check out our quickstart guide! →](https://docs.aqueducthq.com/quickstart-guide)**
Aqueduct is an open-source MLOps framework that allows you to write code in vanilla Python, run that code on any cloud infrastructure you'd like to use, and gain visibility into the execution and performance of your models and predictions. **[See what infrastructure Aqueduct works with. →](https://aqueducthq.com/integrations/)**
Here's how you can get started:
```bash
pip3 install aqueduct-ml
aqueduct start
```
### How it works
Aqueduct's Python native API allows you to define ML tasks in regular Python code. You can connect Aqueduct to your existing cloud infrastructure ([docs](https://docs.aqueducthq.com/integrations)), and Aqueduct will seamlessly move your code from your laptop to the cloud or between different cloud infrastructure layers.
For example, we can define a pipeline that trains a model on Kubernetes using a GPU and validates that model in AWS Lambda in a few lines of Python:
```python
# Use an existing LLM.
vicuna = aq.llm_op('vicuna_7b', engine='eks-us-east-2')
features = vicuna(
raw_logs,
{
"prompt":
"Turn this log entry into a CSV: {text}"
}
)
# Or write a custom op on your favorite infrastructure!
@op(
engine='kubernetes',
# Get a GPU.
resources={'gpu_resource_name': 'nvidia.com/gpu'}
)
def train(featurized_logs):
return model.train(features) # Train your model.
train(features)
```
Once you publish this workflow to Aqueduct, you can see it on the UI:
To see how to build your first workflow, check out our **[quickstart guide! →](https://docs.aqueducthq.com/quickstart-guide)**
## Why Aqueduct?
MLOps has become a [tangled mess of siloed infrastructure](https://aqueducthq.com/post/the-mlops-knot/). Most teams need to set up and operate many different cloud infrastructure tools to run ML effectively, but these tools have disparate APIs and interoperate poorly.
Aqueduct provides a single interface to running machine learning tasks on your existing cloud infrastructure — Kubernetes, Spark, Lambda, etc. From the same Python API, you can run code across any or all of these systems seamlessly and gain visibility into how your code is performing.
* **Python-native pipeline API**: Aqueduct’s API allows you define your workflows in vanilla Python, so you can get code into production quickly and effectively. No more DSLs or YAML configs to worry about.
* **Integrated with your infrastructure**: Workflows defined in Aqueduct can run on any cloud infrastructure you use, like Kubernetes, Spark, Airflow, or AWS Lambda. You can get all the benefits of Aqueduct without having to rip-and-replace your existing tooling.
* **Centralized visibility into code, data, & metadata**: Once your workflows are in production, you need to know what’s running, whether it’s working, and when it breaks. Aqueduct gives you visibility into what code, data, metrics, and metadata are generated by each workflow run, so you can have confidence that your pipelines work as expected — and know immediately when they don’t.
* **Runs securely in your cloud**: Aqueduct is fully open-source and runs in any Unix environment. It runs entirely in your cloud and on your infrastructure, so you can be confident that your data and code are secure.
## Overview & Examples
The core abstraction in Aqueduct is a [Workflow](https://docs.aqueducthq.com/workflows), which is a sequence of [Artifacts](https://docs.aqueducthq.com/artifacts) (data) that are transformed by [Operators](https://docs.aqueducthq.com/operators) (compute).
The input Artifact(s) for a Workflow is typically loaded from a database, and the output Artifact(s) are typically persisted back to a database.
Each Workflow can either be run on a fixed schedule or triggered on-demand.
To see Aqueduct in action on some real-world machine learning workflows, check out some of our examples:
* [Churn Ensemble](https://github.com/aqueducthq/aqueduct/blob/main/examples/churn_prediction/Customer%20Churn%20Prediction.ipynb)
* [Sentiment Analysis](https://github.com/aqueducthq/aqueduct/blob/main/examples/sentiment-analysis/Sentiment%20Model.ipynb)
* [Impute Missing Wine Data](https://github.com/aqueducthq/aqueduct/blob/main/examples/wine-ratings-prediction/Predict%20Missing%20Wine%20Ratings.ipynb)
* ... [and more](https://github.com/aqueducthq/aqueduct/tree/main/examples)!
## What's next?
Check out our [documentation](https://docs.aqueducthq.com/), where you'll find:
* a [Quickstart Guide](https://docs.aqueducthq.com/quickstart-guide)
* [example workflows](https://docs.aqueducthq.com/example-workflows)
* and more details on [creating workflows](https://docs.aqueducthq.com/workflows)
If you have questions or comments or would like to learn more about what we're
building, please [reach out](mailto:[email protected]), [join our Slack
channel](https://join.slack.com/t/aqueductusers/shared_invite/zt-11hby91cx-cpmgfK0qfXqEYXv25hqD6A), or [start a conversation on GitHub](https://github.com/aqueducthq/aqueduct/issues/new).
We'd love to hear from you!
If you're interested in contributing, please check out our [roadmap](https://roadmap.aqueducthq.com) and join the development channel in [our community Slack](https://slack.aqueducthq.com).