https://github.com/apache/systemds

An open source ML system for the end-to-end data science lifecycle
https://github.com/apache/systemds

dml java python systemds

Last synced: 2 days ago
JSON representation

An open source ML system for the end-to-end data science lifecycle

• Host: GitHub
• URL: https://github.com/apache/systemds
• Owner: apache
• License: apache-2.0
• Created: 2015-11-10T08:00:06.000Z (about 9 years ago)
• Default Branch: main
• Last Pushed: 2024-10-27T16:27:12.000Z (2 months ago)
• Last Synced: 2024-10-29T15:10:40.426Z (2 months ago)
• Topics: dml, java, python, systemds
• Language: Java
• Homepage: https://systemds.apache.org/
• Size: 364 MB
• Stars: 1,033
• Watchers: 89
• Forks: 467
• Open Issues: 42
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Citation: CITATION

Awesome Lists containing this project

README

        


# Apache SystemDS

**Overview:** SystemDS is an open source ML system for the end-to-end data science lifecycle from data integration, cleaning,

and feature engineering, over efficient, local and distributed ML model training, to deployment and serving. To this

end, we aim to provide a stack of declarative languages with R-like syntax for (1) the different tasks of the data-science

lifecycle, and (2) users with different expertise. These high-level scripts are compiled into hybrid execution plans of

local, in-memory CPU and GPU operations, as well as distributed operations on Apache Spark. In contrast to existing

systems - that either provide homogeneous tensors or 2D Datasets - and in order to serve the entire data science lifecycle,

the underlying data model are DataTensors, i.e., tensors (multi-dimensional arrays) whose first dimension may have a

heterogeneous and nested schema.

Resource | Links

---------|------

**Quick Start** | [Install, Quick Start and Hello World](https://apache.github.io/systemds/site/install.html)

**Documentation:** | [SystemDS Documentation](https://apache.github.io/systemds/)

**Python Documentation** | [Python SystemDS Documentation](https://apache.github.io/systemds/api/python/index.html)

**Issue Tracker** | [Jira Dashboard](https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335852)

**Status and Build:** SystemDS is renamed from SystemML which is an **Apache Top Level Project**.

To build from source visit [SystemDS Install from source](https://apache.github.io/systemds/site/install.html)

[![Build](https://github.com/apache/systemds/actions/workflows/build.yml/badge.svg?branch=main)](https://github.com/apache/systemds/actions/workflows/build.yml)

[![Documentation](https://github.com/apache/systemds/actions/workflows/documentation.yml/badge.svg?branch=main)](https://github.com/apache/systemds/actions/workflows/documentation.yml)

[![LicenseCheck](https://github.com/apache/systemds/actions/workflows/license.yml/badge.svg?branch=main)](https://github.com/apache/systemds/actions/workflows/license.yml)

[![Java Tests](https://github.com/apache/systemds/actions/workflows/javaTests.yml/badge.svg?branch=main)](https://github.com/apache/systemds/actions/workflows/javaTests.yml)

[![codecov](https://codecov.io/gh/apache/systemds/graph/badge.svg?token=4YfvX8s6Dz)](https://codecov.io/gh/apache/systemds)

[![Python Test](https://github.com/apache/systemds/actions/workflows/python.yml/badge.svg?branch=main)](https://github.com/apache/systemds/actions/workflows/python.yml)

[![Total PyPI downloads](https://static.pepy.tech/personalized-badge/systemds?units=abbreviation&period=total&left_color=grey&right_color=blue&left_text=Total%20PyPI%20Downloads)](https://pepy.tech/project/systemds)

[![Monthly PyPI downloads](https://static.pepy.tech/personalized-badge/systemds?units=abbreviation&left_color=grey&right_color=blue&left_text=Monthly%20PyPI%20Downloads)](https://pepy.tech/project/systemds)