{"id":13405868,"url":"https://github.com/microsoft/SynapseML","last_synced_at":"2025-03-14T10:31:53.630Z","repository":{"id":37080909,"uuid":"93381875","full_name":"microsoft/SynapseML","owner":"microsoft","description":"Simple and Distributed Machine Learning","archived":false,"fork":false,"pushed_at":"2024-05-21T16:05:57.000Z","size":145577,"stargazers_count":4986,"open_issues_count":349,"forks_count":819,"subscribers_count":146,"default_branch":"master","last_synced_at":"2024-05-21T21:55:05.878Z","etag":null,"topics":["ai","apache-spark","azure","big-data","cognitive-services","data-science","databricks","deep-learning","http","lightgbm","machine-learning","microsoft","ml","model-deployment","onnx","opencv","pyspark","scala","spark","synapse"],"latest_commit_sha":null,"homepage":"http://aka.ms/spark","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/microsoft.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":"CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-06-05T08:23:44.000Z","updated_at":"2024-05-28T23:16:03.286Z","dependencies_parsed_at":"2023-09-22T08:27:24.616Z","dependency_job_id":"9b965a2b-3270-496e-b25a-8b8a6dd734bd","html_url":"https://github.com/microsoft/SynapseML","commit_stats":{"total_commits":1555,"total_committers":123,"mean_commits":"12.642276422764228","dds":0.7183279742765274,"last_synced_commit":"9b008b58ae84eb58772c00650492919686ef2c05"},"previous_names":["azure/mmlspark"],"tags_count":80,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2FSynapseML","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2FSynapseML/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2FSynapseML/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/microsoft%2FSynapseML/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/microsoft","download_url":"https://codeload.github.com/microsoft/SynapseML/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221458243,"owners_count":16825277,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","apache-spark","azure","big-data","cognitive-services","data-science","databricks","deep-learning","http","lightgbm","machine-learning","microsoft","ml","model-deployment","onnx","opencv","pyspark","scala","spark","synapse"],"created_at":"2024-07-30T19:02:14.351Z","updated_at":"2025-03-14T10:31:53.621Z","avatar_url":"https://github.com/microsoft.png","language":"Scala","readme":"![SynapseML](https://mmlspark.azureedge.net/icons/mmlspark.svg)\n\n# Synapse Machine Learning\n\nSynapseML (previously known as MMLSpark), is an open-source library that simplifies the creation of massively scalable machine learning (ML) pipelines. SynapseML provides simple, composable, and distributed APIs for a wide variety of different machine learning tasks such as text analytics, vision, anomaly detection, and many others. SynapseML is built on the [Apache Spark distributed computing framework](https://spark.apache.org/) and shares the same API as the [SparkML/MLLib library](https://spark.apache.org/mllib/), allowing you to seamlessly embed SynapseML models into existing Apache Spark workflows.\n\nWith SynapseML, you can build scalable and intelligent systems to solve challenges in domains such as anomaly detection, computer vision, deep learning, text analytics, and others. SynapseML can train and evaluate models on single-node, multi-node, and elastically resizable clusters of computers. This lets you scale your work without wasting resources. SynapseML is usable across Python, R, Scala, Java, and .NET. Furthermore, its API abstracts over a wide variety of databases, file systems, and cloud data stores to simplify experiments no matter where data is located.\n\nSynapseML requires Scala 2.12, Spark 3.4+, and Python 3.8+.   \n\n| Topics  | Links                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |\n| :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |\n| Build   | [![Build Status](https://msdata.visualstudio.com/A365/_apis/build/status/microsoft.SynapseML?branchName=master)](https://msdata.visualstudio.com/A365/_build/latest?definitionId=17563\u0026branchName=master) [![codecov](https://codecov.io/gh/Microsoft/SynapseML/branch/master/graph/badge.svg)](https://codecov.io/gh/Microsoft/SynapseML) [![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)                     |\n| Version | [![Version](https://img.shields.io/badge/version-1.0.10-blue)](https://github.com/Microsoft/SynapseML/releases) [![Release Notes](https://img.shields.io/badge/release-notes-blue)](https://github.com/Microsoft/SynapseML/releases) [![Snapshot Version](https://mmlspark.blob.core.windows.net/icons/badges/master_version3.svg)](#sbt)                                                                                                                                       |\n| Docs    | [![Website](https://img.shields.io/badge/SynapseML-Website-blue)](https://aka.ms/spark) [![Scala Docs](https://img.shields.io/static/v1?label=api%20docs\u0026message=scala\u0026color=blue\u0026logo=scala)](https://mmlspark.blob.core.windows.net/docs/1.0.10/scala/index.html#package) [![PySpark Docs](https://img.shields.io/static/v1?label=api%20docs\u0026message=python\u0026color=blue\u0026logo=python)](https://mmlspark.blob.core.windows.net/docs/1.0.10/pyspark/index.html) [![Academic Paper](https://img.shields.io/badge/academic-paper-7fdcf7)](https://arxiv.org/abs/1810.08744) |\n| Support | [![Gitter](https://badges.gitter.im/Microsoft/MMLSpark.svg)](https://gitter.im/Microsoft/MMLSpark?utm_source=badge\u0026utm_medium=badge\u0026utm_campaign=pr-badge) [![Mail](https://img.shields.io/badge/mail-synapseml--support-brightgreen)](mailto:synapseml-support@microsoft.com)                                                                                                                                                                                                  |\n| Binder  | [![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/microsoft/SynapseML/v1.0.10?labpath=notebooks%2Ffeatures)                                                                                                                                                                                                                                                                                                                                           |\n| Usage | [![Downloads](https://static.pepy.tech/badge/synapseml)](https://pepy.tech/project/synapseml) |\n\u003c!-- markdownlint-disable MD033 --\u003e\n\u003cdetails open\u003e\n\u003csummary\u003e\n\u003cstrong\u003e\u003cem\u003eTable of Contents\u003c/em\u003e\u003c/strong\u003e\n\u003c/summary\u003e\n\n- [Synapse Machine Learning](#synapse-machine-learning)\n  - [Features](#features)\n  - [Documentation and Examples](#documentation-and-examples)\n  - [Setup and installation](#setup-and-installation)\n    - [Synapse Analytics](#synapse-analytics)\n    - [Databricks](#databricks)\n    - [Microsoft Fabric](#microsoft-fabric)\n    - [Python Standalone](#python-standalone)\n    - [Spark Submit](#spark-submit)\n    - [SBT](#sbt)\n    - [Apache Livy and HDInsight](#apache-livy-and-hdinsight)\n    - [Docker](#docker)\n    - [R](#r)\n    - [C# (.NET)](#c-net)\n    - [Building from source](#building-from-source)\n  - [Papers](#papers)\n  - [Learn More](#learn-more)\n  - [Contributing \\\u0026 feedback](#contributing--feedback)\n  - [Other relevant projects](#other-relevant-projects)\n\n\u003c/details\u003e\n\u003c!-- markdownlint-enable MD033 --\u003e\n\n## Features\n\n\u003c!-- markdownlint-disable MD033 --\u003e\n| \u003cimg width=\"800\" src=\"https://mmlspark.blob.core.windows.net/graphics/Readme/vw-blue-dark-orange.svg\"\u003e |                     \u003cimg width=\"800\"  src=\"https://mmlspark.blob.core.windows.net/graphics/Readme/cog_services_on_spark_2.svg\"\u003e                     | \u003cimg width=\"800\"  src=\"https://mmlspark.blob.core.windows.net/graphics/Readme/decision_tree_recolor.png\"\u003e | \u003cimg width=\"800\" src=\"https://mmlspark.blob.core.windows.net/graphics/Readme/mmlspark_serving_recolor.svg\"\u003e |\n| :----------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------: | :---------------------------------------------------------------------------------------------------------: |\n|      [**Vowpal Wabbit on Spark**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/Vowpal%20Wabbit/Overview/)       | [**The Cognitive Services for Big Data**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/AI%20Services/Overview/) |       [**LightGBM on Spark**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/LightGBM/Overview/)        |        [**Spark Serving**](https://microsoft.github.io/SynapseML/docs/Deploy%20Models/Overview/)        |\n|                               Fast, Sparse, and Effective Text Analytics                               |                        Leverage the Microsoft Cognitive Services at Unprecedented Scales in your existing SparkML pipelines                         |                               Train Gradient Boosted Machines with LightGBM                               |                  Serve any Spark Computation as a Web Service with Sub-Millisecond Latency                  |\n\n|                     \u003cimg width=\"800\" src=\"https://mmlspark.blob.core.windows.net/graphics/Readme/microservice_recolor.png\"\u003e                      | \u003cimg width=\"800\" src=\"https://mmlspark.blob.core.windows.net/graphics/emails/onnxai-ar21_crop.svg\"\u003e |                  \u003cimg width=\"800\"  src=\"https://mmlspark.blob.core.windows.net/graphics/emails/scales.svg\"\u003e                   |              \u003cimg width=\"800\"  src=\"https://mmlspark.blob.core.windows.net/graphics/Readme/bindings.png\"\u003e               |\n| :----------------------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------: | :---------------------------------------------------------------------------------------------------------------------------: |:-----------------------------------------------------------------------------------------------------------------------:|\n| [**HTTP on Spark**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/AI%20Services/Overview/#arbitrary-web-apis) |        [**ONNX on Spark**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/Deep%20Learning/ONNX/)         | [**Responsible AI**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/Responsible%20AI/Interpreting%20Model%20Predictions/) |                                          [**Spark Binding Autogeneration**](https://microsoft.github.io/SynapseML/docs/Reference/Developer%20Setup/#packagepython)                                           |\n|                       An Integration Between Spark and the HTTP Protocol, enabling Distributed Microservice Orchestration                        |                    Distributed and Hardware Accelerated Model Inference on Spark                    |                                    Understand Opaque-box Models and Measure Dataset Biases                                    |                             Automatically Generate Spark bindings for PySpark and SparklyR                              |\n\n|                 \u003cimg width=\"150\" src=\"https://mmlspark.blob.core.windows.net/graphics/emails/isolation forest 3.svg\"\u003e                 |                          \u003cimg width=\"150\" src=\"https://mmlspark.blob.core.windows.net/graphics/emails/cyberml.svg\"\u003e                           |                     \u003cimg width=\"150\" src=\"https://mmlspark.blob.core.windows.net/graphics/emails/conditional_knn.svg\"\u003e                     |\n| :-----------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------------------------: | :----------------------------------------------------------------------------------------------------------------------------------------: |\n| [**Isolation Forest on Spark**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/Anomaly%20Detection/Quickstart%20-%20Isolation%20Forests/) | [**CyberML**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/Other%20Algorithms/Cyber%20ML/) | [**Conditional KNN**](https://microsoft.github.io/SynapseML/docs/Explore%20Algorithms/Other%20Algorithms/Quickstart%20-%20Exploring%20Art%20Across%20Cultures/) |\n|                                                Distributed Nonlinear Outlier Detection                                                |                                                   Machine Learning Tools for Cyber Security                                                   |                                                Scalable KNN Models with Conditional Queries                                                |\n\u003c!-- markdownlint-enable MD033 --\u003e\n\n## Documentation and Examples\n\nFor quickstarts, documentation, demos, and examples please see our [website](https://aka.ms/spark).\n\n## Setup and installation\n\nFirst select the correct platform that you are installing SynapseML into:\n\u003c!--ts--\u003e\n- [Microsoft Fabric](#microsoft-fabric)\n- [Synapse Analytics](#synapse-analytics)\n- [Databricks](#databricks)\n- [Python Standalone](#python-standalone)\n- [Spark Submit](#spark-submit)\n- [SBT](#sbt)\n- [Apache Livy and HDInsight](#apache-livy-and-hdinsight)\n- [Docker](#docker)\n- [R](#r)\n- [Building from source](#building-from-source)\n\u003c!--te--\u003e\n\n\n\n### Microsoft Fabric\n\nIn Microsoft Fabric notebooks SynapseML is already installed. To change the version please place the following in the first cell of your notebook.\n\n\n```bash\n%%configure -f\n{\n  \"name\": \"synapseml\",\n  \"conf\": {\n      \"spark.jars.packages\": \"com.microsoft.azure:synapseml_2.12:\u003cTHE_SYNAPSEML_VERSION_YOU_WANT\u003e\",\n      \"spark.jars.repositories\": \"https://mmlspark.azureedge.net/maven\",\n      \"spark.jars.excludes\": \"org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind\",\n      \"spark.yarn.user.classpath.first\": \"true\",\n      \"spark.sql.parquet.enableVectorizedReader\": \"false\"\n  }\n}\n```\n\n\n\n\n### Synapse Analytics\n\nIn Azure Synapse notebooks please place the following in the first cell of your notebook. \n\n- For Spark 3.4 Pools:\n\n```bash\n%%configure -f\n{\n  \"name\": \"synapseml\",\n  \"conf\": {\n      \"spark.jars.packages\": \"com.microsoft.azure:synapseml_2.12:1.0.10\",\n      \"spark.jars.repositories\": \"https://mmlspark.azureedge.net/maven\",\n      \"spark.jars.excludes\": \"org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind\",\n      \"spark.yarn.user.classpath.first\": \"true\",\n      \"spark.sql.parquet.enableVectorizedReader\": \"false\"\n  }\n}\n```\n\n- For Spark 3.3 Pools:\n\n```bash\n%%configure -f\n{\n  \"name\": \"synapseml\",\n  \"conf\": {\n      \"spark.jars.packages\": \"com.microsoft.azure:synapseml_2.12:0.11.4-spark3.3\",\n      \"spark.jars.repositories\": \"https://mmlspark.azureedge.net/maven\",\n      \"spark.jars.excludes\": \"org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind\",\n      \"spark.yarn.user.classpath.first\": \"true\",\n      \"spark.sql.parquet.enableVectorizedReader\": \"false\"\n  }\n}\n```\n\n\n\nTo install at the pool level instead of the notebook level [add the spark properties listed above to the pool configuration](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/how-to-set-spark-pyspark-custom-configs-in-synapse-workspace/ba-p/2114434).\n\n### Databricks\n\nTo install SynapseML on the [Databricks\ncloud](http://community.cloud.databricks.com), create a new [library from Maven\ncoordinates](https://docs.databricks.com/user-guide/libraries.html#libraries-from-maven-pypi-or-spark-packages)\nin your workspace.\n\nFor the coordinates use: `com.microsoft.azure:synapseml_2.12:1.0.10`\nwith the resolver: `https://mmlspark.azureedge.net/maven`. Ensure this library is\nattached to your target cluster(s).\n\nFinally, ensure that your Spark cluster has at least Spark 3.2 and Scala 2.12. If you encounter Netty dependency issues please use DBR 10.1.\n\nYou can use SynapseML in both your Scala and PySpark notebooks. To get started with our example notebooks import the following databricks archive:\n\n`https://mmlspark.blob.core.windows.net/dbcs/SynapseMLExamplesv1.0.10.dbc`\n\n### Python Standalone\n\nTo try out SynapseML on a Python (or Conda) installation you can get Spark\ninstalled via pip with `pip install pyspark`.  You can then use `pyspark` as in\nthe above example, or from python:\n\n```python\nimport pyspark\nspark = pyspark.sql.SparkSession.builder.appName(\"MyApp\") \\\n            .config(\"spark.jars.packages\", \"com.microsoft.azure:synapseml_2.12:1.0.10\") \\\n            .getOrCreate()\nimport synapse.ml\n```\n\n### Spark Submit\n\nSynapseML can be conveniently installed on existing Spark clusters via the\n`--packages` option, examples:\n\n```bash\nspark-shell --packages com.microsoft.azure:synapseml_2.12:1.0.10\npyspark --packages com.microsoft.azure:synapseml_2.12:1.0.10\nspark-submit --packages com.microsoft.azure:synapseml_2.12:1.0.10 MyApp.jar\n```\n\n### SBT\n\nIf you are building a Spark application in Scala, add the following lines to\nyour `build.sbt`:\n\n```scala\nlibraryDependencies += \"com.microsoft.azure\" % \"synapseml_2.12\" % \"1.0.10\"\n```\n\n### Apache Livy and HDInsight\n\nTo install SynapseML from within a Jupyter notebook served by Apache Livy the following configure magic can be used. You will need to start a new session after this configure cell is executed.\n\nExcluding certain packages from the library may be necessary due to current issues with Livy 0.5.\n\n```bash\n%%configure -f\n{\n    \"name\": \"synapseml\",\n    \"conf\": {\n        \"spark.jars.packages\": \"com.microsoft.azure:synapseml_2.12:1.0.10\",\n        \"spark.jars.excludes\": \"org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind\"\n    }\n}\n```\n\n### Docker\n\nThe easiest way to evaluate SynapseML is via our pre-built Docker container.  To\ndo so, run the following command:\n\n```bash\ndocker run -it -p 8888:8888 -e ACCEPT_EULA=yes mcr.microsoft.com/mmlspark/release jupyter notebook\n```\n\nNavigate to \u003chttp://localhost:8888/\u003e in your web browser to run the sample\nnotebooks.  See the [documentation](https://microsoft.github.io/SynapseML/docs/Reference/Docker%20Setup/) for more on Docker use.\n\n\u003e To read the EULA for using the docker image, run `docker run -it -p 8888:8888 mcr.microsoft.com/mmlspark/release eula`\n\n### R\n\nTo try out SynapseML using the R autogenerated wrappers [see our\ninstructions](https://microsoft.github.io/SynapseML/docs/Reference/R%20Setup/).  Note: This feature is still under development\nand some necessary custom wrappers may be missing.\n\n### Building from source\n\nSynapseML has recently transitioned to a new build infrastructure.\nFor detailed developer docs please see the [Developer Readme](https://microsoft.github.io/SynapseML/docs/Reference/Developer%20Setup/)\n\nIf you are an existing synapsemldeveloper, you will need to reconfigure your\ndevelopment setup. We now support platform independent development and\nbetter integrate with intellij and SBT.\n If you encounter issues please reach out to our support email! \n\n## Papers\n\n- [Large Scale Intelligent Microservices](https://arxiv.org/abs/2009.08044)\n\n- [Conditional Image Retrieval](https://arxiv.org/abs/2007.07177)\n\n- [MMLSpark: Unifying Machine Learning Ecosystems at Massive Scales](https://arxiv.org/abs/1810.08744)\n\n- [Flexible and Scalable Deep Learning with SynapseML](https://arxiv.org/abs/1804.04031)\n\n- [Large-Scale Automatic Audiobook Creation](https://arxiv.org/abs/2309.03926) \n\n## Learn More\n\n- Visit our [website].\n\n- Watch our keynote demos at [the Spark+AI Summit 2019], [the Spark+AI European Summit 2018], [the Spark+AI Summit 2018] and [SynapseML at the Spark Summit].\n\n- See how SynapseML is used to [help endangered species].\n\n- Explore generative adversarial artwork in [our collaboration with The MET and MIT].\n\n- Explore [our collaboration with Apache Spark] on image analysis.\n\n[website]: https://microsoft.github.io/SynapseML/ \"aka.ms/spark\"\n\n[the Spark+AI Summit 2018]: https://databricks.com/sparkaisummit/north-america/spark-summit-2018-keynotes#Intelligent-cloud \"Developing for the Intelligent Cloud and Intelligent Edge\"\n\n[the Spark+AI Summit 2019]: https://youtu.be/T_fs4C0aqD0?t=425\n\n[the Spark+AI European Summit 2018]: https://youtu.be/N3ozCZXeOeU?t=472\n\n[help endangered species]: https://www.microsoft.com/en-us/ai/ai-lab-stories?activetab=pivot1:primaryr3 \"Identifying snow leopards with AI\"\n\n[our collaboration with The MET and MIT]: https://www.microsoft.com/en-us/ai/ai-lab-stories?activetab=pivot1:primaryr4 \"Generative art at the MET\"\n\n[our collaboration with Apache Spark]: https://blogs.technet.microsoft.com/machinelearning/2018/03/05/image-data-support-in-apache-spark/ \"Image Data Support in Apache Spark\"\n\n[SynapseML at the Spark Summit]: https://databricks.com/session/mmlspark-lessons-from-building-a-sparkml-compatible-machine-learning-library-for-apache-spark \"MMLSpark: Lessons from Building a SparkML-Compatible Machine Learning Library for Apache Spark\"\n\n## Contributing \u0026 feedback\n\nThis project has adopted the [Microsoft Open Source Code of Conduct].  For more\ninformation see the [Code of Conduct FAQ] or contact\n[opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional\nquestions or comments.\n\n[Microsoft Open Source Code of Conduct]: https://opensource.microsoft.com/codeofconduct/\n\n[Code of Conduct FAQ]: https://opensource.microsoft.com/codeofconduct/faq/\n\nSee [CONTRIBUTING.md](CONTRIBUTING.md) for contribution guidelines.\n\nTo give feedback and/or report an issue, open a [GitHub\nIssue](https://help.github.com/articles/creating-an-issue/).\n\n## Other relevant projects\n\n- [Vowpal Wabbit](https://github.com/VowpalWabbit/vowpal_wabbit)\n\n- [LightGBM](https://github.com/Microsoft/LightGBM)\n\n- [DMTK: Microsoft Distributed Machine Learning Toolkit](https://github.com/Microsoft/DMTK)\n\n- [Recommenders](https://github.com/recommenders-team/Recommenders)\n\n- [JPMML-SparkML plugin for converting SynapseML LightGBM models to PMML](https://github.com/alipay/jpmml-sparkml-lightgbm)\n\n- [Microsoft Cognitive Toolkit](https://github.com/Microsoft/CNTK)\n\n_Apache®, Apache Spark, and Spark® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries._\n","funding_links":[],"categories":["Scala","Repositories","分布式机器学习","Official","Uncategorized","Machine Learning Framework","Tools","Repos","人工智能"],"sub_categories":["Tools \u0026 Samples","Official Repositories and Tools","Uncategorized","General Purpose Framework"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmicrosoft%2FSynapseML","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmicrosoft%2FSynapseML","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmicrosoft%2FSynapseML/lists"}