https://github.com/Hydrospheredata/mist
Serverless proxy for Spark cluster
https://github.com/Hydrospheredata/mist
apache-spark api big-data serverless
Last synced: 8 months ago
JSON representation
Serverless proxy for Spark cluster
- Host: GitHub
- URL: https://github.com/Hydrospheredata/mist
- Owner: Hydrospheredata
- License: apache-2.0
- Created: 2016-01-15T07:22:05.000Z (almost 10 years ago)
- Default Branch: master
- Last Pushed: 2020-10-29T16:47:24.000Z (about 5 years ago)
- Last Synced: 2024-10-19T03:39:05.273Z (about 1 year ago)
- Topics: apache-spark, api, big-data, serverless
- Language: Scala
- Homepage: http://hydrosphere.io/mist/
- Size: 9.96 MB
- Stars: 326
- Watchers: 39
- Forks: 68
- Open Issues: 31
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
- awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / [Tools](#tools-1))
- awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / Speech Recognition)
- awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java)
- awesome-production-machine-learning - Hydrosphere Mist - Serverless proxy for Apache Spark clusters (Function as a Service Frameworks)
- awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
- fucking-awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / [Tools](#tools-1))
- fucking-awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
- fucking-awesome-datascience - Hydrosphere Mist
- awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / [Tools](#tools-1))
- awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
- awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / Speech Recognition)
- A-curated-list-of-awesome-big-data-frameworks-ressources-and-other-awesomeness.- - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
- data-engineering-collection - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
- awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / [Tools](#tools-1))
- awesome-datascience - Hydrosphere Mist
- awesome-advanced-metering-infrastructure - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Java / Speech Recognition)
- awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
README
[](https://ci.hydrosphere.io/job/hydrosphere.io/job/mist/job/master/)
[](https://travis-ci.org/Hydrospheredata)
[](https://maven-badges.herokuapp.com/maven-central/io.hydrosphere/mist-lib_2.11/)
[](https://img.shields.io/docker/pulls/hydrosphere/mist.svg)
# Hydrosphere Mist
[](https://gitter.im/Hydrospheredata/mist?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)
[Hydrosphere](http://hydrosphere.io) Mist is a serverless proxy for Spark cluster.
Mist provides a new functional programming framework and deployment model for Spark applications.
Please see our [quick start guide](https://hydrosphere.io/mist-docs/quick_start.html) and [documentation](https://hydrosphere.io/mist-docs/)
Features:
* **Spark Function as a Service**. Deploy Spark functions rather than notebooks or scripts.
* Spark Cluster and Session management. Fully managed Spark sessions backed by on-demand EMR, Hortonworks, Cloudera, DC/OS and vanilla Spark clusters.
* **Typesafe** programming framework that clearly defines inputs and outputs of every Spark job.
* **REST** HTTP & Messaging (MQTT, Kafka) API for Scala & Python Spark jobs.
* Multi-cluster mode: Seamless Spark cluster on-demand provisioning, autoscaling and termination(**pending**)
It creates a unified API layer for building enterprise solutions and microservices on top of a Spark functions.
## High Level Architecture
## Contact
Please report bugs/problems to:
.
[LinkedIn](https://www.linkedin.com/company/hydrospherebigdata)
[Facebook](https://www.facebook.com/hydrosphere.io/)
[Twitter](https://twitter.com/hydrospheredata)