Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/Hydrospheredata/mist

Serverless proxy for Spark cluster
https://github.com/Hydrospheredata/mist

apache-spark api big-data serverless

Last synced: about 1 month ago
JSON representation

Serverless proxy for Spark cluster

Host: GitHub
URL: https://github.com/Hydrospheredata/mist
Owner: Hydrospheredata
License: apache-2.0
Created: 2016-01-15T07:22:05.000Z (over 8 years ago)
Default Branch: master
Last Pushed: 2020-10-29T16:47:24.000Z (over 3 years ago)
Last Synced: 2024-04-14T07:52:52.113Z (2 months ago)
Topics: apache-spark, api, big-data, serverless
Language: Scala
Homepage: http://hydrosphere.io/mist/
Size: 9.96 MB
Stars: 326
Watchers: 41
Forks: 67
Open Issues: 31
Metadata Files:
- Readme: README.md
- License: LICENSE

Lists

awesome-datascience - Hydrosphere Mist
awesome-spark - Mist - commit/Hydrospheredata/mist.svg"> - Service for exposing Spark analytical jobs and machine learning models as realtime, batch or reactive web services. (Packages / Middleware)
data-engineering-collection - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
awesome-production-machine-learning - Hydrosphere Mist - Serverless proxy for Apache Spark clusters (Function as a Service Frameworks)
Awesome-AIML-Data-Ops - Hydrosphere Mist - Serverless proxy for Apache Spark clusters (Function as a Service Frameworks)
awesome-production-machine-learning - Hydrosphere Mist - Serverless proxy for Apache Spark clusters (Function as a Service Frameworks)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
awesome-stars - Hydrospheredata/mist - Serverless proxy for Spark cluster (Scala)
awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
awesome-machine-learnings - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
Data-Science-academic---awesome-datascience - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Toolboxes - Environment)
awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
AI - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
A-curated-list-of-awesome-big-data-frameworks-ressources-and-other-awesomeness.- - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
awesome-datascience - Hydrosphere Mist
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-advanced-metering-infrastructure - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Python / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-datascience - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Toolboxes - Environment)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-spark - Mist - commit/Hydrospheredata/mist.svg"> - Service for exposing Spark analytical jobs and machine learning models as realtime, batch or reactive web services. (Packages / Middleware)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning-library - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-bigdata - Hydrosphere Mist - a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services. (Service Programming)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)
awesome-machine-learning - Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services. (Scala / General-Purpose Machine Learning)

README

        [![Build Status](https://ci.hydrosphere.io/buildStatus/icon?job=hydrosphere.io/mist/master)](https://ci.hydrosphere.io/job/hydrosphere.io/job/mist/job/master/)

[![Build Status](https://travis-ci.org/Hydrospheredata/mist.svg?branch=master)](https://travis-ci.org/Hydrospheredata)

[![Maven Central](https://maven-badges.herokuapp.com/maven-central/io.hydrosphere/mist-lib_2.11/badge.svg)](https://maven-badges.herokuapp.com/maven-central/io.hydrosphere/mist-lib_2.11/)

[![Docker Hub Pulls](https://img.shields.io/docker/pulls/hydrosphere/mist.svg)](https://img.shields.io/docker/pulls/hydrosphere/mist.svg)

# Hydrosphere Mist

[![Join the chat at https://gitter.im/Hydrospheredata/mist](https://badges.gitter.im/Hydrospheredata/mist.svg)](https://gitter.im/Hydrospheredata/mist?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)

[Hydrosphere](http://hydrosphere.io) Mist is a serverless proxy for Spark cluster.

Mist provides a new functional programming framework and deployment model for Spark applications. 

Please see our [quick start guide](https://hydrosphere.io/mist-docs/quick_start.html) and [documentation](https://hydrosphere.io/mist-docs/)

Features:

* **Spark Function as a Service**. Deploy Spark functions rather than notebooks or scripts.

* Spark Cluster and Session management. Fully managed Spark sessions backed by on-demand EMR, Hortonworks, Cloudera, DC/OS and vanilla Spark clusters.

* **Typesafe** programming framework that clearly defines inputs and outputs of every Spark job.

* **REST** HTTP & Messaging (MQTT, Kafka) API for Scala & Python Spark jobs.

* Multi-cluster mode: Seamless Spark cluster on-demand provisioning, autoscaling and termination(**pending**)

![Cluster of Spark Clusters](http://dv9c7babquml0.cloudfront.net/docs-images/mist-cluster-of-spark-clusters.gif)

It creates a unified API layer for building enterprise solutions and microservices on top of a Spark functions.

![Mist use cases](http://dv9c7babquml0.cloudfront.net/docs-images/mist-use-case.png)

## High Level Architecture

![High Level Architecture](http://dv9c7babquml0.cloudfront.net/docs-images/mist-highlevel-architecture.png)

## Contact

Please report bugs/problems to: 

.

[LinkedIn](https://www.linkedin.com/company/hydrospherebigdata)

[Facebook](https://www.facebook.com/hydrosphere.io/)

[Twitter](https://twitter.com/hydrospheredata)