{"id":13487250,"url":"https://github.com/Hydrospheredata/mist","last_synced_at":"2025-03-27T21:32:13.589Z","repository":{"id":57735594,"uuid":"49703422","full_name":"Hydrospheredata/mist","owner":"Hydrospheredata","description":"Serverless proxy for Spark cluster","archived":false,"fork":false,"pushed_at":"2020-10-29T16:47:24.000Z","size":10449,"stargazers_count":326,"open_issues_count":31,"forks_count":68,"subscribers_count":39,"default_branch":"master","last_synced_at":"2024-10-19T03:39:05.273Z","etag":null,"topics":["apache-spark","api","big-data","serverless"],"latest_commit_sha":null,"homepage":"http://hydrosphere.io/mist/","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Hydrospheredata.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-01-15T07:22:05.000Z","updated_at":"2024-09-15T14:21:45.000Z","dependencies_parsed_at":"2022-08-23T20:30:28.883Z","dependency_job_id":null,"html_url":"https://github.com/Hydrospheredata/mist","commit_stats":null,"previous_names":[],"tags_count":49,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hydrospheredata%2Fmist","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hydrospheredata%2Fmist/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hydrospheredata%2Fmist/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Hydrospheredata%2Fmist/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Hydrospheredata","download_url":"https://codeload.github.com/Hydrospheredata/mist/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":222206741,"owners_count":16948797,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache-spark","api","big-data","serverless"],"created_at":"2024-07-31T18:00:57.046Z","updated_at":"2024-10-30T22:30:45.190Z","avatar_url":"https://github.com/Hydrospheredata.png","language":"Scala","readme":"[![Build Status](https://ci.hydrosphere.io/buildStatus/icon?job=hydrosphere.io/mist/master)](https://ci.hydrosphere.io/job/hydrosphere.io/job/mist/job/master/)\n[![Build Status](https://travis-ci.org/Hydrospheredata/mist.svg?branch=master)](https://travis-ci.org/Hydrospheredata)\n[![Maven Central](https://maven-badges.herokuapp.com/maven-central/io.hydrosphere/mist-lib_2.11/badge.svg)](https://maven-badges.herokuapp.com/maven-central/io.hydrosphere/mist-lib_2.11/)\n[![Docker Hub Pulls](https://img.shields.io/docker/pulls/hydrosphere/mist.svg)](https://img.shields.io/docker/pulls/hydrosphere/mist.svg)\n# Hydrosphere Mist\n\n[![Join the chat at https://gitter.im/Hydrospheredata/mist](https://badges.gitter.im/Hydrospheredata/mist.svg)](https://gitter.im/Hydrospheredata/mist?utm_source=badge\u0026utm_medium=badge\u0026utm_campaign=pr-badge\u0026utm_content=badge)\n\n[Hydrosphere](http://hydrosphere.io) Mist is a serverless proxy for Spark cluster.\nMist provides a new functional programming framework and deployment model for Spark applications. \n\nPlease see our [quick start guide](https://hydrosphere.io/mist-docs/quick_start.html) and [documentation](https://hydrosphere.io/mist-docs/)\n\nFeatures:\n* **Spark Function as a Service**. Deploy Spark functions rather than notebooks or scripts.\n* Spark Cluster and Session management. Fully managed Spark sessions backed by on-demand EMR, Hortonworks, Cloudera, DC/OS and vanilla Spark clusters.\n* **Typesafe** programming framework that clearly defines inputs and outputs of every Spark job.\n* **REST** HTTP \u0026 Messaging (MQTT, Kafka) API for Scala \u0026 Python Spark jobs.\n* Multi-cluster mode: Seamless Spark cluster on-demand provisioning, autoscaling and termination(**pending**)\n![Cluster of Spark Clusters](http://dv9c7babquml0.cloudfront.net/docs-images/mist-cluster-of-spark-clusters.gif)\n\nIt creates a unified API layer for building enterprise solutions and microservices on top of a Spark functions.\n\n![Mist use cases](http://dv9c7babquml0.cloudfront.net/docs-images/mist-use-case.png)\n\n## High Level Architecture\n\n![High Level Architecture](http://dv9c7babquml0.cloudfront.net/docs-images/mist-highlevel-architecture.png)\n\n## Contact\n\nPlease report bugs/problems to: \n\u003chttps://github.com/Hydrospheredata/mist/issues\u003e.\n\n\u003chttp://hydrosphere.io/\u003e\n\n[LinkedIn](https://www.linkedin.com/company/hydrospherebigdata)\n\n[Facebook](https://www.facebook.com/hydrosphere.io/)\n\n[Twitter](https://twitter.com/hydrospheredata)\n","funding_links":[],"categories":["The Data Science Toolbox","Scala","Service Programming","Java","Function as a Service Frameworks"],"sub_categories":["Miscellaneous Tools","Tools","[Tools](#tools-1)","Speech Recognition"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FHydrospheredata%2Fmist","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FHydrospheredata%2Fmist","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FHydrospheredata%2Fmist/lists"}