{"id":15517098,"url":"https://github.com/deric/storm-mesos","last_synced_at":"2025-04-23T03:49:14.000Z","repository":{"id":18455628,"uuid":"21649722","full_name":"deric/storm-mesos","owner":"deric","description":"Storm framework for Mesos with Debian packaging","archived":false,"fork":false,"pushed_at":"2022-01-08T18:23:52.000Z","size":3680,"stargazers_count":6,"open_issues_count":1,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-23T03:49:08.983Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/deric.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-07-09T11:19:56.000Z","updated_at":"2022-01-08T18:23:41.000Z","dependencies_parsed_at":"2022-09-06T11:10:37.497Z","dependency_job_id":null,"html_url":"https://github.com/deric/storm-mesos","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deric%2Fstorm-mesos","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deric%2Fstorm-mesos/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deric%2Fstorm-mesos/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deric%2Fstorm-mesos/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/deric","download_url":"https://codeload.github.com/deric/storm-mesos/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250366685,"owners_count":21418768,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-02T10:11:34.032Z","updated_at":"2025-04-23T03:49:13.981Z","avatar_url":"https://github.com/deric.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Storm-mesos\n\nStorm framework for Mesos for running Storm in production. Currently includes several services:\n\n   * `storm-mesos` - Nimbus (Mesos scheduler)\n   * `storm-ui` - web interface (default port is `8080`)\n   * `storm-drpc` - DRPC daemon\n   * `storm-log` - service for displaying logs in web UI (fetching logs from computing nodes)\n\nNote that Storm supervisor daemons are not needed as they are launched by Mesos.\n\n## how to build\n\n    $ ./bin/package --version 0.9.1-incubating\n\nwhere specified version of `apache-storm` should exists on Storm website: e.g. http://www.us.apache.org/dist/incubator/storm/\n\neventually you can specify a patch version for package\n\n    $ ./bin/package --version 0.9.1-incubating --patch \"-p1\"\n\nStorm integration with the Mesos cluster resource manager. This runs in production within Twitter.\n\nPrebuilt Storm/Mesos releases are available from the [downloads page](https://github.com/nathanmarz/storm-mesos/downloads).\n\nTo use a release, you first need to unpack the distribution, fill in configurations listed below into the conf/storm.yaml file, and then repack the distribution.\n\nBe sure to use Mesos as of [this commit](https://github.com/apache/mesos/commit/caff34a67fd855067089f30f68e46e325659ad08), as prior versions of Mesos had some bugs.\n\nAlong with the Mesos master and Mesos cluster, you'll need to run the Storm master as well. Launch Nimbus with this command:\n\n```\n$ /etc/init.d/storm-mesos start\n```\nor using upstart on Ubuntu:\n```\n$ service storm-mesos start\n```\n\nIt's recommended that you also run the UI on the same machine as Nimbus via the following command:\n\n```\n$ /etc/init.d/storm-ui start\n```\n\nfor displaying nodes you will also need to start log service:\n```\n$ /etc/init.d/storm-log start\n```\n\n\n\n\nTopologies are submitted to a Storm/Mesos cluster the exact same way they are submitted to a regular Storm cluster.\n\nStorm/Mesos provides resource isolation between topologies. So you don't need to worry about topologies interfering with one another.\n\n## Mandatory configurations:\n\n1. `mesos.executor.uri`: Once you fill in the configs and repack the distribution, you need to place the distribution somewhere where Mesos executors can find it. Typically this is on HDFS, and this config is the location of where you put the distibution.\n2. `mesos.master.url`: URL for the Mesos master.\n3. `java.library.path`: Needs the location of the ZeroMQ libs and the Mesos native libraries. The Storm/Mesos distribution comes with the native ZeroMQ libraries in the \"native\" folder (for Linux). This config is typically set to \"native:{location of mesos native libs}\"\n4. `storm.zookeeper.servers`: The location of the Zookeeper servers to be used by the Storm master.\n5. `nimbus.host`: The hostname of where you run Nimbus.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fderic%2Fstorm-mesos","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fderic%2Fstorm-mesos","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fderic%2Fstorm-mesos/lists"}