{"id":26947166,"url":"https://github.com/lsds/seep","last_synced_at":"2025-04-02T20:18:12.739Z","repository":{"id":9603601,"uuid":"11525787","full_name":"lsds/SEEP","owner":"lsds","description":"Cluster computing using Stateful Dataflow Graphs","archived":false,"fork":false,"pushed_at":"2022-07-15T20:10:44.000Z","size":141100,"stargazers_count":26,"open_issues_count":32,"forks_count":12,"subscribers_count":21,"default_branch":"master","last_synced_at":"2024-03-27T08:48:29.456Z","etag":null,"topics":["cluster-computing","dataflow-programming","sdg","stateful"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lsds.png","metadata":{"files":{"readme":"README.txt","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2013-07-19T10:44:05.000Z","updated_at":"2022-12-14T16:02:38.000Z","dependencies_parsed_at":"2022-08-07T05:01:10.012Z","dependency_job_id":null,"html_url":"https://github.com/lsds/SEEP","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsds%2FSEEP","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsds%2FSEEP/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsds%2FSEEP/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lsds%2FSEEP/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lsds","download_url":"https://codeload.github.com/lsds/SEEP/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246884767,"owners_count":20849554,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cluster-computing","dataflow-programming","sdg","stateful"],"created_at":"2025-04-02T20:18:12.174Z","updated_at":"2025-04-02T20:18:12.732Z","avatar_url":"https://github.com/lsds.png","language":"Java","readme":"SEEP is an experimental parallel data processing system that is being developed\nby the Large-Scale Distributed Systems (LSDS) research group\n(http://lsds.doc.ic.ac.uk) at Imperial College London. It is licsensed under\nEPL (Eclipse Public License).\n\nThe SEEP system is under heavy development and should be considered an alpha\nrelease. This is not considered a \"stable\" branch.\n\nFurther details on SEEP, including papers that explain the underlying model \ncan be found at the project website:\nhttp://lsds.doc.ic.ac.uk/projects/SEEP\n\nThe SEEP system consists of two modules, the runtime system (seep-system) and a\ncompiler (java2sdg). Below is some information regarding how to build the\nsystem and modules.\n\nBUILDING:\n#####################\nThe project follows the standard Maven directory structure, with two\ndifferentiated modules, seep-system and seep-java2sdg.\n\nThere are two options to build the SEEP system:\n\nOption 1, single jar (recommended) -- run:\n\nmvn clean compile assembly:single\n\nThis produces one jar with all dependencies included.\n\nOption 2, without dependencies -- to compile it:\n\nmvn -DskipTests package\n\nIn this case, ensure that the classpath includes the dependencies.\n\nYou can alternatively build only individual modules, by running the same\noptions above inside seep-system or seep-java2sdg, respectively.\n\n************\nseep-system\n************\n\nRUNNING:\n#########################\nThe system requires one master node and N worker nodes (one worker node per\nOperator).\n\nFirst set the IP address of the master node in \"mainAddr\" inside\nconfig.properties and build the SEEP system.\n\nNext run the master in the designated node:\n\njava -jar \u003csystem.jar\u003e Master \u003cquery.jar\u003e \u003cBase-class\u003e\n\nwhere query.jar is the compiled query and the last parameter is the name of \nthe base class, not a path.\n\nFinally run as many worker nodes as your query requires:\n\njava -jar \u003csystem.jar\u003e Worker\n\nLocal mode:\n\nTo run the SEEP system in a single local machine, append a different port to\neach Worker node:\n\njava -jar \u003csystem.jar\u003e Worker \u003cport\u003e\n\n*************\nseep-java2sdg\n*************\n\nRUNNING:\n###########################\nIt is mandatory to indicate an input program, an output file name and a target\n(dot/seepjar) and the classpath to the driver program and its dependencies.\nExamples: \n\njava -jar \u003cjava2sdg.jar\u003e -i Driver -t dot -o myOutput -cp examples/\n\nThe above code will process input program \"Driver\" using the dependencies in\n\"examples/\" to generate an output file \"myOutput.dot\".\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flsds%2Fseep","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flsds%2Fseep","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flsds%2Fseep/lists"}