{"id":19839354,"url":"https://github.com/redislabs/spark-redis-ml","last_synced_at":"2025-08-01T23:42:11.400Z","repository":{"id":141980853,"uuid":"70080180","full_name":"RedisLabs/spark-redis-ml","owner":"RedisLabs","description":"A spark package for loading Spark ML models to Redis-ML","archived":false,"fork":false,"pushed_at":"2019-06-22T07:00:48.000Z","size":34,"stargazers_count":63,"open_issues_count":3,"forks_count":14,"subscribers_count":15,"default_branch":"master","last_synced_at":"2025-04-06T17:02:53.970Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"http://redisml.io","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/RedisLabs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-10-05T16:54:05.000Z","updated_at":"2023-11-08T23:52:01.000Z","dependencies_parsed_at":null,"dependency_job_id":"f0786e4d-a746-4162-9442-4058f4eeb85a","html_url":"https://github.com/RedisLabs/spark-redis-ml","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RedisLabs%2Fspark-redis-ml","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RedisLabs%2Fspark-redis-ml/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RedisLabs%2Fspark-redis-ml/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/RedisLabs%2Fspark-redis-ml/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/RedisLabs","download_url":"https://codeload.github.com/RedisLabs/spark-redis-ml/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251932513,"owners_count":21667157,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-12T12:21:59.150Z","updated_at":"2025-05-01T19:30:18.669Z","avatar_url":"https://github.com/RedisLabs.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"---\n#### Notice RedisML is planned to be replaced by [RedisAI](http://redisai.io), adding support for deep learning.\n***\n\n# Spark-Redis-ML\n\n### A spark package for loading Spark ML models to  [Redis-ML](https://github.com/RedisLabsModules/redis-ml \"Redis-ML\")   \n\n## Requirments: \n\nApache [Spark](https://github.com/apache/spark) 2.0 or later\n\n[Redis](https://github.com/antirez/redis) build from unstable branch\n\n[Jedis](https://github.com/xetorthio/jedis)\n\n[Jedis-ml](https://github.com/RedisLabs/jedis-ml)\n\n## Installation:\n\n```sh\n#get and build redis-ml\ngit clone https://github.com/RedisLabsModules/redis-ml.git\ncd redis-ml/src\nmake \n\n#get and build jedis\ngit clone https://github.com/xetorthio/jedis.git\ncd jedis\nmvn package -Dmaven.test.skip=true\n\n#get and build jedis-ml\ncd..\ngit clone https://github.com/RedisLabs/jedis-ml.git\ncd jedis-ml\nmkdir lib\ncp ../jedis/target/jedis-3.0.0-SNAPSHOT.jar lib/\nmvn install \n\n#get and build spark-jedis-ml\ncd.. \ngit clone https://github.com/RedisLabs/spark-redis-ml.git\ncd spark-redis-ml\ncp ../jedis/target/jedis-3.0.0-SNAPSHOT.jar lib/\ncp ../jedis-ml/target/jedis-ml-1.0-SNAPSHOT.jar lib/\nsbt assembly\n```\n\n\n\n### Usage:\n\nRun Redis server with redis-ml module:\n\n```sh\n/path/to/redis-server --loadmodule ./redis-ml.so\n```\n\n\n\nFrom Spark root directory, Run Spark shell with the required jars:\n\n```sh\n./bin/spark-shell --jars ../spark-redis-ml/target/scala-2.11/spark-redis-ml-assembly-0.1.0.jar,../spark-redis-ml/lib/jedis-3.0.0-SNAPSHOT.jar,../spark-redis-ml/lib/jedis-ml-1.0-SNAPSHOT.jar\n```\n\n\n\nOn Spark shell:\n\n```sh\nscala\u003e :load \"../spark-redis-ml/scripts/forest-example.scala\"\nscala\u003e benchmark(10)\n```\n\n\n\n### \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fredislabs%2Fspark-redis-ml","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fredislabs%2Fspark-redis-ml","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fredislabs%2Fspark-redis-ml/lists"}