{"id":15056834,"url":"https://github.com/navicore/mysparksql","last_synced_at":"2026-01-02T13:11:54.237Z","repository":{"id":145650687,"uuid":"81663190","full_name":"navicore/mysparksql","owner":"navicore","description":null,"archived":false,"fork":false,"pushed_at":"2022-11-25T23:52:18.000Z","size":16,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-21T02:25:54.193Z","etag":null,"topics":["apache-cassandra","apache-spark","cassandra","kubernetes","spark"],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/navicore.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-02-11T15:53:12.000Z","updated_at":"2017-02-11T18:50:45.000Z","dependencies_parsed_at":null,"dependency_job_id":"11c2faa7-583e-4dad-b4d3-dd113ccda93e","html_url":"https://github.com/navicore/mysparksql","commit_stats":{"total_commits":11,"total_committers":2,"mean_commits":5.5,"dds":0.09090909090909094,"last_synced_commit":"55e866f0d145c56a76e2d57ba29e8cd574ba8a55"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navicore%2Fmysparksql","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navicore%2Fmysparksql/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navicore%2Fmysparksql/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/navicore%2Fmysparksql/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/navicore","download_url":"https://codeload.github.com/navicore/mysparksql/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243544665,"owners_count":20308168,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache-cassandra","apache-spark","cassandra","kubernetes","spark"],"created_at":"2024-09-24T21:56:47.521Z","updated_at":"2026-01-02T13:11:54.200Z","avatar_url":"https://github.com/navicore.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# mysparksql\n\na minimal code example of reading from cassandra via spark 2.x\n\n\nclient mode:\n\n```console\n/opt/spark/bin/spark-submit --master spark://\u003cYOUR SPARK MASTER\u003e:7077 --class onextent.demo.mysparksql.Main --driver-java-options=\"-DCASSANDRA_HOST=\u003cYOUR CASSANDRA HOST(s)\u003e -DKEYSPACE=\u003cYOUR KEYSPACE\u003e -DTABLE=\u003cYOUR TABLE\u003e\" --deploy-mode client ./mysparksql.jar\n```\n\nvia docker:\n\n```console\ndocker run -e SPARK_MASTER=spark://\u003cYOUR SPARK MASTER\u003e -e CASSANDRA_HOST=\u003cYOUR CASSANDRA HOST\u003e -e KEYSPACE=\u003cYOUR KEYSPACE\u003e -e TABLE=\u003cYOUR TABLE\u003e -it navicore/mysparksql\n```\n\nvia kubernetes job:\n\n```yaml\napiVersion: batch/v1\nkind: Job\nmetadata:\n  name: mysparksql\nspec:\n  template:\n    metadata:\n      name: mysparksql\n    spec:\n      containers:\n      - name: mysparksql\n        image: navicore/mysparksql\n        env: \n        - name: CASSANDRA_HOST\n          value: \"\u003cYOUR CASSANDRA HOST\u003e\"\n        - name: SPARK_MASTER\n          value: \"spark://\u003cYOUR SPARK MASTER\u003e\"\n        - name: KEYSPACE\n          value: \"\u003cYOUR KEYSPACE\u003e\"\n        - name: TABLE\n          value: \"\u003cYOUR TABLE\u003e\"\n      restartPolicy: Never\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnavicore%2Fmysparksql","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnavicore%2Fmysparksql","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnavicore%2Fmysparksql/lists"}