{"id":22636147,"url":"https://github.com/47degrees/how-to-test-spark","last_synced_at":"2026-02-13T08:07:33.576Z","repository":{"id":37524923,"uuid":"500870821","full_name":"47degrees/how-to-test-spark","owner":"47degrees","description":"Different techniques to do unit testing in Spark without the need to rely on anything else than your IDE and SBT","archived":false,"fork":false,"pushed_at":"2022-07-27T08:22:53.000Z","size":63,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-09-25T20:58:32.931Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/47degrees.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-06-07T14:16:50.000Z","updated_at":"2022-10-21T15:11:07.000Z","dependencies_parsed_at":"2022-08-19T03:41:10.976Z","dependency_job_id":null,"html_url":"https://github.com/47degrees/how-to-test-spark","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/47degrees/how-to-test-spark","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/47degrees%2Fhow-to-test-spark","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/47degrees%2Fhow-to-test-spark/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/47degrees%2Fhow-to-test-spark/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/47degrees%2Fhow-to-test-spark/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/47degrees","download_url":"https://codeload.github.com/47degrees/how-to-test-spark/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/47degrees%2Fhow-to-test-spark/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29399431,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-13T06:24:03.484Z","status":"ssl_error","status_checked_at":"2026-02-13T06:23:12.830Z","response_time":78,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-09T03:18:30.028Z","updated_at":"2026-02-13T08:07:33.540Z","avatar_url":"https://github.com/47degrees.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# how-to-test-spark\nDifferent techniques to do unit testing in Spark without the need to rely on anything else than your IDE and SBT.\n\nThe focus of this project is to share ideas on how to test the small. \nTesting the small means testing the basic transformations that every spark application has in an isolated manner. \n\n## Run applications\nThe project also gives you the oportunity to run your applications locally if you wish to - drop local to run it in a cluster.\n\n```bash\nsbt \"run $inputPath/inputFile.csv $outputPath/outputFile.csv local\"\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F47degrees%2Fhow-to-test-spark","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F47degrees%2Fhow-to-test-spark","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F47degrees%2Fhow-to-test-spark/lists"}