{"id":16599730,"url":"https://github.com/tupol/spark-utils-demos","last_synced_at":"2026-05-18T03:03:03.491Z","repository":{"id":130092738,"uuid":"167579439","full_name":"tupol/spark-utils-demos","owner":"tupol","description":"Demos for the tupol/spark-utils project together with a storyline","archived":false,"fork":false,"pushed_at":"2019-08-31T06:20:42.000Z","size":30,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-19T03:23:20.206Z","etag":null,"topics":["configuration","demo","framework","scala","spark"],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tupol.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-01-25T16:39:13.000Z","updated_at":"2019-08-31T06:20:44.000Z","dependencies_parsed_at":null,"dependency_job_id":"25503e99-896f-4292-8a17-ae22559507aa","html_url":"https://github.com/tupol/spark-utils-demos","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/tupol/spark-utils-demos","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tupol%2Fspark-utils-demos","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tupol%2Fspark-utils-demos/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tupol%2Fspark-utils-demos/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tupol%2Fspark-utils-demos/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tupol","download_url":"https://codeload.github.com/tupol/spark-utils-demos/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tupol%2Fspark-utils-demos/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33163413,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-17T22:39:12.733Z","status":"online","status_checked_at":"2026-05-18T02:00:06.436Z","response_time":71,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["configuration","demo","framework","scala","spark"],"created_at":"2024-10-12T00:12:25.681Z","updated_at":"2026-05-18T03:03:03.466Z","avatar_url":"https://github.com/tupol.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Creating Simple Configurable Spark Applications in Scala\n\n\n## Motivation\n\nAll of us can recall the first days of picking up a new technology and running the first “*Hello, World!*” or “*Count words*”\napplications that get us started with a new language or a platform.\n\nUp to a certain point of exploring and creating demos or prototypes everything is nice, but when it comes to creating\n*production ready* configurable applications we all have a hard time and actually start thinking about the operational\nuse of our applications and how they will be deployed to a production system. This is the moment when a few lines of\nbeautiful code tend to get cluttered by a lot of configuration, wiring and setup.\n\nWhen it comes to Apache Spark it gets even more complicated, setting up the Spark context and setting up the input\nsources and outputs.\nIt would be really nice to have a simple framework that keeps our Spark code clean and uncluttered.\n\n\n## Audience\n\nDevelopers starting up into the [Apache Spark](https://spark.apache.org/) application development\nin [Scala](https://www.scala-lang.org/).\n\nSome basic Scala and Apache Spark knowledge is crucial to make sense of this presentation.\n\nThis article is not meant as a Scala or an Apache Spark tutorial.\n\n\n## spark-utils\n\n[`spark-utils`](https://github.com/tupol/spark-utils) is a simple framework, developed\nacross a few years of writing Spark applications that so far helped me starting up new projects and creating\napplications fast and relatively easy.\nThe main ideas behind building a new Spark application are logic, configuration and execution.\n\n[Full article is available as a Wiki page here.](https://github.com/tupol/spark-utils-demos/wiki)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftupol%2Fspark-utils-demos","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftupol%2Fspark-utils-demos","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftupol%2Fspark-utils-demos/lists"}