{"id":20304344,"url":"https://github.com/dev-michael-schmidt/spark-scala-stocks","last_synced_at":"2026-05-07T22:38:31.485Z","repository":{"id":255050288,"uuid":"847971355","full_name":"dev-michael-schmidt/spark-scala-stocks","owner":"dev-michael-schmidt","description":"An ETL that loads 20+ years of stock price data for the top stocks, performs some quantitative analysis, and visualizes the results. It uses Spark, Airflow, Grafana, Python, and Scala. That could be cool, right? ","archived":false,"fork":false,"pushed_at":"2024-10-24T14:02:01.000Z","size":319,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-10-24T17:25:36.224Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dev-michael-schmidt.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-08-26T22:33:29.000Z","updated_at":"2024-10-24T14:02:05.000Z","dependencies_parsed_at":"2024-10-28T05:32:13.714Z","dependency_job_id":null,"html_url":"https://github.com/dev-michael-schmidt/spark-scala-stocks","commit_stats":null,"previous_names":["dev-michael-schmidt/spark-scala-stocks"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dev-michael-schmidt/spark-scala-stocks","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dev-michael-schmidt%2Fspark-scala-stocks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dev-michael-schmidt%2Fspark-scala-stocks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dev-michael-schmidt%2Fspark-scala-stocks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dev-michael-schmidt%2Fspark-scala-stocks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dev-michael-schmidt","download_url":"https://codeload.github.com/dev-michael-schmidt/spark-scala-stocks/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dev-michael-schmidt%2Fspark-scala-stocks/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32759443,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-07T02:14:30.463Z","status":"ssl_error","status_checked_at":"2026-05-07T02:14:29.405Z","response_time":62,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-14T16:43:51.068Z","updated_at":"2026-05-07T22:38:31.471Z","avatar_url":"https://github.com/dev-michael-schmidt.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# spark-scala-stocks\r\n\r\nI delivered on a complete, end-to-end, financial ETL pipeline. I learned\r\n\r\n- Apache Airflow\r\n- Scala\r\n- Apache Spark\r\n- Grafana\r\n- Kafka (soon)\r\n  - Broker-controller (static scaling)\r\n  - Calculate important events to trigger email alerts\r\n\r\n\u003cimg src=\"https://github.com/dev-michael-schmidt/spark-scala-stocks/blob/master/4_grid_example.png\" width=\"960px\" height=\"auto\"\u003e\r\n\r\n- Loads 20+ years of stock price data from the S\u0026P 500\r\n- Performs quantitative analysis (currently, parameterized SMA, EMA)\r\n- Visualizes the results\r\n\r\nI knew PostgreSQL, Docker (and compose), and Python (yeah, Duh!)\r\n\r\nPretty nifty? There's more to come!\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdev-michael-schmidt%2Fspark-scala-stocks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdev-michael-schmidt%2Fspark-scala-stocks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdev-michael-schmidt%2Fspark-scala-stocks/lists"}