{"id":21070358,"url":"https://github.com/learningjournal/apache-spark-and-databricks-stream-processing-in-lakehouse","last_synced_at":"2025-08-27T17:21:14.110Z","repository":{"id":204457327,"uuid":"711897026","full_name":"LearningJournal/Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse","owner":"LearningJournal","description":null,"archived":false,"fork":false,"pushed_at":"2024-01-09T16:47:28.000Z","size":11902,"stargazers_count":40,"open_issues_count":2,"forks_count":72,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-11-19T19:00:49.645Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/LearningJournal.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-10-30T11:52:51.000Z","updated_at":"2024-11-05T06:54:59.000Z","dependencies_parsed_at":"2024-11-19T18:57:48.849Z","dependency_job_id":null,"html_url":"https://github.com/LearningJournal/Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse","commit_stats":null,"previous_names":["learningjournal/apache-spark-and-databricks-stream-processing-in-lakehouse"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LearningJournal%2FApache-Spark-and-Databricks-Stream-Processing-in-Lakehouse","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LearningJournal%2FApache-Spark-and-Databricks-Stream-Processing-in-Lakehouse/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LearningJournal%2FApache-Spark-and-Databricks-Stream-Processing-in-Lakehouse/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/LearningJournal%2FApache-Spark-and-Databricks-Stream-Processing-in-Lakehouse/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/LearningJournal","download_url":"https://codeload.github.com/LearningJournal/Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":234862665,"owners_count":18898394,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-19T18:46:38.782Z","updated_at":"2025-01-20T21:55:55.487Z","avatar_url":"https://github.com/LearningJournal.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse\nThis is the central repository for all the materials related to \u003cem\u003eApache Spark and Databricks Stream Processing in Lakehouse\u003c/em\u003e \u003cbr\u003eCourse by Prashant Kumar Pandey.\n\u003cbr\u003e You can get the full course at \u003ca href=\"https://www.udemy.com/course/spark-streaming-using-python/?referralCode=127B048D9EBD2D1278DC\"\u003e \n  Apache Spark and Databricks Stream Processing in Lakehouse @ Udemy.\n\u003c/a\u003e\n\n\u003cdiv\u003e\n\u003ca href=\"https://www.udemy.com/course/spark-streaming-using-python/?referralCode=127B048D9EBD2D1278DC\"\u003e\n\u003cimg src=\"https://drive.google.com/uc?id=1Df0TU_h-rcupXCrHitSQcHiviovlJOcZ\" alt=\"Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse\" width=\"300\" align=\"left\"\u003e \n\u003c/a\u003e\n\n\u003ch2\u003e Description \u003c/h2\u003e\n\u003cp align=\"justify\"\u003e\n  I am creating Apache Spark and Databricks - Stream Processing in Lakehouse using the Python Language and PySpark API. This course will help you understand Real-time Stream processing using Apache Spark and Databricks Cloud and apply that knowledge to build real-time stream processing solutions. This course is example-driven and follows a working session-like approach. We will take a live coding approach and explain all the needed concepts.\n\u003c/p\u003e\n\n\u003ch3\u003eCapstone Project\u003c/h3\u003e\n\u003cp align=\"justify\"\u003e\nThis course also includes an End-To-End Capstone project. The project will help you understand the real-life project design, coding, implementation, testing, and CI/CD approach. \n\u003c/p\u003e\n\n\u003ch3\u003eWho should take this Course?\u003c/h3\u003e\n\u003cp align=\"justify\"\u003e\nI designed this course for software engineers willing to develop a Real-time Stream Processing Pipeline and application using Apache Spark. I am also creating this course for data architects and data engineers who are responsible for designing and building the organization’s data-centric infrastructure. Another group of people is the managers and architects who do not directly work with Spark implementation. Still, they work with those implementing Apache Spark at the ground level.\n\u003c/p\u003e\n\n\u003ch3\u003eSpark and source code version\u003c/h3\u003e\n\u003cp align=\"justify\"\u003e\nThis Course is using the Apache Spark 3.5. I have tested all the source code and examples used in this Course on Azure Databricks Cloud using Databricks Runtime 14.1.\n\u003c/p\u003e\n\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flearningjournal%2Fapache-spark-and-databricks-stream-processing-in-lakehouse","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flearningjournal%2Fapache-spark-and-databricks-stream-processing-in-lakehouse","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flearningjournal%2Fapache-spark-and-databricks-stream-processing-in-lakehouse/lists"}