{"id":13680003,"url":"https://github.com/shijinkui/spark_study","last_synced_at":"2025-04-29T19:32:33.924Z","repository":{"id":25642292,"uuid":"29077669","full_name":"shijinkui/spark_study","owner":"shijinkui","description":"spark源码学习","archived":true,"fork":false,"pushed_at":"2016-01-21T02:31:21.000Z","size":10708,"stargazers_count":305,"open_issues_count":0,"forks_count":94,"subscribers_count":38,"default_branch":"master","last_synced_at":"2024-11-11T22:35:50.323Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shijinkui.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-01-11T01:35:29.000Z","updated_at":"2024-08-13T14:21:55.000Z","dependencies_parsed_at":"2022-07-16T23:06:56.439Z","dependency_job_id":null,"html_url":"https://github.com/shijinkui/spark_study","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shijinkui%2Fspark_study","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shijinkui%2Fspark_study/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shijinkui%2Fspark_study/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shijinkui%2Fspark_study/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shijinkui","download_url":"https://codeload.github.com/shijinkui/spark_study/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251569568,"owners_count":21610577,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-02T13:01:11.996Z","updated_at":"2025-04-29T19:32:28.914Z","avatar_url":"https://github.com/shijinkui.png","language":null,"funding_links":[],"categories":["大数据/人工智能","Others"],"sub_categories":[],"readme":"#\t\tSpark Study\n----------------\n\n通过spark源码阅读，把spark内部运行逻辑用`图表+文字说明`的形式展现出来。\n图表能够清晰表达全局的逻辑关系和细节部分\n\n##\t\t目录\n\n1.\t[Graphx:构建graph和聚合消息](spark_graphx_analyze.markdown)\n2.\t[从SparkPi图解Spark core](spark_core_getstart_from_pi.markdown) (hangzhou spark meetup分享过一次)\n3.\t[spark UI源码阅读](spark_ui.markdown) *2015.6.11*\n4.\t[食不厌精，脍不厌细：如何一步步将kcore算法提升5倍性能](spark_core_getstart_from_pi.markdown) *2014.12.27*\n5.\t[图解spark repl](spark_repl.markdown) *2016.1.12*\n\n##\t\tSpark八法\n@玄畅    @明风\n\n\u003e\t“井中八法”一共八式，因寇仲天赋行军打仗的超卓领导才能，以兵法入刀，故各式均含用兵之道。\n\n\u003e\t总纲：故善战者，立于不败之地，而不失敌之败也。是故胜兵先胜而后求战，败兵先战而后求胜，因敌而制胜。\n\n从八个方面分析spark, 观脉络看细节。\n\n1.\t[概要](spark_eight_style.markdown)\n2.\t[Spark八法之方圆: RDD](spark_eight_style_1_rdd.markdown)\n3.\t[Spark八法之不攻: DAG、Lazy](spark_eight_style_2_dag_lazy.markdown) 进行中\n\n\n\n------------------\n\n微博: @时金魁\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshijinkui%2Fspark_study","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshijinkui%2Fspark_study","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshijinkui%2Fspark_study/lists"}