https://github.com/endymecy/spark-graphx-source-analysis

spark graphx 的原理及相关操作的源码解析
https://github.com/endymecy/spark-graphx-source-analysis

Last synced: 3 months ago
JSON representation

spark graphx 的原理及相关操作的源码解析

• Host: GitHub
• URL: https://github.com/endymecy/spark-graphx-source-analysis
• Owner: endymecy
• Created: 2016-03-07T09:26:03.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2016-12-11T01:23:28.000Z (almost 8 years ago)
• Last Synced: 2024-05-13T23:57:10.154Z (6 months ago)
• Homepage: https://github.com/endymecy/spark-graphx-source-analysis
• Size: 3.12 MB
• Stars: 211
• Watchers: 21
• Forks: 87
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# `Spark GraphX`源码分析

  `Spark GraphX`是一个新的`Spark API`，它用于图和分布式图(`graph-parallel`)的计算。`GraphX` 综合了 `Pregel` 和 `GraphLab` 两者的优点，即接口相对简单，又保证性能，可以应对点分割的图存储模式，胜任符合幂律分布的自然图的大型计算。

本专题会详细介绍`GraphX`的实现原理，并对`GraphX`的存储结构以及部分操作作详细分析。

  本专题介绍的内容如下：

## 目录

* [分布式图计算](parallel-graph-system.md)

* [GraphX简介](graphx-introduce.md)

* [GraphX点切分存储](vertex-cut.md)

* [vertices、edges和triplets](vertex-edge-triple.md)

* [图的构建](build-graph.md)

* [GraphX的图运算操作](operators/readme.md)

    * [转换操作](operators/transformation.md)

    * [结构操作](operators/structure.md)

    * [关联操作](operators/join.md)

    * [聚合操作](operators/aggregate.md)

    * [缓存操作](operators/cache.md)

* [GraphX Pregel API](pregel-api.md)

* [图算法实现]

    * [宽度优先遍历](graphAlgorithm/BFS.md)

    * [单源最短路径](graphAlgorithm/shortest_path.md)

    * [连通组件](graphAlgorithm/ConnectedComponents.md)

    * [三角计数](graphAlgorithm/TriangleCounting.md)

    * [PageRank](graphAlgorithm/PageRank.md)