https://github.com/mrpowers-io/spark-style-guide

Spark style guide
https://github.com/mrpowers-io/spark-style-guide

Last synced: 4 days ago
JSON representation

Spark style guide

• Host: GitHub
• URL: https://github.com/mrpowers-io/spark-style-guide
• Owner: mrpowers-io
• Created: 2017-03-07T17:45:18.000Z (almost 8 years ago)
• Default Branch: main
• Last Pushed: 2024-09-30T19:00:52.000Z (4 months ago)
• Last Synced: 2025-01-22T09:02:14.439Z (11 days ago)
• Language: Jupyter Notebook
• Size: 341 KB
• Stars: 257
• Watchers: 18
• Forks: 47
• Open Issues: 10
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Spark Style Guide

Spark is an amazingly powerful big data engine that's written in Scala with different programatic APIs.

This repo contains style guides for the different APIs:

* [PySpark style guide](https://github.com/MrPowers/spark-style-guide/blob/main/PYSPARK_STYLE_GUIDE.md) for the Python API.

* [Spark Scala style guide](https://github.com/MrPowers/spark-style-guide/blob/main/SPARK_SCALA_STYLE_GUIDE.md).

This document draws on the Spark source code, the [Spark examples](http://spark.apache.org/examples.html), and popular open source Spark libraries to outline coding conventions and best practices.

Comprehensive Python/Scala/Java style guides already exist and this document focuses specifically on the style issues for Spark programmers.

Reader beware:

> Any style guide written in English is either so brief that it’s ambiguous, or so long that no one reads it.

> - [Bob Nystrom](http://journal.stuffwithstuff.com/2015/09/08/the-hardest-program-ive-ever-written/)