https://github.com/scrapcodes/spark-templates

One stop shop for Apache spark starter samples.
https://github.com/scrapcodes/spark-templates

apache samples spark

Last synced: about 1 month ago
JSON representation

One stop shop for Apache spark starter samples.

• Host: GitHub
• URL: https://github.com/scrapcodes/spark-templates
• Owner: ScrapCodes
• License: apache-2.0
• Created: 2020-07-24T12:23:30.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-08-04T08:30:33.000Z (over 4 years ago)
• Last Synced: 2024-11-09T06:38:58.380Z (3 months ago)
• Topics: apache, samples, spark
• Language: Scala
• Homepage:
• Size: 1.07 MB
• Stars: 1
• Watchers: 3
• Forks: 4
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: license.txt

Awesome Lists containing this project

README

        
# Spark templates

One stop shop for all your spark starter codes.

1. [Spark scala template](scala-template)

    

    Uses SBT as the build system and also includes docker files

    for publishing to docker repo. More details and how to use the

    code sample is available in [README](scala-template/readme.md).

    

    a) [SQL Example](scala-template/src/main/scala/com/github/scrapcodes/scala/template/SparkScalaSQLExample.scala)

    b) [Cloud Object Storage Example](scala-template/src/main/scala/com/github/scrapcodes/scala/template/SparkScalaCOSExample.scala)

    Works for Cloud object store, e.g.: Amazon S3 or IBM Cloud Object Store.

2. [Spark java template](java-template)

    Uses Maven as the build system and also includes docker files for publishing as docker images.

    Check out the template specific readme for more information, here: [README](java-template/readme.md)