https://github.com/codait/spark-bench

Benchmark Suite for Apache Spark
https://github.com/codait/spark-bench

Last synced: 6 days ago
JSON representation

Benchmark Suite for Apache Spark

• Host: GitHub
• URL: https://github.com/codait/spark-bench
• Owner: CODAIT
• License: apache-2.0
• Created: 2015-08-13T23:34:08.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2023-04-12T09:08:55.000Z (over 1 year ago)
• Last Synced: 2024-05-01T23:32:56.605Z (7 months ago)
• Language: Scala
• Homepage: https://codait.github.io/spark-bench/
• Size: 3.98 MB
• Stars: 238
• Watchers: 34
• Forks: 126
• Open Issues: 63
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

        

# spark-bench

## Benchmark Suite for Apache Spark

[![GitHub issues](https://img.shields.io/github/release/CODAIT/spark-bench.svg)](https://github.com/codait/spark-bench/releases/latest)

[![Build Status](https://travis-ci.org/CODAIT/spark-bench.svg?branch=master)](https://travis-ci.org/CODAIT/spark-bench)

[![codecov](https://codecov.io/gh/CODAIT/spark-bench/branch/master/graph/badge.svg)](https://codecov.io/gh/CODAIT/spark-bench)



# READ OUR DOCS

The documentation for Spark-Bench is all in our shiny new docs site: 

# Versions And Compatibility

## Spark Version

Spark-Bench is currently compiled against the Spark 2.1.1 jars and should work with Spark 2.x.

If you experience compatibility issues between Spark-Bench and any 2.x version of Spark, please let us know!

## Scala Version

Spark-Bench is written using Scala 2.11.8. It is _incompatible_ with Spark versions running Scala 2.10.x

# Installation

Follow the [Quickstart guide](https://codait.github.io/spark-bench/quickstart/) from our docs site. For more details, see the [Installation page](https://codait.github.io/spark-bench/users-guide/installation).

# Legacy Version

spark-bench has recently gone through an extensive rewrite.

While we think you'll like the new capabilities, it is not quite feature complete with the previous version of spark-bench.

Many of the workloads that were available in the legacy have not yet been ported over, but they will be!

In the meantime, if you would like to see the old version of spark-bench, it's preserved in [the legacy branch](https://github.com/codait/spark-bench/tree/legacy).

You can also grab the last official release of the legacy version [from here](https://github.com/codait/spark-bench/releases/tag/SparkBench_spark-v1.6).