https://github.com/gabrielenizzoli/spark_engine

Build a complex spark execution plan by composing many different spark operations.
https://github.com/gabrielenizzoli/spark_engine

spark sql yaml

Last synced: 4 days ago
JSON representation

Build a complex spark execution plan by composing many different spark operations.

• Host: GitHub
• URL: https://github.com/gabrielenizzoli/spark_engine
• Owner: gabrielenizzoli
• License: apache-2.0
• Created: 2020-04-26T00:36:57.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2023-05-20T20:15:53.000Z (over 1 year ago)
• Last Synced: 2024-12-19T10:12:54.475Z (about 2 months ago)
• Topics: spark, sql, yaml
• Language: Java
• Homepage: https://www.spark-engine.com/
• Size: 970 KB
• Stars: 0
• Watchers: 2
• Forks: 2
• Open Issues: 17
• Metadata Files:
  • Readme: docs/README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Welcome to spark_engine project

*Build a complex spark execution plan using composition, and yaml :D*.

## Table of contents

- [Status](#status)

- [Spark and Scala versions](#versions-supported)

## Status

Master branch status: ![Build](https://github.com/gabrielenizzoli/spark_engine/workflows/Build/badge.svg?branch=master)

## Versions supported

We are just focused on the latest versions right now. So if you use it, be aware that it will only work with:

* Java: 1.11

* Scala 2.12

* Spark: 3.0.0