https://github.com/datumbrain/gossub

Trigger spark-submit in Golang. A Go implementation of famous SparkLauncher.java.
https://github.com/datumbrain/gossub

apachespark go golang spark

Last synced: 3 months ago
JSON representation

Trigger spark-submit in Golang. A Go implementation of famous SparkLauncher.java.

• Host: GitHub
• URL: https://github.com/datumbrain/gossub
• Owner: datumbrain
• License: mit
• Created: 2020-10-30T18:38:20.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2020-10-31T14:23:43.000Z (over 4 years ago)
• Last Synced: 2024-06-20T10:56:00.704Z (8 months ago)
• Topics: apachespark, go, golang, spark
• Language: Go
• Homepage:
• Size: 4.88 KB
• Stars: 7
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# gossub (Go `spark-submit` wrapper)

Trigger spark-submit in Golang. A Go implementation of `org.apache.spark.launcher.SparkLauncher`.

## Usage

```go

package main

import (

	"os"

	"github.com/datumbrain/gossub"

)

func main() {

	sl := gossub.SparkLauncher{

		AppName:     "my-new-app",

		AppResource: "test",

		MainClass:   "org.apache.spark.examples.SparkPi",

		SparkHome:   "/usr/local/spark",

		Jar:         "original-spark-examples_2.12-3.1.0-SNAPSHOT.jar",

	}

	sl.Init()

	sl.RedirectError(os.Stderr)

	sl.RedirectOutput(os.Stdout)

	sl.Launch()

}

```

## Author

[Fahad Siddiqui](https://github.com/fahadsiddiqui)

## License 

MIT